UPDATED 10:09 EDT / SEPTEMBER 20 2018

BIG DATA

Neo4j tunes its graph engine for AI applications

Neo4j Inc. is targeting artificial intelligence and machine learning applications with a new version of its graph database announced today.

Graph engines differ from conventional relational and NoSQL databases in that they document connections between data elements. That enables organizations to map relationships that would be impractical or impossible to represent in other database engines, such as those among all the characters in “Game of Thrones” (pictured).

Graph databases are increasingly being used in AI scenarios because of this unique capability, said Philip Rathle, vice president of products at Neo4j. “The problem with NoSQL databases is that they give you data but not the connections,” he said. “People are now looking to bridge connections to make better decisions with context.” For example, AI-driven voice-response systems are more effective when they understand the context of a command.

Graph engines are also well-suited to scenarios in which decisions made by an algorithm must be explained, Rathle said. For example, if a bank customer contests a denied loan application, “both the bank and regulators are going to want to know why the machine made that decision,” he said. “Many machine learning and deep learning processes [based upon conventional databases] are so complex that it can take weeks to understand.”

Version 3.5 adds full-text indexing to enable text-intensive applications such as metadata management and bill-of-materials processing. The feature, which is based on the open-source Lucene engine, “is one of the most highly requested features we’ve had for years,” Rathle said.

Native index support has been expanded to include spatial, temporal and Boolean values along with composite indexing. The result is up to a fivefold performance improvement, the company claimed. “It turned out that 80 percent of Neo4J’s time was being spent on indexing during large data ingestions,” Rathle said. Native indexes are now also used for sorting operations for queries written in Neo4j’s Cypher language.

The second most-common user request has been for improved handling of large write transactions, so a new memory subsystem was added for that purpose. The so-called off-heap transaction subsystem, coupled with clustering, uses native memory more efficiently to propagate large writes throughout the cluster. Off-heap memory management bypasses the garbage cleanup process in Java that can create processing pauses. “We’ve implemented some specific low-level memory management rather than relying on Java,” Rathle said.

Other new features include a driver for the increasingly popular Go programming language developed by Google LLC and graph algorithms for unsupervised learning methods such as Random Walks, Personalized PageRank, Similarities, DeepGL and DeepWalk.

Image: Neo4j

A message from John Furrier, co-founder of SiliconANGLE:

Support our open free content by sharing and engaging with our content and community.

Join theCUBE Alumni Trust Network

Where Technology Leaders Connect, Share Intelligence & Create Opportunities

11.4k+  
CUBE Alumni Network
C-level and Technical
Domain Experts
15M+ 
theCUBE
Viewers
Connect with 11,413+ industry leaders from our network of tech and business leaders forming a unique trusted network effect.

SiliconANGLE Media is a recognized leader in digital media innovation serving innovative audiences and brands, bringing together cutting-edge technology, influential content, strategic insights and real-time audience engagement. As the parent company of SiliconANGLE, theCUBE Network, theCUBE Research, CUBE365, theCUBE AI and theCUBE SuperStudios — such as those established in Silicon Valley and the New York Stock Exchange (NYSE) — SiliconANGLE Media operates at the intersection of media, technology, and AI. .

Founded by tech visionaries John Furrier and Dave Vellante, SiliconANGLE Media has built a powerful ecosystem of industry-leading digital media brands, with a reach of 15+ million elite tech professionals. The company’s new, proprietary theCUBE AI Video cloud is breaking ground in audience interaction, leveraging theCUBEai.com neural network to help technology companies make data-driven decisions and stay at the forefront of industry conversations.