NEWS
NEWS
NEWS
SAP launches in-memory query engine for Spark into general availability
It’s becoming increasingly rare to see a major player in the open-source analytics ecosystem that doesn’t offer some sort of homegrown query engine. Every leading Hadoop distributor has one, as does Pivotal Software Inc., and now SAP SE is joining the fray too with the introduction of a new in-memory variant for Apache Spark.
Vora offers many of the same as the German software giant’s HANA database, which takes a similar approach to handling information as the analytics framework. Records are loaded into memory before processing to avoid the need for requests to be executed against the slow mechanical storage where the data is normally kept, an approach that can improve performance by several orders of magnitude. The creators of Spark claim that it’s capable of carrying out certain calculations up to a hundred times faster than the disk-based MapReduce as a result.
The fact it’s based on the equally speedy HANA enables users enables Vora to take full advantage of the analytics framework’s processing power. Ad hoc queries designed to serve a narrow purpose like tweak a problematic subset of a company’s sales data may be executed near-instantaneously in some cases, which makes it possible to quickly try different approaches until discovering what works best. And more time-consuming operations higher up on the complexity scale are likewise able to benefit from the tool’s performance, meaning important business information can be delivered to executives faster.
Like the other query engines available in the Hadoop ecosystem, Vora makes it possible to carry out this work using the same structured syntax that analysts have been using to query relational systems like HANA. Besides easing the learning curve, the commonality between the offerings also makes it relatively straightforward to move data back and forth, which is a useful feature for customers that are looking to deploy the database alongside Spark. SAP has already managed to win over CenterPoint Energy Inc., a Fortune 500 utility with more than 2.3 million customers that plans to use the software in order to analyze how power from its grid is consumed.
Image via Geralt
A message from John Furrier, co-founder of SiliconANGLE:
Support our mission to keep content open and free by engaging with theCUBE community. Join theCUBE’s Alumni Trust Network, where technology leaders connect, share intelligence and create opportunities.
- 15M+ viewers of theCUBE videos, powering conversations across AI, cloud, cybersecurity and more
- 11.4k+ theCUBE alumni — Connect with more than 11,400 tech and business leaders shaping the future through a unique trusted-based network
Are you an AWS customer? Support SiliconANGLE financially by buying your AWS services from our Marketplace portal page and links: https://siliconangle.com/aws-marketplace/
About SiliconANGLE Media
SiliconANGLE Media is a recognized leader in digital media innovation, uniting breakthrough technology, strategic insights and real-time audience engagement. As the parent company of SiliconANGLE, theCUBE Network, theCUBE Research, CUBE365, theCUBE AI and theCUBE SuperStudios — with flagship locations in Silicon Valley and the New York Stock Exchange — SiliconANGLE Media operates at the intersection of media, technology and AI.
Founded by tech visionaries John Furrier and Dave Vellante, SiliconANGLE Media has built a dynamic ecosystem of industry-leading digital media brands that reach 15+ million elite tech professionals. Our new proprietary theCUBE AI Video Cloud is breaking ground in audience interaction, leveraging theCUBEai.com neural network to help technology companies make data-driven decisions and stay at the forefront of industry conversations.
