UPDATED 11:23 EDT / APRIL 08 2016

NEWS

Qubole releases SQL optimizer as open source

 

Big data-as-a-service provider Qubole Inc. has open-sourced its Quark cost-based SQL optimizer that simplifies and optimize access to data across multiple hosts.

Quark essentially chooses between popular big data open source query systems such as Hive, RedShift and Presto/Impala to select that which will deliver the best query results. “All of these query engines are good at some things and bad at others,” said Ashish Thusoo, co-founder and CEO of the 90-employee Qubole. “Subsuming that intelligence allows the machine to decide what engine is best used for that query.”

Quark addresses the problem of duplication caused when data sets are aggregated and copied to multiple analytics systems to balance performance and cost, making it difficult to efficiently query the data. Quark optimizes access to data by managing relationships between tables across an organization’s databases.

Quark models relationships between datasets using well-known database concepts like materialized views and OLAP cubes, enabling data analysts to automatically take advantage of the fastest and most efficient data set for their queries. Qubole provides platforms and tools for data-driven tasks that hide the complexity of SQL and back-end processing engines.

The Quark project is now available in open-source on GitHub, as well as in a SaaS implementation via the Qubole Data Service.

Thusoo and co-founder Joydeep Sen Sarma have authored or participated in several prominent open source projects, including the Apache Hive Project.  Prior to founding Qubole, Thusoo was head of the data infrastructure team at Facebook.


A message from John Furrier, co-founder of SiliconANGLE:

Support our mission to keep content open and free by engaging with theCUBE community. Join theCUBE’s Alumni Trust Network, where technology leaders connect, share intelligence and create opportunities.

  • 15M+ viewers of theCUBE videos, powering conversations across AI, cloud, cybersecurity and more
  • 11.4k+ theCUBE alumni — Connect with more than 11,400 tech and business leaders shaping the future through a unique trusted-based network.
About SiliconANGLE Media
SiliconANGLE Media is a recognized leader in digital media innovation, uniting breakthrough technology, strategic insights and real-time audience engagement. As the parent company of SiliconANGLE, theCUBE Network, theCUBE Research, CUBE365, theCUBE AI and theCUBE SuperStudios — with flagship locations in Silicon Valley and the New York Stock Exchange — SiliconANGLE Media operates at the intersection of media, technology and AI.

Founded by tech visionaries John Furrier and Dave Vellante, SiliconANGLE Media has built a dynamic ecosystem of industry-leading digital media brands that reach 15+ million elite tech professionals. Our new proprietary theCUBE AI Video Cloud is breaking ground in audience interaction, leveraging theCUBEai.com neural network to help technology companies make data-driven decisions and stay at the forefront of industry conversations.