UPDATED 12:17 EDT / FEBRUARY 17 2016

NEWS

Is simplifying Big Data possible? Databricks says yes | #SparkSummit

When the Hadoop project (an open-source software for reliable, scalable, distributed computing) began, it became clear that things were far too complicated. So Databricks, Inc. set out to simplify the Big Data process with the Apache Spark project.

Dave Vellante and George Gilbert, cohosts of theCUBE, from the SiliconANGLE Media team, set down at Spark Summit East 2016 to speak with Ali Ghodsi, CEO of Databricks, to talk about the simplification of Big Data.

The advantages of Cloud 

The implementation of Cloud has made everything a very different game, and Databricks is using this to its advantage with Apache Spark, the largest open-source project in data processing.

“This is one of the beauties of the Cloud,” Ghodsi said. “It’s up and running. It’s elastic. So you can compose those services and products that you need seamlessly.”

For admins, it’s easier because Databricks makes sure software updates are always integrated. The company only has two versions of its software running at all times in the Cloud. And it also releases updates every week. But with non-Cloud settings, things release every few months. “It’s continuously developing features and deploying them to customers,” said Ghodsi.

Big Data problems customers need solved 

For businesses and Big Data, the problem that Databricks is attacking has many pieces. First, companies have already stored data, but the data is siloed and they can’t make decisions on it. Second, there was the problem of unifying the use cases that companies have. Companies want to go further with advanced analytics. They want to cluster and segment the data they have. They also want to do things in real time.

So one of the visions of  Databricks’ Spark service is: How can Spark give businesses something that works end to end? “So unifying these is where we provide value to the customer,” said Ghodsi.

Watch the full video interview below, and be sure to check out more of SiliconANGLE and theCUBE’s coverage of Spark Summit East 2016. And join in on the conversation by CrowdChatting with theCUBE hosts.

https://youtu.be/NKUvui8D8Ic

Photo by SiliconANGLE

A message from John Furrier, co-founder of SiliconANGLE:

Support our mission to keep content open and free by engaging with theCUBE community. Join theCUBE’s Alumni Trust Network, where technology leaders connect, share intelligence and create opportunities.

  • 15M+ viewers of theCUBE videos, powering conversations across AI, cloud, cybersecurity and more
  • 11.4k+ theCUBE alumni — Connect with more than 11,400 tech and business leaders shaping the future through a unique trusted-based network.
About SiliconANGLE Media
SiliconANGLE Media is a recognized leader in digital media innovation, uniting breakthrough technology, strategic insights and real-time audience engagement. As the parent company of SiliconANGLE, theCUBE Network, theCUBE Research, CUBE365, theCUBE AI and theCUBE SuperStudios — with flagship locations in Silicon Valley and the New York Stock Exchange — SiliconANGLE Media operates at the intersection of media, technology and AI.

Founded by tech visionaries John Furrier and Dave Vellante, SiliconANGLE Media has built a dynamic ecosystem of industry-leading digital media brands that reach 15+ million elite tech professionals. Our new proprietary theCUBE AI Video Cloud is breaking ground in audience interaction, leveraging theCUBEai.com neural network to help technology companies make data-driven decisions and stay at the forefront of industry conversations.