UPDATED 08:00 EDT / JULY 22 2015

NEWS

Spark is hot, but not ready for prime time | #HadoopSummit

theCUBE cohosts John Furrier, Jeff Frick, and George Gilbert discussed the convergence of Cloud and analytics as they concluded talks for the recently concluded Hadoop Summit 2015.

Furrier noted that Hadoop, an open-source data management tool, has proven its place as far as the Cloud is concerned, winning the hearts of Cloud service providers. “Hadoop is ready for prime time,” he said. “That said, there is a world bigger than Hadoop. Spark [an alternative to Hadoop MapReduce] had an undercurrent throughout the show. Also, a lot of people validated our thesis that the next level of analytics, real time, streaming, will all be powered by the cloud, certainly in the enterprise.”

The importance of the Open Data Platform

Gilbert discussed the challenge in balancing innovation with potential for complexity. He also gave his take on the Open Data Platform (ODP). ODP, a shared industry effort by organizations like General Electric, IBM and Hortonworks, focuses on promoting and advancing the state of Apache Hadoop, as well as Big Data technologies for the enterprise.

“Apache Software Foundation has done an amazing job of incubating and releasing individual projects,” he said. “When you get to a Hadoop product, it’s really an ecosystem. We needed something to unify those individual components, and ODP is a very important step in that.”

Spark got attention at Hadoop Summit, although theCUBE cohosts believe the framework has to gain some experience before it joins the “prime time” offerings. “Spark hasn’t gone through the hardening process that Hadoop has gone through for the enterprise,” said Frick. “But ISVs are starting to build tools on top of it.”

Watch the full interview below, and be sure to check out more of SiliconANGLE and theCUBE’s coverage of Hadoop Summit 2015.

Photo by SiliconANGLE

A message from John Furrier, co-founder of SiliconANGLE:

Support our mission to keep content open and free by engaging with theCUBE community. Join theCUBE’s Alumni Trust Network, where technology leaders connect, share intelligence and create opportunities.

  • 15M+ viewers of theCUBE videos, powering conversations across AI, cloud, cybersecurity and more
  • 11.4k+ theCUBE alumni — Connect with more than 11,400 tech and business leaders shaping the future through a unique trusted-based network.
About SiliconANGLE Media
SiliconANGLE Media is a recognized leader in digital media innovation, uniting breakthrough technology, strategic insights and real-time audience engagement. As the parent company of SiliconANGLE, theCUBE Network, theCUBE Research, CUBE365, theCUBE AI and theCUBE SuperStudios — with flagship locations in Silicon Valley and the New York Stock Exchange — SiliconANGLE Media operates at the intersection of media, technology and AI.

Founded by tech visionaries John Furrier and Dave Vellante, SiliconANGLE Media has built a dynamic ecosystem of industry-leading digital media brands that reach 15+ million elite tech professionals. Our new proprietary theCUBE AI Video Cloud is breaking ground in audience interaction, leveraging theCUBEai.com neural network to help technology companies make data-driven decisions and stay at the forefront of industry conversations.