Spark is hot, but not ready for prime time | #HadoopSummit
theCUBE cohosts John Furrier, Jeff Frick, and George Gilbert discussed the convergence of Cloud and analytics as they concluded talks for the recently concluded Hadoop Summit 2015.
Furrier noted that Hadoop, an open-source data management tool, has proven its place as far as the Cloud is concerned, winning the hearts of Cloud service providers. “Hadoop is ready for prime time,” he said. “That said, there is a world bigger than Hadoop. Spark [an alternative to Hadoop MapReduce] had an undercurrent throughout the show. Also, a lot of people validated our thesis that the next level of analytics, real time, streaming, will all be powered by the cloud, certainly in the enterprise.”
The importance of the Open Data Platform
Gilbert discussed the challenge in balancing innovation with potential for complexity. He also gave his take on the Open Data Platform (ODP). ODP, a shared industry effort by organizations like General Electric, IBM and Hortonworks, focuses on promoting and advancing the state of Apache Hadoop, as well as Big Data technologies for the enterprise.
“Apache Software Foundation has done an amazing job of incubating and releasing individual projects,” he said. “When you get to a Hadoop product, it’s really an ecosystem. We needed something to unify those individual components, and ODP is a very important step in that.”
Spark got attention at Hadoop Summit, although theCUBE cohosts believe the framework has to gain some experience before it joins the “prime time” offerings. “Spark hasn’t gone through the hardening process that Hadoop has gone through for the enterprise,” said Frick. “But ISVs are starting to build tools on top of it.”
Watch the full interview below, and be sure to check out more of SiliconANGLE and theCUBE’s coverage of Hadoop Summit 2015.
Photo by SiliconANGLE
A message from John Furrier, co-founder of SiliconANGLE:
Your vote of support is important to us and it helps us keep the content FREE.
One click below supports our mission to provide free, deep, and relevant content.
Join our community on YouTube
Join the community that includes more than 15,000 #CubeAlumni experts, including Amazon.com CEO Andy Jassy, Dell Technologies founder and CEO Michael Dell, Intel CEO Pat Gelsinger, and many more luminaries and experts.
THANK YOU