Will Spark’s continuous app innovation eclipse other data tools? | #SparkSummit
Spark 2.0 and continuous application technology are making waves in the industry. It seems to solve so many data problems in one throw that some are questioning how other data players will compete.
John Walls and George Gilbert (@ggilbert41), cohosts of theCUBE, from the SiliconANGLE Media team, spoke about the excitement around the innovation at the Spark Summit at The Hilton San Francisco Union Square. Gilbert said this marks a new point in the journey we’ve traveled from batch to interactive and now to continuous.
“For the first time in 60 years, we’re inventing a new programming model, a new way of interacting with applications where they never stop, they’re always working,” Gilbert said.
Spark pulls ahead of Hadoop
Gilbert said that while Hadoop still has some interesting features to offer, Spark has become the choice for most developers because it is simpler to operate.
“Spark is one singular engine,” he said, explaining that “all those components run the same way; their security works the same way; their high availability works the same way.”
He said that Hadoop is more spread out and complicated to use, and “that worked 10 years ago, but we can do better now.”
A longer runway
Walls broached the dubious fate of MapReduce, saying, “You could see the shelf life. People from a few years back were predicting its end.”
Gilbert agreed, saying that MapReduce was a limited language that “hit the end of its runway,” whereas “Spark is like San Francisco International Airport; the runway is much longer.”
Watch the full video interview below, and be sure to check out more of SiliconANGLE and theCUBE’s coverage of Spark Summit 2016.
Photo by SiliconANGLE
A message from John Furrier, co-founder of SiliconANGLE:
Your vote of support is important to us and it helps us keep the content FREE.
One click below supports our mission to provide free, deep, and relevant content.
Join our community on YouTube
Join the community that includes more than 15,000 #CubeAlumni experts, including Amazon.com CEO Andy Jassy, Dell Technologies founder and CEO Michael Dell, Intel CEO Pat Gelsinger, and many more luminaries and experts.
THANK YOU