UPDATED 19:10 EDT / JUNE 15 2015

NEWS

Apache Spark community comes together at Spark Summit | #sparkinsight

IBM is showing its support for Apache Spark in a big way at Spark Summit, a three-day event packed with lectures from leading production users of Spark, Spark SQL, Spark Streaming and related projects. Attendees will learn where project development is going and how to use the Spark stack in a variety of applications.

theCUBE kicked off its first day of interviews with IBM Big Data Evangelist James Kobielus, the senior program director for Product Marketing in Big Data Analytics for IBM. Kobielus also serves as team lead, technical marketing for the IBM Big Data & Analytics Hub.

‘Spark is a complement for Hadoop; not a replacement’

Kobielus explained for theCUBE viewers that Spark addresses limitations found in “traditional” Hadoop. “Spark is part of the Hadoop distro,” he said. “The Spark community has developed within the Hadoop community. It is a complement for Hadoop; not a replacement.”

Through various product announcements and other internal developments, such as dedicating 3,500 developers and researchers to work on Spark-related projects, IBM makes clear its level of commitment to Spark. Today, Kobielus said that IBM will also announce a new Hack Spark Challenge.

“There is a lot of excitement in the developer community around Spark,” said Kobielus. “IBM understands that Spark is important to the future of Big Data.”

IBM to open source its IBM SystemML machine learning technology

Among other announcements, IBM will open source its IBM SystemML machine learning technology and collaborate with Databricks to advance Spark’s machine learning capabilities. IBM will also build Spark into the core of the company’s analytics and commerce platforms.

“This is a big move for IBM,” said Kobielus. “This is our coming out.”

In an Internet of Things scenario, Kobielus said that Spark engines can bring behavioral data and real-time coordinates together to serve the customer better. “Spark streaming is for close-to-real-time data,” he said.

Day One continues with interviews with key players from IBM, Galvanize, Databricks, Inc., and Lawrence Berkeley National Laboratory.

Watch the full interview below, and be sure to check out more of SiliconANGLE and theCUBE’s coverage of IBM Spark 2015.

 


A message from John Furrier, co-founder of SiliconANGLE:

Your vote of support is important to us and it helps us keep the content FREE.

One click below supports our mission to provide free, deep, and relevant content.  

Join our community on YouTube

Join the community that includes more than 15,000 #CubeAlumni experts, including Amazon.com CEO Andy Jassy, Dell Technologies founder and CEO Michael Dell, Intel CEO Pat Gelsinger, and many more luminaries and experts.

“TheCUBE is an important partner to the industry. You guys really are a part of our events and we really appreciate you coming and I know people appreciate the content you create as well” – Andy Jassy

THANK YOU