Open-source has been at the heart of IBM’s approach to innovation. Linux is probably the best known example of IBM’s investment in open source, and exemplifies how quickly innovation can be derived, so Big Blue is a specialist at leveraging this community while also providing for it.

It’s all about bringing “community and partners” together to create “faster, more efficient solutions,” explained Rob Thomas, VP of product development at IBM. This is why IBM is investing in Spark heavily. This, among many insights, were uncovered by Dave Vellante and George Gilbert, cohosts of theCUBE, from the SiliconANGLE Media team, at IBM Insight 2015.

Why Spark?

Spark will be the next Linux for IBM, according to Thomas, who touts that IBM has set the goal of educating “one million data scientists” and has educated over 300,000 to date. This pairs with its investments in the Spark Technology Center, which has been a source of talent for IBM, and its collaboration has allowed IBM to bring 15 Spark-integrated applications to market.

In an example utilizing IBM’s SPSS analytic software as a use case, Thomas explained that IBM was able to “integrate directly into Spark” the fundamental algorithms that make SPSS function. This SPSS engine integrated into Spark means real-time, as well as machine learning of data with the analytic component of IBM’s proprietary software. This pairing is incredible and one of the reasons why IBM is planning to “move all apps to Spark.”

Leveraging open source

IBM in the open-source world, as Vellante noted, was like an “adult getting in the sandbox.” However, Thomas likes to think it’s a little “younger.” The relationship IBM has with open source has always been strong, and the communities it has come to support have led to immense innovation both outside and inside IBM.

Thomas said to “expect Spark to be enterprise ready by 2016” and to look for the impact especially in the Internet of Things (IoT) where Spark has a distinct advantage in handling a great deal of real-time data, such as for sensors on a wind turbine. As Linux inspired huge innovation shortly after IBM’s investment, it would be safe to expect those predictions to be true of Spark as well, a seemingly win/win for Big Blue and Spark users.

Watch the full video interview below, and be sure to check out more of SiliconANGLE and theCUBE’s coverage of IBM Insight 2015. And join in on the conversation by CrowdChatting with theCUBE hosts.

Photo by SiliconANGLE