As analytics accelerate closer to real-time, historical analytics are not being displaced. The benefits of a comprehensive and historic view of data is becoming more than just a daydream. Imagine a problem with a fleet of vehicles. Would current information and stats be the only aspect an analyst might look at? Wouldn’t the history of the whole fleet factor in? Only when viewed together can we see the entire context.

Integrations in this fashion are the focus of the innovation arm of Pentaho Corp., according to Will Gorman, VP of Pentaho Labs at Pentaho Corp.

Labs works closely with engineering and product management to development prototypes of “what will be relevant,” Gorman told George Gilbert and Dave Vellante, co-hosts of theCUBE, from the SiliconANGLE Media team, during an interview at PentahoWorld 2015 in Orlando.

Gorman’s team is the “first to evaluate a product or attraction” and determine the “right tech investment,” like integrating Apache Hadoop and Spark. According to figures presented by Gilbert, users see 91 percent higher performance and 60 percent better ease of use than Hadoop alone. Currently, Labs is working on “orchestration for Spark,” as well as on a “deeper integration between Spark and Pentaho.” The ultimate goal is to make a “development tool with Spark running underneath.” Gorman predicted that Spark will replace MapReduce.

Pentaho is “jazzed about containers, too,” remarked Gorman. He has seen some early customers adopt Docker, although it still has some “security concerns” to be “worked out as a community.” Gorman described Docker as “great, but emerging.”

Watch the full video interview below, and be sure to check out more of SiliconANGLE and theCUBE’s coverage of PentahoWorld 2015. And join in on the conversation by CrowdChatting with theCUBE hosts.

Photo by SiliconANGLE