As open-source and Big Data offerings become more complex, consultants are stepping into the gap to help companies make the right choices for their IT needs. Rishi Yadav, CEO of InfoObjects, Inc., joined Juan Asenjo, lead technology architect for Rockwell Automation, Inc., on theCUBE, SiliconANGLE Media’s production team, at Hadoop Summit 2015 to talk about the maturing Big Data infrastructure market and business needs.

“Spark has been a blessing … the whole Big Data ecosystem has stabilized a lot,” according to Yadav. He said that clients are becoming more aware of the options and how they match their needs. “The place where they get confused is all these distributions … how many distributions does this planet need? Now the number of distributions is much less than they were two years back, but still it becomes confusing enough for the clients. So that’s where we come into the picture … as a vendor-neutral partner to our clients.”

Open-source movement takes future-proofing to new level

The idea is that in the future, the core platform will remain — no matter what happens with a company or any of the distributions, Yadav said. “You’re not really stuck to any specific vendor, because the base is the same and is open to everyone,” he explained. “And everybody can look at the code base, everybody can improve the code base, everybody can contribute to the code base. So, in fact, the open-source movement has taken the future-proofing to a completely new level.”

InfoObjects has simplified the process of setting up and integrating Big Data into existing enterprises for many customers, including Rockwell Automation. Asenjo talked about why they chose to work with InfoObjects.

“When you come to picking technology and integrating technology … you need help, and you have to find a company that can bring all of those elements together,” he said. “We need to really understand our use case and pick the one that is future-proof, cost effective, and you can’t really do that with the resources we have. I would say probably we are in the same boat with many other companies. And we have to augment our capacity by going through a consultant that has experience with this topic.”

How has it worked out? It’s been worth the investment, according to Asenjo. “I’ve been very impressed with their capabilities,” especially their domain expertise.

Watch the full interview below, and be sure to check out more of SiliconANGLE and theCUBE’s coverage of Hadoop Summit 2015.

And also check out what Rishi Yadav had to say in another segment with theCUBE.

Photo by SiliconANGLE