UPDATED 09:36 EDT / JULY 26 2016

NEWS

Adoption complexity is holding back big data growth, says Wikibon

Ten years into the Hadoop-driven big data “revolution,” big data tools and platforms are widely available. But, writes Wikibon Big Data and Analytics Analyst George Gilbert, “the path from procurement to business value remains complex and labor intensive.”

Gilbert blames this on the community’s intensive focus on tools rather than applications. This is a typical cycle in the IT industry in which “the tools and platforms that work for one class of applications go through a process of ‘adaptive stretch,’ beyond which they become unproductive for new applications,” he writes (see figure above). At that point a new set of tools and platforms emerges to empower the new class of applications.

However, Gilberts sees hope as big data decision-makers focus on new questions, including:

  • How can we avoid creating big data legacy technologies?
  • Why hasn’t Hadoop broken out of the big companies?
  • What are the safe paths forward?

One symptom of the ‘adaptive stretch’ of Hadoop is the increasing cost of integration. Cloudera Inc. told Wikibon that it budgets 50 percent of its engineering effort for each new component to integration. That leaves only 50 percent for adding functionality. This complexity explains why customers need five different administrators with specialized skills to operate a 10-server pilot. Another symptom is that most large Hadoop production deployments are in the tech industry, including ad tech, rather than in more traditional enterprises.

The full article, available to Wikibon Premium subscribers, discusses the issues in more depth and provides guidance for corporations struggling with big data tool complexity.

Graphic © 2016 SiliconAngle Media

A message from John Furrier, co-founder of SiliconANGLE:

Your vote of support is important to us and it helps us keep the content FREE.

One click below supports our mission to provide free, deep, and relevant content.  

Join our community on YouTube

Join the community that includes more than 15,000 #CubeAlumni experts, including Amazon.com CEO Andy Jassy, Dell Technologies founder and CEO Michael Dell, Intel CEO Pat Gelsinger, and many more luminaries and experts.

“TheCUBE is an important partner to the industry. You guys really are a part of our events and we really appreciate you coming and I know people appreciate the content you create as well” – Andy Jassy

THANK YOU