UPDATED 14:30 EDT / FEBRUARY 27 2012

Outline of Hadoop’s Problems is Shortsighted

Jessica Vascellaro of WSJ published a piece in which she engaged the buzz around Hadoop from the opposite angle, highlighting some of the reasons the open-source parallel analytics platform may not be the universal cure of massive datasets.

One of her main points is that the fact Hadoop is free doesn’t necessary translate into a drastic cut in overhead on the bottom line when taking into account a couple factors. For one, data scientists – the people tasked with managing what is unquestionably a very complicated operation, especially at scale – are currently a scarce resource in the job market. The second was laid out by the head of Hortonworks, also described it as an “aspirin for a broken leg” scenario by Collectivei co-founder co-founder Stephen Messer.

“Rob Bearden, CEO of Hortonworks in Sunnyvale, says the impulse to store lots of data because it can be cheap can lead to storing too much and make answering simple questions harder. “You want to have some sort of control over what data you push into an application,” he says. “Otherwise, your juice isn’t really worth the squeeze.”

However, this perspective addresses only a small aspect of the market. The counter-argument comes from a broader point of view, one that includes Cloudera as well. Chief executive Mike Olson attributed the challenge Bearden outlined above to the relatively small Hadoop ecosystem, specifically to a shortage in applications that “make the data they [companies] are storing useful.”

Nevertheless, the reality is that the market still has a lot of room to mature, though the actual numbers showing that the universal cure may not be completely unachievable after all. Cloudera’s sales doubled in the past 12 months according to the company, and recent data by Wikibon seems to point towards a a similar phenomenon occurring market-wide. In 2012 big data analytics will be worth a total of roughly $5 billion, and in just five years this demand will grow tenfold.


A message from John Furrier, co-founder of SiliconANGLE:

Your vote of support is important to us and it helps us keep the content FREE.

One click below supports our mission to provide free, deep, and relevant content.  

Join our community on YouTube

Join the community that includes more than 15,000 #CubeAlumni experts, including Amazon.com CEO Andy Jassy, Dell Technologies founder and CEO Michael Dell, Intel CEO Pat Gelsinger, and many more luminaries and experts.

“TheCUBE is an important partner to the industry. You guys really are a part of our events and we really appreciate you coming and I know people appreciate the content you create as well” – Andy Jassy

THANK YOU