UPDATED 09:12 EDT / APRIL 14 2016

NEWS

The Hadoop ecosystem still fragmented and in need of unification | #HS16Dublin

As day two of the Hadoop Summit – Dublin 2016 began in Dublin, the consensus seemed to be that the Hadoop ecosystem is not moving fast enough to bring the platform to the enterprise.

John Furrier (@furrier) and Dave Vellante (@dvellante), cohosts of theCUBE, from the SiliconANGLE Media team, opened the show today viewing the landscape of the Hadoop ecosystem, noting that it is still fragmented and needs unification.

A changing landscape

“You are seeing the transformation of the ecosystem, and it couldn’t be more highlighted by this show. In our view, it’s growing, but is it big enough?” said Furrier. He continued by saying that the big players are moving into the space, including Oracle, IBM, HP and Microsoft, and he wondered what the landscape is going to look like in the ecosystem.

Furrier feels as if the Hadoop ecosystem has failed customers by not going faster. He explained that there is probably about 10 percent enterprise penetration, and while it is still early, the market is shifting and if it doesn’t grow fast enough, the big guys will be moving into the space with the cloud.

Hitting the numbers

Vellante pointed out that the only “pure play” companies to hit the leaderboard in terms of revenue were Palantir Technologies, Inc. and Splunk, Inc.

“Add those two up and you’re talking about a billion dollars; and Cloudera, a private company, is estimated to be just under $200 million in revenue last year … and Hortonworks hit about 120 million, so they are becoming more than rounding errors,” he said. However, he also pointed out that players like Microsoft could aim at big data and takeover, much like Amazon Web Services (AWS), but in a bigger way.

Furrier believes we are seeing a wave of change with the enterprise transitioning. And while there are some successful new startups, he feels that experience matters and we are seeing the same movie over and over again.

Community matters

The companies in the ecosystem are targeting the CIO, who wants simplicity not complexity. “They are kind of misfiring on what CIOs want,” Furrier states. He compared Hadoop to Linux and said that history is repeating itself in the open-source environment.

The innovation for Linux really begun once everyone came together as a community, so in his view, the community needs to come together around a core platform because there are many opportunities in the Internet of Things (IoT) and analytic markets.

Total cost of ownership

Vellante spoke about the total cost of ownership and how the bigger companies like AWS are providing growth and value.

According to Furrier, “This industry has to move out of the catch-up, fall behind, the catch-up, fall behind to catch up and drive.”

Furrier also advised that insights will not win the battle; value must be added. He offered up the low-hanging fruit of cybersecurity, fraud detection and 360 marketing, but ultimately he said that the public cloud guys will win the profit battle.

Furrier and Vellante concluded that the Hadoop ecosystem needs to go beyond and do a better job of providing value.

Watch the full interview below, and be sure to check out more of SiliconANGLE and theCUBE’s coverage of Hadoop Summit 2016 – Dublin. And make sure to join in during theCUBE’s live coverage during the event by joining in on CrowdChat.

Photo by SiliconANGLE

A message from John Furrier, co-founder of SiliconANGLE:

Your vote of support is important to us and it helps us keep the content FREE.

One click below supports our mission to provide free, deep, and relevant content.  

Join our community on YouTube

Join the community that includes more than 15,000 #CubeAlumni experts, including Amazon.com CEO Andy Jassy, Dell Technologies founder and CEO Michael Dell, Intel CEO Pat Gelsinger, and many more luminaries and experts.

“TheCUBE is an important partner to the industry. You guys really are a part of our events and we really appreciate you coming and I know people appreciate the content you create as well” – Andy Jassy

THANK YOU