UPDATED 14:45 EST / OCTOBER 12 2010

Hadoop is a “Big part of Twitter’s ecosystem”

Cloudera is really aiming for the enterprise with open-source project Hadoop, and its focusing its efforts around data management and transfer, easing analysis systems within virtulized environments.  Twitter is one of the many big players that has found benefits in Hadoop’s tools, and we discuss with Twitter developer Kevin Weil at Hadoop World today.

“Hadoop is a big part of Twitter’s ecosystem,” Weil tells us during TheCUBE interview (view our live coverage here at SiliconANGLE.tv).  When it comes to scalability, there are few companies that understand server needs better than Twitter.  An analyst lead at Twitter, Weil knows firsthand the demands around handling data, analyzing it, and putting it back into the system in order to improve it.

“I think it’s one of the great things about growing fast.  Your data is growing at intense rates, and you have to be able to analyze it and turn it into something the company can use,” Weil continues.

The interview goes on to discuss the need for a strong community around cloud computing, especially as it pertains to open-source projects.  For something like Hadoop, the presence of a robust, public tool really helps to build a prosperous ecosystem.

Even third-party Twitter developers are partial to Hadoop, as Weil mentions the usability of Hadoop, saying,“Hadoop is easy to use…they’re easier for our brand developers to pick up, you’ll see more software getting involved. Hadoop takes a lot of the hard edges off.”

Twitter’s also using Hadoop as another forum for engaging its developer community.  One thing Twitter has always done is share a great deal with third party developers, putting their own tools back into the community.  “It makes Twitter a good place to work because of it,” Weil notes.


A message from John Furrier, co-founder of SiliconANGLE:

Your vote of support is important to us and it helps us keep the content FREE.

One click below supports our mission to provide free, deep, and relevant content.  

Join our community on YouTube

Join the community that includes more than 15,000 #CubeAlumni experts, including Amazon.com CEO Andy Jassy, Dell Technologies founder and CEO Michael Dell, Intel CEO Pat Gelsinger, and many more luminaries and experts.

“TheCUBE is an important partner to the industry. You guys really are a part of our events and we really appreciate you coming and I know people appreciate the content you create as well” – Andy Jassy

THANK YOU