UPDATED 10:08 EDT / FEBRUARY 01 2011

Yahoo Re-Thinks the Open Cloud, Drops its Own Hadoop Distribution

Yahoo is dropping its own Hadoop distribution, deciding to instead focus on Apache Hadoop, It was an arduous decision for team members at Yahoo, especially since the project was one very near to many employees’ hearts.  The news came in conjunction with the O’Reilly Strata Conference, held in California this week to discuss many pressing issues around cloud computing.

Hadoop, which was initially built by Apache Chairman Doug Cutting while still at Yahoo, has grown to prominence in data centers and cloud computing as an industry.  With this decision comes the long process of “undoing” the many man-hours of work that went into Hadoop’s implementation, with a long vision steady on the future.

Yahoo plans to remove all references to a Yahoo distribution from its website, closing its github repo, and resting its focus on working closely with the Apache community.  The intent here is to aid Apache in the production of binary releases for its Hadoop product, working towards a solid release that can be easily integrated in Hadoop clusters.

It’s a challenge for any company to undertake such a feat, and in Yahoo’s ongoing changes company-wide, it’s an important journey that must re-shift attention back to Yahoo’s core.  When it comes to open-source cloud projects, however, the very word implementation carries an entirely different meaning.  That process of re-branding its own involvement with Hadoop highlights the obstacles that the cloud industry still bears, making Yahoo a willing witness in overcoming new iterations of a spcialized project.

What remains clear, however, is Yahoo’s commitment to open sourcing within the cloud developer community, having revised its goals as they relate to Hadoop.  “We’ve concluded that focusing on Apache Hadoop is the way forward,” says Eric Baldeschwieler, vice president of Hadoop development at Yahoo. We believe that more focus on communicating our goals to the Apache Hadoop community, and more willingness to compromise on how we get to those goals, will help us get back to making Hadoop even better.”


A message from John Furrier, co-founder of SiliconANGLE:

Support our mission to keep content open and free by engaging with theCUBE community. Join theCUBE’s Alumni Trust Network, where technology leaders connect, share intelligence and create opportunities.

  • 15M+ viewers of theCUBE videos, powering conversations across AI, cloud, cybersecurity and more
  • 11.4k+ theCUBE alumni — Connect with more than 11,400 tech and business leaders shaping the future through a unique trusted-based network.
About SiliconANGLE Media
SiliconANGLE Media is a recognized leader in digital media innovation, uniting breakthrough technology, strategic insights and real-time audience engagement. As the parent company of SiliconANGLE, theCUBE Network, theCUBE Research, CUBE365, theCUBE AI and theCUBE SuperStudios — with flagship locations in Silicon Valley and the New York Stock Exchange — SiliconANGLE Media operates at the intersection of media, technology and AI.

Founded by tech visionaries John Furrier and Dave Vellante, SiliconANGLE Media has built a dynamic ecosystem of industry-leading digital media brands that reach 15+ million elite tech professionals. Our new proprietary theCUBE AI Video Cloud is breaking ground in audience interaction, leveraging theCUBEai.com neural network to help technology companies make data-driven decisions and stay at the forefront of industry conversations.