UPDATED 10:08 EST / FEBRUARY 01 2011

Yahoo Re-Thinks the Open Cloud, Drops its Own Hadoop Distribution

Yahoo is dropping its own Hadoop distribution, deciding to instead focus on Apache Hadoop, It was an arduous decision for team members at Yahoo, especially since the project was one very near to many employees’ hearts.  The news came in conjunction with the O’Reilly Strata Conference, held in California this week to discuss many pressing issues around cloud computing.

Hadoop, which was initially built by Apache Chairman Doug Cutting while still at Yahoo, has grown to prominence in data centers and cloud computing as an industry.  With this decision comes the long process of “undoing” the many man-hours of work that went into Hadoop’s implementation, with a long vision steady on the future.

Yahoo plans to remove all references to a Yahoo distribution from its website, closing its github repo, and resting its focus on working closely with the Apache community.  The intent here is to aid Apache in the production of binary releases for its Hadoop product, working towards a solid release that can be easily integrated in Hadoop clusters.

It’s a challenge for any company to undertake such a feat, and in Yahoo’s ongoing changes company-wide, it’s an important journey that must re-shift attention back to Yahoo’s core.  When it comes to open-source cloud projects, however, the very word implementation carries an entirely different meaning.  That process of re-branding its own involvement with Hadoop highlights the obstacles that the cloud industry still bears, making Yahoo a willing witness in overcoming new iterations of a spcialized project.

What remains clear, however, is Yahoo’s commitment to open sourcing within the cloud developer community, having revised its goals as they relate to Hadoop.  “We’ve concluded that focusing on Apache Hadoop is the way forward,” says Eric Baldeschwieler, vice president of Hadoop development at Yahoo. We believe that more focus on communicating our goals to the Apache Hadoop community, and more willingness to compromise on how we get to those goals, will help us get back to making Hadoop even better.”


Since you’re here …

… We’d like to tell you about our mission and how you can help us fulfill it. SiliconANGLE Media Inc.’s business model is based on the intrinsic value of the content, not advertising. Unlike many online publications, we don’t have a paywall or run banner advertising, because we want to keep our journalism open, without influence or the need to chase traffic.The journalism, reporting and commentary on SiliconANGLE — along with live, unscripted video from our Silicon Valley studio and globe-trotting video teams at theCUBE — take a lot of hard work, time and money. Keeping the quality high requires the support of sponsors who are aligned with our vision of ad-free journalism content.

If you like the reporting, video interviews and other ad-free content here, please take a moment to check out a sample of the video content supported by our sponsors, tweet your support, and keep coming back to SiliconANGLE.