Arista on the Hadoop-Aware Network: IT Will Have to Change
Doug Gourlay of Arista Networks sat down for an interview with SiliconANGLE’s John Furrier and Wikibon’s Dave Vellante, providing a glimpse into the networking layer of a Hadoop deployment.
After a brief talk about the growth his company has seen recently, Gourlay discussed the differences between the traditional datacenter network, and the one used to transfer data within a Hadoop cluster. He explained that Hadoop distributes the data across a large number of nodes and replicates it for data protection purposes. This process takes a Layer 3 Hadoop-aware file system, compared to the “fat and flat” networks needed for virtualization. “You can route it,” Gourlay added to sum up the requirements of the big data analytics engine.
Furrier went on to ask what some of the disruptions the networking veteran believes Hadoop will drive among traditional players, and Gourlay responded by highlighting the storage industry first and foremost. Hadoop, for all its open aspects, eliminates the need for multi-million storage arrays in favor of more economic solutions, according him, which means storage vendors are going to have to adapt. The same can be said of the companies that are relying on their analytics infrastructure, if they are looking to pursue the advantages of consolidating their clouds.
Speaking from experience, Gourlay stressed that organizations should be focusing on squeezing in more servers in a smaller footprint – operate at scale, and bring what would be several small datacenters-worth of servers under one room in order to cut overhead costs. This approach requires a change to the existing IT model, which also encompasses a number of other things.
Arista’s VP of marketing added that companies should be centralizing the IT department as well, and extending the role of their engineers to stretch across a number of areas. A lot of companies having already opened up to this notion, such as Facebook, and the demand for data scientists – professionals who have a skill-set covering both both programming and analytics – is a strong indicator of that.
Watch live video from SiliconANGLE.com on Justin.tv
Since you’re here …
… We’d like to tell you about our mission and how you can help us fulfill it. SiliconANGLE Media Inc.’s business model is based on the intrinsic value of the content, not advertising. Unlike many online publications, we don’t have a paywall or run banner advertising, because we want to keep our journalism open, without influence or the need to chase traffic.The journalism, reporting and commentary on SiliconANGLE — along with live, unscripted video from our Silicon Valley studio and globe-trotting video teams at theCUBE — take a lot of hard work, time and money. Keeping the quality high requires the support of sponsors who are aligned with our vision of ad-free journalism content.
If you like the reporting, video interviews and other ad-free content here, please take a moment to check out a sample of the video content supported by our sponsors, tweet your support, and keep coming back to SiliconANGLE.
