UPDATED 10:11 EDT / DECEMBER 17 2013

AWS and hyperspecialization: the more the better

Infrastructure is the secret to Amazon’s cloud dominance, so naturally the company has kept quiet about it. But last month at re:Invent 2013, vice president James Hamilton, an early advocate of commodity hardware who helped architect Microsoft’s data centers, opened up about the technologies that enable AWS to disrupt the economics of IT at petabyte scale. In his latest article, Wikibon Principal Research Contributor Stu Miniman separates the signal from the noise for the enterprise CIO.

Facebook, a hyperscale pioneer, has standardized its massive environment on a set of five internally-developed server configurations optimized for maximum efficiency. Amazon takes a different approach, leveraging an array of hyperspecalized components each designed with a specific workload in mind. AWS S3 stores trillions of objects generating more than 1.5 million requests per second, with DynamoDB averaging a mere 3 milliseconds of latency, Miniman details. At this scale, the added overhead of a more heterogeneous (but nonetheless tightly integrated) stack is more than offset by the cost benefits, he explains, especially since the company’s applications are developed from the ground up to run at scale.

Hamilton revealed in his speech that Amazon’s rack configurations weigh over one ton, significantly more than the densest commercially available Hadoop solutions. And on the storage side, the cloud giant leverages a distributed DAS architecture that includes both traditional hard drives and flash.

Amazon ties it all together with a white box network based on custom routers and protocols that, as Miniman observes, enable admins to rapidly troubleshoot an issue instead of having to wait months for a vendor to release a patch. The end result is unparalleled efficiency, which the company sustains with what he calls a low margin cycle of innovation that drives efficiencies and created value for customers. Traditional enterprises should take notice.

“CIOs need to pay attention to the hyperscale players which herald the direction of technology. The forecast of public versus private cloud usage over the next few years is hotly debated, but it is without doubt that infrastructure designs and operational models are seeing seismic shifts and Amazon is a key disruptor,” Miniman concludes.


A message from John Furrier, co-founder of SiliconANGLE:

Your vote of support is important to us and it helps us keep the content FREE.

One click below supports our mission to provide free, deep, and relevant content.  

Join our community on YouTube

Join the community that includes more than 15,000 #CubeAlumni experts, including Amazon.com CEO Andy Jassy, Dell Technologies founder and CEO Michael Dell, Intel CEO Pat Gelsinger, and many more luminaries and experts.

“TheCUBE is an important partner to the industry. You guys really are a part of our events and we really appreciate you coming and I know people appreciate the content you create as well” – Andy Jassy

THANK YOU