Web 2.0: Microsoft looks for alternative datacentres in mobile shipping containers

Fast, cheap and all over the place. That is how technology experts behind Microsoft's fast-growing Live offerings envision the future of the enterprise datacentre in a Web 2.0 driven world.


Fast, cheap and all over the place. That is how technology experts behind Microsoft's fast-growing Live offerings envision the future of the enterprise datacentre in a Web 2.0 driven world.

Faced with a shortage of datacentre space and demand for datacentre space that is more than doubling every 24 months, Microsoft is eyeing alternatives to traditional datacentre design, including the use of mobile shipping-containers spread all over the globe to facilitate growth and deal with user demand, according to James Hamilton, architect of Microsoft's Windows Live.

Hamilton's comments came during a presentation on datacentre design at the Web 2.0 Expo in San Francisco

Just as Web 2.0 application developers pursue innovative means for achieving explosive growth, those in charge of the Web 2.0 server room are looking for cutting-edge methods for processing and facilitating that growth, Hamilton said.

"The glut of 2000 datacentre space is over," he said, referring to the fallout of the dotcom market collapse, which left an excess datacentre and bandwidth capacity. "We are out of space industry-wide. We have taken all the most desirable space and everyone is in a mass build-up."

Google alone has 450,000 systems running across 20 datacentres, and Microsoft's Windows Live team is doubling the number of servers it uses every 14 months, which is faster than Moore's Law, Hamilton said, referring to the famous observation by Gordon Moore that the number of transistors on an integrated circuit doubles every 24 months.

Companies like Microsoft and Google have been expanding their datacentre facilities at a breathtaking pace in recent years.

Microsoft, IBM, HP, Sun and others have also formed a consortium called the Green Grid to tackle an impending energy crisis that threatens datacentre growth.

Hamilton discussed a datacentre design strategy that used the storage container as a core building block and stressed the importance of a paradigm shift in server farm architecture in light of the data deluge brought on by the expansive growth of Web 2.0.

To meet the growing need for datacentre space, Hamilton advocates what he called a services rather than an enterprise model for the Web 2.0 datacentre: housing operations in dispersed, tightly packed storage-container datacentres, not unlike Sun Microsystems Project Blackbox.

The air-tight containers would be constructed to achieve close proximity between server boxes and computer room air-conditioning units (CRACs), with variable fans controlling airflow. The power-efficiency benefits of this construction would be further enhanced by the near total elimination of ingress and egress for human access, thereby eliminating the space-waste issues faced by traditional datacentres, Hamilton said.

The containers -- the datacentre equivalents of flash drives -- would be dispersed strategically about the globe in an effort to move capacity to the edge, closer to customers, thereby diminishing dependency on and costs associated with content distribution networks (CDNs), he said.

"We're not close enough to customers, so we have to work with content distribution networks as well," Hamilton said.

Web 2.0 enterprises also need to adopt a radically different approach to hardware maintenance in a world of small, cheap, mobile datacentres, he said.

Noting that 40% of the cost of datacentre operations goes toward staff, Hamilton said that companies need to eliminate headcount in datacentres as much as possible, by switching to a "detect/reboot/replace" approach to server failure, rather than costly maintenance and servicing of malfunctioning hardware. Such an approach could improve servers-per-administrator ratios from 100-to-1 to upwards of 1,000-to-1, Hamilton said.

"Spending 20% of your datacentre budget on service? Well, then, don't service it," Hamilton added. "It seems ironic to build systems that run well on unreliable components and then house those unreliable components in a super-reliable datacentre."

The payoffs of such an approach go beyond mere cost savings. Forgoing the solitary central facility in favour of a distributed-microcentre approach will also increase reliability and be more flexible in the face of large, often seasonal fluctuations of customer loads, or regional disputes like war or national disaster, he said.

Not that the distributed model does not come with risks and challenges. A shift to smaller, trailer based datacentres has implications in the software programming model. Also, savings on datacentre administrators will likely be diverted to pay for more application developers.

Judging from the looks of the application development crowd that makes up the audience of Web 2.0 Exposition, however, that would be just fine.

Now take part in our How Green is your IT survey

"Recommended For You"

Datacentres get religion Microsoft: How we run a greener IT environment