Hello. Sign in to personalize your visit. New user? Register now.  


 
 

The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines

Synthesis Lectures on Computer Architecture

2009, 108 pages, (doi:10.2200/S00193ED1V01Y200905CAC006)
Luiz André Barroso​‌
Google Inc.
Urs Hölzle​‌
Google Inc.

Abstract

Note: This book is available free to registered individual users. Simply click here, fill in the registration form, and then return to this page to download the PDF (you may need to refresh this page after registering). If you are already a registered individual user, or at a licensed IP-authenticated institution, click the PDF link to the right or below the abstract to download the book.

As computation continues to move into the cloud, the computing platform of interest no longer resembles a pizza box or a refrigerator, but a warehouse full of computers. These new large datacenters are quite different from traditional hosting facilities of earlier times and cannot be viewed simply as a collection of co-located servers. Large portions of the hardware and software resources in these facilities must work in concert to efficiently deliver good levels of Internet service performance, something that can only be achieved by a holistic approach to their design and deployment. In other words, we must treat the datacenter itself as one massive warehouse-scale computer (WSC). We describe the architecture of WSCs, the main factors influencing their design, operation, and cost structure, and the characteristics of their software base. We hope it will be useful to architects and programmers of today's WSCs, as well as those of future many-core platforms which may one day implement the equivalent of today's WSCs on a single board.

Table of Contents: Introduction / Workloads and Software Infrastructure / Hardware Building Blocks / Datacenter Basics / Energy and Power Efficiency / Modeling Costs / Dealing with Failures and Repairs / Closing Remarks

PDF (2829 KB) PDF Plus (1325 KB)

Cited by

, , . (2015) The life cycle assessment of a UK data centre. The International Journal of Life Cycle Assessment 20, 332-349.
Online publication date: 1-Mar-2015.
CrossRef
, . (2015) Virtual machine selection and placement for dynamic consolidation in Cloud computing environment. Frontiers of Computer Science.
Online publication date: 11-Feb-2015.
CrossRef
, , , , , . (2014) Dynamic Data Migration in Hybrid Main Memories for In-Memory Big Data Storage. ETRI Journal 36, 988-998.
Online publication date: 1-Dec-2014.
CrossRef
, , , . (2014) Performance analysis of backup-task scheduling with deadline time in cloud computing. Journal of Industrial and Management Optimization 11, 867-886.
Online publication date: 1-Oct-2014.
CrossRef
, , , . (2014) Aquifer thermal energy storages as a cooling option for German data centers. Energy Efficiency.
Online publication date: 27-Sep-2014.
CrossRef
, , . (2014) Analyzing job completion reliability and job energy consumption for a heterogeneous MapReduce cluster under different intermediate-data replication policies. The Journal of Supercomputing.
Online publication date: 11-Sep-2014.
CrossRef
, , , . (2014) Energy-aware joint management of networks and Cloud infrastructures. Computer Networks 70, 75-95.
Online publication date: 1-Sep-2014.
CrossRef
, , . (2014) Provisioning high-availability datacenter networks for full bandwidth communication. Computer Networks 68, 71-94.
Online publication date: 1-Aug-2014.
CrossRef
, , , . (2014) JET: Electricity cost-aware dynamic workload management in geographically distributed datacenters. Computer Communications.
Online publication date: 1-Feb-2014.
CrossRef
, , , . (2013) Performance analysis of large-scale parallel-distributed processing with backup tasks for cloud computing. Journal of Industrial and Management Optimization 10, 113-129.
Online publication date: 1-Oct-2013.
CrossRef
, , , , . (2013) Cloud engineering is Search Based Software Engineering too. Journal of Systems and Software 86, 2225-2241.
Online publication date: 1-Sep-2013.
CrossRef
, , , , . (2013) Data center demand response: Avoiding the coincident peak via workload shifting and local generation. Performance Evaluation.
Online publication date: 1-Aug-2013.
CrossRef
, . (2013) Recent Changes in the Internet Landscape. it - Information Technology 55, 133-138.
Online publication date: 1-Jul-2013.
CrossRef
, , , , , , , . (2013) Numerical and experimental study of a high port-density WDM optical packet switch architecture for data centers. Optics Express 21, 263.
Online publication date: 14-Jan-2013.
CrossRef
, , , . (2012) Parallel job scheduling for power constrained HPC systems. Parallel Computing 38, 615-630.
Online publication date: 1-Dec-2012.
CrossRef
, , . (2012) Energy-efficient Task Scheduling Model based on MapReduce for Cloud Computing using Genetic Algorithm. Journal of Computers 7.
Online publication date: 1-Dec-2012.
CrossRef
. (2012) Toward on-chip datacenters: a perspective on general trends and on-chip particulars. The Journal of Supercomputing 62, 214-226.
Online publication date: 1-Oct-2012.
CrossRef
, , . (2012) Economic model of a Cloud provider operating in a federated Cloud. Information Systems Frontiers 14, 827-843.
Online publication date: 1-Sep-2012.
CrossRef
. (2012) How much power is needed for a billion-thread high-throughput server?. Frontiers of Computer Science.
Online publication date: 20-Jul-2012.
CrossRef
, , . (2012) Energy-Efficient Multi-Job Scheduling Model for Cloud Computing and Its Genetic Algorithm. Mathematical Problems in Engineering 2012, 1-16.
Online publication date: 1-Jan-2012.
CrossRef
, , , . (2011) Optimal network locality in distributed virtualized data-centers. Computer Communications 34, 1968-1979.
Online publication date: 1-Oct-2011.
CrossRef
, . (2010) Data-Intensive Text Processing with MapReduce. Synthesis Lectures on Human Language Technologies 3:1, 1-177.
Online publication date: 1-Jan-2010.
Abstract | PDF (1170 KB) | PDF Plus (1172 KB) 
, . Location and Provisioning Problems in Cloud Computing Networks. Communication Infrastructures for Cloud Computing, 22-45.
CrossRef
 



Prev. lecture | Next lecture
View/Print PDF (2829 KB)
View PDF Plus (1325 KB)
Add to favorites
Email to a friend
TOC Alert | Citation Alert What is RSS?

Quick Search
for
Authors:
Luiz André Barroso
Urs Hölzle
Keywords:
computer organization and design
Internet services
energy efficiency
fault-tolerant computing
cluster computing
data centers
distributed systems
cloud computing
Home | Synthesis | Search | Profile | Access | Author | Help | About
Technology Partner - Atypon Systems, Inc.