The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines
2009,
108 pages, (doi:10.2200/S00193ED1V01Y200905CAC006)
Luiz André Barroso Google Inc. Urs Hölzle Google Inc. Abstract Note: This book is available free to registered individual users. Simply click here, fill in the registration form, and then return to this page to download the PDF (you may need to refresh this page after registering). If you are already a registered individual user, or at a licensed IP-authenticated institution, click the PDF link to the right or below the abstract to download the book. As computation continues to move into the cloud, the computing platform of interest no longer resembles a pizza box or a refrigerator, but a warehouse full of computers. These new large datacenters are quite different from traditional hosting facilities of earlier times and cannot be viewed simply as a collection of co-located servers. Large portions of the hardware and software resources in these facilities must work in concert to efficiently deliver good levels of Internet service performance, something that can only be achieved by a holistic approach to their design and deployment. In other words, we must treat the datacenter itself as one massive warehouse-scale computer (WSC). We describe the architecture of WSCs, the main factors influencing their design, operation, and cost structure, and the characteristics of their software base. We hope it will be useful to architects and programmers of today's WSCs, as well as those of future many-core platforms which may one day implement the equivalent of today's WSCs on a single board. Table of Contents: Introduction / Workloads and Software Infrastructure / Hardware Building Blocks / Datacenter Basics / Energy and Power Efficiency / Modeling Costs / Dealing with Failures and Repairs / Closing Remarks
Cited byBeth Whitehead, Deborah Andrews, Amip Shah. (2015) The life cycle assessment of a UK data centre. The International Journal of Life Cycle Assessment 20, 332-349. Online publication date: 1-Mar-2015. CrossRef Xiong Fu, Chen Zhou. (2015) Virtual machine selection and placement for dynamic consolidation in Cloud computing environment. Frontiers of Computer Science. Online publication date: 11-Feb-2015. CrossRef Hai Thanh Mai, Kyoung Hyun Park, Hun Soon Lee, Chang Soo Kim, Miyoung Lee, Sung Jin Hur. (2014) Dynamic Data Migration in Hybrid Main Memories for In-Memory Big Data Storage. ETRI Journal 36, 988-998. Online publication date: 1-Dec-2014. CrossRef Kyosuke Hashimoto, Hiroyuki Masuyama, Shoji Kasahara, Yutaka Takahashi. (2014) Performance analysis of backup-task scheduling with deadline time in cloud computing. Journal of Industrial and Management Optimization 11, 867-886. Online publication date: 1-Oct-2014. CrossRef Gregor Drenkelfort, Stefan Kieseler, André Pasemann, Frank Behrendt. (2014) Aquifer thermal energy storages as a cooling option for German data centers. Energy Efficiency. Online publication date: 27-Sep-2014. CrossRef Jia-Chun Lin, Fang-Yie Leu, Ying-Ping Chen. (2014) Analyzing job completion reliability and job energy consumption for a heterogeneous MapReduce cluster under different intermediate-data replication policies. The Journal of Supercomputing. Online publication date: 11-Sep-2014. CrossRef Bernardetta Addis, Danilo Ardagna, Antonio Capone, Giuliana Carello. (2014) Energy-aware joint management of networks and Cloud infrastructures. Computer Networks 70, 75-95. Online publication date: 1-Sep-2014. CrossRef Wenda Ni, Changcheng Huang, Jing Wu. (2014) Provisioning high-availability datacenter networks for full bandwidth communication. Computer Networks 68, 71-94. Online publication date: 1-Aug-2014. CrossRef Zehua Guo, Zhemin Duan, Yang Xu, H. Jonathan Chao. (2014) JET: Electricity cost-aware dynamic workload management in geographically distributed datacenters. Computer Communications. Online publication date: 1-Feb-2014. CrossRef Tsuguhito Hirai, Hiroyuki Masuyama, Shoji Kasahara, Yutaka Takahashi. (2013) Performance analysis of large-scale parallel-distributed processing with backup tasks for cloud computing. Journal of Industrial and Management Optimization 10, 113-129. Online publication date: 1-Oct-2013. CrossRef Mark Harman, Kiran Lakhotia, Jeremy Singer, David R. White, Shin Yoo. (2013) Cloud engineering is Search Based Software Engineering too. Journal of Systems and Software 86, 2225-2241. Online publication date: 1-Sep-2013. CrossRef Zhenhua Liu, Adam Wierman, Yuan Chen, Benjamin Razon, Niangjun Chen. (2013) Data center demand response: Avoiding the coincident peak via workload shifting and local generation. Performance Evaluation. Online publication date: 1-Aug-2013. CrossRef Steve Uhlig, Felix Cuadrado Latasa. (2013) Recent Changes in the Internet Landscape. it - Information Technology 55, 133-138. Online publication date: 1-Jul-2013. CrossRef S. Di Lucente, J. Luo, R. Pueyo Centelles, A. Rohit, S. Zou, K. A. Williams, H. J. S. Dorren, N. Calabretta. (2013) Numerical and experimental study of a high port-density WDM optical packet switch architecture for data centers. Optics Express 21, 263. Online publication date: 14-Jan-2013. CrossRef M. Etinski, J. Corbalan, J. Labarta, M. Valero. (2012) Parallel job scheduling for power constrained HPC systems. Parallel Computing 38, 615-630. Online publication date: 1-Dec-2012. CrossRef Xiaoli Wang, Yuping Wang, Hai Zhu. (2012) Energy-efficient Task Scheduling Model based on MapReduce for Cloud Computing using Genetic Algorithm. Journal of Computers 7. Online publication date: 1-Dec-2012. CrossRef Miray Kas. (2012) Toward on-chip datacenters: a perspective on general trends and on-chip particulars. The Journal of Supercomputing 62, 214-226. Online publication date: 1-Oct-2012. CrossRef Íñigo Goiri, Jordi Guitart, Jordi Torres. (2012) Economic model of a Cloud provider operating in a federated Cloud. Information Systems Frontiers 14, 827-843. Online publication date: 1-Sep-2012. CrossRef Zhiwei Xu. (2012) How much power is needed for a billion-thread high-throughput server?. Frontiers of Computer Science. Online publication date: 20-Jul-2012. CrossRef Xiaoli Wang, Yuping Wang, Hai Zhu. (2012) Energy-Efficient Multi-Job Scheduling Model for Cloud Computing and Its Genetic Algorithm. Mathematical Problems in Engineering 2012, 1-16. Online publication date: 1-Jan-2012. CrossRef Jimmy Leblet, Zhe Li, Gwendal Simon, Di Yuan. (2011) Optimal network locality in distributed virtualized data-centers. Computer Communications 34, 1968-1979. Online publication date: 1-Oct-2011. CrossRef Jimmy Lin, Chris Dyer. (2010) Data-Intensive Text Processing with MapReduce. Synthesis Lectures on Human Language Technologies 3:1, 1-177. Online publication date: 1-Jan-2010. Abstract | PDF (1170 KB) | PDF Plus (1172 KB) Federico Larumbe, Brunilde Sansò. Location and Provisioning Problems in Cloud Computing Networks. Communication Infrastructures for Cloud Computing, 22-45. CrossRef
|
|
|