SLA-Based, Energy-Efficient Resource Management In
Total Page:16
File Type:pdf, Size:1020Kb
SLA-based, Energy-Efficient Resource Management in Cloud Computing Systems by Hadi Goudarzi ______________________________________________________________ A Dissertation Presented to the FACULTY OF THE USC GRADUATE SCHOOL UNIVERSITY OF SOUTHERN CALIFORNIA In Partial Fulfillment of the Requirements for the Degree DOCTOR OF PHILOSOPHY (ELECTRICAL ENGINEERING) December 2013 Copyright 2013 Hadi Goudarzi DEDICATION To my family for their everlasting love and support ii ACKNOWLEDGEMENTS The completion of this doctoral dissertation has been a long journey made possible through the inspiration and support of a handful of people. First and foremost, I especially would like to thank my Ph.D. advisor and dissertation committee chairman, Professor Massoud Pedram, for his enthusiasm, mentorship, and encouragement throughout my graduate studies and academic research. He has been a continuous source of motivation and support for me and I want to sincerely thank him for all I have achieved. His passion for scientific discoveries and his dedication in making technical contributions to the computer engineering community have been invaluable in shaping my academic and professional career. Special thanks go to my dissertation and qualification committees, including Professor Sandeep K. Gupta, Professor Murali Annavaram, Professor Viktor K. Prasanna, Professor Aiichiro Nakano, and Professor Mansour Rahimi for their time, guidance, and feedback. Special thanks to Dr. Shahin Nazarian with whom I have collaborated on some projects. I truly appreciate his mentorship, priceless advices, feedback, and help. I would like to thank those who have in many ways contributed to the success of my academic endeavors. They are the Electrical Engineering staff at the University of Southern California, particularly Annie Yu, Diane Demetras, and Tim Boston; the iii members of the System Power Optimization and Regulation Technology (SPORT) Laboratory; and my best and dearest friends. Last but not least, my deepest gratitude goes to my family for their unconditional love, support, and devotion throughout my life and especially during my education. I would not have been able to accomplish my goals without their support and encouragement. I am much indebted to my mother and father, for believing in me and encouraging me to pursue my goals. I would also like to thank my sister and brother, Zahra and Hamid, who I love dearly. No matter how far away they may be physically, they are never far from my heart and mind. iv TABLE OF CONTENTS Dedication ........................................................................................................................... ii Acknowledgements ............................................................................................................ iii List of Tables .................................................................................................................... vii List of Figures .................................................................................................................. viii Abstract .............................................................................................................................. xi Chapter 1. Energy-efficient Datacenters ..............................................................................1 1.1 Introduction ..................................................................................................1 1.2 Datacenter Organization ..............................................................................6 1.3 Datacenter Management ............................................................................12 1.4 Resource Arbiter related work ...................................................................14 1.5 Power manager related work .....................................................................18 1.6 Thermal Management ................................................................................25 1.7 Geographical Load Balancing ....................................................................28 1.8 Structure of this thesis and parameter definition .......................................31 Chapter 2. SLA-based Optimization of Power and Migration Cost in Cloud Computing 34 2.1 Introduction ................................................................................................34 2.2 System Model ............................................................................................35 2.2.1 Datacenter Configuration ................................................................... 35 2.2.2 VM Management System ................................................................... 37 2.2.3 Performance Modeling ....................................................................... 39 2.2.4 SLA model for the clients ................................................................... 42 2.3 Problem Formulation .................................................................................42 2.4 Cost Minimization Algorithm ....................................................................45 2.4.1 Initial Solution .................................................................................... 46 2.4.2 Resource allocation adjustment .......................................................... 50 2.4.3 Turn OFF under-utilized servers ........................................................ 50 2.5 Simulation Results .....................................................................................51 2.5.1 Simulation Setup ................................................................................ 51 2.5.2 Heuristics for Comparison .................................................................. 52 2.5.3 Numerical Results .............................................................................. 53 2.6 Conclusion .................................................................................................55 v Chapter 3. Hierarchical SLA-Driven Resource Management for Peak Power-Aware and Energy-Efficient Operation of a Cloud Datacenter ...........................................................57 3.1 Introduction ................................................................................................57 3.2 Cloud Datacenter and Key Parameters ......................................................59 3.2.1 Cloud datacenter ................................................................................. 60 3.2.2 Virtual machine characteristics .......................................................... 65 3.3 Cloud Datacenter Resource Management Problem ...................................68 3.4 Periodic optimization: VM assignment .....................................................75 3.5 Periodic optimization: Local Search Method ............................................85 3.6 Methods to Deal with Emergencies ...........................................................89 3.7 Simulation framework and results .............................................................97 3.7.1 Simulation framework ........................................................................ 97 3.7.2 Base-line heuristics ............................................................................. 99 3.7.3 Simulation results ............................................................................. 101 3.8 Conclusion ...............................................................................................112 Chapter 4 . Geographical Load Balancing for Online Service Applications in Distributed Datacenters ....................................................................................................113 4.1 Introduction ..............................................................................................113 4.2 Parameter definitions ...............................................................................115 4.3 Problem Formulation for the Static Problem ...........................................121 4.4 Algorithm for the Static Solution .............................................................124 4.5 Formulation and Solution of the Dynamic Version of the Problem ........130 4.6 Simulation Results ...................................................................................133 4.7 Conclusion ...............................................................................................142 Chapter 5. Conclusions and Future Work ........................................................................143 Bibliography ....................................................................................................................145 Alphabetized Bibliography ..............................................................................................154 vi LIST OF TABLES Table I. Notation and Definitions of Common Parameters in this Thesis ........................ 33 Table II. Notation and Definitions in Chapter 2 ............................................................... 36 Table III. Performance of SPMCM w.r.t. lower bound cost............................................. 54 Table IV. Notation and Definitions in Chapter 3 .............................................................. 60 Table V. Notation and Definitions in Chapter 4 ............................................................. 116 Table VI. Normalized operational cost of the cloud during four days using different load balancing algorithms ...................................................................................... 140 vii LIST OF FIGURES Figure 1. High level view of key components