The CRISP Performance Model for Dynamic Voltage and Frequency Scaling in a GPGPU

Total Page:16

File Type:pdf, Size:1020Kb

The CRISP Performance Model for Dynamic Voltage and Frequency Scaling in a GPGPU The CRISP Performance Model for Dynamic Voltage and Frequency Scaling in a GPGPU Rajib Nath Dean Tullsen University of California, San Diego University of California, San Diego 9500 Gilman Drive, La Jolla, CA 9500 Gilman Drive, La Jolla, CA ABSTRACT frequency for energy and power savings, but can also This paper presents CRISP, the first runtime analytical address other problems such as temperature [11], reli- model of performance in the face of changing frequency ability [12], and variability [13]. However, in all cases in a GPGPU. It shows that prior models not targeted it trades off performance for other gains, so properly at a GPGPU fail to account for important characteris- setting DVFS to maximize particular goals can only be tics of GPGPU execution, including the high degree of done with the assistance of an accurate estimate of the overlap between memory access and computation and performance of the system at alternate frequency set- the frequency of store-related stalls. tings. CRISP provides significantly greater accuracy than While extensive research has been done on DVFS per- prior runtime performance models, being within 4% on formance modeling for CPU cores, there is little guid- average when scaling frequency by up to 7X. Using ance in the literature for GPU and GPGPU settings, de- CRISP to drive a runtime energy efficiency controller spite the fact that modern GPUs have extensive support yields a 10.7% improvement in energy-delay product, vs for DVFS [14, 15, 16, 17]. However, the potential for 6.2% attainable via the best prior performance model. DVFS on GPUs is high for at least two reasons. First, the maximum power consumption in a GPGPU is of- ten higher than CPUs, e.g., 250 Watts for the NVIDIA Categories and Subject Descriptors GTX480. Second, while the range of DVFS settings in C.1.4 [Processor Architectures]: Parallel Architec- modern CPUs is shrinking, that is not yet the case for tures; C.4 [Performance of Systems]: Modeling tech- GPUs, which have ranges such as 0.5V-1.0V (NVIDIA niques Fermi [18]). This work presents a performance model that closely Keywords tracks GPGPU performance on a wide variety of work- loads, and significantly outperforms existing models which Critical Path, GPGPU, DVFS are tuned to the CPU. We show that the GPU presents key differences that are not handled by those models. 1. INTRODUCTION Most DVFS performance models are empirical and This paper describes the CRISP (CRItical Stalled use statistical [19, 20, 21, 22, 23] or machine learning Path) performance predictor for GPGPUs under vary- methods [24, 25], or assume a simple linear relation- ing core frequency. Existing analytical models that ac- ship [26, 27, 28, 29, 30, 31, 32] between performance count for frequency change only target CPU perfor- and frequency. Abe et al., [14] target GPUs, but with a mance, and do not effectively capture the execution regression based offline statistical model that is neither characteristics of a GPU. targeted for, nor conducive to, runtime analysis. Dynamic voltage and frequency scaling (DVFS) [1] Recent research presents new performance counter ar- has shown the potential for significant power and energy chitectures [33, 34, 35] to model the impact of frequency savings in many system components including processor scaling on CPU workloads. These analytical models cores [2, 3], memory system [4, 5, 6], last level cache [7], (e.g., leading load [33] and critical path [34]) divide a and interconnect [8, 9, 10]. DVFS scales voltage and CPU program into two disjoint segments representing the non-pipelined (TMemory) and pipelined (TCompute) portion of the computation. They make two assump- tions: (a) the memory portion of the computation never Permission to make digital or hard copies of all or part of this work for scales with frequency, and (b) cores never stall for store personal or classroom use is granted without fee provided that copies are operations. Though these assumptions are reasonably not made or distributed for profit or commercial advantage and that copies valid in CPUs, they start to fail as we move to massively bear this notice and the full citation on the first page. To copy otherwise, to parallel architecture like GPGPUs. No existing run- republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. time analytical models for GPGPUs handle the effect MICRO 2015 Waikiki, Hawaii USA of voltage frequency changes. Copyright 2015 ACM 978-1-4503-4034-2/15/12 ...$15.00. A program running on a GPGPU, typically referred nating sequence of compute and memory phases. In to as a kernel, will have a high degree of thread level par- a compute phase, the core executes useful instructions allelism. The single instruction multiple thread (SIMT) without generating any memory requests (e.g., instruc- parallelism in GPGPUs allows a significant portion of tion fetches, data loads) that reach main memory. A the computation to be overlapped with memory latency, memory request which misses the last level cache might which can make the memory portion of the computa- trigger a memory phase, but only when a resource is tion elastic to core clock frequency and thus breaks the exhausted and the pipeline stalls. Once the instruction first assumption of the prior models. Though mem- or data access returns, the core typically begins a new ory/computation overlap has been used for program op- compute phase. In all the current analytical models, the timization, modeling frequency scaling in the presence execution time (T) of a program at a voltage-frequency of abundant parallelism and high memory/computation setting with cycle time t is expressed as overlap is new and a complex problem. Moreover, due to the wide single instruction multiple data (SIMD) vec- T (t)= TCompute(t)+ TMemory (1) tor units in GPGPU streaming multiprocessors (SMs) They strictly assume that the pipeline portion of the ex- and homogeneity of computation in SIMT scheduling, ecution time (T ) scales with the frequency, while GPGPU SMs often stall due to stores. Compute the non-pipeline portion (TMemory) does not. The exe- The CRISP predictor accounts for these differences, cution time at an unexplored voltage-frequency setting plus others. It provides accuracy within 4% when scal- of v2,f2 can be estimated from the measurement in the ing from 700 MHz to 400 MHz, and 8% when scaling current settings v ,f by all the way to 100 MHz. It reduces the maximum error 1 1 by a factor of 3.6 compared to prior models. Addi- f1 T (v2,f2)= TCompute(v1,f1) × + TMemory (2) tionally, when used to direct GPU DVFS settings, it f2 enables nearly double the gains of prior models (10.7% EDP gain vs 5.7% with critical path and 6.2% with The accuracy of these models relies heavily on ac- leading load). We also show CRISP effectively used to curate classification of cycles into compute or memory reduce ED2P, or to reduce energy while maintaining a phase cycles, and this is the primary way in which these performance constraint. models differ. We describe them next. Stall Time: Stall time [35] estimates the non-pipeline phase (TMemory) as the number of cycles the core is un- 2. MOTIVATION AND RELATED WORK able to retire any instructions due to outstanding last Our model of GPGPU performance in the presence of level cache misses. It ignores computation performed DVFS builds on prior work on modeling CPU DVFS. during the miss before the pipeline stall. Since the scal- Since there are no analytical DVFS models for GPG- ing of this portion of computation can be hidden under PUs, we will describe some of the prior work in the CPU memory latency, stall time overpredicts execution time. domain and the shortcomings of those models when ap- Miss Model: The Miss model [35] includes ROB plied to GPUs. We also describe recent GPU-specific fill time inside the memory phase. It identifies all the performance models at the end of this section. stand alone misses, but only the first miss in a group of overlapped misses as a contributor to TMemory. In par- 2.1 CPU-based Performance Models for DVFS ticular, it ignores misses that occur within the memory Effective use of DVFS relies on some kind of predic- latency of an initial miss. The resulting miss count is tion of the performance and power of the system at then multiplied by a fixed memory latency to compute different voltage and frequency settings. An inaccurate TMemory. This approach loses accuracy due to its fixed model results in the selection of non-optimal settings latency assumption and also ignores stall cycles due to and lost performance and/or energy. instruction cache misses. Existing DVFS performance models are primarily aimed Leading Load: Leading load [33, 36] recognizes both at the CPU. They each exploit some kind of linear front-end stalls due to instruction cache misses and back- model, based on the fact that CPU computation scales end stalls due to load misses. Their model counts the with frequency speed while memory latency does not. cycles when an instruction cache miss occurs in the These models fall into four classes: (a) proportional, (b) last level cache. It adopts a similar approach to the sampling, (c) empirical, and (d) analytical. The propor- miss model to address memory level parallelism for data tional scaling model assumes a linear relation between loads. However, to account for variable memory latency, the performance and the core clock frequency. The sam- it counts the actual number of cycles a contributor load pling model better accounts for memory effects by iden- is outstanding.
Recommended publications
  • Analysis of Body Bias Control Using Overhead Conditions for Real Time Systems: a Practical Approach∗
    IEICE TRANS. INF. & SYST., VOL.E101–D, NO.4 APRIL 2018 1116 PAPER Analysis of Body Bias Control Using Overhead Conditions for Real Time Systems: A Practical Approach∗ Carlos Cesar CORTES TORRES†a), Nonmember, Hayate OKUHARA†, Student Member, Nobuyuki YAMASAKI†, Member, and Hideharu AMANO†, Fellow SUMMARY In the past decade, real-time systems (RTSs), which must in RTSs. These techniques can improve energy efficiency; maintain time constraints to avoid catastrophic consequences, have been however, they often require a large amount of power since widely introduced into various embedded systems and Internet of Things they must control the supply voltages of the systems. (IoTs). The RTSs are required to be energy efficient as they are used in embedded devices in which battery life is important. In this study, we in- Body bias (BB) control is another solution that can im- vestigated the RTS energy efficiency by analyzing the ability of body bias prove RTS energy efficiency as it can manage the tradeoff (BB) in providing a satisfying tradeoff between performance and energy. between power leakage and performance without affecting We propose a practical and realistic model that includes the BB energy and the power supply [4], [5].Itseffect is further endorsed when timing overhead in addition to idle region analysis. This study was con- ducted using accurate parameters extracted from a real chip using silicon systems are enabled with silicon on thin box (SOTB) tech- on thin box (SOTB) technology. By using the BB control based on the nology [6], which is a novel and advanced fully depleted sili- proposed model, about 34% energy reduction was achieved.
    [Show full text]
  • Dynamic Voltage/Frequency Scaling and Power-Gating of Network-On-Chip with Machine Learning
    Dynamic Voltage/Frequency Scaling and Power-Gating of Network-on-Chip with Machine Learning A thesis presented to the faculty of the Russ College of Engineering and Technology of Ohio University In partial fulfillment of the requirements for the degree Master of Science Mark A. Clark May 2019 © 2019 Mark A. Clark. All Rights Reserved. 2 This thesis titled Dynamic Voltage/Frequency Scaling and Power-Gating of Network-on-Chip with Machine Learning by MARK A. CLARK has been approved for the School of Electrical Engineering and Computer Science and the Russ College of Engineering and Technology by Avinash Karanth Professor of Electrical Engineering and Computer Science Dennis Irwin Dean, Russ College of Engineering and Technology 3 Abstract CLARK, MARK A., M.S., May 2019, Electrical Engineering Dynamic Voltage/Frequency Scaling and Power-Gating of Network-on-Chip with Machine Learning (89 pp.) Director of Thesis: Avinash Karanth Network-on-chip (NoC) continues to be the preferred communication fabric in multicore and manycore architectures as the NoC seamlessly blends the resource efficiency of the bus with the parallelization of the crossbar. However, without adaptable power management the NoC suffers from excessive static power consumption at higher core counts. Static power consumption will increase proportionally as the size of the NoC increases to accommodate higher core counts in the future. NoC also suffers from excessive dynamic energy as traffic loads fluctuate throughout the execution of an application. Power- gating (PG) and Dynamic Voltage and Frequency Scaling (DVFS) are two highly effective techniques proposed in literature to reduce static power and dynamic energy in the NoC respectively.
    [Show full text]
  • Real-Time Dynamic Voltage Scaling for Low-Power Embedded Operating Systems£
    Real-Time Dynamic Voltage Scaling for Low-Power Embedded Operating Systems£ Padmanabhan Pillai and Kang G. Shin Real-Time Computing Laboratory Department of Electrical Engineering and Computer Science The University of Michigan Ann Arbor, MI 48109-2122, U.S.A. pillai,kgshin @eecs.umich.edu ABSTRACT ful microprocessors running sophisticated, intelligent control soft- In recent years, there has been a rapid and wide spread of non- ware in a vast array of devices including digital camcorders, cellu- traditional computing platforms, especially mobile and portable com- lar phones, and portable medical devices. puting devices. As applications become increasingly sophisticated and processing power increases, the most serious limitation on these Unfortunately, there is an inherent conflict in the design goals be- devices is the available battery life. Dynamic Voltage Scaling (DVS) hind these devices: as mobile systems, they should be designed to has been a key technique in exploiting the hardware characteristics maximize battery life, but as intelligent devices, they need powerful of processors to reduce energy dissipation by lowering the supply processors, which consume more energy than those in simpler de- voltage and operating frequency. The DVS algorithms are shown to vices, thus reducing battery life. In spite of continuous advances in be able to make dramatic energy savings while providing the nec- semiconductor and battery technologies that allow microprocessors essary peak computation power in general-purpose systems. How- to provide much greater computation per unit of energy and longer ever, for a large class of applications in embedded real-time sys- total battery life, the fundamental tradeoff between performance tems like cellular phones and camcorders, the variable operating and battery life remains critically important.
    [Show full text]
  • Learning-Directed Dynamic Voltage and Frequency Scaling Scheme with Adjustable Performance for Single-Core and Multi-Core Embedded and Mobile Systems †
    sensors Article Learning-Directed Dynamic Voltage and Frequency Scaling Scheme with Adjustable Performance for Single-Core and Multi-Core Embedded and Mobile Systems † Yen-Lin Chen 1,* , Ming-Feng Chang 2, Chao-Wei Yu 1 , Xiu-Zhi Chen 1 and Wen-Yew Liang 1 1 Department of Computer Science and Information Engineering, National Taipei University of Technology, Taipei 10608, Taiwan; [email protected] (C.-W.Y.); [email protected] (X.-Z.C.); [email protected] (W.-Y.L.) 2 MediaTek Inc., Hsinchu 30078, Taiwan; [email protected] * Correspondence: [email protected]; Tel.: +886-2-27712171 (ext. 4239) † This paper is an expanded version of “Learning-Directed Dynamic Volt-age and Frequency Scaling for Computation Time Prediction” published in Proceedings of 2011 IEEE 10th International Conference on Trust, Security and Privacy in Computing and Communications, Changsha, China, 16–18 November 2011. Received: 6 August 2018; Accepted: 8 September 2018; Published: 12 September 2018 Abstract: Dynamic voltage and frequency scaling (DVFS) is a well-known method for saving energy consumption. Several DVFS studies have applied learning-based methods to implement the DVFS prediction model instead of complicated mathematical models. This paper proposes a lightweight learning-directed DVFS method that involves using counter propagation networks to sense and classify the task behavior and predict the best voltage/frequency setting for the system. An intelligent adjustment mechanism for performance is also provided to users under various performance requirements. The comparative experimental results of the proposed algorithms and other competitive techniques are evaluated on the NVIDIA JETSON Tegra K1 multicore platform and Intel PXA270 embedded platforms.
    [Show full text]
  • Energy Proportional Computing in Commercial Fpgas with Adaptive
    Energy proportional computing in Commercial FPGAs with Adaptive Voltage Scaling Jose Nunez-Yanez Department of Electrical and Electronic Engineering University of Bristol, UK +44 117 3315128 [email protected] ABSTRACT an open-loop configuration. However, worst case variability is Voltage and frequency adaptation can be used to create energy rarely the case. For this reason, this paper investigates Adaptive proportional systems in which energy usage adapts to the amount Voltage Scaling (AVS) in which run-time monitoring of of work to be done in the available time. Closed-loop voltage and performance variability in the silicon is used together with system frequency scaling can also take into account process and characterization to influence the voltage and the frequency on the temperature variations in addition to system load and this removes fly in a closed-loop configuration. a significant proportion of the margins used by device The rest of the paper is structured as follows. Section 2 describes manufacturers. This paper explores the capabilities of commercial related work. Section 3 presents the hardware platform used in FPGAs to use closed-loop adaptive voltage scaling to improve this research while section 4 introduces the design flow that their energy and performance profiles beyond nominal. An embeds the AVS capabilities in the user design. Section 5 adaptive power architecture based on a modified design flow is presents the power adaptive architecture based on the novel in- created with in-situ detectors and dynamic reconfiguration of situ detectors. Section 6 presents and discusses the results clock management resources. The results of deploying AVS in focusing on power and energy measurements.
    [Show full text]
  • The Dynamic Voltage and Frequency Scaling Based on the On-Chip Microcontroller System
    Journal of Theoretical and Applied Information Technology 10th May 2013. Vol. 51 No.1 © 2005 - 2013 JATIT & LLS. All rights reserved. ISSN: 1992-8645 www.jatit.org E-ISSN: 1817-3195 THE DYNAMIC VOLTAGE AND FREQUENCY SCALING BASED ON THE ON-CHIP MICROCONTROLLER SYSTEM 1,2TIEFENG LI, 1CAIWEN MA, 1WENHUA LI 1 Xi'an Institute of Optics and Precision Mechanics of Chinese Academy of Sciences, Xi’an, 710119,China 2The Graduate University of Chinese Academy of Sciences ,Beijing, 100049, China E-mail: [email protected] , [email protected] , [email protected] ABSTRACT With the rapid increase of complexity and size of the on-chip microcontroller system (OCMS), the power consumption issue for the OMCS is increasingly becoming critical and needs to be solved quickly. Because the CPU is often the major power consumer in the OCMS, so an important strategy to achieve energy saving is via the dynamic voltage and frequency scaling (DVFS), which can enable a processor to operate at a range of voltages and frequencies. However, it needs to be emphasized that the conventional DVFS is fully executed by the software scheduler in the operating system, and its main drawback is that the scheduler can’t accurately track the performance requirements of CPU when the dormant frequency of CPU is increasing continuously. In this paper, we firstly present a typical hardware DVFS architecture, which can automatically carry out DVFS without the software scheduler involvement. Therefore, it avoids increasing the software's workload and reduces the power consumption. Keywords: Power Consumption, DVFS, Software Scheduler, Performance Requirement 1.
    [Show full text]
  • LG8: (E) Engineering and Physical Considerations
    LG8: (E) Engineering and Physical Considerations Topics: Power consumption, scaling, size, logical effort and performance limits. LG8.1 - E - 90 Nanometer Gate Length. LG8.2 - E - Power Consumption LG8.3 - E - Dynamic Power Gating LG8.4 - E - Dynamic Frequency Scaling LG8.5 - E - Dynamic Voltage Scaling LG8.6 - E - Logical Effort LG8.7 - E - Information Flux What is the Silicon End Point ? 1 LG8.1 - E - 90 Nanometer Gate Length. The mainstream VLSI technology in the period 2004-2008. Parameters from a 90 nanometer standard cell library: Parameter Value Unit Drawn Gate Length 0.08 µm Metal Layers 6 to 9 layers Max Gate Density 400K gates/mm2 Track Width 0.25 µm Track Spacing 0.25 µm Tracking Capacitance 1 fF/mm Core Supply Voltage 0.9 to 1.4 V FO4 Delay 51 ps Typical processor core: 200k gates + 4 RAMs: one square millimeter. Typical SoC chip area is 50-100 mm2 20-40 million gates. Actual gate and transistor count higher owing to custom blocks (RAMs mainly). Now the industry is moving to 45 nanometer. 2007: Dual-core Intel Itanium2: 2 billion transistors. http://en.wikipedia.org/wiki/Moore’s_law 2 LG8.2- E - Power Consumption P = V × I = E × f I (current) = Static Current + Dynamic Current. Early CMOS (VCC= 5 volts): negligible static current. Today it’s 30 % of dynamic. Dynamic current = Short circuit current + Charge current. Charge current: • All energy in a net/gates is wasted each time it toggles. • The energy in a capacitor is E = CV 2/2. • Dominant capacitance is proportional to net length.
    [Show full text]
  • Analysis of Clocked Timing Elements for Dynamic Voltage Scaling Effects Over Process Parameter Variation Hoang Q
    Analysis of Clocked Timing Elements for Dynamic Voltage Scaling Effects over Process Parameter Variation Hoang Q. Dao Kevin Nowka Vojin G. Oklobdzija ACSEL Lab IBM Austin Research Lab ACSEL Lab University of California, Davis 11400 Burnet Road MS9460, University of California, Davis 1 Shields Avenue, Davis, CA 95616 Austin, TX 78758 1 Shields Avenue, Davis, CA 95616 +1-530-754-6827 +1-512-838-3350 +1-530-754-6827 [email protected] [email protected] [email protected] ABSTRACT It was our interest to analyze the effect of large supply voltage In power-constrained systems, the power efficiency of latches and variation as well as the typical process and environmental flip-flops is pivotal. Characteristics of three selected latches and variation in bulk CMOS circuits. In assessing the quality of FFs were analyzed for their behavior under voltage scaling and designs for the low power, both the designs and the evaluation different process corners in a 0.18um CMOS technology. The methodology and criteria are equally important. We specifically relative performance amongst the latches/FFs was consistent focus on latches and flip-flops: an improved semi-dynamic flip- across the different supply voltages. At low-voltage power-delay- flop (SDFF) [1], the sense-amplifier flip-flop (SAFF) [2] and the product was degraded by about 25%. Energy-delay-product was master-slave PowerPC latch [5]. Section 2 presents the effects of approximately doubled at low-voltage – for all latches/FFs over voltage scaling. Section 3 discusses modification to the test all process corners. This result was smaller in comparison to the bench by Stojanovic and Oklobdzija [3].
    [Show full text]
  • Dynamic Voltage and Frequency Scaling : the Laws of Diminishing Returns Authors Etienne Le Sueur and Gernot Heiser
    Dynamic Voltage and Frequency Scaling : The laws of diminishing returns Authors Etienne Le Sueur and Gernot Heiser Workshop on Power Aware Computing and Systems, pp. 1–5, Vancouver, Canada, October, 2010 1. Senior Member of Technical Staff at Vmware. During the research he was at NICTA is Australia's Information and Communications Technology Presented By Research Centre of Excellence. 2. Scientia Professor and Prasanth B L John Lions Chair of Operating Systems Aakash Arora School of Computer science and Engineering UNSW , Sydney, Australia Introduction • What contributions are in this paper (according to the authors)? The Authors analyzed and examined the potential of DVFS across three platforms with recent generation of AMD processors in various aspects viz.,. Scaling of Silicon Transistor technology, Improved memory performance, Improved sleep/ idle mode, Multicore Processors. • What possible consequences can the contributions have? The results shows that on the most recent platform, the effectiveness of DVFS is markedly reduced, and actual savings are only observed when shorter executions (at higher frequency) are padded with the energy consumed when idle. Previous Works Before Author related to DVFS Previous research has attempted to leverage DVFS as a means to improve energy efficiency by lowering the CPU frequency when cycles are being wasted, stalled on memory resources. Energy can only be saved if the power consumption is reduced enough to cover the extra time it takes to run the work load at the lower frequency. "Hot" gigahertz Higher the frequency more the power consumption • An example to understand the scaling of Voltage and frequency by simple instruction execution Case 1: Equal execution time for each stage Case 2: Unequal execution time for each stage Previous Research works Referenced They used simulated execution traces and the level of slack time to choose a new CPU frequency at each OS scheduler invocation [7].
    [Show full text]
  • Adaptive, Transparent Frequency and Voltage Scaling of Communication
    Adaptive, Transparent Frequency and Voltage Scaling of Communication Phases in MPI Programs ¡ Min Yeol Lim Vincent W. Freeh David K. Lowenthal Abstract because power is proportional to the product of the frequency and the square of the voltage. As an ex- Although users of high-performance computing are ample of the problem that is faced, several years ago most interested in raw performance, both energy and it was observed that on their current trend, the power power consumption have become critical concerns. density of a microprocessor will reach that of a nu- Some microprocessors allow frequency and voltage clear reactor by the year 2010 [17]. scaling, which enables a system to reduce CPU per- To balance the concerns of power and perfor- formance and power when the CPU is not on the crit- mance, new architectures have aggressive power ical path. When properly directed, such dynamic fre- controls. One common mechanism on newer micro- quency and voltage scaling can produce significant processors is the ability of the application or operat- energy savings with little performance penalty. ing system to select the frequency and voltage on the This paper presents an MPI runtime system that fly. We call this dynamic voltage and frequency scal- dynamically reduces CPU performance during com- ing (DVFS) and denote each possible combination of munication phases in MPI programs. It dynamically voltage and frequency a processor state, or p-state. identifies such phases and, without profiling or train- While changing p-states has broad utility, includ- ing, selects the CPU frequency in order to minimize ing extending battery life in small devices, the pri- energy-delay product.
    [Show full text]
  • Energy Consumption Evaluation of Flip-Flops for Dynamic Voltage Scaling Systems and Circulating-Temperature Applications
    Title Page Energy Consumption Evaluation of Flip-Flops for Dynamic Voltage Scaling Systems and Circulating-Temperature Applications by Minghe Shao Submitted to the Graduate Faculty of the Swanson School of Engineering in partial fulfillment of the requirements for the degree of Master of Science University of Pittsburgh 2021 Committee Membership Page UNIVERSITY OF PITTSBURGH SWANSON SCHOOL OF ENGINEERING This thesis was presented by Minghe Shao It was defended on March 5, 2021 and approved by In Hee Lee, PhD, Assistant Professor, Department of Electrical and Computer Engineering Samuel Dickerson, PhD, Assistant Professor, Department of Electrical and Computer Engineering Rajkumar Kubendran, PhD, Assistant Professor, Department of Electrical and Computer Engineering Thesis Advisor: In Hee Lee, PhD, Assistant Professor, Department of Electrical and Computer Engineering ii Copyright © by Minghe Shao 2021 iii Abstract Energy Consumption Evaluation of Flip-Flops for Dynamic Voltage Scaling Systems and Circulating-Temperature Applications Minghe Shao, M.S. University of Pittsburgh, 2021 CMOS circuit technology has developed with a help of transistor scaling. In past decades, previous studies found that operating environment of digital system affects circuit performance significantly. For example, extensive research has been performed to learn temperature dependency of CMOS circuits and optimize their performance at given temperature. Adaptive voltage scaling (AVS) is one of the important techniques, responses to operating temperature and dynamically change supply voltage of digital circuits to optimize circuit performance. AVS can enable energy optimization for a system experiencing significant temperature variation, including a space satellite. However, inappropriate AVS results in functional failure in an extreme condition, which can cause substantial problem for a critical mission.
    [Show full text]
  • Power Management and Dynamic Voltage Scaling: Myths and Facts
    Power Management and Dynamic Voltage Scaling: Myths and Facts David Snowdon, Sergio Ruocco and Gernot Heiser National ICT Australia and School of Computer Science and Engineering University of NSW, Sydney 2052, Australia [email protected] Abstract frequency. The total energy ¨ for the computation is then proportional to the square of the voltage: This paper investigates the validity of common ap- ¤ ¨ ¢ ¦ proaches to power management based on dynamic volt- ¥ (2) age scaling (DVS). Using instrumented hardware and ap- propriate operating-system support, we account separately Note that the total energy for a computation does in this for energy consumed by the processor and the memory sys- simple model not depend on the frequency, but a reduced tem. We find that memory often contributes significantly to core voltage requires a reduction of the clock frequency and overall power consumption, which leads to a much more therefore implies a longer overall execution time. complex relationship between energy consumption and core The assumptions behind Eqn. 2 are highly dubious, as voltage and frequency than is frequently assumed. As a they ignore other system components, in particular the consequence, we find that the voltage and frequency setting front-side bus and memory [2]. Those other components that minimises energy consumption is dependent on system impact the execution time of a program, leading to a much characteristics, and, more importantly, on the application- more complex dependence on the processor frequency. Fur- specific balance of memory and CPU activity. The optimal thermore, those components themselves consume energy, setting of core voltage and frequency therefore requires ei- and that energy consumption scales differently than the pro- ther a-priori analysis of the application or, where this is not cessor’s.
    [Show full text]