DOCSLIB.ORG

Powerkap - a Tool for Improving Energy Transparency for Software Developers on GNU/Linux (X86) Platforms

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Powerkap - a Tool for Improving Energy Transparency for Software Developers on GNU/Linux (X86) Platforms Project Report Department of Computing Imperial College of Science, Technology and Medicine PowerKap - A tool for Improving Energy Transparency for Software Developers on GNU/Linux (x86) platforms Author: Supervisor: Krish De Souza Dr. Anandha Gopalan Submitted in partial fulfilment of the requirements for the M.Eng Computing 4 of Imperial College London Contents 1 Introduction 6 1.1 Motivation . .6 1.2 Objectives . .7 1.3 Achievements . .7 2 Background 9 2.1 The relationship between power and energy. .9 2.2 Power controls on x86 platforms . .9 2.3 Improving software for power efficiency . 10 2.3.1 Algorithm . 10 2.3.2 Multithreading . 10 2.3.3 Vectorisation . 10 2.3.4 Improper sleep loops . 12 2.3.5 OS Timers . 13 2.3.6 Context aware programming . 13 2.4 Current methods of monitoring energy. 14 2.4.1 Out of Band Energy Monitor . 14 2.4.2 In-Band Energy Monitor . 14 2.4.2.1 Powertop . 15 2.4.2.2 Turbostat . 16 2.5 Related Work . 16 2.5.1 ENTRA 2012-2015 . 16 2.5.1.1 Common Assertion Language . 16 2.5.1.2 Compiler Optimisation and Power Trade-offs . 18 2.5.1.3 Superoptimization . 18 2.5.1.4 Thermal trade-off . 20 2.5.2 eProf . 20 2.5.2.1 Asynchronous vs Synchronous . 20 2.5.2.2 Profiling implementation . 21 2.5.3 Energy Formal Definitions . 21 2.5.3.1 Java Based Energy Formalism . 22 2.5.3.2 Energy Application Model . 22 2.5.4 Impact of language, Compiler, Optimisations . 22 2.5.4.1 Choice of Language . 22 2.5.4.2 Relation of execution time and energy consumption . 23 2.5.4.3 Impact of Optimisation flags . 23 2.5.4.4 Choice in Algorithm . 25 2.6 Similar Tools . 25 2.6.1 AEON . 25 2.6.2 Visual Studio . 26 2.7 Gathering Energy Measurements . 27 2.7.1 Module Specific Registers (MSR) . 27 2.7.1.1 Running Average Power Limits (RAPL) Interfaces . 27 2.7.2 Perf . 30 2.7.3 PAPI (Performance Application Programming Interface) . 30 1 2.7.4 HWMON . 30 2.7.5 Intel Powercap . 30 2.7.6 PowerAPI . 31 2.7.7 Summary . 31 2.8 Interacting with these interfaces from user space . 33 2.8.1 Sysfs . 33 2.8.2 NetLink . 33 2.8.3 Procfs . 33 3 Profiling a program 35 3.1 Initial Ideas . 35 3.2 The Profiler . 35 3.2.1 Design Ideas . 35 3.2.2 Chosen Design . 36 3.2.3 Why not use current profilers? . 38 3.2.4 Choice of energy interface . 38 3.2.4.1 Energy Consumption of CPU and Memory . 38 3.2.5 Thermal Information . 39 3.2.5.1 Battery Information . 39 3.2.5.2 DiskIO . 39 3.2.5.3 Network . 40 3.2.5.4 Choice of language . 41 3.2.6 Profiler Design . 41 3.2.6.1 Forker . 41 3.2.6.2 Profiler . 43 3.2.6.3 Sysfs, Procfs and Energy Interfaces . 43 3.2.6.4 Printer . 45 3.2.6.5 Measurement and Energy Structure . 45 3.2.6.6 Networking Script . 49 3.2.7 Implementation Details . 49 3.2.7.1 Steps taken to minimise the overhead introduced by the profiler 49 3.2.7.2 Avoiding the impact of the user environment . 51 3.3 Linux Java Energy Assessment (LJEA) plugin . 51 3.3.1 Choice of IDE . 52 3.3.2 EnergyPoints . 52 3.3.2.1 The profiling code . 52 3.3.2.2 StackTrace . 54 3.3.2.3 Energy Graphs . 54 3.3.3 Implementation Details . 54 3.3.3.1 The UI design . 54 3.3.3.2 Action Classes . 57 4 Project Evaluation 59 4.1 The hardware and methodology . 59 4.2 The Profiler . 62 4.2.1 The Results . 62 4.3 The Battery Measurements . 62 4.4 CPU Measurements . 66 2 4.4.1 Battery vs CPU measurements . 66 4.4.2 CPU Stress Test . 66 4.4.3 Desktop vs Laptop . 69 4.4.3.1 Gaming Desktop . 69 4.4.3.2 Modern Laptop . 72 4.4.4 Governor Choice . 74 4.4.5 BigBuckBunny Mplayer Test . 76 4.4.6 Choice of Algorithm . 79 4.4.7 Asynchronous vs Busywait . 81 4.4.8 Effects of Timers . 83 4.4.9 Reproducibility of the results gathered . 83 4.4.9.1 John the Ripper . 85 4.4.9.2 OpenSSL . 86 4.4.9.3 STREAM Benchmark . 86 4.4.9.4 Sunflow benchmark . 87 4.4.9.5 MPlayer . 87 4.4.9.6 Summary of Benchmark Findings . 89 4.4.10 Temperature Sensor Data . 89 4.4.11 IO Capturing Capability . 91 4.4.11.1 Ping Test . 91 4.4.12 DiskIO Capturing Technique . 94 4.4.13 Case Study: Browser Comparison . 96 4.4.14 LJEA . 100 4.4.14.1 Graphing Module . 100 4.4.14.2 Energy Trace . 100 5 Conclusion 103 6 Recommendations for Future Work 104 6.1 PowerKap . 104 6.1.1 Expanding the interfaces . 104 6.1.2 Sysfs/Procfs/Linux Interfaces . 104 6.1.3 Asynchronous computing . 104 6.1.4 Machine Learning and Model Generating . 105 6.1.5 Handling Thermal Spikes . 105 6.2 LJEA . 105 6.2.1 Introducing code suggestions . ..
Load more

Recommended publications
  • Advanced Programming for the Java(TM) 2 Platform
    Advanced Programming for the Java(TM) 2 Platform Training Index Advanced Programming for the JavaTM 2 Platform By Calvin Austin and Monica Pawlan November 1999 [CONTENTS] [NEXT>>] [DOWNLOAD] Requires login As an experienced developer on the JavaTM platform, you undoubtedly know how fast moving and comprehensive the Early Access platform is. Its many application programming interfaces (APIs) Downloads provide a wealth of functionality for all aspects of application and system-level programming. Real-world developers never use one Bug Database or two APIs to solve a problem, but bring together key Submit a Bug functionality spanning a number of APIs. Knowing which APIs you View Database need, which parts of which APIs you need, and how the APIs work together to create the best solution can be a daunting task. Newsletters Back Issues To help you navigate the Java APIs and fast-track your project Subscribe development time, this book includes the design, development, test, and deployment phases for an enterprise-worthy auction Learning Centers application. While the example application does not cover every Articles possible programming scenario, it explores many common Bookshelf situations and the discussions leave you with a solid methodology Code Samples for designing and building your own solutions. New to Java Question of the Week This book is for developers with more than a beginning level of Quizzes understanding of writing programs in the Java programming Tech Tips language. The example application is written with the Java® 2 Tutorials platform APIs and explained in terms of functional hows and whys, so if you need help installing the Java platform, setting up your Forums environment, or getting your first application to work, you should first read a more introductory book such as Essentials of the Java Programming Language: A Hands-On Guide or The Java Tutorial.
    [Show full text]
  • Enea® Linux 4.0 Release Information
    Enea® Linux 4.0 Release Information 4.0-docupdate1 Enea® Linux 4.0 Release Information Enea® Linux 4.0 Release Information Copyright Copyright © Enea Software AB 2014. This User Documentation consists of confidential information and is protected by Trade Secret Law. This notice of copyright does not indicate any actual or intended publication of this information. Except to the extent expressly stipulated in any software license agreement covering this User Documentation and/or corresponding software, no part of this User Documentation may be reproduced, transmitted, stored in a retrieval system, or translated, in any form or by any means, without the prior written permission of Enea Software AB. However, permission to print copies for personal use is hereby granted. Disclaimer The information in this User Documentation is subject to change without notice, and unless stipulated in any software license agreement covering this User Documentation and/or corresponding software, should not be construed as a commitment of Enea Software AB. Trademarks Enea®, Enea OSE®, and Polyhedra® are the registered trademarks of Enea AB and its subsidiaries. Enea OSE®ck, Enea OSE® Epsilon, Enea® Element, Enea® Optima, Enea® Linux, Enea® LINX, Enea® LWRT, Enea® Accelerator, Polyhedra® Flash DBMS, Polyhedra® Lite, Enea® dSPEED, Accelerating Network Convergence™, Device Software Optimized™, and Embedded for Leaders™ are unregistered trademarks of Enea AB or its subsidiaries. Any other company, product or service names mentioned in this document are the registered or unregistered trade- marks of their respective owner. Acknowledgements and Open Source License Conditions Information is found in the Release Information manual. © Enea Software AB 2014 4.0-docupdate1 ii Enea® Linux 4.0 Release Information Table of Contents 1 - About This Release .....................................................................................................
    [Show full text]
  • Linux Kernel and Driver Development Training Slides
    Linux Kernel and Driver Development Training Linux Kernel and Driver Development Training © Copyright 2004-2021, Bootlin. Creative Commons BY-SA 3.0 license. Latest update: October 9, 2021. Document updates and sources: https://bootlin.com/doc/training/linux-kernel Corrections, suggestions, contributions and translations are welcome! embedded Linux and kernel engineering Send them to [email protected] - Kernel, drivers and embedded Linux - Development, consulting, training and support - https://bootlin.com 1/470 Rights to copy © Copyright 2004-2021, Bootlin License: Creative Commons Attribution - Share Alike 3.0 https://creativecommons.org/licenses/by-sa/3.0/legalcode You are free: I to copy, distribute, display, and perform the work I to make derivative works I to make commercial use of the work Under the following conditions: I Attribution. You must give the original author credit. I Share Alike. If you alter, transform, or build upon this work, you may distribute the resulting work only under a license identical to this one. I For any reuse or distribution, you must make clear to others the license terms of this work. I Any of these conditions can be waived if you get permission from the copyright holder. Your fair use and other rights are in no way affected by the above. Document sources: https://github.com/bootlin/training-materials/ - Kernel, drivers and embedded Linux - Development, consulting, training and support - https://bootlin.com 2/470 Hyperlinks in the document There are many hyperlinks in the document I Regular hyperlinks: https://kernel.org/ I Kernel documentation links: dev-tools/kasan I Links to kernel source files and directories: drivers/input/ include/linux/fb.h I Links to the declarations, definitions and instances of kernel symbols (functions, types, data, structures): platform_get_irq() GFP_KERNEL struct file_operations - Kernel, drivers and embedded Linux - Development, consulting, training and support - https://bootlin.com 3/470 Company at a glance I Engineering company created in 2004, named ”Free Electrons” until Feb.
    [Show full text]
  • Fixing USB Autosuspend Serge Y
    Fixing USB Autosuspend Serge Y. Stroobandt Copyright 2015–2017, licensed under Creative Commons BY-NC-SA Problem The Linux kernel automatically suspends USB de- vices when there is driver support and the devices are not in use.1 This saves quite a bit of power. How- ever, some USB devices are not compatible with USB autosuspend and will misbehave at some point. Af- fected devices are most commonly USB mice and keyboards.2 Personally,I had only one Microsoft™ Wheel Mouse Optical affected, despitewning o other mod- els of the same brand. In essence, this is not really a USB hardware problem, but perhaps more a Lin- ux problem. The actual fault lies with a misinterpretation of the eXtensible Host Controller Interface (xHCI) specification. This issueviousl pre y did not exist with the older Enhanced Host Controller Interface (EHCI) specification. A «Sharp» explanation is available online.3 The Linux kernel patch for this problem will probably one day automatically trickle in downstream and onto my affectedubuntu X LTS 14.04 system. Nonetheless, with a crashing computer mouse at hand, things cannot wait. However, patching my current 3.13.0-35-generic x86_64 kernel is out of the question! We will rather grab this opportunity to learn a bit about writing rules for udev , the device manager for the Linux kernel. I am writing “for the Linux kernel”, because udev executes entirely in user space. Identify the device First, one needs to properly identify the affected USBvice de by its vendor and product ID. Run the following command and look for the device description.
    [Show full text]
  • Practical-Electronic
    EVERYDAY DECEMBER 1997 ELECTRON http://www.epemag.wimborne.co.uk £2.65 pa; cinE, GIANT PULL•OUT , • • «Mr am, - DettgeR:)t tam 4"- ACTIVE , •• MICROPHONE • A simple circuit to increase sensitivity P. rs .• • • - - MINI - •• - • L. tr. ORGAN 1:7 \ An unusual, inexpensive •P 7 " • e design t Ort 9. SA 11 '7 • SOUND rtr1 1 Alarm deterrent for P1R securit hts TEACH-IN 98 ........ Part 2: Capacitors and Inductors Index for Volume 26 THE Noil MAGAZINE FO. ELL TECHNOLOGY- r ra spedal ALTERNATIVE _.•ii 9 770262 361089 Feat and FUTURE TECHNOLOGIES ELECTRIC MAN PLANS, SHOCK PEOPLE WITH THE TOUCH OF YOUR HAND! E5/set Ref F/EMA1 PARABOLIC DISH MICROPHONE PLANS Listen to distant sounds and voices open windows sound sources in 'hard to ger or hostile premises Uses Satellite technology to gather distant sounds and focus them to our ultra sensitive electronics Plans also Sn0,11 xn optional wireless link system £8/set ref F/PM5 2 FOR 1 MULTIFUNCTIONAL HIGH FREQUENCY AND HIGH DC VOLTAGE, SOLID STATE TESLA COIL A AND VARIABLE 100,000 VDC OUTPUT GENERATOR PLANS Operates on 9-12v0c, many possible experiments £10 Ref WIND GENERATORS 380 WATT 1 14 metre rta cades aaroon riatri cades .a year warranty vdc output 24v version available control electronics included brushless neodymium cubic curve alternator only two moving pans maintenance free simple roof top installation start up speed 7mph max output (30mph) 380w £499 ref AIR1 PLANS PORTABLE X RAY MACHINE PLANS Easy to construct e e- plans on a simple and cheap way to build a home X-ray rnachinei Effective device X-ray sealed assemblies can beused for experimental purposes Not a toy or for minors' £6,/set Ref F/XP I TELEKINETIC ENHÀNCER PLANS Mystrfy and amaze your COLOUR CCTV friends by creating motion with no known apparent means or cause Uses no electnca Ior mechanical connections no special gimmicks yet produces positive motion and effect Excellent for science projects.
    [Show full text]
  • SUSE Linux Enterprise Server 12 SP4 System Analysis and Tuning Guide System Analysis and Tuning Guide SUSE Linux Enterprise Server 12 SP4
    SUSE Linux Enterprise Server 12 SP4 System Analysis and Tuning Guide System Analysis and Tuning Guide SUSE Linux Enterprise Server 12 SP4 An administrator's guide for problem detection, resolution and optimization. Find how to inspect and optimize your system by means of monitoring tools and how to eciently manage resources. Also contains an overview of common problems and solutions and of additional help and documentation resources. Publication Date: September 24, 2021 SUSE LLC 1800 South Novell Place Provo, UT 84606 USA https://documentation.suse.com Copyright © 2006– 2021 SUSE LLC and contributors. All rights reserved. Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or (at your option) version 1.3; with the Invariant Section being this copyright notice and license. A copy of the license version 1.2 is included in the section entitled “GNU Free Documentation License”. For SUSE trademarks, see https://www.suse.com/company/legal/ . All other third-party trademarks are the property of their respective owners. Trademark symbols (®, ™ etc.) denote trademarks of SUSE and its aliates. Asterisks (*) denote third-party trademarks. All information found in this book has been compiled with utmost attention to detail. However, this does not guarantee complete accuracy. Neither SUSE LLC, its aliates, the authors nor the translators shall be held liable for possible errors or the consequences thereof. Contents About This Guide xii 1 Available Documentation xiii
    [Show full text]
  • Installing Python, Pygame, and Visual Studio Code
    Set up Python and Visual Studio Code: Macs Installing Python, Pygame, and Visual Studio Code To provide more flexibility, capability, and better tools for editing and debugging your code we are going to set up our computers with software for developing Python applications, Python games, and Web sites. Python 3 Installation (includes IDLE and Pip) • This will install the following software: o Python 3 Programming language and Interpreter o IDLE: an integrated development environment for Python o Pip: Python package installer • We want to use Python 3. Although Python is already installed on most Macs, it may be Python 2, or maybe an older version of Python 3. We need to leave Python 2 alone as your Mac may need it for some apps. We will install the latest version of Python 3. • Check your version of MacOS (Apple icon: About this Mac); the latest Python 3 requires version 10.9 or higher • Check your versions of Python: o Open terminal from the dock or command-space and type “Terminal” o In terminal type ‘python —version’ to see the version of Python 2 o In terminal type ‘python3 —version’ to see the version of Python3 • Go to https://www.python.org/downloads/ • The site detects whether you are on Windows or Mac and presents a download button for the latest version for your operating system. Click the “Download Python 3.8.1” button (or whatever is current version…) • Install by clicking Downloads from the dock or Finder, then click python-3-8-1- macosx-10.9.pkg to bring up the installer © Fox1 Valley Girls Coding Club Setup Python and Visual Studio Code: Windows • Follow the steps in the installer.
    [Show full text]
  • Cmake / Ctest / Cpack
    Building, Testing, and Deploying Software in a Cross-Platform Development Environment Julien Jomier [email protected] About Kitware • Software Development Company • Founded in 1998 • 110+ employees and growing • Focus in – Scientific computing – Large data visualization – Medical image processing – Informatics – Computer vision – Scientific data publishing – Quality software processes • Primarily work in Open Source About Kitware • Provide training and support • Do custom development • Sell technical books • Host and maintain projects including: VTK The Visualization Toolkit CMake A platform agnostic build system ITK Insight Segmentation and Registration Toolkit ParaView A parallel visualization application • Primary (but not sole) developers of each project Kitware: Core Technologies Overview • What is CMake? • Building with CMake • Testing with CTest/CDash • Packaging with CPack What is CMake? • CMake is the cross-platform, open-source build system that lets you use the native development tools you love the most. • It’s a build system generator • It takes plain text files as input that describe your project and produces project files or make files for use with a wide variety of native development tools. • Family of Software Development Tools – Build – CMake – Test – CTest/CDash – Package – CPack CMake: History • Built for the Insight Segmentation and Registration Toolkit (ITK) http://www.itk.org • Funded by National Library of Medicine (NLM): part of the Visible Human Project • Release-1-0 branch created in late 2001 • Other
    [Show full text]
  • Special Characters Numbers
    Index ■Special Characters AddServiceEndpoint( ) member, ServiceHost type, #define, preprocessor directive, 317–319 1032 #elif, preprocessor directive, 317–318 ADO.NET #else, preprocessor directive, 317–318 additional namespaces, 763–764 #endif, preprocessor directive, 317–318 vs. ADO classic, 759–760 #endregion, preprocessor directive, 317 application configuration files, 769–770 #if, preprocessor directive, 317–318 asynchronous data access, 792–793 #region, preprocessor directive, 317 autogenerated data components, 824–825 #undef, preprocessor directive, 317–319 autogenerating SQL commands, 816–817 % modulo operator, C#, 1097 autoincrementing, 797 & operator, pointer types, 312–313 binding DataTables to user interfaces, 804, 806 * operator, pointer types, 312–313 Command object, 781–782 ?? operator, 133 connected layer, 778 += operator, 610 connected vs. disconnected layer, 760 <%@Page%> directive attribute, ASP.NET, 846 connecting to database, Visual Studio 2005, 776 <%Import%> directive, ASP.NET, 846–847 connection objects, 779–780 => token, 1098 ConnectionStringBuilder object, 780–781 ? suffix, nullable types, 131 connectionStrings element, application configuration, 774–775 ■Numbers data access libraries, 1130 data adapter objects, 811–812 3D graphics graphical service, WPF, 1012 data providers, 760, 762 3D rendered animation, 970 data wizards, 822–825 100% code approach, 1048 DataColumn objects, 796, 798 ■ DataRelation objects, 817–820 A DataRow objects, 798–799, 801 A# programming language, 8 DataRow.RowState property, 799–800 Abort(
    [Show full text]
  • Controlling Processor C-State Usage in Linux
    Controlling Processor C-State Usage in Linux A Dell technical white paper describing the use of C-states with Linux operating systems Stuart Hayes | Enterprise Linux Engineering Controlling Processor C-State Usage in Linux THIS DOCUMENT IS FOR INFORMATIONAL PURPOSES ONLY, AND MAY CONTAIN TYPOGRAPHICAL ERRORS AND TECHNICAL INACCURACIES. THE CONTENT IS PROVIDED AS IS, WITHOUT EXPRESS OR IMPLIED WARRANTIES OF ANY KIND. © 2013 Dell Inc. All rights reserved. Reproduction of this material in any manner whatsoever without the express written permission of Dell Inc. is strictly forbidden. For more information, contact Dell. Dell, the DELL logo, and the DELL badge are trademarks of Dell Inc. Intel and Xeon are registered trademarks of Intel Corporation in the U.S. and other countries. Other trademarks and trade names may be used in this document to refer to either the entities claiming the marks and names or their products. Dell Inc. disclaims any proprietary interest in trademarks and trade names other than its own. November 2013 | Revision 1.1 Page ii Controlling Processor C-State Usage in Linux Contents Introduction ................................................................................................................ 4 Background ................................................................................................................. 4 Checking C-State Usage .................................................................................................. 4 Disabling C-States for Low Latency ...................................................................................
    [Show full text]
  • Comparative Studies of Six Programming Languages
    Comparative Studies of Six Programming Languages Zakaria Alomari Oualid El Halimi Kaushik Sivaprasad Chitrang Pandit Concordia University Concordia University Concordia University Concordia University Montreal, Canada Montreal, Canada Montreal, Canada Montreal, Canada [email protected] [email protected] [email protected] [email protected] Abstract Comparison of programming languages is a common topic of discussion among software engineers. Multiple programming languages are designed, specified, and implemented every year in order to keep up with the changing programming paradigms, hardware evolution, etc. In this paper we present a comparative study between six programming languages: C++, PHP, C#, Java, Python, VB ; These languages are compared under the characteristics of reusability, reliability, portability, availability of compilers and tools, readability, efficiency, familiarity and expressiveness. 1. Introduction: Programming languages are fascinating and interesting field of study. Computer scientists tend to create new programming language. Thousand different languages have been created in the last few years. Some languages enjoy wide popularity and others introduce new features. Each language has its advantages and drawbacks. The present work provides a comparison of various properties, paradigms, and features used by a couple of popular programming languages: C++, PHP, C#, Java, Python, VB. With these variety of languages and their widespread use, software designer and programmers should to be aware
    [Show full text]
  • Oracle Solaris Operating System: Optimized for Sun X86 Systems in the Enterprise
    An Oracle White Paper August 2011 Oracle Solaris Operating System: Optimized for Sun x86 Systems in the Enterprise Oracle Solaris Operating System: Optimized for Sun x86 Systems in the Enterprise Executive Overview ........................................................................... 1 Introduction ....................................................................................... 2 The Oracle Solaris Ecosystem ....................................................... 3 Intel Xeon Processor E7 Family ..................................................... 3 Oracle Integration .......................................................................... 4 Intelligent Performance ...................................................................... 5 Memory Placement Optimization (MPO) ........................................ 5 Intel Turbo Boost ........................................................................... 8 Automated Energy Efficiency ............................................................. 8 Oracle Solaris Power Aware Dispatcher ........................................ 9 PowerTOP ................................................................................... 10 Power Budgets and Power Capping ............................................ 11 Always Running APIC Timer ....................................................... 12 Reliability ......................................................................................... 12 Oracle Solaris FMA for Intel Xeon Processors ............................. 13 Security
    [Show full text]