Cross Layer Reliability Estimation for Digital Systems

Total Page:16

File Type:pdf, Size:1020Kb

Cross Layer Reliability Estimation for Digital Systems Politecnico di Torino Porto Institutional Repository [Doctoral thesis] Cross layer reliability estimation for digital systems Original Citation: Vallero, Alessandro (2017). Cross layer reliability estimation for digital systems. PhD thesis Availability: This version is available at : http://porto.polito.it/2673865/ since: June 2017 Published version: DOI:10.6092/polito/porto/2673865 Terms of use: This article is made available under terms and conditions applicable to Open Access Policy Article ("Public - All rights reserved") , as described at http://porto.polito.it/terms_and_conditions. html Porto, the institutional repository of the Politecnico di Torino, is provided by the University Library and the IT-Services. The aim is to enable open access to all the world. Please share with us how this access benefits you. Your story matters. (Article begins on next page) Doctoral Dissertation Doctoral Program in Computer Engineering (29thcycle) Cross layer reliability estimation for digital systems By Alessandro Vallero ****** Supervisor(s): Prof. Stefano Di Carlo, Supervisor Doctoral Examination Committee: Prof. Regis Leveugle , Referee, TIMA Grenoble Prof. Marco Ottavi, Referee, University of “Rome Tor Vergata” Prof. Ramon Canal, UPC Barcelona Prof. Lorena Angel, TIMA Grenoble Prof. Dimitris Gizopoulos, University of Athens Politecnico di Torino 2017 Declaration I hereby declare that, the contents and organization of this dissertation constitute my own original work and does not compromise in any way the rights of third parties, including those relating to the security of personal data. Alessandro Vallero 2017 * This dissertation is presented in partial fulfillment of the requirements for Ph.D. degree in the Graduate School of Politecnico di Torino (ScuDo). I would like to dedicate this thesis to my grandparents who always open my mind toward new horizons Acknowledgements I would like to acknowledge Prof. Stefano Di Carlo, at first. He made my Ph.D. a pleasant journey during which I had the chance to learn so many things from him, from both a professional and a human point of view. Secondly, I would like to thank my mother, Linda, and my sister, Greta. They supported me emotionally, even in very stressful moments. I acknowledge Computer Architecture Lab of University of Athens. It was a pleasure to work together. During my visiting you made me feel like at home. Thank you Prof. Dimitris Gizopoulos, Sotiris Tselonis, Manolis Kaliorakis, Athanasios Chatzdimitriou, Giorgos Papadimitriou. In addition, I would like to thank all the CLERECO partners with which I collaborated for my Ph.D. activities. I would also like to acknowledge my housemates, Ivan and Daniele, who suffered me for more than two long years! Finally, I thank all the guys of my lab at Politecnico di Torino (Lab 6) who always laughed at my jokes and contributed to create a pleasant atmosphere. Abstract Forthcoming manufacturing technologies hold the promise to increase multifuctional computing systems performance and functionality thanks to a remarkable growth of the device integration density. Despite the benefits introduced by this technology improvements, reliability is becoming a key challenge for the semiconductor industry. With transistor size reaching the atomic dimensions, vulnerability to unavoidable fluctuations in the manufacturing process and environmental stress rise dramatically. Failing to meet a reliability requirement may add excessive re-design cost to recover and may have severe consequences on the success of a product. One of the open challenges for future technologies is building “dependable” systems on top of unreliable components, which will degrade and even fail during normal lifetime of the chip. Conventional design techniques are highly inefficient. They expend significant amount of energy to tolerate the device unpredictability by adding safety margins to a circuit’s operating voltage, clock frequency or charge stored per bit. Unfortunately, the additional cost introduced to compensate unre- liability are rapidly becoming unacceptable in today’s environment where power consumption is often the limiting factor for integrated circuit performance, and energy efficiency is a top concern. Attention should be payed to tailor techniques to improve the reliability of a system on the basis of its requirements, ending up with cost-effective solutions favoring the success of the product on the market. Cross-layer reliability is one of the most promising approaches to achieve this goal. Cross-layer reliability techniques take into account the interactions between the layers composing a complex system (i.e., technology, hardware and software layers) to implement efficient cross-layer fault mitigation mechanisms. Fault tolerance mechanism are carefully implemented at different layers starting from the technology up to the software layer to carefully vi optimize the system by exploiting the inner capability of each layer to mask lower level faults. For this purpose, cross-layer reliability design techniques need to be comple- mented with cross-layer reliability evaluation tools, able to precisely assess the reliability level of a selected design early in the design cycle. Accurate and early reliability estimates would enable the exploration of the system design space and the optimization of multiple constraints such as performance, power consumption, cost and reliability. This Ph.D. thesis is devoted to the development of new methodologies and tools to evaluate and optimize the reliability of complex digital systems during the early design stages. More specifically, techniques addressing hardware accelerators (i.e., FPGAs and GPUs), microprocessors and full systems are discussed. All developed methodologies are presented in conjunction with their application to real-world use cases belonging to different computational domains. Contents List of Figures xi List of Tables xvii Nomenclature xviii 1 Introduction4 1.1 Motivation . .4 1.2 Goals . .7 1.3 Structure of the thesis . .9 2 Dependability of digital systems 12 2.1 Dependability . 12 2.2 Reliability metrics of digital systems . 14 2.2.1 Failure Rate . 15 2.2.2 Failures In Time . 15 2.2.3 Mean Time To Failure . 15 2.2.4 Mean Time To Repair . 16 2.2.5 Mean Time Between Failures . 16 2.2.6 Availability . 16 2.2.7 Mean Workload To Failure . 17 viii Contents 2.2.8 Mean Instruction To Failure . 17 2.3 Dependability threats . 17 2.3.1 Faults . 17 2.3.2 Errors . 20 2.3.3 Failures . 21 2.4 Soft errors . 23 2.5 Dependability enhancement techniques . 26 2.5.1 The traditional approach . 28 2.5.2 Cross-layer reliability enhancement . 31 3 Fault tolerance in autonomous FPGA-based systems 33 3.1 Introduction . 33 3.2 State-of-the-art . 35 3.3 The proposed methodology . 37 3.3.1 The proposed system architecture . 37 3.3.2 The proposed partitioning methodology . 39 3.3.3 The proposed partitioning algorithm . 41 3.4 Experimental results . 44 3.5 Conclusion . 48 4 GPGPU Reliability evaluation 49 4.1 Introduction . 50 4.2 Related works . 52 4.3 The Southern Islands AMD architecture . 53 4.4 SIFI architecture and functionalities . 54 4.4.1 Fault injection engine . 56 4.4.2 ACE analysis engine . 57 Contents ix 4.5 Experimental results . 59 4.5.1 SIFI results . 59 4.5.2 A multi-faceted comparison of reliability between AMD and NVIDIA GPU architectures . 65 4.6 Conclusions . 77 5 A Bayesian model for reliability evaluation of CPU-based systems 80 5.1 Introduction . 81 5.2 Reliability analysis . 83 5.3 Experimental results . 89 5.3.1 Framework implementation . 89 5.3.2 Experiment setup . 90 5.3.3 Results . 92 5.4 Conclusion . 93 6 Reliability estimation of complex digital systems 95 6.1 Introduction . 96 6.2 Related works . 98 6.2.1 Architectural level reliability analysis . 98 6.2.2 Accounting for software effects in reliability analysis . 98 6.2.3 Bayesian models for reliability estimation . 99 6.3 The proposed system level reliability framework . 100 6.3.1 Qualitative model of the system . 101 6.3.2 Quantitative model of the system . 104 6.3.3 Reasoning on the model of the system . 108 6.4 Integrated tools framework . 109 6.4.1 Technology Domain . 109 6.4.2 Hardware Domain . 111 x Contents 6.4.3 Software Domain . 112 6.4.4 System Domain . 112 6.5 Results . 113 6.5.1 The experimental setup . 113 6.5.2 The validation framework . 115 6.5.3 Experimental Results . 119 6.6 Conclusions . 135 7 Reliability optimization of complex digital systems 137 7.1 Introduction . 138 7.2 System level modeling . 139 7.3 System optimization methodology . 142 7.3.1 Extremal optimization theory . 142 7.3.2 Definitions and notation . 143 7.3.3 Optimization algorithm . 144 7.4 Experimental Results . 149 7.4.1 Experimental setup . 149 7.4.2 Results and discussion . 151 7.4.3 From benchmarks to real applications . 155 7.5 Conclusion . 156 8 Conclusions 159 References 160 Appendix A The SER of future devices 175 List of Figures 2.1 All the aspects of dependability. 13 2.2 The chain of dependability threats. 18 2.3 Classification of faults. 19 2.4 Classification of errors caused by faulty bits. 22 2.5 Failure modes of computing systems. 22 2.6 The dependability enhancing mechanisms. 27 2.7 The conventional approach to enhance reliability usually targets one or two layers of the system. 28 2.8 Cross-layer information sharing and cooperation. 31 3.1 The proposed system architecture (Source: [1]). 38 3.2 Circuit basic components and tiles organization (Source: [1]). 39 3.3 The recovery strategies when a permanent faults occur. Fig 3.3a illustrates the relocation of the faulty logic tile into a recovery tile and the reconfiguration of the interconnection tile. Fig 3.3d shows how interconnections are reconfigured when a permanent fault is detected inside the active interconnection tile (Source: [1]). 42 3.4 FEMIP basic components (Source: [1]).
Recommended publications
  • Heterogeneous Computing for Advanced Driver Assistance Systems
    TECHNISCHE UNIVERSITAT¨ MUNCHEN¨ Lehrstuhl fur¨ Robotik, Kunstliche¨ Intelligenz und Echtzeitsysteme Heterogeneous Computing for Advanced Driver Assistance Systems Xiebing Wang Vollstandiger¨ Abdruck der von der Fakultat¨ der Informatik der Technischen Universitat¨ Munchen¨ zur Erlangung des akademischen Grades eines Doktors der Naturwissenschaen (Dr. rer. nat.) genehmigten Dissertation. Vorsitzender: Prof. Dr. Daniel Cremers Prufer¨ der Dissertation: 1. Prof. Dr.-Ing. habil. Alois Knoll 2. Assistant Prof. Xuehai Qian, Ph.D. 3. Prof. Dr. Kai Huang Die Dissertation wurde am 25.04.2019 bei der Technischen Universitat¨ Munchen¨ eingereicht und durch die Fakultat¨ fur¨ Informatik am 17.09.2019 angenommen. Abstract Advanced Driver Assistance Systems (ADAS) is an indispensable functionality in state-of- the-art intelligent cars and the deployment of ADAS in automated driving vehicles would become a standard in the near future. Current research and development of ADAS still faces several problems. First of all, the huge amount of perception data captured by mas- sive vehicular sensors have posed severe computation challenge for the implementation of real-time ADAS applications. Secondly, conventional automotive Electronic Control Units (ECUs) have to cope with the knoy issues such as technology discontinuation and the consequent tedious hardware/soware (HW/SW) maintenance. Lastly, ADAS should be seamlessly shied towards a mixed and scalable system in which safety, security, and real-time critical components must coexist with the less critical counterparts, while next- generation computation resources can still be added exibly so as to provide sucient computing capacity. is thesis gives a systematic study of applying the emerging heterogeneous comput- ing techniques to the design of an automated driving module and the implementation of real-time ADAS applications.
    [Show full text]
  • AMD APP SDK V2.8.1
    AMD APP SDK v2.8.1 FAQ 1 General Questions 1. Do I need to use additional software with the SDK? To run an OpenCL™ application, you must have an OpenCL™ runtime on your system. If your system includes a recent AMD discrete GPU, or an APU, you also should install the latest Catalyst™ drivers, which can be downloaded from AMD.com. Information on supported devices can be found at developer.amd.com/appsdk. If your system does not include a recent AMD discrete GPU, or APU, the SDK installs a CPU-only OpenCL™ run-time. Also, we recommend using the debugging profiling and analysis tools contained in the AMD CodeXL heterogeneous compute tools suite. 2. Which versions of the OpenCL™ standard does this SDK support? AMD APP SDK 2.8.1 supports the development of applications using the OpenCL™ Specification v 1.2. 3. Will applications developed to execute on OpenCL™ 1.1 still operate in an OpenCL™ 1.2 environment? OpenCL™ is designed to be backwards compatible. The OpenCL™ 1.2 run-time delivered with the AMD Catalyst drivers run any OpenCL™ 1.1-compliant application. However, an OpenCL™ 1.2-compliant application will not execute on an OpenCL™ 1.1 run-time if APIs only supported by OpenCL™ 1.2 are used. 4. Does AMD provide any additional OpenCL™ samples, other than those contained within the SDK? The most recent versions of all of the samples contained within the SDK are also available for individual download from the developer.amd.com/appsdk “Samples & Demos” page. This page also contains additional samples that either were too large to include in the SDK, or which have been developed since the most recent SDK release.
    [Show full text]
  • AMD APP SDK V2.9.1 Getting Started
    AMD APP SDK v2.9.1 Getting Started 1 Overview The AMD APP SDK is provided to the developer community to accelerate the programming in a heterogeneous environment by enabling AMD GPUs to work in concert with the system's x86 CPU cores. The SDK provides samples, documentation, and other materials to quickly get you started leveraging accelerated compute using OpenCL™, Bolt, OpenCV, C++ AMP for your C/C++ application, or Aparapi for your Java application. This document provides instructions on using the AMD APP SDK. The necessary prerequisite installations, environment settings, build and execute instructions for the samples are provided. Review the following quick links to the important sections: Section 2, “APP SDK on Windows” Section 2.1, “Installation” Section 2.2, “General Prerequisites” Section 2.3, “OpenCL” Section 2.4, “BOLT” Section 2.5, “C++ AMP” Section 2.6, “Aparapi” Section 2.7, “OpenCV” Section 3, “APP SDK on Linux” Section 3.1, “Installation” Section 3.2, “General prerequisites” Section 3.3, “OpenCL” Section 3.4, “BOLT” Section 3.5, “Aparapi” Section 3.6, “OpenCV” Section Appendix A, “Important Notes” Section Appendix C, “CMAKE” Section Appendix D, “Building OpenCV from sources” Getting Started 1 of 19 2 APP SDK on Windows 2.1 Installation The AMD APP SDK 2.9.1 installer is delivered as a self-extracting installer for 32-bit and 64-bit systems on Windows. For details on how to install the APP SDK on Windows, see the AMD APP SDK Installation Notes document. The default installation path is C:\Users\<userName>\AMD APP SDK\<appSdkVersion>\.
    [Show full text]
  • AMD APP SDK V3.0 Beta
    AMD APP SDK v3.0 Beta FAQ 1 General Questions 1. Do I need to use additional software with the SDK? For information about the additional software to be used with the AMD APP SDK, see the AMD APP SDK Getting Started Guide. Also, we recommend using the debugging profiling and analysis tools contained in the AMD CodeXL heterogeneous compute tools suite. 2. Which versions of the OpenCL™ standard does this SDK support? AMD APP SDK version 3.0 Beta supports the development of applications using the OpenCL™ Specification version 2.0. 3. Will applications developed to execute on OpenCL™ 1.2 still operate in an OpenCL™ 2.0 environment? OpenCL™ is designed to be backwards compatible. The OpenCL™ 2.0 run-time delivered with the AMD Catalyst drivers run any OpenCL™ 1.2-compliant application. However, an OpenCL™ 2.0-compliant application will not execute on an OpenCL™ 1.2 run-time if APIs only supported by OpenCL™ 2.0 are used. 4. Does AMD provide any additional OpenCL™ samples, other than those contained within the SDK? The most recent versions of all of the samples contained within the SDK are also available for individual download from the developer.amd.com/appsdk “Samples & Demos” page. This page also contains additional samples that either were too large to include in the SDK, or which have been developed since the most recent SDK release. Check the AMD APP SDK web page for new, updated, or large samples. 5. How often can I expect to get AMD APP SDK updates? Developers can expect that the AMD APP SDK may be updated two to three times a year.
    [Show full text]
  • AMD APP SDK Developer Release Notes
    AMD APP SDK v3.0 Beta Developer Release Notes 1 What’s New in AMD APP SDK v3.0 Beta 1.1 New features in AMD APP SDK v3.0 Beta AMD APP SDK v3.0 Beta includes the following new features: OpenCL 2.0: There are 20 samples that demonstrate various features of OpenCL 2.0 such as Shared Virtual Memory, Platform Atomics, Device-side Enqueue, Pipes, New workgroup built-in functions, Program Scope Variables, Generic Address Space, and OpenCL 2.0 image features. For the complete list of the samples, see the AMD APP SDK Samples Release Notes (AMD_APP_SDK_Release_Notes_Samples.pdf) document. Support for Bolt 1.3 library. 6 additional samples that demonstrate various APIs in the Bolt C++ AMP library. One new sample that demonstrates the consumption of SPIR 1.2 binary. Enhancements and bug fixes in several samples. A lightweight installer that supports the following features: Customized online installation Ability to download the full installer for install and distribution 1.2 New features for AMD CodeXL version 1.6 The following new features in AMD CodeXL version 1.6 provide the following improvements to the developer experience: GPU Profiler support for OpenCL 2.0 API-level debugging for OpenCL 2.0 Power Profiling For information about CodeXL and about how to use CodeXL to gather performance data about your OpenCL application, such as application traces and timeline views, see the CodeXL home page. Developer Release Notes 1 of 4 2 Important Notes OpenCL 2.0 runtime support is limited to 64-bit applications running on 64-bit Windows and Linux operating systems only.
    [Show full text]
  • Press Release
    Wednesday, December 5, 2012 12:54:49 PM Eastern Standard Time Subject: AMD Paves Ease-of-Programming Path to Heterogeneous System Architecture with New APP SDK 2.8 and Unified Developer Tool Suite Date: Tuesday, December 4, 2012 8:04:53 AM Eastern Standard Time From: AMD Communications To: All AMD The following news releases cleared Market Wire at 8:00 a.m. (ET), Tuesday, December 4, 2012. Due to incompatible email and PC platforms, some symbols may not translate and spacing may be off. PRESS RELEASE Contact: Travis Williams AMD Public Relations (512) 602-4863 [email protected] AMD Paves Ease-of-Programming Path to Heterogeneous System Architecture with New APP SDK 2.8 and Unified Developer Tool Suite – New Array of Developer Tool Kits, Suites and Libraries Makes Heterogeneous Compute Programming More Accessible on AMD Platforms – SUNNYVALE, Calif. — Dec. 4, 2012 — AMD (NYSE: AMD) today announced availability of the AMD APP SDK 2.8 and the AMD CodeXL unified tool suite to provide developers the tools and resources needed to accelerate applications with AMD accelerated processing units (APUs) and graphics processing units (GPUs). The APP SDK 2.8 and CodeXL tool suite provides access to code samples, white papers, libraries and tools to leverage the processing power of heterogeneous compute with OpenCL™, C++, DirectCompute and more. “With CodeXL and APP SDK 2.8, our highest performing SDK to date which leaps past the competition in performance on standard benchmarks1, AMD continues to empower developers with the resources they need for greater performance and power-efficient applications,” said Manju Hegde, corporate vice president, Heterogeneous Applications and Developer Solutions, AMD.
    [Show full text]
  • AMD APP SDK 3.0 Samples Release Notes Document
    AMD APP SDK 3.0 Samples Release Notes 1 What’s New Installer The AMD APP SDK can be installed on Linux with root as well as non-root permissions. New Samples HeatPDE: This sample demonstrates simulating heat field using shared virtual memory feature of OpenCL. The host and the device interactively access the same virtual memory and use platform atomics for ensuring memory consistency. The sample also graphically shows the simulation of heat field using OpenGL APIs. AdvancedConvolution: This sample demonstrates the optimal implementation of separable and non-separable filters. The sample implements 3X3 and 5X5 Sobel, Box, and Gaussian Filters. Updated Samples SVMAtomicsBinaryTreeInsert: The sample has been enhanced to show visualization of the nodes inserted. It shows nodes in different colors depending on whether it contains child nodes inserted by host only (blue), device only (Red), both host and device (Green) or a leaf node (Gray). SimpleConvolution: The sample has been extended to include separable filter in addition to the existing non-separable filter. NBody: The sample now prints performance metric in GFLOPS. Restructured OpenCL Samples Directory OpenCL samples have now been restructured such that directory in which they are located is based on the OpenCL version features that they use. The samples that use 2.0 features are located in the \\samples\opencl\cl\2.0 directory. The samples that use 1.x features are located in the \\samples\opencl\cl\1.x directory and the \\samples\opencl\cpp_cl\1.x directory. APARAPI Samples Excluded The Aparapi samples are not included in the latest APP SDK. For reference on usage of Aparapi, developers can see earlier versions of the AMD APP SDK (now AMD APP SDK) or visit https://code.google.com/p/aparapi/.
    [Show full text]
  • Regression Modelling of Power Consumption for Heterogeneous Processors
    Regression Modelling of Power Consumption for Heterogeneous Processors by Tahir Diop A thesis submitted in conformity with the requirements for the degree of Master of Applied Science Graduate Department of Departement of Electrical and Computer Engineering University of Toronto c Copyright 2013 by Tahir Diop Abstract Regression Modelling of Power Consumption for Heterogeneous Processors Tahir Diop Master of Applied Science Graduate Department of Departement of Electrical and Computer Engineering University of Toronto 2013 This thesis is composed of two parts, that relate to both parallel and heterogeneous processing. The first describes DistCL, a distributed OpenCL framework that allows a cluster of GPUs to be programmed like a single device. It uses programmer-supplied meta-functions that associate work-items to memory. DistCL achieves speedups of up to 29× using 32 peers. By comparing DistCL to SnuCL, we determine that the compute-to-transfer ratio of a benchmark is the best predictor of its performance scaling when distributed. The second is a statistical power model for the AMD Fusion heterogeneous processor. We present a systematic methodology to create a representative set of compute micro-benchmarks using data collected from real hardware. The power model is created with data from both micro-benchmarks and application benchmarks. The model showed an average predictive error of 6.9% on heterogeneous workloads. The Multi2Sim heterogeneous simulator was modified to support configurable power modelling. ii Dedication To my wife and best
    [Show full text]
  • Matrox Imaging Library (MIL) 9.0
    ------------------------------------------------------------------------------- Matrox Imaging Library (MIL) 9.0. MIL 9.0 Update 35 (GPU Processing) Release Notes (July 2011) (c) Copyright Matrox Electronic Systems Ltd., 1992-2011 ------------------------------------------------------------------------------- Main table of contents Section 1 : Differences between MIL 9.0 Update 35 and MIL 9.0 Update 30 Section 2 : Differences between MIL 9.0 Update 30 and MIL 9.0 Update 14 Section 3 : Differences between MIL 9.0 Update 14 and MIL 9.0 Update 3 Section 4 : Differences between MIL 9.0 Update 3 and MIL 9.0 Section 5 : MIL 9.0 GPU (Graphics Processing Unit) accelerations ------------------------------------------------------------------------------- ------------------------------------------------------------------------------- ------------------------------------------------------------------------------- Section 1: Differences between MIL 9.0 Update 35 and MIL 9.0 Update 30 Table of Contents for Section 1 1. Overview 2. GPU acceleration restrictions 3. New GPU functionalities and improvements 3.1. GPU accelerated image processing operations 3.1.1. MimHistogram 4. GPU specific examples 4.1. MilInteropWithCUDA (Updated) 4.2. MilInteropWithDX (Updated) 4.3. MilInteropWithOpenCL (New) 5. Is my application running on the GPU? 5.1. Deactivate MIL Host processing compensation 5.2. Windows SysInternals Process Explorer v15.0 (c) tool 6. Do MIL GPU results and precision change between updates? 6.1. MIL GPU algortihms 6.2. Graphics card firmware 7. Fixed bugs 7.1. All modules (DX9, DX10, DX11) 8. GPU boards 8.1. List of tested GPUs 8.2. GPU board limitations ------------------------------------------------------------------------------- 1. Overview - New DirectX 11 and DirectCompute support (shader models 5.0) - Minimal requirement: Microsoft Windows Vista with SP2 (or later), Windows 7 Note: Make sure that Windows Update 971512 (Windows Graphics, Imaging, and XPS Library) is installed to use DirectX 11 and Direct Compute in Windows Vista with SP2.
    [Show full text]
  • Design and Evaluation of Register Allocation on Gpus
    Design and Evaluation of Register Allocation on GPUs A Thesis Presented by Charu Kalra to The Department of Electrical and Computer Engineering in partial fulfillment of the requirements for the degree of Master of Science in Electrical and Computer Engineering Northeastern University Boston, Massachusetts November 2015 ⃝c Copyright 2015 by Charu Kalra All Rights Reserved i Abstract The rapid adoption of Graphics Processing Unit (GPU) computing has led to the develop- ment of workloads which can leverage the massive parallelism offered by GPUs. The use of GPUs is no longer limited to graphics, but has been extended to support compute-intensive applications from various scientific and commercial domains. Significant effort and expertise are required to optimize applications targeted for a specific GPU architecture. One of the keys to improving the performance of the applications is to utilize the available hardware resources efficiently. The archi- tectural complexity of the GPU makes it challenging to optimize performance at both the source level and the compiler level. In this thesis, we develop a transformation pass (i.e., a register allocator) that optimizes both vector and scalar register usage on GPUs. We introduce an open-source compiler framework, Multi2C, which converts OpenCL kernel into AMD Southern Islands binaries. The register alloca- tor is integrated as a part of the Multi2C optimization framework. Register allocation for each class of registers is run as a separate pass in the compiler. We also highlight the challenges faced when performing register allocation targeting a GPU, including issues with thread divergence and proper handling of contiguous register series. We evaluate the performance of our allocator for applications taken from the AMD APP SDK.
    [Show full text]
  • Parallel for Loops on Heterogeneous Resources
    University of Tennessee, Knoxville TRACE: Tennessee Research and Creative Exchange Doctoral Dissertations Graduate School 12-2012 Parallel For Loops on Heterogeneous Resources Frederick Edward Weber University of Tennessee - Knoxville, [email protected] Follow this and additional works at: https://trace.tennessee.edu/utk_graddiss Part of the Computer and Systems Architecture Commons, Numerical Analysis and Scientific Computing Commons, and the Programming Languages and Compilers Commons Recommended Citation Weber, Frederick Edward, "Parallel For Loops on Heterogeneous Resources. " PhD diss., University of Tennessee, 2012. https://trace.tennessee.edu/utk_graddiss/1570 This Dissertation is brought to you for free and open access by the Graduate School at TRACE: Tennessee Research and Creative Exchange. It has been accepted for inclusion in Doctoral Dissertations by an authorized administrator of TRACE: Tennessee Research and Creative Exchange. For more information, please contact [email protected]. To the Graduate Council: I am submitting herewith a dissertation written by Frederick Edward Weber entitled "Parallel For Loops on Heterogeneous Resources." I have examined the final electronic copy of this dissertation for form and content and recommend that it be accepted in partial fulfillment of the requirements for the degree of Doctor of Philosophy, with a major in Computer Engineering. Gregory D. Peterson, Major Professor We have read this dissertation and recommend its acceptance: Robert J. Harrison, Micah Beck, Robert Hettich Accepted for the Council: Carolyn R. Hodges Vice Provost and Dean of the Graduate School (Original signatures are on file with official studentecor r ds.) Parallel For Loops on Heterogeneous Resources A Dissertation Presented for the The Doctor of Philosophy Degree The University of Tennessee, Knoxville Frederick Edward Weber December 2012 c by Frederick Edward Weber, 2012 All Rights Reserved.
    [Show full text]
  • AMD Compute SDK 1.0 FAQ Document
    AMD APP SDK 3.0 FAQ 1 General Questions 1. Do I need to use additional software with the SDK? For information about the additional software to be used with the AMD APP SDK, see the AMD APP SDK Getting Started Guide. Also, we recommend using the debugging profiling and analysis tools contained in the AMD CodeXL heterogeneous compute tools suite. 2. Which versions of the OpenCL™ standard does this SDK support? AMD APP SDK 3.0 supports the development of applications using the OpenCL™ Specification version 2.0. 3. Will applications developed to execute on OpenCL™ 1.2 still operate in an OpenCL™ 2.0 environment? OpenCL™ is designed to be backwards compatible. The OpenCL™ 2.0 run-time delivered with the AMD Catalyst drivers run any OpenCL™ 1.2-compliant application. However, an OpenCL™ 2.0-compliant application will not execute on an OpenCL™ 1.2 run-time if APIs only supported by OpenCL™ 2.0 are used. 4. How often can I expect to get AMD APP SDK updates? Developers can expect that the AMD APP SDK may be updated two to three times a year. Actual release intervals may vary depending on available new features and product updates. AMD is committed to providing developers with regular updates to allow them to take advantage of the latest developments in AMD heterogeneous compute technology. 5. What is the difference between the CPU and GPU components of OpenCL™ that are bundled with the AMD APP SDK? The CPU component uses the compatible CPU cores in your system to accelerate your OpenCL™ compute kernels; the GPU component uses the compatible GPU cores in your system to accelerate your OpenCL™ compute kernels.
    [Show full text]