Automatic Program Optimization

Total Page:16

File Type:pdf, Size:1020Kb

Automatic Program Optimization Automatic Program Optimization SIGPLAN '93 PLDI Tutorial Notes Ron Cytron Washington University St. Louis, Missouri Printing: August 5, 1994 c 1993 by Ron K. Cytron Compiler organizations Program Front end: Operator and storage ab- stractions, alias mechanisms. Middle end: Parser Front Dead code elimination End Code motion Semantics Reduction in strength Constant propagation Common subexpression elimina- Middle tion Optimizer End Fission Fusion Strip mining Code Back Jamming Generation End Splitting Collapsing Executable Back end: Finite resource issues and Text code generation. Copyright c 1993 Ron K. Cytron. All rights reserved ±1± SIGPLAN '93 PROGRAM OPTIMIZATION TUTORIAL Some thoughts Misconceptions All too often::: Optimization optimizes your program. Optimization is disabled by default. De- There's probably a better algorithm or sequence of bugging optimized code can be treacherous [71, 42]. program transformations. While optimization hopefully Optimization is often the primary suspect of program improves your program, the result is usually not optimal. misbehaviorÐsometimes deservedly so. ªNo, not the Optimization requires (much) more third switch!º compilation time. For example, dead code Optimization is slow. Transformations are often elimination can reduce the size of program text such applied to too much of a program. Optimizations are that overall compile time is also reduced. often textbook recipes, applied without proper thought. A clever programmer is a good sub- Optimization produces incorrect code. stitute for an optimizing compiler. Although recent work is encouraging [67], optimizations While ef®cient coding of an algorithm is essential, pro- are usually developed ad hoc. grams should not be obfuscated by ªtricksº that are Programmers are trained by their com- architecture- (and sometimes compiler-) speci®c. pilers. A style is inevitably developed that is con- ducive to optimization. Optimization is like sex: Everybody claims to get good results using exotic techniques; Nobody is willing to provide the details. Copyright c 1993 Ron K. Cytron. All rights reserved ±2± SIGPLAN '93 PROGRAM OPTIMIZATION TUTORIAL Multilingual systems C FTN. ADA C FTN. ADA IL IBM SUN IBM SUN . CRAY . CRAY RS/6000 SPARC RS/6000 SPARC Architecting an intermediate language reduces the incremental cost of accom- modating new source languages or target architectures [7]. Moreover, many optimizations can be performed directly on the intermediate language text, so that source- and machine-independent optimizations can be performed by a common middle-end. Copyright c 1993 Ron K. Cytron. All rights reserved ±3± SIGPLAN '93 PROGRAM OPTIMIZATION TUTORIAL Intermediate languages It's very easy to devote much time and effort toward choosing the ªrightº IL. Below are some guidelines for choosing or developing a useful intermediate language: The IL should be a bona ®de language, and not just an aggregation of data structures. The semantics of the IL should be cleanly de®ned and readily apparent. The IL's representation should not be overly verbose: ± Although some expansion is inevitable, the IL-to-source token ratio should be as low as possible. ± It's desirable for the IL to have a verbose, human-readable form. The IL should be easily and cleanly extensible. The IL should be suf®ciently general to represent the important aspects of multiple front-end languages. The IL should be suf®ciently general to support ef®cient code generation for multiple back-end targets. A sampling of dif®cult issues: Ideally, an IL has fractal characteristics: optimization can proceed at a given How should a string operation be level; the IL can be ªloweredº; opti- represented (intact or as a ªloopº)? mization is then applied to the freshly How much detail of a procedure's exposed description. behavior is relevant? Copyright c 1993 Ron K. Cytron. All rights reserved ±4± SIGPLAN '93 PROGRAM OPTIMIZATION TUTORIAL Intermediate languages (cont'd) Components of an IL: SymbolTable: declares the name space of a procedure. AliasRelations: declares sets of aliased names. Semantics: gives a formal speci®cation of the procedure's behavior. Example program: Procedure foox; y The procedure randomly assigns the ad- declare dress of a or b to p, and then stores x + y into the location dereferenced by p. x; y integer a; b integer This example is intended to illustrate ?p integer may-alias behavior: ?p may be an alias for a or b, and static analysis certainly p r and ?&a :&b can't decide which alias will hold at run- ?p x + y time. end We'll now look at a possible intermediate representation of this procedure, using a Lisp-like notation that is easy to parse and to extend. The verbose keywords are easily coded and stored ef®ciently as terminals of the language's grammar. Copyright c 1993 Ron K. Cytron. All rights reserved ±5± SIGPLAN '93 PROGRAM OPTIMIZATION TUTORIAL Symbol table (SymbolTable (Symbol (NumSymbols 5) (SymbolName a) (Symbol (SymbolID 4) (SymbolName x) ) (SymbolID 1) (Symbol ) (SymbolName b) (Symbol (SymbolID 5) (SymbolName y) ) (SymbolID 2) ) ) (Symbol (SymbolName p) (SymbolID 3) ) Symbol attributes (SymbolType, SymbolSize, SymbolVolatile, etc.) can be added as needed. Copyright c 1993 Ron K. Cytron. All rights reserved ±6± SIGPLAN '93 PROGRAM OPTIMIZATION TUTORIAL Alias relations In programs with pointers or reference (AliasRelations parameters, use of a lexical name could (NumAliasRelations 2) refer to one of multiple, distinct storage (AliasRelation names. We therefore specify sets of (AliasID 1) names that might be treated in this man- (MayAliases 2 a b) ner. Subsequently, a given reference to ) a lexical name can be associated with (AliasRelation an alias relation entry, to describe the (AliasID 2) potential effects of that reference. (MustAliases 1 y) (MayAliases 1 x) In this example, we have an alias re- ) lation with may-aliases for a and b and (AliasRelation no must-aliases. This relation might be (AliasID 3) appropriate for the assignment through (MustAliases 1 x) ?p. (MayAliases 1 y) Also shown are two relations in which x ) and y are alternately must- and may- ) aliased. If parameters are passed ªby- addressº, then a use of x may be a use of y if each parameter is supplied the same address. Copyright c 1993 Ron K. Cytron. All rights reserved ±7± SIGPLAN '93 PROGRAM OPTIMIZATION TUTORIAL Procedure semantics (ProcSemantics (NodeSemantics (NumNodes 5) (NodeID 2) (Def (NodeSemantics (DefID 2) (NodeID 1) (SymbID ?) (Def (AliasWith 1) (DefID 1) (DefValue (SymbID p) (+ (DefValue (Use (Choose (UseID 1) ((= rand() 0) (SymbID x) (Addr a) ) (Addr b) (Use ) (UseID 2) ) (SymbID y) ) ) ) ) (Jump 2) ) ) ) ) ) Copyright c 1993 Ron K. Cytron. All rights reserved ±8± SIGPLAN '93 PROGRAM OPTIMIZATION TUTORIAL What happens in the middle end? Essentially, the program is transformed Control Flow Graph into an observably equivalent while less resource-consumptive program. Such Depth-First Numbering transformation is often based on: Spanning Tree Assertions provided by the program Dominators Intervals author or benefactor. Program Dominance Semantics Profiling The program dependence Frontiers graph [50, 35, 10]. Sparse Evaluation Static Single Static single assignment (SSA) Graph Assignment Control form [26, 5, 69, 28]. Form Dependence Data Flow Static information gathered by solv- Edges ing data ¯ow problems [44, 51, 52, Problems 53, 41, 54, 55, 48]. Data Dependence Run-time information collected by Edges pro®ling [61]. Program Program Dependence Graph Transformation Let's take a look at an example that bene®ts greatly from optimization::: Copyright c 1993 Ron K. Cytron. All rights reserved ±9± SIGPLAN '93 PROGRAM OPTIMIZATION TUTORIAL Unoptimized matrix multiply for i = 1 to N do for j = 1 to N do A[i; j ] 0 for k = 1 to N do A[i; j ] A[i; j ]+B [i; k ] C [k; j ] od od od Note that A[i; j ] is really Addr A+i 1 K1 +j 1 K2 which takes 6 integer operations. The innermost loop of this ªtextbookº program takes 24 integer ops 3loads 1 ¯oating add 1 ¯oating mpy 1store 30 instructions Copyright c 1993 Ron K. Cytron. All rights reserved ±10± SIGPLAN '93 PROGRAM OPTIMIZATION TUTORIAL Optimizing matrix multiply for i = 1 to N do The expression A[i; j ] is loop-invariant j = N for 1 to do with respect to the k loop. Thus, code a &A[i; j ] motion can move the address arith- A[i; j ] for k = 1 to N do metic for out of the innermost loop. ?a ?a + B [i; k ] C [k; j ] The resulting innermost loop contains od only 12 integer operations. od od for i = 1 to N do As loop k iterates, addressing arithmetic b &B [i; 1] for B changes from B [i; k ] to B [i; k + 1]. for j = 1 to N do Induction variable analysis detects the a &A[i; j ] constant difference between these ex- for k = 1 to N do pressions. ?a ?a + ?b C [k; j ] The resulting innermost loop contains b b + K B only 7 integer operations. od od od Similar analysis for C yields only 2 integer operations in the innermost loop, for a speedup of nearly 5. We can do better, especially for large arrays. Copyright c 1993 Ron K. Cytron. All rights reserved ±11± SIGPLAN '93 PROGRAM OPTIMIZATION TUTORIAL If optimization is::: so great becase: then: A good compiler can sell (even a slow) Why does it take so long? Compilation machine. Optimizing compilers easily provide a time is usually 2±5 times slower, and programs with large factor of two in performance. Moreover, the analysis procedures often take longer. Often this is the result of performed during program optimization can be incor- poor engineering: better data structures or algorithms porated into the ªprogramming environmentº [50, 25, can help in the optimizer. 68]. Why does the resulting program some- New languages and architectures mo- times exhibit unexpected behavior? tivate new program optimizations. Al- Sometimes the source program is at fault, and a bug though some optimizations are almost universally bene®- is uncovered when the optimized code is executed; cial, the advent of functional and parallel programming sometimes the optimizing compiler is itself to blame.
Recommended publications
  • Program Analysis and Optimization for Embedded Systems
    Program Analysis and Optimization for Embedded Systems Mike Jochen and Amie Souter jochen, souter ¡ @cis.udel.edu Computer and Information Sciences University of Delaware Newark, DE 19716 (302) 831-6339 1 Introduction ¢ have low cost A proliferation in use of embedded systems is giving cause ¢ have low power consumption for a rethinking of traditional methods and effects of pro- ¢ require as little physical space as possible gram optimization and how these methods and optimizations can be adapted for these highly specialized systems. This pa- ¢ meet rigid time constraints for computation completion per attempts to raise some of the issues unique to program These requirements place constraints on the underlying analysis and optimization for embedded system design and architecture’s design, which together affect compiler design to address some of the solutions that have been proposed to and program optimization techniques. Each of these crite- address these specialized issues. ria must be balanced against the other, as each will have an This paper is organized as follows: section 2 provides effect on the other (e.g. making a system smaller and faster pertinent background information on embedded systems, de- will typically increase its cost and power consumption). A lineating the special needs and problems inherent with em- typical embedded system, as illustrated in figure 1, consists bedded system design; section 3 addresses one such inherent of a processor core, a program ROM (Read Only Memory), problem, namely limited space for program code; section 4 RAM (Random Access Memory), and an ASIC (Applica- discusses current approaches and open issues for code min- tion Specific Integrated Circuit).
    [Show full text]
  • Stochastic Program Optimization by Eric Schkufza, Rahul Sharma, and Alex Aiken
    research highlights DOI:10.1145/2863701 Stochastic Program Optimization By Eric Schkufza, Rahul Sharma, and Alex Aiken Abstract Although the technique sacrifices completeness it pro- The optimization of short sequences of loop-free, fixed-point duces dramatic increases in the quality of the resulting code. assembly code sequences is an important problem in high- Figure 1 shows two versions of the Montgomery multiplica- performance computing. However, the competing constraints tion kernel used by the OpenSSL RSA encryption library. of transformation correctness and performance improve- Beginning from code compiled by llvm −O0 (116 lines, not ment often force even special purpose compilers to pro- shown), our prototype stochastic optimizer STOKE produces duce sub-optimal code. We show that by encoding these code (right) that is 16 lines shorter and 1.6 times faster than constraints as terms in a cost function, and using a Markov the code produced by gcc −O3 (left), and even slightly faster Chain Monte Carlo sampler to rapidly explore the space of than the expert handwritten assembly included in the all possible code sequences, we are able to generate aggres- OpenSSL repository. sively optimized versions of a given target code sequence. Beginning from binaries compiled by llvm −O0, we are able 2. RELATED WORK to produce provably correct code sequences that either Although techniques that preserve completeness are effec- match or outperform the code produced by gcc −O3, icc tive within certain domains, their general applicability −O3, and in some cases expert handwritten assembly. remains limited. The shortcomings are best highlighted in the context of the code sequence shown in Figure 1.
    [Show full text]
  • The Effect of Code Expanding Optimizations on Instruction Cache Design
    May 1991 UILU-EN G-91-2227 CRHC-91-17 Center for Reliable and High-Performance Computing THE EFFECT OF CODE EXPANDING OPTIMIZATIONS ON INSTRUCTION CACHE DESIGN William Y. Chen Pohua P. Chang Thomas M. Conte Wen-mei W. Hwu Coordinated Science Laboratory College of Engineering UNIVERSITY OF ILLINOIS AT URBANA-CHAMPAIGN Approved for Public Release. Distribution Unlimited. UNCLASSIFIED____________ SECURITY ¿LASSIPlOvriON OF t h is PAGE REPORT DOCUMENTATION PAGE 1a. REPORT SECURITY CLASSIFICATION 1b. RESTRICTIVE MARKINGS Unclassified None 2a. SECURITY CLASSIFICATION AUTHORITY 3 DISTRIBUTION/AVAILABILITY OF REPORT 2b. DECLASSIFICATION/DOWNGRADING SCHEDULE Approved for public release; distribution unlimited 4. PERFORMING ORGANIZATION REPORT NUMBER(S) 5. MONITORING ORGANIZATION REPORT NUMBER(S) UILU-ENG-91-2227 CRHC-91-17 6a. NAME OF PERFORMING ORGANIZATION 6b. OFFICE SYMBOL 7a. NAME OF MONITORING ORGANIZATION Coordinated Science Lab (If applicable) NCR, NSF, AMD, NASA University of Illinois N/A 6c ADDRESS (G'ty, Staff, and ZIP Code) 7b. ADDRESS (Oty, Staff, and ZIP Code) 1101 W. Springfield Avenue Dayton, OH 45420 Urbana, IL 61801 Washington DC 20550 Langley VA 20200 8a. NAME OF FUNDING/SPONSORING 8b. OFFICE SYMBOL ORGANIZATION 9. PROCUREMENT INSTRUMENT IDENTIFICATION NUMBER 7a (If applicable) N00014-91-J-1283 NASA NAG 1-613 8c. ADDRESS (City, State, and ZIP Cod*) 10. SOURCE OF FUNDING NUMBERS PROGRAM PROJECT t a sk WORK UNIT 7b ELEMENT NO. NO. NO. ACCESSION NO. The Effect of Code Expanding Optimizations on Instruction Cache Design 12. PERSONAL AUTHOR(S) Chen, William, Pohua Chang, Thomas Conte and Wen-Mei Hwu 13a. TYPE OF REPORT 13b. TIME COVERED 14. OATE OF REPORT (Year, Month, Day) Jl5.
    [Show full text]
  • ARM Optimizing C/C++ Compiler V20.2.0.LTS User's Guide (Rev. V)
    ARM Optimizing C/C++ Compiler v20.2.0.LTS User's Guide Literature Number: SPNU151V January 1998–Revised February 2020 Contents Preface ........................................................................................................................................ 9 1 Introduction to the Software Development Tools.................................................................... 12 1.1 Software Development Tools Overview ................................................................................. 13 1.2 Compiler Interface.......................................................................................................... 15 1.3 ANSI/ISO Standard ........................................................................................................ 15 1.4 Output Files ................................................................................................................. 15 1.5 Utilities ....................................................................................................................... 16 2 Using the C/C++ Compiler ................................................................................................... 17 2.1 About the Compiler......................................................................................................... 18 2.2 Invoking the C/C++ Compiler ............................................................................................. 18 2.3 Changing the Compiler's Behavior with Options ......................................................................
    [Show full text]
  • Compiler Optimization-Space Exploration
    Journal of Instruction-Level Parallelism 7 (2005) 1-25 Submitted 10/04; published 2/05 Compiler Optimization-Space Exploration Spyridon Triantafyllis [email protected] Department of Computer Science Princeton University Princeton, NJ 08540 USA Manish Vachharajani [email protected] Department of Electrical and Computer Engineering University of Colorado at Boulder Boulder, CO 80309 USA David I. August [email protected] Department of Computer Science Princeton University Princeton, NJ 08540 USA Abstract To meet the performance demands of modern architectures, compilers incorporate an ever- increasing number of aggressive code transformations. Since most of these transformations are not universally beneficial, compilers traditionally control their application through predictive heuris- tics, which attempt to judge an optimization’s effect on final code quality a priori. However, com- plex target architectures and unpredictable optimization interactions severely limit the accuracy of these judgments, leading to performance degradation because of poor optimization decisions. This performance loss can be avoided through the iterative compilation approach, which ad- vocates exploring many optimization options and selecting the best one a posteriori. However, existing iterative compilation systems suffer from excessive compile times and narrow application domains. By overcoming these limitations, Optimization-Space Exploration (OSE) becomes the first iterative compilation technique suitable for general-purpose production compilers. OSE nar- rows down the space of optimization options explored through limited use of heuristics. A compiler tuning phase further limits the exploration space. At compile time, OSE prunes the remaining opti- mization configurations in the search space by exploiting feedback from earlier configurations tried. Finally, rather than measuring actual runtimes, OSE compares optimization outcomes through static performance estimation, further enhancing compilation speed.
    [Show full text]
  • XL Fortran: Getting Started
    IBM XL Fortran for AIX, V12.1 Getting Started with XL Fortran Ve r s i o n 12.1 GC23-8898-00 IBM XL Fortran for AIX, V12.1 Getting Started with XL Fortran Ve r s i o n 12.1 GC23-8898-00 Note Before using this information and the product it supports, read the information in “Notices” on page 29. First edition This edition applies to IBM XL Fortran for AIX, V12.1 (Program number 5724-U82) and to all subsequent releases and modifications until otherwise indicated in new editions. Make sure you are using the correct edition for the level of the product. © Copyright International Business Machines Corporation 1996, 2008. All rights reserved. US Government Users Restricted Rights – Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. Contents About this document . .v Architecture and processor support . .12 Conventions . .v Performance and optimization . .13 Related information . .ix Other new or changed compiler options . .15 IBM XL Fortran information . .ix Standards and specifications . .x Chapter 3. Setting up and customizing Other IBM information. .xi XL Fortran . .17 Technical support . .xi Using custom compiler configuration files . .17 How to send your comments . .xi Chapter 4. Developing applications Chapter 1. Introducing XL Fortran . .1 with XL Fortran . .19 Commonality with other IBM compilers . .1 The compiler phases . .19 Hardware and operating system support . .1 Editing Fortran source files . .19 A highly configurable compiler . .1 Compiling with XL Fortran . .20 Language standards compliance . .2 Invoking the compiler . .22 Source-code migration and conformance checking 3 Compiling parallelized XL Fortran applications 22 Tools and utilities .
    [Show full text]
  • Machine Learning in Compiler Optimisation Zheng Wang and Michael O’Boyle
    1 Machine Learning in Compiler Optimisation Zheng Wang and Michael O’Boyle Abstract—In the last decade, machine learning based com- hope of improving performance but could in some instances pilation has moved from an an obscure research niche to damage it. a mainstream activity. In this article, we describe the rela- Machine learning predicts an outcome for a new data point tionship between machine learning and compiler optimisation and introduce the main concepts of features, models, training based on prior data. In its simplest guise it can be considered and deployment. We then provide a comprehensive survey and a from of interpolation. This ability to predict based on prior provide a road map for the wide variety of different research information can be used to find the data point with the best areas. We conclude with a discussion on open issues in the outcome and is closely tied to the area of optimisation. It is at area and potential research directions. This paper provides both this overlap of looking at code improvement as an optimisation an accessible introduction to the fast moving area of machine learning based compilation and a detailed bibliography of its problem and machine learning as a predictor of the optima main achievements. where we find machine-learning compilation. Optimisation as an area, machine-learning based or other- Index Terms—Compiler, Machine Learning, Code Optimisa- tion, Program Tuning wise, has been studied since the 1800s [8], [9]. An interesting question is therefore why has has the convergence of these two areas taken so long? There are two fundamental reasons.
    [Show full text]
  • An Optimization-Driven Incremental Inline Substitution Algorithm for Just-In-Time Compilers
    An Optimization-Driven Incremental Inline Substitution Algorithm for Just-in-Time Compilers Aleksandar Prokopec Gilles Duboscq David Leopoldseder Thomas Würthinger Oracle Labs, Switzerland Oracle Labs, Switzerland JKU Linz, Austria Oracle Labs, Switzerland [email protected] [email protected] [email protected] [email protected] Abstract—Inlining is one of the most important compiler mization prediction by incrementally exploring and specializing optimizations. It reduces call overheads and widens the scope of the program’s call tree, and clusters the callsites before inlining. other optimizations. But, inlining is somewhat of a black art of an We report the following new observations: optimizing compiler, and was characterized as a computationally intractable problem. Intricate heuristics, tuned during countless • In many programs, there is an impedance between the hours of compiler engineering, are often at the core of an logical units of code (i.e. subroutines) and the optimizable inliner implementation. And despite decades of research, well- units of code (groups of subroutines). It is therefore established inlining heuristics are still missing. beneficial to inline specific clusters of callsites, instead In this paper, we describe a novel inlining algorithm for of a single callsite at a time. We describe how to identify JIT compilers that incrementally explores a program’s call graph, and alternates between inlining and optimizations. We such callsite clusters. devise three novel heuristics that guide our inliner: adaptive • When deciding when to stop inlining, using an adaptive decision thresholds, callsite clustering, and deep inlining trials. threshold function (rather than a fixed threshold value) We implement the algorithm inside Graal, a dynamic JIT produces more efficient programs.
    [Show full text]
  • A Unified Approach to Global Program Optimization
    A UNIFIED APPROACH TO GLOBAL PROGRAM OPTIMIZATION Gary A. Kildall Computer Science Group Naval Postgraduate School Monterey, California Abstract A technique is presented for global analysie of program structure in order to perform compile time optimization of object code generated for expressions. The global expression optimization presented includes constant propagation, common subexpression elimination, elimination of redundant register load operations, and live expression analysis. A general purpose program flow analysis algorithm is developed which depends upon the existence of an “optimizing function.” The algorithm is defined formally using a directed graph model of program flow structure, and is shown to be correct, Several optimizing functions are defined which, when used in conjunction with the flow analysis algorithm, provide the various forms of code optimization. The flow analysis algorithm is sufficiently general that additional functions can easily be defined for other forms of globa~ cod: optimization. 1. INTRODUCTION of the graph represent program control flow Dossi- bilities between the nodes at execution–time. A number of techniques have evolved for the compile-time analysis of program structure in order to locate redundant computations, perform constant computations, and reduce the number of store–load sequences between memory and high-speed registers. Some of these techniques provide analysis of only entry’ ~:=j straight-line sequences of instructions [5,6,9,14, o 17,18,19,20,27,29,34,36,38,39,43,45 ,46], while B others take the program branching structure into &() account [2,3,4,10,11,12,13,15,23,30, 32,33,35]. The purpose here is to describe a single program c flow analysis algorithm which extends all of b=2 these straight-line optimizing techniques to in- D clude branching structure.
    [Show full text]
  • XL C/C++: Optimization and Programming Guide About This Document
    IBM XL C/C++ for Linux, V16.1.1 IBM Optimization and Programming Guide Version 16.1.1 SC27-8046-01 IBM XL C/C++ for Linux, V16.1.1 IBM Optimization and Programming Guide Version 16.1.1 SC27-8046-01 Note Before using this information and the product it supports, read the information in “Notices” on page 121. First edition This edition applies to IBM XL C/C++ for Linux, V16.1.1 (Program 5765-J13, 5725-C73) and to all subsequent releases and modifications until otherwise indicated in new editions. Make sure you are using the correct edition for the level of the product. © Copyright IBM Corporation 1996, 2018. US Government Users Restricted Rights – Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. Contents About this document ......... v Optimizing at level 4 .......... 26 Who should read this document........ v Optimizing at level 5 .......... 27 How to use this document.......... v Tuning for your system architecture ...... 28 How this document is organized ....... v Getting the most out of target machine options 28 Conventions .............. vi Using high-order loop analysis and transformations 29 Related information ............ ix Getting the most out of -qhot ....... 30 Available help information ........ ix Using shared-memory parallelism (SMP) .... 31 Standards and specifications ........ xi Getting the most out of -qsmp ....... 32 Technical support ............ xi Using interprocedural analysis ........ 33 How to send your comments ........ xii Getting the most from -qipa ........ 35 Using profile-directed feedback ........ 36 Chapter 1. Using XL C/C++ with Fortran 1 Compiling with -qpdf1 ......... 37 Training with typical data sets ......
    [Show full text]
  • Demand-Driven Inlining Heuristics in a Region-Based Optimizing Compiler for ILP Architectures
    Demand-driven Inlining Heuristics in a Region-based Optimizing Compiler for ILP Architectures Tom Way, Ben Breech, Wei Du and Lori Pollock Department of Computer and Information Sciences University of Delaware, Newark, DE 19716, USA ¡ email: way,breech,wei,pollock ¢ @cis.udel.edu ABSTRACT compilation unit size and content. In addition to expos- While scientists and engineers have been taking on the ing opportunities for interprocedural instruction schedul- challenge of converting their applications into parallel ing and optimization, the size of the resulting regions (i.e., programs, compilers are charged with identifying op- compilation units) has been shown to be smaller than func- portunities and transforming codes to exploit the avail- tions, and can be limited to any desired size, in order to able instruction-level parallelism (ILP) offered by today’s reduce the impact of the quadratic algorithmic complexity uniprocessors, even within a parallel computing environ- of the applied optimization transformations [14]. ment. Region-based compilation repartitions a program The key component of a region-based compiler is the into more desirable compilation units for optimization and region formation phase which partitions the program into ILP scheduling. With region-based compilation, the com- regions using heuristics with the intent that the optimizer piler can control problem size and complexity by control- will be invoked with a scope that is limited to a single re- ling region size and contents, and expose interprocedu- gion at a time. Thus, the quality of the generated code ral scheduling and optimization opportunities without in- depends greatly upon the ability of the region formation terprocedural analysis or large function bodies.
    [Show full text]
  • Analysis and Optimization of Scientific Applications Through Set and Relation Abstractions M
    Louisiana State University LSU Digital Commons LSU Doctoral Dissertations Graduate School 2017 Analysis and Optimization of Scientific Applications through Set and Relation Abstractions M. Tohid (Rastegar Tohid, Mohammed) Louisiana State University and Agricultural and Mechanical College Follow this and additional works at: https://digitalcommons.lsu.edu/gradschool_dissertations Part of the Electrical and Computer Engineering Commons Recommended Citation Tohid (Rastegar Tohid, Mohammed), M., "Analysis and Optimization of Scientific Applications through Set and Relation Abstractions" (2017). LSU Doctoral Dissertations. 4404. https://digitalcommons.lsu.edu/gradschool_dissertations/4404 This Dissertation is brought to you for free and open access by the Graduate School at LSU Digital Commons. It has been accepted for inclusion in LSU Doctoral Dissertations by an authorized graduate school editor of LSU Digital Commons. For more information, please [email protected]. ANALYSIS AND OPTIMIZATION OF SCIENTIFIC APPLICATIONS THROUGH SET AND RELATION ABSTRACTIONS A Dissertation Submitted to the Graduate Faculty of the Louisiana State University and Agricultural and Mechanical College in partial fulfillment of the requirements for the degree of Doctor of Philosophy in The School of Electrical Engineering and Computer Science by Mohammad Rastegar Tohid M.Sc., Newcastle University, 2008 B.Sc., Azad University (S. Tehran Campus), 2006 May 2017 Dedication Dedicated to my parents who have dedicated their lives to their children. ii Acknowledgments I thank my advisor Dr. Ramanujam for valueing independent research and allowing me to work on topics that geniunely intrigued me while never lettig me go off the rail. His optimism and words of encouragement always aspired me. It has been a great pleasure to have known and worked with him.
    [Show full text]