Ghosh Wsu 0251E 12693.Pdf (9.791Mb)

Total Page:16

File Type:pdf, Size:1020Kb

Ghosh Wsu 0251E 12693.Pdf (9.791Mb) SUPPORTING EFFICIENT GRAPH ANALYTICS AND SCIENTIFIC COMPUTATION USING ASYNCHRONOUS DISTRIBUTED-MEMORY PROGRAMMING MODELS By SAYAN GHOSH A dissertation submitted in partial fulfillment of the requirements for the degree of DOCTOR OF PHILOSOPHY WASHINGTON STATE UNIVERSITY School of Electrical Engineering and Computer Science MAY 2019 c Copyright by SAYAN GHOSH, 2019 All Rights Reserved c Copyright by SAYAN GHOSH, 2019 All Rights Reserved To the Faculty of Washington State University: The members of the Committee appointed to examine the dissertation of SAYAN GHOSH find it satisfactory and recommend that it be accepted. Assefaw H. Gebremedhin, Ph.D., Chair Carl Hauser, Ph.D. Ananth Kalyanaraman, Ph.D. Pavan Balaji, Ph.D. Mahantesh Halappanavar, Ph.D. ii ACKNOWLEDGEMENT I thank my adviser, Dr. Assefaw Gebremedhin for his generous guidance, unflagging support, and considerable enthusiasm toward my research. I greatly appreciate his attempts in always push- ing me to refine my writing and narration skills, which has helped me to become a better researcher and communicator. I would like to thank Dr. Jeff Hammond for introducing me to one-sided communication models, which play an important role in my thesis. I would also like to thank Dr. Barbara Chapman and Dr. Sunita Chandrasekaran, for their unwavering support during my Masters studies at the University of Houston. I am immensely fortunate to have had the opportunity to work with all of my thesis committee members. As a Teaching Assistant to Dr. Carl Hauser for the Computer Networks course, I appreciate that he encouraged me to solve the problem sets on my own, so that I could assist the students effectively. Through the discussions with Dr. Pavan Balaji, I have learned the importance of low-level performance analysis for comprehensive evaluation of an application. I am grateful to Drs. Mahantesh Halappanavar and Ananth Kalyanaraman for introducing me to graph community detection related research. I sincerely believe that criticism outperforms praise. I have been lucky to have mentors who never settled for less and always pushed me to explore a bit more. I appreciate the supervision of Drs. Jeff Hammond, Pavan Balaji, Antonio Pena˜ and Yanfei Guo during my internships at Argonne National Laboratory. I spent over a year as an intern and an Alternate Sponsored Fellow at Pacific Northwest National Laboratory, and I would like to thank Drs. Mahantesh Halappanavar and Antonino Tumeo for engaging me with research on graph community detection. I admire every one of them for their guidance and the efforts in enhancing my knowledge. Special thanks to the administrative staff of the Electrical Engineering and Computer Science department, Graduate School, and the Office of International Programs at Washington State Uni- versity for their commitment toward helping students. iii I would like to thank my parents/in-laws for their unswerving support and deep empathy, de- spite the vast distance between us. Finally, I would like to recognize my wife Priyanka for her constructive criticisms, logical disagreements, unconditional love, and sharing all the hardships of student life with magnificent flair — ”Strangers on this road we are on; We are not two, we are one”. iv SUPPORTING EFFICIENT GRAPH ANALYTICS AND SCIENTIFIC COMPUTATION USING ASYNCHRONOUS DISTRIBUTED-MEMORY PROGRAMMING MODELS Abstract by Sayan Ghosh, Ph.D. Washington State University May 2019 Chair: Assefaw H. Gebremedhin Future High Performance Computing (HPC) nodes will have many more processors than the contemporary architectures. In such a system with massive parallelism it will be necessary to use all the available cores to drive the network performance. Hence, there is a need to explore one-sided models which decouple communication from synchronization. Apart from focusing on optimizing communication, it is also desirable to improve the productivity of existing one-sided models by designing convenient abstractions that can alleviate the complexities of parallel appli- cation development. Classically, a majority of applications running on HPC systems have been arithmetic intensive. However, data-driven applications are becoming more prominent, employ- ing algorithms from areas such as graph theory, machine learning, and data mining. Most graph applications have minimal arithmetic requirements, and exhibit irregular communication patterns. Therefore, it is useful to identify approximate methods that can enable communication-avoiding optimizations for graph applications, by potentially sacrificing some quality. The first part of this dissertation addresses the need to reduce synchronization by exploring one-sided communication models and designing convenient abstractions that serve the need of distributed-memory scientific applications. The second part of the dissertation is about evaluating v the impact of approximate methods and communication models on parallel graph applications. We begin with the design and development of an asynchronous matrix communication inter- face that can be leveraged in parallel numerical linear algebra applications. Next, we discuss the design of a compact set of C++ abstractions over a one-sided communication model, which improves developer productivity significantly. Then, we study the challenges associated with par- allelizing community detection in graphs, and develop a distributed-memory implementation that incorporates a number of approximate methods to optimize performance. Finally, we consider a half-approximation algorithm for graph matching, and evaluate the implications of different com- munication models in its distributed-memory implementation. We also examine the effect of data reordering on performance. In summary, this dissertation provides concrete insights into designing low-overhead high-level interfaces over asynchronous distributed-memory models for building parallel scientific applica- tions, and presents empirical analysis on the effect of approximate methods and communication models in deriving efficiency for irregular scientific applications using distributed-memory graph applications as a use-case. vi TABLE OF CONTENTS Page ACKNOWLEDGEMENT . ii ABSTRACT . v LIST OF TABLES . xiii LIST OF FIGURES . xvi CHAPTER 1: INTRODUCTION . 1 1.1 HARDWARE TRENDS . 1 1.2 POWER CONSUMPTION GOVERN FUTURE SYSTEM DESIGN . 1 1.3 IRREGULAR APPLICATION CHALLENGES . 3 1.4 USING SPARSE LINEAR ALGEBRA FOR GRAPH APPLICATIONS . 4 1.5 MOTIVATION . 5 1.5.1 Distributed-memory applications and Message Passing Interface . 6 1.5.2 One-sided communication model . 7 1.5.3 Approximate computing techniques . 8 1.5.4 Summary . 9 1.6 CONTRIBUTIONS . 10 1.7 PUBLICATIONS . 11 vii 1.8 DISSERTATION ORGANIZATION . 12 CHAPTER 2: BACKGROUND ON MPI ONE-SIDED COMMUNICATION . 14 2.1 INTRODUCTION . 14 2.2 REMOTE DIRECT MEMORY ACCESS . 16 2.3 MEMORY MODEL . 17 2.3.1 Memory consistency . 17 2.3.2 MPI RMA memory model . 18 2.4 MPI-2 TO MPI-3 RMA . 19 2.5 CHAPTER SUMMARY . 20 CHAPTER 3: ONE-SIDED INTERFACE FOR MATRIX OPERATIONS USING MPI: A CASE STUDY WITH ELEMENTAL . 21 3.1 INTRODUCTION . 21 3.2 ABOUT ELEMENTAL . 23 3.2.1 Data Distribution . 24 3.2.2 Elemental AXPY Interface . 26 3.3 BEYOND THE ELEMENTAL AXPY INTERFACE . 27 3.3.1 Enhancing the Performance of the Existing AXPY Interface . 28 3.3.2 From the AXPY Interface to the RMA Interface . 29 3.4 PROPOSED ONE-SIDED APIS . 30 3.4.1 RMAInterface ................................. 30 3.4.2 Distributed Arrays Interface (EL::DA) . 35 3.5 EXPERIMENTAL EVALUATION . 36 viii 3.5.1 Microbenchmark Evaluation . 38 3.5.2 Application Evaluation – GTFock . 42 3.6 CHAPTER SUMMARY . 43 CHAPTER 4: RMACXX: AN EFFICIENT HIGH-LEVEL C++ INTERFACE OVER MPI-3 RMA . 45 4.1 INTRODUCTION . 45 4.2 RELATED WORK . 49 4.3 DESIGN PRINCIPLES OF RMACXX . 51 4.3.1 Window class . 52 4.3.2 Standard interface . 56 4.3.3 Expression interface . 60 4.4 EXPERIMENTAL EVALUATION . 66 4.4.1 Instruction count and latency analysis . 67 4.4.2 Message rate and remote atomics . 72 4.4.3 Application evaluations . 75 4.5 CHAPTER SUMMARY . 79 CHAPTER 5: DISTRIBUTED-MEMORY PARALLEL LOUVAIN METHOD FOR GRAPH COMMUNITY DETECTION . 80 5.1 INTRODUCTION . 80 5.2 RELATED WORK . 82 5.3 PRELIMINARIES . 83 5.3.1 Modularity . 83 5.3.2 Serial Louvain algorithm . 85 ix 5.3.3 Challenges in distributed-memory parallelization . 85 5.4 THE PARALLEL ALGORITHM . 86 5.4.1 Input distribution . 87 5.4.2 Overview of the parallel algorithm . 87 5.5 APPROXIMATE METHODS FOR PERFORMANCE OPTIMIZATION . 91 5.5.1 Threshold Cycling . 93 5.5.2 Early Termination . 93 5.5.3 Incomplete Coloring . 95 5.6 EXPERIMENTAL EVALUATION . 96 5.6.1 Algorithms compared . 97 5.6.2 Experimental platforms . 97 5.6.3 Test graphs . 98 5.6.4 Comparison on a single node . 100 5.6.5 Strong scaling . 101 5.6.6 Weak scaling . 102 5.6.7 Analysis of performance of the approximate computing methods/heuristics 104 5.6.8 Combining approximate methods/heuristics delivers better performance . 107 5.6.9 Solution quality assessment . 109 5.7 APPLICABILITY OF THE LOUVAINMETHOD AS A BENCHMARKING TOOL FOR GRAPH ANALYTICS . 110 5.7.1 Characteristics of distributed-memory Louvain method . 111 5.7.2 Synthetic Data Generation . 113 5.8 ANALYSIS OF MEMORY AFFINITY, POWER CONSUMPTION, AND COM- MUNICATION PRIMITIVES . 115 x 5.8.1 Evaluation on Intel Knights Landing R architecture . 116 5.8.2 Power, energy and memory usage . 118 5.8.3 Impact of MPI communication method . 119 5.9 ADDRESSING THE RESOLUTION LIMIT PROBLEM . 123 5.10 CHAPTER SUMMARY . 126 CHAPTER 6: EXPLORING MPI COMMUNICATION MODELS FOR GRAPH AP- PLICATIONS USING GRAPH MATCHING AS A CASE STUDY . 127 6.1 INTRODUCTION . 127 6.2 IMPLEMENTING DISTRIBUTED-MEMORY PARALLEL GRAPH ALGORITHMS USING MPI . ..
Recommended publications
  • Thriving in a Crowded and Changing World: C++ 2006–2020
    Thriving in a Crowded and Changing World: C++ 2006–2020 BJARNE STROUSTRUP, Morgan Stanley and Columbia University, USA Shepherd: Yannis Smaragdakis, University of Athens, Greece By 2006, C++ had been in widespread industrial use for 20 years. It contained parts that had survived unchanged since introduced into C in the early 1970s as well as features that were novel in the early 2000s. From 2006 to 2020, the C++ developer community grew from about 3 million to about 4.5 million. It was a period where new programming models emerged, hardware architectures evolved, new application domains gained massive importance, and quite a few well-financed and professionally marketed languages fought for dominance. How did C++ ś an older language without serious commercial backing ś manage to thrive in the face of all that? This paper focuses on the major changes to the ISO C++ standard for the 2011, 2014, 2017, and 2020 revisions. The standard library is about 3/4 of the C++20 standard, but this paper’s primary focus is on language features and the programming techniques they support. The paper contains long lists of features documenting the growth of C++. Significant technical points are discussed and illustrated with short code fragments. In addition, it presents some failed proposals and the discussions that led to their failure. It offers a perspective on the bewildering flow of facts and features across the years. The emphasis is on the ideas, people, and processes that shaped the language. Themes include efforts to preserve the essence of C++ through evolutionary changes, to simplify itsuse,to improve support for generic programming, to better support compile-time programming, to extend support for concurrency and parallel programming, and to maintain stable support for decades’ old code.
    [Show full text]
  • Ali Aydar Anita Borg Alfred Aho Bjarne Stroustrup Bill Gates
    Ali Aydar Ali Aydar is a computer scientist and Internet entrepreneur. He is the chief executive officer at Sporcle. He is best known as an early employee and key technical contributor at the original Napster. Aydar bought Fanning his first book on programming in C++, the language he would use two years later to build the Napster file-sharing software. Anita Borg Anita Borg (January 17, 1949 – April 6, 2003) was an American computer scientist. She founded the Institute for Women and Technology (now the Anita Borg Institute for Women and Technology). While at Digital Equipment, she developed and patented a method for generating complete address traces for analyzing and designing high-speed memory systems. Alfred Aho Alfred Aho (born August 9, 1941) is a Canadian computer scientist best known for his work on programming languages, compilers, and related algorithms, and his textbooks on the art and science of computer programming. Aho received a B.A.Sc. in Engineering Physics from the University of Toronto. Bjarne Stroustrup Bjarne Stroustrup (born 30 December 1950) is a Danish computer scientist, most notable for the creation and development of the widely used C++ programming language. He is a Distinguished Research Professor and holds the College of Engineering Chair in Computer Science. Bill Gates 2 of 10 Bill Gates (born October 28, 1955) is an American business magnate, philanthropist, investor, computer programmer, and inventor. Gates is the former chief executive and chairman of Microsoft, the world’s largest personal-computer software company, which he co-founded with Paul Allen. Bruce Arden Bruce Arden (born in 1927 in Minneapolis, Minnesota) is an American computer scientist.
    [Show full text]
  • Bjarne Stroustrup
    Bjarne Stroustrup 52 Riverside Dr. #6A +1 979 219 5004 NY, NY 10024 [email protected] USA www.stroustrup.com Education Ph.D. in Computer Science, University of Cambridge, England, 1979 Ph.D. Thesis: Communication and Control in Distributed Computer Systems Thesis advisor: David Wheeler Cand.Scient. in Mathematics with Computer Science, Aarhus University, Denmark, 1975 Thesis advisor: Brian H. Mayoh Research Interests Distributed Systems, Design, Programming techniques, Software development tools, and Programming Languages Professional Experience Technical Fellow, Morgan Stanley, New York, January 2019 – present Managing Director, Division of Technology and Data, Morgan Stanley, New York, January 2014 – present Visiting Professor, Columbia University, New York, January 2014 – present Visiting Professor in the Computer Lab and Fellow of Churchill College, Cambridge University, Spring 2012 Visiting Professor in the Computer Science Department, Princeton University, Fall 2011 The College of Engineering Chair Professor in Computer Science, Department of Computer Science, Texas A&M University, October 2002 – January 2014 Department Head, AT&T Laboratories – Research, Florham Park, New Jersey, July 1995 – October 2002 Distinguished Member of Technical Staff, AT&T Bell Laboratories, Murray Hill, NJ, June 1987 – July 1995 Member of Technical Staff, AT&T Bell Laboratories, Murray Hill, NJ, March 1979 – June 1987 Honors & Awards 2019: Honorary doctor of University Carlos III in Madrid, Spain. 1 2018: The John Scott Legacy Medal and Premium from The Franklin Institute and the City Council of Philadelphia to men and women whose inventions improved the comfort, welfare, and happiness of human kind in a significant way. 2018: The Computer Pioneer Award from The IEEE Computer Society For bringing object- oriented programming and generic programming to the mainstream with his design and implementation of the C++ programming language.
    [Show full text]
  • Academic Program Review
    Academic Program Review April 16-18, 2012 Department of Computer Science and Engineering Room 301 Harvey R. Bright Building Texas A&M University College Station, Texas 1 Contents I Introduction ............................................................................................................................... 4 I.1 Charge to Review Committee ............................................................................................. 4 I.2 Schedule of Review/Itinerary ............................................................................................. 5 I.3 Administrative Structure .................................................................................................... 6 II Brief History ............................................................................................................................... 7 II.1 Founding of Department .................................................................................................... 7 II.2 Founding and Development of Related Centers ................................................................ 7 II.3 Review and Changes in Past Seven Years ........................................................................ 15 II.4 Date of Last Program Review ........................................................................................... 16 III Vision and Goals ................................................................................................................... 16 III.1 Strategic Plan ...................................................................................................................
    [Show full text]
  • A History of C++: 1979− 1991
    A History of C++: 1979−1991 Bjarne Stroustrup AT&T Bell Laboratories Murray Hill, New Jersey 07974 ABSTRACT This paper outlines the history of the C++ programming language. The emphasis is on the ideas, constraints, and people that shaped the language, rather than the minutiae of language features. Key design decisions relating to language features are discussed, but the focus is on the overall design goals and practical constraints. The evolution of C++ is traced from C with Classes to the current ANSI and ISO standards work and the explosion of use, interest, commercial activity, compilers, tools, environments, and libraries. 1 Introduction C++ was designed to provide Simula’s facilities for program organization together with C’s effi- ciency and flexibility for systems programming. It was intended to deliver that to real projects within half a year of the idea. It succeeded. At the time, I realized neither the modesty nor the preposterousness of that goal. The goal was modest in that it did not involve innovation, and preposterous in both its time scale and its Draco- nian demands on efficiency and flexibility. While a modest amount of innovation did emerge over the years, efficiency and flexibility have been maintained without compromise. While the goals for C++ have been refined, elaborated, and made more explicit over the years, C++ as used today directly reflects its original aims. This paper is organized in roughly chronological order: §2 C with Classes: 1979– 1983. This section describes the fundamental design decisions for C++ as they were made for C++’s immediate predecessor. §3 From C with Classes to C++: 1982– 1985.
    [Show full text]
  • Introduc)On to C++
    Introduc)on to C++ CS 16: Solving Problems with Computers I Lecture #2 Ziad Matni Dept. of Computer Science, UCSB Announcements • Homework #1 due today – Please take out any staples or paper clips • No more switching lab )mes – Labs at 9am, 10am, 11am are FULL – Other labs have some space leF 9/27/16 Matni, CS16, Fa16 2 Lecture Outline • Computer Systems -­‐-­‐-­‐ A review from last week • Programming and Problem Solving • IntroducPon to C++ 9/27/16 Matni, CS16, Fa16 3 Defining Computer A device that can be instructed to carry out an arbitrary set of arithme)c or logical opera)ons automaPcally 9/27/16 Matni, CS16, Fa16 4 Computer SoFware • The collecPon of programs used by a computer, and includes: – ApplicaPons – Translators (compilers) – System Managers (drivers, other OS components) 9/27/16 Matni, CS16, Fa16 5 5 Main Components to Computers • Inputs • Outputs • Processor • Main memory – Usually inside the computer, volaPle • Secondary memory – More permanent memory for mass storage of data 9/27/16 Matni, CS16, Fa16 6 Computer Memory • Usually organized in two parts: – Address • Where can I find my data? – Data (payload) • What is my data? • The smallest representaPon of the data – A binary bit (“0”s and “1”s) – A common collecPon of bits is a byte (8 bits = 1 byte) 9/27/16 Matni, CS16, Fa16 7 What is the Most Basic Form of Computer Language? • Binary a.k.a Base-­‐2 • Expressing data AND instrucPons in either “1” or “0” – So, “01010101 01000011 01010011 01000010 00100001 00100001” could mean an instruc-on to “calculate 2 + 3” Or it could
    [Show full text]
  • 2004 Annual Report
    2004 Annual Report NATIONAL ACADEMY OF ENGINEERING ENGINEERING THE FUTURE NATIONAL ACADEMY OF ENGINEERING 2101 Constitution Avenue, NW Washington, DC 20418 www.nae.edu 1 Letter from the President 3 In Service to the Nation 3 Mission Statement 4 Program Reports The National Academy of Sciences is a private, non- 4 Engineering Education profit, self-perpetuating society of distinguished schol- 4 ars engaged in scientific and engineering research, Center for the Advancement of Scholarship on dedicated to the furtherance of science and technolo- Engineering Education gy and to their use for the general welfare. Upon the 5 authority of the charter granted to it by the Congress in Technological Literacy 1863, the Academy has a mandate that requires it to 6 Public Understanding of Engineering advise the federal government on scientific and techni- cal matters. Dr. Ralph J. Cicerone is president of the Media Relations National Academy of Sciences. Public Relations The National Academy of Engineering was established Developing Effective Messages Project in 1964, under the charter of the National Academy of Great Achievements Website Sciences, as a parallel organization of outstanding 8 engineers. It is autonomous in its administration and in Engineering Ethics the selection of its members, sharing with the National 8 Diversity in the Engineering Workforce Academy of Sciences the responsibility for advising the 11 federal government. The National Academy of Engi- Frontiers of Engineering neering also sponsors engineering programs aimed at Lillian M. Gilbreth Lectureships for Young Engineers meeting national needs, encourages education and 12 research, and recognizes the superior achievements of Engineering and the Health Care System engineers.
    [Show full text]
  • Optimizing a Bank of Kalman Filters for Navigation Integrity
    Air Force Institute of Technology AFIT Scholar Theses and Dissertations Student Graduate Works 3-2021 Optimizing a Bank of Kalman Filters for Navigation Integrity Luis E. Sepulveda Follow this and additional works at: https://scholar.afit.edu/etd Part of the Computer Sciences Commons, and the Navigation, Guidance, Control and Dynamics Commons Recommended Citation Sepulveda, Luis E., "Optimizing a Bank of Kalman Filters for Navigation Integrity" (2021). Theses and Dissertations. 4908. https://scholar.afit.edu/etd/4908 This Thesis is brought to you for free and open access by the Student Graduate Works at AFIT Scholar. It has been accepted for inclusion in Theses and Dissertations by an authorized administrator of AFIT Scholar. For more information, please contact [email protected]. Optimizing Banks of Kalman Filters for Navigation Integrity using Parallel Computing and Efficient Software Design THESIS Luis E. Sepulveda, Captain, USAF AFIT-ENG-MS-21-M-079 DEPARTMENT OF THE AIR FORCE AIR UNIVERSITY AIR FORCE INSTITUTE OF TECHNOLOGY Wright-Patterson Air Force Base, Ohio DISTRIBUTION STATEMENT A APPROVED FOR PUBLIC RELEASE; DISTRIBUTION UNLIMITED. The views expressed in this document are those of the author and do not reflect the official policy or position of the United States Air Force, the United States Department of Defense or the United States Government. This material is declared a work of the U.S. Government and is not subject to copyright protection in the United States. AFIT-ENG-MS-21-M-079 OPTIMIZING BANKS OF KALMAN FILTERS FOR NAVIGATION INTEGRITY USING PARALLEL COMPUTING AND EFFICIENT SOFTWARE DESIGN THESIS Presented to the Faculty Department of Electrical and Computer Engineering Graduate School of Engineering and Management Air Force Institute of Technology Air University Air Education and Training Command in Partial Fulfillment of the Requirements for the Degree of Master of Science in Computer Science Luis E.
    [Show full text]
  • About C++ And... Few More Things
    INTERVIEW Bjarne Stroustrup About C++ and... few more things Bjarne Stroustrup: Born December 30, 1950 in Århus, ( Denmark) He is a computer scientist, most notable for the creation and the development of the widely used C++ programming language. He is currently Professor and holder of the College of Engineering Chair in Computer Science at Texas A&M University C++ is undoubtedly one of the most successful two papers from the ACM History of Programming Lan- programming languages of our era. I know guages conference (HOPL). They are available from my You heard this question many times but today, publications page. looking from almost 30 years perspective, could you say what are in your opinion the What about C compatibility? Is C greatest advantages and disadvanta ges of compatibility a good for C++? this language? From today’s perspective what I decided to build C++ on the fo undation of some exi- would you change/redesign in C++? sting programming language. Si mula67 set an example by There are two ways of approaching this question: building on Algol and I really didn’t want to re-invent the wheel and make the usual set of beginner’s mistakes. I ne- • If I had a time machine and could go back to 1979 eded to build on a systems programming language becau- and start over, what would I have done differently? se my aim was to deal with the increasing complexity of • What would I like to change today? system programs arising from the huge increase in pro- cessor speeds and memory capacities.
    [Show full text]
  • The Political Ascendance of the English Language in Computer Programming
    Talking to Machines: The Political Ascendance of the English Language in Computer Programming by Ejilayomi Mimiko B.A. (History), Simon Fraser University, 2018 Extended Essay Submitted in Partial Fulfillment of the Requirements for the Degree of Master of Arts in the School of Communication (Dual Degree Program in Global Communication) Faculty of Communication, Art and Technology © Ejilayomi Mimiko 2019 SIMON FRASER UNIVERSITY Summer 2019 Copyright in this Work rests With the author. Please ensure that any reproduction or re-use is done in accordance With the relevant national copyright legislation. Approval Name: Ejilayomi Mimiko Degree: Master of Arts Title: Talking to Machines: The Political Ascendance of the English Language in Computer Programming Supervisory Committee: Program Director Katherine Reilly, Professor Yuezhi Zhao Senior Supervisor Professor Katherine Reilly Program Director Associate Professor Date Approved: 29th August, 2019. ii Abstract This essay explores possible reasons Why English has become the "default" natural language from Which programming commands are borroWed. Programming languages like C, C++, Java and Python use English keywords exclusively. The essay explores the social factors that underlie this phenomenon and how traditional poWer hierarchies are perpetuated. The essay is a critical response to the emancipatory rhetoric that ushered in the creation and popularization of the digital computer. It uses the story of ALGOL project to illustrate how technical goals are shaped by social factors Which inevitably reify inequality into technological artefacts. ALGOL, an attempt to create a standardized machine independent universal programming language, While answering a significant amount of technical questions, did not bridge the natural language gap. By Way of historical exploration, I argue this result is an expression of American globalization of the computing industry.
    [Show full text]
  • The Design of C++0X Reinforcing C++’S Proven Strengths, While Moving Into the Future
    Bjarne Stroustrup The Design of C++0x Reinforcing C++’s proven strengths, while moving into the future nce or twice a day, I get e-mail sug- about every computer and operation system to teach and most programmers would settle gesting improvements to C++ [1, 2]. there is, work in just about every application into a small zone of comfort eschewing most O Many suggestions are good in the area there is, and in every country on earth. new features. It would be extremely difficult sense that if one became part of the language This implies a diversity of needs and wishes, to maintain the zero-overhead principle, partly or the Standard Library, it would make life and to me it implies that the further evolution because the implementation effort would be easier for a large number of programmers. must be guided by a set of general principles immense, partly because the implementation The suggestions are, of course, not all unique, to avoid accidentally damaging a of different features would interact, and partly so my suggestion collection contains “only” subcommunity in the quest for improvements because many suggestions don’t consider a hundred or so good ideas. The count de- for some other subcommunity. performance and rely on elaborate runtime pends on how you cluster related suggestions. In this article, I examine the main principles mechanisms. This, of course, presupposes that You can see an incomplete list of suggested we use to guide the development of C++0x, the implementer community would accept language features at http://www.research.att the next version of the C++ Standard.
    [Show full text]
  • Computer List 2011
    w.e.f. Sep.15, 2011 13 No. LIST COMPUTER SCIENCE AND IT CHARTS COMPUTER PIONEERSCOMPUTER PIONEERS Size: 12”X18”Laminated and Framed on Board OR Size: 20”X26” Laminated and attached with Strips Size: 20”X26”Laminated and Framed on Board PIONEERS CONTRIBUTIONS SCP 61 Charles Babbage Father of Computer SCP 62 Blasis Pascal First Mechanical Calculator SCP 63 Ada Augusta The First programmer SCP 64 William Bill Gates Founder of Microsoft SCP 65 Thomas J Watson Founder of IBM DCP 11 John Cocke The concept of the Reduced Instruction Set Computer (RISC). DCP 12 Douglas C. Engelbart In Developing the Mouse as a Input Device, DCP 13 Bob Frankston Advancing the utility of Personal Computers DCP 14 Carver Mead Pioneering the automation, methodology and teaching of integrated circuit design. DCP 15 Ken Olsen For his introduction of the Minicomputer. DCP 16 Pickette Wayne D Inventor of the Principle of CPU on Chip DCP 17 Dr. Vinton G. Cerf Father of internet DCP 18 Bob Kahn Developed the TCP/IP DCP 21 Ken Thompson The Unix Operating System, and for development of the c Programming Language. DCP 24 Paterson Tim Developer of DOS DCP 25 Dennis Ritchie Pioneered the C Programming Language DCP 26 Bjarne Stroustrup Pioneered the C++ Programming Language DCP 27 James Gosling Developed the Java Programming Language DCP 28 Brendan Eich Creator of Java Script DCP 29 Larry Ellison In Developing Oracle DCP 31 William (Bill) Coleman Pioneer of Symantec DCP 32 Michael Saul Dell Founder of Dell DCP 33 Mr. Raj Saraf Founder of Zenith Computers DCP 34 Azim Prem Ji Founder of Wipro Computers DCP 35 N.
    [Show full text]