DOCSLIB.ORG

The IBM PERCS Project: Hardware-Software Co

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
The IBM PERCS Project: Hardware-Software Co The IBM PERCS Project: Hardware- Software Co-design of a Supercomputer for High Programmer Productivity Kemal Ebcioglu Co-leader, Programming Model and Tools Area IBM PERCS Project IBM Research Email: [email protected] This work has been supported in part by the Defense Advanced Research Projects Agency (DARPA) under contract No. NBCH30390004 Disclaimer The research material described in this presentation implies no commitment regarding future IBM software or hardware products. WASP 2005 Keynote Kemal Ebcioglu September 22, 2005 2 PERCS Programming Model & Tools Team X10 PERCS Productivity – Philippe Charles – Catalina Danis – Chris Donawa – Christine Halverson – Kemal Ebcioglu – Wendy Kellogg – Christian Grothoff – Allan Kielstra University partners – Christoph von Praun – MIT – Vijay Saraswat – Purdue University – Vivek Sarkar – UC Berkeley PERCS Tools – U. Delaware – Marina Biberstein – U. Illinois – Bill Chung – U. Pittsburgh – Robert Fuhrer – UT Austin – Matthias Hauswirth – Vanderbilt University – Eugen Nistor – Peter Sweeney Leads – Beth Tibbitts – Mootaz Elnozahy (PERCS Principal Investigator) – Frank Tip – Rama Govindaraju (IBM STG software lead) – Mandana Vaziri – Vivek Sarkar, Kemal Ebcioglu (IBM Research PERCS – Justin Xue Programming Model & Tools leads) WASP 2005 Keynote Kemal Ebcioglu September 22, 2005 3 Talk outline Programming productivity trends in HPC Overview of PERCS project and X10 language Productivity experiments with X10 PERCS hardware-software co-design research agenda – Programmer productivity features – Scalability/performance features – Virtualization features Summary and future challenges WASP 2005 Keynote Kemal Ebcioglu September 22, 2005 4 Programming productivity trends in High Performance Computing Step function breakthroughs in productivity have historically occurred rarely, with fierce natural selection – Fortran; “structured programming” in early days – Integrated Debugging Environments – Safe OO programming – Re-usable components and model-based design – Separation of concerns-Aspect oriented programming (jury still out) The HPC community has stayed behind advances in commercial software engineering – C/C++/Fortran/MPI – command line tools – Very performance driven: functionality and performance concerns often tangled – Modern HPC machine complexities lead to expertise gap: • Only a small percentage of employees are able to produce HPC software on a deadline • [Sarkar, Williams, Ebcioglu 2004] WASP 2005 Keynote Kemal Ebcioglu September 22, 2005 5 Productivity crisis in future scalable computing systems Memory wall: Severe non- Frequency wall: Multiple layers of uniformities in bandwidth & hierarchical heterogeneous latency in memory hierarchy parallelism to compensate for slowdown in frequency scaling Proc Cluster Proc Cluster Clusters (scale-out) PEs, PEs, PEs, PEs, SMP L1 $ . L1 $ L1 $ . L1 $ . Multiple cores on a chip L2 Cache L2 Cache Coprocessors (SPUs) . SMTs SIMD ILP Attempting to overcome these . L3 Cache . obstacles in a 10^5 processor Memory future system reduces productivity: - Lengthen SW life cycle - Increase in expertise gap WASP 2005 Keynote Kemal Ebcioglu September 22, 2005 6 High Productivity Computing Systems (slide from DARPA) Goal: ¾ Provide a new generation of economically viable high productivity computing systems for the national security and industrial user community (2010) Impact: z Performance (time-to-solution): speedup critical national security applications by a factor of 10X to 40X z Programmability (idea-to-first-solution): reduce cost and time of developing application solutions z Portability (transparency): insulate research and operational application software from system z Robustness (reliability): apply all known techniques to protect against outside attacks, hardware faults, & HPCS Program Focus Areas programming errors Applications: z Intelligence/surveillance, reconnaissance, cryptanalysis, weapons analysis, airborne contaminant modeling and biotechnology FillFill thethe CriticalCritical TechnologyTechnology andand CapabilityCapability GapGap TodayToday (late(late 80’s80’s HPCHPC technology)…..technology)…..toto…..Future…..Future (Quantum/Bio(Quantum/Bio Computing)Computing) Overview of IBM PERCS Project PERCS: DARPA-sponsored hardware-software project – 10X productivity improvement – grand challenge – Multi-petaflop performance – more than 100K processors – Commercial viability as an IBM product – Project addresses all levels of hardware-software stack: from circuits to programming model The PERCS productivity strategy – New programming model for scalability and productivity, with embodiment in X10 language – Integrated tools for reduced time-to-solution, built on open- source Eclipse framework – Productivity model and measurement tools, with a focus on addressing the expertise gap WASP 2005 Keynote Kemal Ebcioglu September 22, 2005 8 X10 design goals (productivity) By design, X10 aims to rule out large classes of bugs – Building on proven baseline OO productivity features: • Type safety, memory safety, pointer safety, portability, maintainability – New X10 language features help avoid concurrency errors: e.g. eliminating deadlock with X10 clocks (generalized barriers) Concise specification of distributed aggregate operations – For rapid prototyping Language features for productivity, e.g.: – Atomic sections • Free the programmer from the complexity of lock management – Rooted exception model: • Handling errors from deeply nested parallel asynchronous activities – Integrated fine grain parallelism inside a place and across places • Going beyond the SPMD model Ability to re-use legacy software components Eclipse based tool chain for race detection, refactoring, performance optimization, visualization WASP 2005 Keynote Kemal Ebcioglu September 22, 2005 9 X10 Design Goals (scalability) Aiming to scale X10 programs to O(10^5) threads – Language constructs for explicitly programming non-uniform data accesses • Performance transparency for remote accesses – Ability to specify high degrees of asynchronous parallelism – Scalable memory consistency and synchronization primitives – Automatic and semi-automatic performance optimization based on dynamic feedback • Continuous Program Optimization WASP 2005 Keynote Kemal Ebcioglu September 22, 2005 10 An X10 example program: (HPC Challenge) RandomAccess public boolean run() { dist D = dist.factory.block([0:TABLE_SIZE-1]); Allocate and initialize Table as a final long[.] Table = new long[D] (point [i]) { return i; } block-distributed array. final long[.] RanStarts = new long[dist.factory.unique()] Allocate and initialize RanStarts with (point [i]) { return starts(i*N_UPDATES_PER_PLACE);}; one random number seed for each final long value[.] SmallTable= place. new long value[[0:TABLE_SIZE-1]] (point [i]) {return i*S_TABLE_INIT;}; Allocate a small immutable table that can be copied to all places. finish ateach (point [i] : RanStarts ) { Everywhere in parallel, repeatedly long ran = nextRandom(RanStarts[i]); generate random Table indices and for (point [count]: [1:N_UPDATES_PER_PLACE]) { atomically read/modify/write Table final int J = f(ran); element. final long K = SmallTable[g(ran)]; async (D[J]) atomic Table[J] ^= K; ran = nextRandom(ran); } } return Table.sum() == EXPECTED_RESULT; } WASP 2005 Keynote Kemal Ebcioglu September 22, 2005 11 Current X10 Status and Schedule X10 status and schedule 6/2003 PERCS programming model concept 2/2004 Kickoff of X10 as concrete embodiment of PERCS Prog Model 7/2004 First draft of X10 language specification 2/2005 First (unoptimized) X10 prototype – reference implementation 7/2005 X10 application and productivity studies 3Q2005 Start participation in High Productivity Language “consortium” 1/2006 Second (optimized) X10 prototype 6/2006 Open source release of X10 reference implementation Structure of X10 reference implementation Code X10 Templates X10 Multithreaded Grammar Annotated Target RTS AST Native AST Java code Parser Analysis passes Code emitter JVM X10 source PEM Events WASP 2005 Keynote Kemal Ebcioglu September 22, 2005 12 Productivity experiments with X10 Major study involving 27 subjects, 05/23/2005 – 05/27/2005 – Mostly CS and Science students at Pittsburgh Supercomputing Center Sequence alignment problem in bio-informatics (SSCA#1) – Suggested by David Bader, and refined by PSC bio-informatics experts – Given the sequential version of the code, parallelize it. Three conditions studied on a 3000-processor Alpha supercomputer (lemieux) at PSC – C+MPI – X10 (Parallel execution through emulation only) – UPC 4.5 day experiment – Two days of tutorials taught by experts, hands-on exercises – Two days of coding under observation (both human observation and automated recording of activity) – ½ day exit interview Experiment professionally run by the IBM Research Social Computing Group and PSC team. – Subjects anonymous to the technical team, known as X1, X2,… – All interactions were recorded. … Feedback from study now influencing x10 language and tools design – Unique approach to validating and improving language and tools productivity WASP 2005 Keynote Kemal Ebcioglu September 22, 2005 13 Development Time (slide from PSC team) MPI and UPC both exhibited Development time from the first serial run (if performed) or larger maximum and median parallel construct to the first correct parallel output (where obtained) or to end (where no parallel output obtained) times to correct parallel outputs. Variability of development times for
Load more

Recommended publications
  • Writing Quality Software
    Writing Quality Software About this white paper: This whitepaper was written by David C. Young, an employee of General Dynamics Information Technology (GDIT). Dr. Young is part of a team of GDIT employees who maintain, and support high performance computing systems at the Alabama Supercomputer Center (ASC). This was written in 2020. This paper is written for people who want to write good software, but don’t have a master’s degree in software architecture (or someone managing the project who does). Much of what is here would be covered in a software development practices class, often taught at the master’s degree level. Writing quality software is not only about the satisfaction of a job well done. It is also reflects on you and your professional reputation amongst your peers. In some cases writing quality software can be a factor in getting a job, losing a job, or even life or death. Furthermore, writing quality software should be considered an implicit requirement in every software development project. If the intended useful life of the software is many years, that is yet another reason to do a good job writing it. Introduction Consider this situation, which is all too common. You have written a really neat piece of software. You put it out on github, then tell your colleagues about it. Soon you are bombarded with a series of complaints from people who tried to install, and use your software. Some of those complaints might be; • It won’t install on their version of Linux. • They did the same thing you reported, but got a different answer.
    [Show full text]
  • Studying the Feasibility and Importance of Software Testing: an Analysis
    Dr. S.S.Riaz Ahamed / Internatinal Journal of Engineering Science and Technology Vol.1(3), 2009, 119-128 STUDYING THE FEASIBILITY AND IMPORTANCE OF SOFTWARE TESTING: AN ANALYSIS Dr.S.S.Riaz Ahamed Principal, Sathak Institute of Technology, Ramanathapuram,India. Email:[email protected], [email protected] ABSTRACT Software testing is a critical element of software quality assurance and represents the ultimate review of specification, design and coding. Software testing is the process of testing the functionality and correctness of software by running it. Software testing is usually performed for one of two reasons: defect detection, and reliability estimation. The problem of applying software testing to defect detection is that software can only suggest the presence of flaws, not their absence (unless the testing is exhaustive). The problem of applying software testing to reliability estimation is that the input distribution used for selecting test cases may be flawed. The key to software testing is trying to find the modes of failure - something that requires exhaustively testing the code on all possible inputs. Software Testing, depending on the testing method employed, can be implemented at any time in the development process. Keywords: verification and validation (V & V) 1 INTRODUCTION Testing is a set of activities that could be planned ahead and conducted systematically. The main objective of testing is to find an error by executing a program. The objective of testing is to check whether the designed software meets the customer specification. The Testing should fulfill the following criteria: ¾ Test should begin at the module level and work “outward” toward the integration of the entire computer based system.
    [Show full text]
  • Reliability: Software Software Vs
    Reliability Theory SENG 521 Re lia bility th eory d evel oped apart f rom th e mainstream of probability and statistics, and Software Reliability & was usedid primar ily as a tool to h hlelp Software Quality nineteenth century maritime and life iifiblinsurance companies compute profitable rates Chapter 5: Overview of Software to charge their customers. Even today, the Reliability Engineering terms “failure rate” and “hazard rate” are often used interchangeably. Department of Electrical & Computer Engineering, University of Calgary Probability of survival of merchandize after B.H. Far （[email protected]） 1 http://www. enel.ucalgary . ca/People/far/Lectures/SENG521/ ooene MTTF is R e 0.37 From Engineering Statistics Handbook [email protected] 1 [email protected] 2 Reliability: Natural System Reliability: Hardware Natural system Hardware life life cycle. cycle. Aging effect: Useful life span Life span of a of a hardware natural system is system is limited limited by the by the age (wear maximum out) of the system. reproduction rate of the cells. Figure from Pressman’s book Figure from Pressman’s book [email protected] 3 [email protected] 4 Reliability: Software Software vs. Hardware So ftware life cyc le. Software reliability doesn’t decrease with Software systems time, i.e., software doesn’t wear out. are changed (updated) many Hardware faults are mostly physical faults, times during their e. g., fatigue. life cycle. Each update adds to Software faults are mostly design faults the structural which are harder to measure, model, detect deterioration of the and correct. software system. Figure from Pressman’s book [email protected] 5 [email protected] 6 Software vs.
    [Show full text]
  • Manual on Quality Assurance for Computer Software Related to the Safety of Nuclear Power Plants
    SIMPLIFIED SOFTWARE LIFE-CYCLE DIAGRAM FEASIBILITY STUDY PROJECT TIME I SOFTWARE P FUNCTIONAL I SPECIFICATION! SOFTWARE SYSTEM DESIGN DETAILED MODULES CECIFICATION MODULES DESIGN SOFTWARE INTEGRATION AND TESTING SYSTEM TESTING ••COMMISSIONING I AND HANDOVER | DECOMMISSION DESIGN DESIGN SPECIFICATION VERIFICATION OPERATION AND MAINTENANCE SOFTWARE LIFE-CYCLE PHASES TECHNICAL REPORTS SERIES No. 282 Manual on Quality Assurance for Computer Software Related to the Safety of Nuclear Power Plants f INTERNATIONAL ATOMIC ENERGY AGENCY, VIENNA, 1988 MANUAL ON QUALITY ASSURANCE FOR COMPUTER SOFTWARE RELATED TO THE SAFETY OF NUCLEAR POWER PLANTS The following States are Members of the International Atomic Energy Agency: AFGHANISTAN GUATEMALA PARAGUAY ALBANIA HAITI PERU ALGERIA HOLY SEE PHILIPPINES ARGENTINA HUNGARY POLAND AUSTRALIA ICELAND PORTUGAL AUSTRIA INDIA QATAR BANGLADESH INDONESIA ROMANIA BELGIUM IRAN, ISLAMIC REPUBLIC OF SAUDI ARABIA BOLIVIA IRAQ SENEGAL BRAZIL IRELAND SIERRA LEONE BULGARIA ISRAEL SINGAPORE BURMA ITALY SOUTH AFRICA BYELORUSSIAN SOVIET JAMAICA SPAIN SOCIALIST REPUBLIC JAPAN SRI LANKA CAMEROON JORDAN SUDAN CANADA KENYA SWEDEN CHILE KOREA, REPUBLIC OF SWITZERLAND CHINA KUWAIT SYRIAN ARAB REPUBLIC COLOMBIA LEBANON THAILAND COSTA RICA LIBERIA TUNISIA COTE D'lVOIRE LIBYAN ARAB JAMAHIRIYA TURKEY CUBA LIECHTENSTEIN UGANDA CYPRUS LUXEMBOURG UKRAINIAN SOVIET SOCIALIST CZECHOSLOVAKIA MADAGASCAR REPUBLIC DEMOCRATIC KAMPUCHEA MALAYSIA UNION OF SOVIET SOCIALIST DEMOCRATIC PEOPLE'S MALI REPUBLICS REPUBLIC OF KOREA MAURITIUS UNITED ARAB
    [Show full text]
  • Software Quality Assurance Activities in Software Testing
    Software Quality Assurance Activities In Software Testing Tony never synopsizing any recidivist gazetting thus, is Brooke oncogenic and insolvable enough? Monogenous Chadd externalises, his disciplinarians denudes spring-clean Germanically. Spindliest Antoni never humors so edgewise or attain any shells lyingly. Each module performs one or two tasks, and thenpasses control to another module. Perform test automation for web application using Cucumber. Identify and describe safety software procurement methods, including supplier evaluation and source inspection processes. He previously worked at IBM SWS Toronto Lab. The information maintained in status accounting should enable the rebuild of any previous baseline. Beta Breakers supports all industry sectors. Thank you save time for all the lack of that includes test software assurance and must often. Focus on demonstrating pos next column containing algorithms, activities in software quality assurance testing activities of testing programs for their findings from his piece of skills, validate features to refresh teh page object. XML data sets to simulate production, using LLdap and ALTOVA. Schedule information should be expressed as absolute dates, as dates relative to either SCM or project milestones, or as a simple sequence of events. Its scope of software quality assurance and the correct email list all testshave been completely correct, in software quality assurance activities to be precisely known about its process on a familiarity level. These exercises are performed at every step along the way in the workshop. However, you have to balance driving out quality with production value. The second step is the validation of the computer system implementation against the computer system requirements. Software development tools, whose output becomes part of the program implementation and which can therefore introduce errors.
    [Show full text]
  • Renesas' Synergy Software Quality Handbook
    User’s Manual Synergy Software Quality Handbook Notice 1. Renesas Synergy™ Platform User’s Manual Synergy Software Software Quality Assurance All information contained in these materials, including products and product specifications, represents information on the product at the time of publication and is subject to change by Renesas Electronics Corp. without notice. Please review the latest information published by Renesas Electronics Corp. through various means, including the Renesas Electronics Corp. website (http://www.renesas.com). www.renesas.com Rev. 4.0 April 2019 Synergy Software Quality Handbook Descriptions of circuits, software and other related information in this document are provided only to illustrate the operation of semiconductor products and application examples. You are fully responsible for the incorporation or any other use of the circuits, software, and information in the design of your product or system. Renesas Electronics disclaims any and all liability for any losses and damages incurred by you or third parties arising from the use of these circuits, software, or information. 2. Renesas Electronics hereby expressly disclaims any warranties against and liability for infringement or any other disputes involving patents, copyrights, or other intellectual property rights of third parties, by or arising from the use of Renesas Electronics products or technical information described in this document, including but not limited to, the product data, drawing, chart, program, algorithm, application examples. 3. No license, express, implied or otherwise, is granted hereby under any patents, copyrights or other intellectual property rights of Renesas Electronics or others. 4. You shall not alter, modify, copy, or otherwise misappropriate any Renesas Electronics product, whether in whole or in part.
    [Show full text]
  • Evaluating and Improving Software Quality Using Text Analysis Techniques - a Mapping Study
    Evaluating and Improving Software Quality Using Text Analysis Techniques - A Mapping Study Faiz Shah, Dietmar Pfahl Institute of Computer Science, University of Tartu J. Liivi 2, Tartu 50490, Estonia {shah, dietmar.pfahl}@ut.ee Abstract: Improvement and evaluation of software quality is a recurring and crucial activ- ity in the software development life-cycle. During software development, soft- ware artifacts such as requirement documents, comments in source code, design documents, and change requests are created containing natural language text. For analyzing natural text, specialized text analysis techniques are available. However, a consolidated body of knowledge about research using text analysis techniques to improve and evaluate software quality still needs to be estab- lished. To contribute to the establishment of such a body of knowledge, we aimed at extracting relevant information from the scientific literature about data sources, research contributions, and the usage of text analysis techniques for the im- provement and evaluation of software quality. We conducted a mapping study by performing the following steps: define re- search questions, prepare search string and find relevant literature, apply screening process, classify, and extract data. Bug classification and bug severity assignment activities within defect manage- ment are frequently improved using the text analysis techniques of classifica- tion and concept extraction. Non-functional requirements elicitation activity of requirements engineering is mostly improved using the technique of concept extraction. The quality characteristic which is frequently evaluated for the prod- uct quality model is operability. The most commonly used data sources are: bug report, requirement documents, and software reviews. The dominant type of re- search contributions are solution proposals and validation research.
    [Show full text]
  • Proposing a Methodology to Evaluate Usability of E-Commerce Websites: QUEM Model
    International Journal of Computer Applications (0975 – 8887) Volume 52 – No. 6, August 2012 Proposing a Methodology to Evaluate Usability of E-Commerce Websites: QUEM Model Nasrin Dehbozorgi Shahram Jafari School of e-Learning, School of Electrical and Computer Engineering Shiraz University Shiraz University ABSTRACT e-commerce websites. For customizing these characteristics In this work we propose a methodology named QUEM specifically for e-commerce websites, a wide range of usability (Quantitative Usability Evaluation Model) for quantitative guidelines and checklists were studied, which were mainly usability evaluation of e-commerce websites. Many centered on works done by Nielsen, IBM and W3G guidelines. e-commerce websites lack user friendliness. The main factor Hence, in our model -which is named QUEM model- we that prevents these firms to conduct usability testing is the high propose a generic set of sub-characteristics for evaluation of e- costs and the need for usability experts. In this work, commerce websites. ISO/IEC 9126-1:2001 quality model was selected as a basis for defining usability characteristics of our model. Based on these In the following sections we will have an overview on existing standard usability characteristics a set of usability factors is quality evaluation methods and approaches. Then the research proposed specifically for evaluation of e-commerce websites. methodology will be discussed. Finally in the experimental The usability factors of QUEM model have been extracted from result section, the presented QUEM model is applied on two a wide range of usability guidelines and checklists. Since all of e-commerce systems and their usability is assessed and the usability factors do not have the same significance in the quantified into numerical values and compared with each other.
    [Show full text]
  • Pdf: Software Testing
    Software Testing Gregory M. Kapfhammer Department of Computer Science Allegheny College [email protected] I shall not deny that the construction of these testing programs has been a major intellectual effort: to convince oneself that one has not overlooked “a relevant state” and to convince oneself that the testing programs generate them all is no simple matter. The encouraging thing is that (as far as we know!) it could be done. Edsger W. Dijkstra [Dijkstra, 1968] 1 Introduction When a program is implemented to provide a concrete representation of an algorithm, the developers of this program are naturally concerned with the correctness and performance of the implementation. Soft- ware engineers must ensure that their software systems achieve an appropriate level of quality. Software verification is the process of ensuring that a program meets its intended specification [Kaner et al., 1993]. One technique that can assist during the specification, design, and implementation of a software system is software verification through correctness proof. Software testing, or the process of assessing the func- tionality and correctness of a program through execution or analysis, is another alternative for verifying a software system. As noted by Bowen, Hinchley, and Geller, software testing can be appropriately used in conjunction with correctness proofs and other types of formal approaches in order to develop high quality software systems [Bowen and Hinchley, 1995, Geller, 1978]. Yet, it is also possible to use software testing techniques in isolation from program correctness proofs or other formal methods. Software testing is not a “silver bullet” that can guarantee the production of high quality software systems.
    [Show full text]
  • Beginners Guide to Software Testing
    Beginners Guide To Software Testing Beginners Guide To Software Testing - Padmini C Page 1 Beginners Guide To Software Testing Table of Contents: 1. Overview ........................................................................................................ 5 The Big Picture ............................................................................................... 5 What is software? Why should it be tested? ................................................. 6 What is Quality? How important is it? ........................................................... 6 What exactly does a software tester do? ...................................................... 7 What makes a good tester? ........................................................................... 8 Guidelines for new testers ............................................................................. 9 2. Introduction .................................................................................................. 11 Software Life Cycle ....................................................................................... 11 Various Life Cycle Models ............................................................................ 12 Software Testing Life Cycle .......................................................................... 13 What is a bug? Why do bugs occur? ............................................................ 15 Bug Life Cycle ............................................................................................... 16 Cost of fixing bugs .......................................................................................
    [Show full text]
  • Software Quality Understanding by Analysis of Abundant Data (SQUAAD)
    SQUAAD: Software Quality Understanding by Analysis of Abundant Data Sponsor: DASD(SE) By Mr. Pooyan Behnamghader 6th Annual SERC Doctoral Students Forum November 7, 2018 FHI 360 CONFERENCE CENTER 1825 Connecticut Avenue NW 8th Floor Washington, DC 20009 www.sercuarc.org SDSF 2018 November 7, 2018 Outline ➢ Why Is Studying Software Quality Evolution at Commit-Level Important for Systems Engineering? ➢ A Scalable and Efficient Approach for Compiling and Analyzing Commit History ○ Why Is Compilability Important? ○ Aims ○ Method ○ Research Questions ○ Data Collection ○ Results ○ Discussion of Benefits and Risks ➢ SQUAAD ○ Distribution ○ Deployments ➢ Key Takeaways Why Is Understanding Software Quality Evolution at Commit-Level Important? SLOC Code Smells Code Commit History Over a Period of 9 Years Why Is Compilability Important? ➢ Uncompilable code ○ Symptom of careless development. ○ Static bytecode analysis, and dynamic analysis. ○ Uncompilability in post-development analysis due to compilation environment issues. ➢ Compilation over commit history is a major challenge ○ Alexandru et al. (2017) declare the unavailability of the compiled versions ■ main unresolved source for the manual effort in software evolution analysis. ○ Tufano et al. (2017) mine the commit-history of 100 Apache projects ■ 62% of all commits are currently not compilable. Compilability and Commit-Level Mining Approaches Rev1 Rev2 Rev3 A Single Compile Error M1 M1 M1 Breaks the Build for the 1 1 Whole Software. 2 2 2 3 3 3 M2 M2 M2 4 4 4 9 9 5 5 5 ➢ Analyzing only impacted files M3 M3 M3 6 6 6 ○ Reduce the cost and complexity. 7 7 7 ○ Not suitable for compilation. 8 8 8 ➢ Analyzing the whole Legend software Compilable ○ Suitable for compilation.
    [Show full text]
  • Testing: First Step Towards Software Quality
    Quality in Statistics TESTING: FIRST STEP TOWARDS SOFTWARE QUALITY Quality is never an accident; it is always the result of high intention, sincere effort, intelligent direction and skillful execution; it represents the wise choice of many alternatives. (William A. Foster) Ioan Mihnea IACOB Managing Partner Qualitance QBS, Quality Consulting and Training Services Bachelor Degree in Computer Science from Polytechnic University, Bucharest, Romania CMMI 1.1. (Staged and Continuous) – course from Carnegie Mellon Software Institute E-mail: [email protected] Radu CONSTANTINESCU PhD Candidate, University Assistant Lecturer, Department of Economic Informatics University of Economics, Bucharest, Romania E-mail: [email protected] Abstract: This article’s purpose is to present the benefits of a mature approach to testing and quality activities in an engineering organization, make a case for more education with respect to software quality and testing, and propose a set of goals for quality and testing education. Key words: software testing; course curricula; quality assurance; testing tools 1. Introduction IT managers and professionals may have varied opinions about many software development principles, but most agree on one thing above all – the software you deliver must be accurate and reliable. And successful software development groups have long recognized that effective testing is essential to meeting this goal. In a recent survey of software development managers, the most often cited top-of- mind issue was software testing and quality assurance [Zeich05]1. Testing is not quality assurance—a brilliantly tested product that was badly conceived, incompetently designed and indifferently programmed will end up a well-tested, bad product. However, software testing has long been one of the core technical activities that can be used to improve the quality of software.
    [Show full text]