Tribits Lifecycle Model Version
Total Page:16
File Type:pdf, Size:1020Kb
SANDIA REPORT SAND2012-0561 Unlimited Release Printed February 2012 TriBITS Lifecycle Model Version 1.0 A Lean/Agile Software Lifecycle Model for Research-based Computational Science and Engineering and Applied Mathematical Software Roscoe A. Bartlett Michael A. Heroux James M. Willenbring Prepared by Sandia National Laboratories Albuquerque, New Mexico 87185 and Livermore, California 94550 Sandia National Laboratories is a multi-program laboratory managed and operated by Sandia Corporation, a wholly owned subsidiary of Lockheed Martin Corporation, for the U.S. Department of Energys National Nuclear Security Administration under Contract DE-AC04-94AL85000. Approved for public release; further dissemination unlimited. Issued by Sandia National Laboratories, operated for the United States Department of Energy by Sandia Corporation. NOTICE: This report was prepared as an account of work sponsored by an agency of the United States Government. Neither the United States Government, nor any agency thereof, nor any of their employees, nor any of their contractors, subcontractors, or their employees, make any warranty, express or implied, or assume any legal liability or responsibility for the accuracy, completeness, or usefulness of any information, apparatus, product, or process disclosed, or rep- resent that its use would not infringe privately owned rights. Reference herein to any specific commercial product, process, or service by trade name, trademark, manufacturer, or otherwise, does not necessarily constitute or imply its endorsement, recommendation, or favoring by the United States Government, any agency thereof, or any of their contractors or subcontractors. The views and opinions expressed herein do not necessarily state or reflect those of the United States Government, any agency thereof, or any of their contractors. Printed in the United States of America. This report has been reproduced directly from the best available copy. Available to DOE and DOE contractors from U.S. Department of Energy Office of Scientific and Technical Information P.O. Box 62 Oak Ridge, TN 37831 Telephone: (865) 576-8401 Facsimile: (865) 576-5728 E-Mail: [email protected] Online ordering: http://www.osti.gov/bridge Available to the public from U.S. Department of Commerce National Technical Information Service 5285 Port Royal Rd Springfield, VA 22161 Telephone: (800) 553-6847 Facsimile: (703) 605-6900 E-Mail: [email protected] Online ordering: http://www.ntis.gov/help/ordermethods.asp?loc=7-4-0#online NT O E F E TM N R E A R P G E Y •D • U N A I C T I E R D E S M T A ATES OF ii SAND2012-0561 Unlimited Release Printed February 2012 TriBITS Lifecycle Model Version 1.0 A Lean/Agile Software Lifecycle Model for Research-based Computational Science and Engineering and Applied Mathematical Software Roscoe A. Bartlett Oak Ridge National Laboratory ∗ P.O. Box 2008 Oak Ridge, TN 37831 Michael A. Heroux James M. Willenbring Sandia National Laboratories y P.O. Box 5800 Albuquerque, NM 87185-1320 Abstract Software lifecycles are becoming an increasingly important issue for computational science & engineering (CSE) software. The process by which a piece of CSE software begins life as a set of research requirements and then matures into a trusted high-quality capability is both commonplace and extremely challenging. Although an implicit lifecycle is obviously being used in any effort, the challenges of this process{respecting the competing needs of research vs. production{cannot be overstated. Here we describe a proposal for a well-defined software lifecycle process based on modern Lean/Agile software engineering principles. What we propose is appropriate for many CSE software projects that are initially heavily focused on research but also are expected to eventually produce usable high-quality capabilities. The model is related to TriBITS, a build, integration and testing system, which serves as a strong foundation for this lifecycle model, and aspects of this lifecycle model are ingrained in the TriBITS system. Here, we advocate three to four phases or maturity levels that address the appropriate handling of many issues associated with the transition from research to production software. ∗Oak Ridge National Laboratory is Managed by UT-Battelle, a partnership of the University of Tennessee and Battelle Memorial Institute, for United States Department of Energy under Contract DE-AC05-00OR22725. ySandia National Laboratories is a multi-program laboratory managed and operated by Sandia Corporation, a wholly owned subsidiary of Lockheed Martin Corporation, for the U.S. Department of Energys National Nuclear Security Administration under Contract DE-AC04-94AL85000. iii The goals of this lifecycle model are to better communicate maturity levels with customers and to help to identify and promote Software Engineering (SE) practices that will help to improve productivity and produce better software. An important collection of software in this domain is Trilinos, which is used as the motivation and the initial target for this lifecycle model. However, many other related and similar CSE (and non-CSE) software projects can also make good use of this lifecycle model, especially those that use the TriBITS system. Indeed this lifecycle process, if followed, will enable large-scale sustainable integration of many complex CSE software efforts across several institutions. iv Acknowledgments The authors would like to acknowledge the ASC and CASL programs for supporting TriBITS development. v Contents 1 Introduction and Background........................................................... 1 2 Common Implicit Model: A Validation-Centric Approach............................... 2 3 Current Baseline State for TriBITS projects............................................. 3 4 Overview of the TriBITS Software Lifecycle Model...................................... 4 5 Self-Sustaining Open-Source Software: Defined.......................................... 8 6 Regulated Backward Compatibility...................................................... 11 6.1 The Paradox of Backward Compatibility and Constantly Changing Agile Software.. 11 6.2 The Need for Backward Compatibility....................................... 12 6.3 The Cost of Maintaining Backward Compatibility............................. 12 6.4 Regulated Backward Compatibility: Defined.................................. 14 6.5 Regulated Backward Compatibility: Details.................................. 15 7 Detailed Discussion of the Proposed Lifecycle Stages.................................... 19 7.1 Exploratory............................................................ 19 7.2 Research Stable......................................................... 19 7.3 Production Growth...................................................... 21 7.4 Production Maintenance.................................................. 23 7.5 End of life?............................................................. 23 8 Software Usefulness Maturity and Lifecycle Phases...................................... 24 9 Risk Analysis and Acceptance Testing................................................... 24 10 Comparison to a Typical CSE Lifecycle Model.......................................... 27 11 Grandfathering of Existing Code and Unspecified Maturity.............................. 27 12 Summary and Next Steps............................................................... 30 References................................................................................. 31 Appendix A Comparison to the Trilinos Lifecycle Model 1.0.......................................... 32 B Implementation of the Lifecycle Model in the TriBITS System........................... 35 vi 1 Introduction and Background Computational Science and Engineering (CSE) is experiencing a challenge in software lifecycle issues. Much software in CSE begins development as research software but at some point begins to be used in other software and it is desired (or it is expected) to eventually achieve production-quality. There is currently no sufficient software engineering lifecycle model defined for these types of CSE software that has been shown to be effective. A previous attempt to create a viable lifecycle model for CSE can be seen in the Trilinos Lifecycle Model [17]. This Trilinos lifecycle model provides for transitions of CSE software from research, to production, to maintenance (and later death). Since then we have been learning more effective techniques for software engineering. This present lifecycle model reflects what has been learned. The goals for defining a lifecycle model for CSE (as managed by the TriBITS system for example) are many, but the most important include: • Allow Exploratory Research to Remain Productive: By not requiring more practices than are necessary for doing basic research in early phases, researchers maintain maximum productivity. • Enable Reproducible Research: By considering the minimal but critical software quality aspects needed for producing credible research, algorithm researches will produce better research that will stand a better chance of being published in quality journals that require reproducible research. • Improve Overall Development Productivity: By focusing on the right SE practices at the right times, and the right priorities for a given phase/maturity level, developers can work more productively with as little overhead as reasonably possible. • Improve Production Software Quality: By focusing on foundational issues first in early-phase development, higher-quality