The Significant Properties of Software: a Study

Total Page:16

File Type:pdf, Size:1020Kb

The Significant Properties of Software: a Study The Significant Properties of Software: A Study Brian Matthews, Brian McIlwrath, David Giaretta, Esther Conway STFC Rutherford Appleton Laboratory Chilton OX11 0QX UK December 2008 Significant Properties of Software Revision History: Version Date Authors Sections Affected / Comments 0.1 18/02/2008 BMM Outline 0.5 05/03/2008 BMM First Draft 0.6 09/03/2008 DG DG added section on OAIS/CASPAR 0.7 11/03/2008 BMM Added section on StarLink + revisions. 0.8 23/03/2008 BMcI, EC, BMM Expanded use cases 1.0 28/03/2008 BMM, BMcI First Complete release version 1.1 23/12/2008 BMM Final Revision 2 Significant Properties of Software Executive Summary ...................................................................................................... 5 Recommendations ..................................................................................................................... 6 1 Background to the Study ....................................................................................... 9 1.1 Introduction ................................................................................................................... 9 1.2 Significant Properties .................................................................................................. 10 2 Scope of Study .................................................................................................... 12 2.1 Definition of Software ................................................................................................ 12 2.2 Diversity of Software .................................................................................................. 12 2.3 Scope of Study ............................................................................................................ 14 2.4 Methodology ............................................................................................................... 16 3 Digital Preservation of Software ........................................................................... 18 3.1 What is software preservation? ................................................................................... 18 3.2 Why preserve software? .............................................................................................. 19 3.2.1 Museums and Archives ........................................................................................... 19 3.2.2 Preserve a complete record of work ........................................................................ 21 3.2.3 Preserving the data .................................................................................................. 21 3.2.4 Handling Legacy ..................................................................................................... 22 3.3 The nature of software artefacts .................................................................................. 22 4 Software Engineering .......................................................................................... 24 4.1 Introduction ................................................................................................................. 24 5 Frameworks for Software Preservation ................................................................ 26 5.1 The Role of Software in Approaches to Digital Preservation ..................................... 26 5.1.1 OAIS ....................................................................................................................... 26 5.1.2 CASPAR ................................................................................................................. 29 5.2 Virtualisation and Software Emulation ....................................................................... 29 5.2.1 Basic virtualisation .................................................................................................. 30 5.2.2 Virtualisation and Software Preservation ............................................................... 31 5.2.3 Planets and Dioscuri ............................................................................................... 31 5.3 Existing Software Repositories ................................................................................... 33 5.4 Classification Schemes for Software .......................................................................... 33 5.5 SourceForge and CCPForge ....................................................................................... 34 6 Case Studies of Software Developments ............................................................ 36 6.1 BADC ......................................................................................................................... 36 6.1.1 On the fly provision of processed data ................................................................... 37 6.1.2 Generic Analysis tools ............................................................................................ 38 6.1.3 Met Office Ported Unified Model ........................................................................... 43 6.1.4 Data Set Specific software tools and scripts ........................................................... 44 6.2 NAG ............................................................................................................................ 45 6.2.1 Maintaining the NAG Library ................................................................................ 46 6.2.2 Documenting the NAG Library .............................................................................. 47 6.2.3 Lessons for Software Preservation .......................................................................... 48 6.3 Astronomical Analysis Software – Starlink ................................................................ 48 6.3.1 Astronomical Software ........................................................................................... 48 6.3.2 Introduction to Starlink ........................................................................................... 49 6.3.3 Principle Features .................................................................................................... 50 7 Conceptual Framework ........................................................................................ 58 7.1 Software Preservation Approach ................................................................................ 58 7.2 Performance Model and Adequacy ............................................................................. 59 3 Significant Properties of Software 7.2.1 Performance of software and data ........................................................................... 61 7.3 A Conceptual Model for Software .............................................................................. 62 7.3.1 The Software System .............................................................................................. 63 7.3.2 Software Components ............................................................................................. 66 8 Significant Properties of Software ........................................................................ 69 8.1 Categories of Significant Properties ........................................................................... 69 8.1.1 Package Properties .................................................................................................. 72 8.1.2 Version Properties ................................................................................................... 72 8.1.3 Variant Properties ................................................................................................... 73 8.1.4 Download Properties ............................................................................................... 74 8.2 Component Properties ................................................................................................. 74 8.3 An example of Significant Properties: Xerces ............................................................ 75 9 Conclusions and Recommendations ................................................................... 79 9.1 Conclusions of Study .................................................................................................. 79 9.2 Recommendations ....................................................................................................... 81 Acknowledgements ..................................................................................................... 82 References.................................................................................................................. 83 Appendix A: An OWL Ontology for Significant Properties of Software ........................ 84 Appendix B: Questions to Analyse Software Preservation Practices .......................... 93 Significant Properties of Software .......................................................................................... 93 Outline Questions ....................................................................................................... 94 More detailed questions .............................................................................................. 94 1 What Performance/Behaviour does your current user(s) expect from this software and what needs preserving? .................................................................................................................... 94 2 What information do you provide to a new user, and what support do you give them during their use of the software? .......................................................................................................
Recommended publications
  • CFITSIO User's Reference Guide
    CFITSIO User’s Reference Guide An Interface to FITS Format Files for C Programmers Version 3.3 HEASARC Code 662 Goddard Space Flight Center Greenbelt, MD 20771 USA February 2013 ii Contents 1 Introduction 1 1.1 ABriefOverview .................................. ... 1 1.2 Sources of FITS Software and Information . ........... 1 1.3 Acknowledgments................................. ..... 2 1.4 LegalStuff ....................................... 4 2 Creating the CFITSIO Library 5 2.1 BuildingtheLibrary .............................. ...... 5 2.1.1 UnixSystems................................... 5 2.1.2 VMS......................................... 7 2.1.3 WindowsPCs.................................... 7 2.1.4 MacintoshPCs .................................. 7 2.2 TestingtheLibrary............................... ...... 8 2.3 LinkingProgramswithCFITSIO . ....... 9 2.4 Using CFITSIO in Multi-threaded Environments . ............ 9 2.5 GettingStartedwithCFITSIO . ....... 10 2.6 ExampleProgram .................................. 10 3 A FITS Primer 13 4 Programming Guidelines 15 4.1 CFITSIODefinitions............................... ..... 15 4.2 Current Header Data Unit (CHDU) . ...... 17 4.3 Function Names and Variable Datatypes . .......... 18 4.4 Support for Unsigned Integers and Signed Bytes . ............ 20 4.5 Dealing with Character Strings . ......... 22 iii iv CONTENTS 4.6 ImplicitDataTypeConversion . ........ 23 4.7 DataScaling ..................................... 23 4.8 SupportforIEEESpecialValues . ........ 24 4.9 Error Status Values and the
    [Show full text]
  • The Starlink Build System SSN/78.1 —Abstract I
    SSN/78.1 Starlink Project Starlink System Note 78.1 Norman Gray, Peter W Draper, Mark B Taylor, Steven E Rankin 11 April 2005 Copyright 2004-5, Council for the Central Laboratory of the Research Councils Copyright 2007, Particle Physics and Astronomy Research Council Copyright 2007, Science and Technology Facilities Council The Starlink Build System SSN/78.1 —Abstract i Abstract This document provides an introduction to the Starlink build system. It describes how to use the Starlink versions of the GNU autotools (autoconf, automake and libtool), how to build the software set from a checkout, how to add and configure new components, and acts as a reference manual for the Starlink-specific autoconf macros and Starlink automake features. It does not describe the management of the CVS repository in detail, nor any other source maintainance patterns. It should be read in conjunction with the detailed build instructions in the README file at the top of the source tree (which takes precedence over any instructions in this document, though there should be no major disagreements), and with sun248, which additionally includes platform-specific notes. Copyright 2004-5, Council for the Central Laboratory of the Research Councils Copyright 2007, Particle Physics and Astronomy Research Council Copyright 2007, Science and Technology Facilities Council ii SSN/78.1—Contents Contents 1 Introduction 1 1.1 Quick entry-points . 2 2 Tools 3 2.1 Overview of the Autotools . 3 2.1.1 Autoconf . 5 2.1.2 Automake . 9 2.1.3 Libtool . 13 2.1.4 Autoreconf: why you don’t need to know about aclocal .
    [Show full text]
  • KING-MPIA-DOC-DET-004 Short Title KING 70 Cm Rocon Issue 2.169 Date June 18, 2021
    KING { 70cm Telescope { RoCon Software Manual Doc. No. KING-MPIA-DOC-DET-004 Short Title KING 70 cm Rocon Issue 2.169 Date June 18, 2021 Prepared . .Richard . .J. Mathar . .. .([email protected], . .382) . .June . 18, . .2021 . Name Date Signature Approved ...................................................................N. Surname Name Date Signature Released . .N. Surname . Name Date Signature ii KING-MPIA-DOC-DET-004 { KING 70 cm Rocon { Issue 2.169 Change Record Issue Date Sect. Reason/Initiation/Documents/Remarks 1.055 2020-02-24 all created 2.169 June 18, 2021 all SVN version 44M KING-MPIA-DOC-DET-004 { KING 70 cm Rocon { Issue 2.169 iii Contents 1 OVERVIEW 1 1.1 Acronyms..........................................1 1.2 References..........................................2 2 OBSERVER 2 2.1 Basics of Operation.....................................2 2.2 Info pages..........................................2 2.3 Prerequisites........................................ 19 2.3.1 ccdread....................................... 19 2.3.2 Temperature log.................................. 22 2.4 FITS output........................................ 22 2.5 Temperatures........................................ 23 2.6 PyRAF........................................... 24 2.7 Jupyter........................................... 24 2.8 Pointing Model....................................... 25 2.8.1 Refractive index.................................. 25 2.8.2 Model Fit...................................... 26 2.9 Dome Slit Model.....................................
    [Show full text]
  • A Cpu-Gpu Framework for Astronomical Data Reduction and Analysis
    UNIVERSIDAD DE CHILE FACULTAD DE CIENCIAS F´ISICAS Y MATEMATICAS´ DEPARTAMENTO DE CIENCIAS DE LA COMPUTACION´ FADRA: A CPU-GPU FRAMEWORK FOR ASTRONOMICAL DATA REDUCTION AND ANALYSIS TESIS PARA OPTAR AL GRADO DE MAG´ISTER EN CIENCIAS, MENCION´ COMPUTACION´ FRANCISCA ANDREA CONCHA RAM´IREZ PROFESOR GU´IA: MAR´IA CECILIA RIVARA ZU´NIGA~ PROFESOR CO-GU´IA: PATRICIO ROJO RUBKE MIEMBROS DE LA COMISION:´ ALEXANDRE BERGEL JOHAN FABRY GONZALO ACUNA~ LEIVA Este trabajo ha sido parcialmente financiado por Proyecto FONDECYT 1120299 SANTIAGO DE CHILE 2016 Resumen Esta tesis establece las bases de FADRA: Framework for Astronomical Data Reduction and Analysis. El framework FADRA fue dise~nadopara ser eficiente, simple de usar, modular, expandible, y open source. Hoy en d´ıa,la astronom´ıaes inseparable de la computaci´on,pero algunos de los software m´asusados en la actualidad fueron desarrollados tres d´ecadasatr´asy no est´andise~nadospara enfrentar los actuales paradigmas de big data. El mundo del software astron´omicodebe evolucionar no solo hacia pr´acticasque comprendan y adopten la era del big data, sino tambi´enque est´enenfocadas en el trabajo colaborativo de la comunidad. El trabajo desarollado consisti´oen el dise~no e implementaci´onde los algoritmos b´asicos para el an´alisisde datos astron´omicos, dando inicio al desarrollo del framework. Esto con- sider´ola implementaci´onde estructuras de datos eficientes al trabajar con un gran n´umero de im´agenes,la implementaci´onde algoritmos para el proceso de calibraci´ono reducci´onde im´agenesastron´omicas,y el dise~noy desarrollo de algoritmos para el c´alculode fotometr´ıay la obtenci´onde curvas de luz.
    [Show full text]
  • ORAC-DR: Overview and General Introduction 4.1-0 SUN/230.6 —Abstract Ii
    SUN/230.6 Starlink Project Starlink User Note 230.6 Frossie Economou, Tim Jenness, Malcolm Currie, Andy Adamson, Alasdair Allan, Brad Cavanagh Joint Astronomy Centre, Hilo, Hawaii June 2004 Copyright c 1997-2004 Particle Physics and Astronomy Research Council ORAC-DR: Overview and General Introduction 4.1-0 SUN/230.6 —Abstract ii Abstract ORAC-DR is a general purpose automatic data reduction pipeline environment. It currently supports data reduction for the United Kingdom Infrared Telescope (UKIRT) instruments UFTI, IRCAM, UIST and CGS4, for the James Clerk Maxwell Telescope (JCMT) instrument SCUBA, for the William Herschel Telescope (WHT) instrument INGRID, for the European Southern Observatory (ESO) instrument ISAAC and for the Anglo-Australian Telescope (AAT) instrument IRIS-2. This document describes the general pipeline environment. For specific information on how to reduce the data for a particular instrument, please consult the appropriate ORAC-DR instrument guide. Copyright c 1997-2004 Particle Physics and Astronomy Research Council iii SUN/230.6—Contents Contents 1 Introduction to ORAC-DR 1 2 ORAC-DR 2 3 Setting up to run oracdr 4 4 ORAC-DR Components 5 5 Xoracdr 6 6 oracdr 12 7 oracdr_monitor 18 8 ORAC-DR 20 9 Release Notes 21 A The ORAC-DR Data Loops 22 B The ORAC-DR Display System 23 C The ORAC-DR Calibration Selection 28 D Shell Variables 30 E oracdisp 32 F oracdr_nuke 33 1 SUN/230.6 —Introduction to ORAC-DR 1 Introduction to ORAC-DR An ORAC-DR HowTo. Description This document gives a general introduction to the pipeline, what it does and what it will not do.
    [Show full text]
  • News from the Society for Astronomical Sciences
    eu News from the Society for Astronomical Sciences Vol. 14 No.3 (November, 2016) Getting Ready for SAS- 2017 The 2017 SAS Symposium will be held on June 15-16-17, 2017, at the Ontario Airport Hotel. There will be Work- shops on topics of interest to the small-telescope research community, Technical Papers on research results and project plans, and our Sponsors will have new products on display. The SAS Program Committee is pre- paring the details of the Symposium and looking into some new features. Here’s what you can start doing now: Block the dates (June 15-16-17, 2017) on your calendar. Make travel reservations. Keep working on your projects, and decide which one you would like to present. Start preparing your Abstract Invite your colleagues who are interested in small-telescope re- Reminders ... search activities. Membership Renewal: Even if you Workshop Videos: Video recordings of can’t attend the annual Symposium, most of the Workshops from recent years are available from SAS. If you Kudos or Criticisms? we value your support of the Society for Astronomical Sciences, and your were registered for the Workshop, then the recording is free. If you were not a We are looking forward to seeing re- interest in small-telescope science. registered attendee, then the price is sults on a wide diversity of projects You can renew your membership on $50 per workshop. Contact Bob and objects at SAS-2017! If you have the SAS website (SocAstroSci.org), by Buchheim ([email protected]) for any questions or ideas for the Sympo- going to the MEMBERSHIP/REGISTRATION the details.
    [Show full text]
  • Ucam Installation Manual
    UCam Installation Manual Version 0.3 Stewart McLay 5th March 2010 Acknowledgements Professor Vikram Dhillon who was P.I. for the UltraCam instrument the project from which UCam was born. The UCam development team has involved several members of UK ATC staff. Valuable contributions were made by: David Atkinson, Steven Beard, Derek Ives, Stewart McLay, Chris Tierney and Andy Vick. The Enhanced Machine Controller (EMC) project for their knowledge base wiki which has been a valuable source of information for installing RTAI on Debian Linux. 2 Table of Contents 1Introduction........................................................................................................................................5 1.1About UltraCam..........................................................................................................................5 1.2About ARC Controller................................................................................................................5 1.3About UK Astronomy Technology Centre.................................................................................6 1.4Acronyms And Abbreviations.....................................................................................................6 1.5Stylistic Conventions..................................................................................................................6 2How To Install Debian Linux.............................................................................................................8 2.1Debian Releases..........................................................................................................................8
    [Show full text]
  • ORAC-DR: a Generic Data Reduction Pipeline Infrastructure✩
    Astronomy and Computing 9 (2015) 40–48 Contents lists available at ScienceDirect Astronomy and Computing journal homepage: www.elsevier.com/locate/ascom Full length article ORAC-DR: A generic data reduction pipeline infrastructureI Tim Jenness ∗, Frossie Economou 1 Joint Astronomy Centre, 660 N. A`ohok¯ u¯ Place, Hilo, HI 96720, USA article info a b s t r a c t Article history: ORAC-DR is a general purpose data reduction pipeline system designed to be instrument and observatory Received 5 September 2014 agnostic. The pipeline works with instruments as varied as infrared integral field units, imaging arrays Accepted 27 October 2014 and spectrographs, and sub-millimeter heterodyne arrays and continuum cameras. This paper describes Available online 1 November 2014 the architecture of the pipeline system and the implementation of the core infrastructure. We finish by discussing the lessons learned since the initial deployment of the pipeline system in the late 1990s. Keywords: ' 2014 The Authors. Published by Elsevier B.V. Data reduction pipelines This is an open access article under the CC BY license Techniques: miscellaneous Methods: data analysis (http://creativecommons.org/licenses/by/3.0/). 1. Introduction The Observatory Reduction and Acquisition Control Data Re- duction pipeline (orac-dr; Cavanagh et al., 2008; Economou et al., In the early 1990s each instrument delivered to the United King- 1999; ascl:1310.001) was the resulting system. In the sections that dom Infrared Telescope (UKIRT) and the James Clerk Maxwell Tele- follow we present an overview of the architectural design and scope (JCMT) came with its own distinct data reduction system that then describe the pipeline implementation.
    [Show full text]
  • Data Reduction Helpdesk First Responder Guidelines Kathleen Labrie
    Data Reduction Helpdesk First Responder Guidelines Kathleen Labrie Science Users Support Department V2.0 – 14 November 2019 Revision History V1.0 – 16 January 2018 Kathleen Labrie V1.1 – 12 March 2018 Kathleen Labrie V2.0 – 14 November 2019 Kathleen Labrie Document ID: DPSG-USER-101_DRHDFirstResponderGuidelines Document Purpose This document aims to help the Tier 1 assignee respond to the data reduction tickets in a manner that will gather the necessary information for understanding and debugging the problem reported by the users in a timely manner. Intended Audience This document is intended primarily for Tier 1 Data Reduction Helpdesk assignee, who are often NGO members. Members of the Science Users Support Department new to handling data reduction tickets should also read this. Table of Contents 1. Introduction ............................................................................................................................. 2 2. Preparations – Assembling your First-aid Kit .......................................................................... 2 2.1 Choosing a platform ....................................................................................................... 2 2.2 AstroConda .................................................................... Error! Bookmark not defined. 2.3 IRAF and Gemini IRAF .................................................................................................. 3 2.3.1 IRAF ..........................................................................................................................
    [Show full text]
  • Book of Abstracts 2009 European Week of Astronomy and Space
    rs uvvwxyuzyws { yz|z|} rsz}~suzywsu}u~w vz~wsw 456789@A C 99D 7EFGH67A7I P @AQ R8@S9 RST9AS9 UVWUX `abcdUVVe fATg96GTHP7Eh96HE76QGiT69pf q rAS76876@HTAs tFR u Fv wxxy @AQ 4FR 4u Fv wxxy UVVe abbc d dbdc e f gc hi` ij ad bch dgcadabdddc c d ac k lgbc bcgb dmg agd g` kg bdcd dW dd k bg c ngddbaadgc gabmob nb boglWad g kdcoddog kedgcW pd gc bcogbpd kb obpcggc dd kfq` UVVe c iba ! " #$%& $' ())01023 Book of Abstracts – Table of Contents Welcome to the European Week of Astronomy & Space Science ...................................................... iii How space, and a few stars, came to Hatfield ............................................................................... v Plenary I: UK Solar Physics (UKSP) and Magnetosphere, Ionosphere and Solar Terrestrial (MIST) ....... 1 Plenary II: European Organisation for Astronomical Research in the Southern Hemisphere (ESO) ....... 2 Plenary III: European Space Agency (ESA) .................................................................................. 3 Plenary IV: Square Kilometre Array (SKA), High-Energy Astrophysics, Asteroseismology ................... 4 Symposia (1) The next era in radio astronomy: the pathway to SKA .............................................................. 5 (2) The standard cosmological models - successes and challenges .................................................. 17 (3) Understanding substellar populations and atmospheres: from brown dwarfs to exo-planets .......... 28 (4) The life cycle of dust ...........................................................................................................
    [Show full text]
  • Pyraf FAQ Pyraf Pyraf FAQ
    1/12/2018 PyRAF FAQ PyRAF PyRAF FAQ Last edited: 6 Jan 2017. 0. Support Status Due to reduced budgets for HST, we can only provide minimal pyraf support. If you have a problem that cannot be solved quickly by our first tier support, we may be unable to help. This is unfortunate, but it is the best we can do with the resources available. 1. Installation 1.1. How do I download and install PyRAF? 1.2. I am on a Mac. Can I use PyRAF with/without running X11? 1.3. Can I run PyRAF without IRAF? 1.4. What are the errors about Python.h / numpy.h ? 1.5. Can I run PyRAF with the 64-bit version of IRAF (v2.15.*)? 1.6. Does PyRAF run on OSX Mountain Lion (10.8)? 1.7. How do I run PyRAF on Windows? 1.8. Does PyRAF work under Python 3? 1.9. What is "X11/X.h: No such file or directory"? 1.10. Does PyRAF work within IPython Notebook? 1.11. Do you support other downloads of PyRAF? 2. Startup 2.1. How do I execute a Python script during startup? 2.2. How can I make my PyRAF session start up faster? 2.3. Why do I get messages about the "CL script cache" when I start up? 2.4. Why does PyRAF fail on startup with a message about togl.so? 2.5. How can I tell PyRAF that I want to run without graphics? 2.6. Why do I see "Could not import aqutil"? What's that? 2.7.
    [Show full text]
  • Advanced Bash-Scripting Guide
    Advanced Bash−Scripting Guide An in−depth exploration of the art of shell scripting Mendel Cooper <[email protected]> 4.0 18 June 2006 Revision History Revision 3.8 26 Feb 2006 Revised by: mc 'BLAEBERRY' release: Minor Update. Revision 3.9 15 May 2006 Revised by: mc 'SPICEBERRY' release: Minor Update. Revision 4.0 18 May 2006 Revised by: mc 'WINTERBERRY' release: Major Update. This tutorial assumes no previous knowledge of scripting or programming, but progresses rapidly toward an intermediate/advanced level of instruction . all the while sneaking in little snippets of UNIX® wisdom and lore. It serves as a textbook, a manual for self−study, and a reference and source of knowledge on shell scripting techniques. The exercises and heavily−commented examples invite active reader participation, under the premise that the only way to really learn scripting is to write scripts. This book is suitable for classroom use as a general introduction to programming concepts. The latest update of this document, as an archived, bzip2−ed "tarball" including both the SGML source and rendered HTML, may be downloaded from the author's home site. A pdf version is also available. See the change log for a revision history. Dedication For Anita, the source of all the magic Advanced Bash−Scripting Guide Table of Contents Chapter 1. Why Shell Programming?...............................................................................................................1 Chapter 2. Starting Off With a Sha−Bang.......................................................................................................3
    [Show full text]