The Lessons of Open Source for Historians

Total Page:16

File Type:pdf, Size:1020Kb

The Lessons of Open Source for Historians Think Piece Open Source’s Lessons for Historians Nathan L. Ensmenger University of Pennsylvania Of all the developments in the recent history of comput- methods are also the best in a larger social, moral, and ing, none has attracted such widespread attention as the political sense. As Steven Weber suggests in his excellent emergence of the open-source software movement. In part, book The Success of Open Source, “Technical discussions [in this is due to the remarkable successes of such open-source the open-source community] on how things should work projects as Linux, Sendmail, and Apache. Versions of the and should be done are intimately related to beliefs about GNU/Linux operating system are used by 40 percent of and reflections on social practices”2 Open-source projects large American corporations, 65 percent of the world’s Web represent an idealized vision of democracy in action—run servers run Apache, and Sendmail manages 80 percent of by volunteers and organized only on an informal, ad hoc the world’s email. Even traditional commercial vendors basis; decisions are made by consensus rather than decree. such as IBM, Apple, and Novell have jumped on the open- Project participants are independent agents—often wide- source bandwagon; the Macintosh OS X operating system ly distributed geographically—who communicate largely is based on a BSD derivative, and IBM recently announced through email and newsgroups. There are no scheduled a $1 billion commitment to open-source development.1 meetings, no rigid job descriptions or organized division Despite these apparent successes, however, the lessons of labor, no managerial hierarchies or process controls. of the open-source movement are not necessarily those In short, open-source development projects seem to that its proponents might hope or imagine. They suggest ignore almost all the supposed lessons of modern indus- more about new methods and questions for historians to trial manufacturing. By radically altering the social and grapple with than obvious conclusions about a new “one political organization of software development, open best way” to manage software development. source seemingly solves some of the most intractable problems that have plagued the software industry over The various meanings of “openness” the last several decades. Theological debates about the At its most basic, open source refers simply to software intricacies of intellectual property law and licensing that is made publicly available as uncompiled source schemes aside, the open-source movement is about new code. Such openness is unusual but hardly unprecedent- ways of managing complex development projects. ed. There can be compelling reasons for making source Increasingly, this applies not only to software; the open- code available, even in competitive commercial environ- source model has been extended (in theory) to include a ments in which intellectual property rights are generally wide range of problem domains. fiercely protected. After all, secrets are just one way of pro- It is easy to see why the open-source movement has tecting intellectual property; there are others, equally attracted so much popular and scholarly attention. It is common and effective. at once political, social, and technical. By freely giving In popular usage, however, the designation of open away valuable intellectual property, open-source devel- source is often used to refer to software that is not just opers turn on its head one of the fundamental assump- open but also free. Free software, in this case, refers to tions that neoclassical economists make about basic software source code that is both publicly available and human motivation. As seemingly self-organizing com- free (mostly) of license and copyright restrictions. In gen- munities, they suggest interesting new ways for ethnog- eral, the only restrictions imposed are designed to assure raphers and political scientists to think about the process that it continues to remain unrestricted. Finally, software of self-governance. Also, as part of the anti-Microsoft that is free (of licensing restrictions) is often also made movement, they represent hope to those who resent large available free of cost. Most often when people talk about corporate monopolies and the constraints (and expens- open-source software they are referring to projects that es) of propriety software systems. For programmers and are simultaneously open, free, and free of charge. engineers feeling trapped by cubicles and bureaucracy, The appeal and power of open-source software goes open source is an opportunity for creativity, autonomy, beyond these notions of openness and freedom, however. and self respect. For everyone else, open source offers up The open-source philosophy is as much about process as colorful stories full of eccentrics, underdogs, and 20-year- it is product. Although advocates argue that open-source old billionaires. In many ways, the open-source move- methods produce the best software in technical terms (in ment has become a kind of Rorschach blot in which large part because it can harness the many eyes of a larger everyone sees what they are already looking for. community to develop, test, and debug software), these continued on p. 102 104 IEEE Annals of the History of Computing Published by the IEEE Computer Society 1058-6180/04/$20.00 © 2004 IEEE Think Piece unbundling decision, that software developed into a packaged product. In the mainframe In many ways, open source world, purchasing software was often as much about consulting services and support as it was can only be understood as the actual application code. The emergence of a market for closed-source, packaged software the most recent chapter was not an obvious or inevitable development; like most other developments in the history of in a long-running debate computing, it is the result of complex histori- cal processes playing out in a larger social, tech- that encompasses the nical, legal, and economic environment.4 In this light, open-source software is part of a con- entire history of tinuum of possible configurations of technolo- gy, markets, and intellectual property regimes, software development. rather than a radical departure from some nat- ural arrangement. Second, what is often seen as the open- continued from p. 104 source movement’s most distinctive character- istic—its seamless blending of technical, social, The future of open source’s past and political agendas—has been a central fea- Despite the open-source movement’s diverse ture of the history of software since at least the appeal (or perhaps because of it), the literature 1950s. Developing good software is notorious- on the subject is still immature. Much of it is ly difficult, and the central themes of the per- ahistorical and lacking in context, is written by sistent “software crisis” that has plagued the advocates, and is therefore uncritical or takes industry since the early 1960s are as much too seriously such vague notions as “self organ- social as they are technical: izing” or “gift economies.” Let me therefore suggest two potential contributions that the • the problem of managing complexity and history of computing can make to understand- communications within large organizations; ing open-source development lessons and spec- • the difficulties inherent in negotiating ulate on several ways in which historians could between business and technical objectives; in turn benefit from this discussion. and First of all, much of the literature on open • the rising costs associated with user support, source emphasizes its radical break with the training, documentation, and maintenance. dominant model of closed-source, proprietary, packaged commercial software. Although this Open-source advocates are not the first to rec- model might dominate in the modern PC soft- ognize the social and organization dimensions ware market, it is by no means universal, par- of this crisis. A widely cited 1968 article by ticularly if we are looking across the entire Melvin Conway argued that a system’s archi- history of electronic computing. In fact, the tecture reflects the communications structure very notion of software is a historically con- of the organization that produced it.5 Frederick structed category. Although the term itself has Brooks’ 1975 classic book The Mythical Man- been around since the 1850s, it was first applied Month described the failure of the OS/360 to computing only in the late 1950s. It was not software development project as one of organ- until the 1960s that it became widely adopted, ization and communication.6 The solutions to and even then, it was often used to refer to sys- these problems proposed in this earlier period tems software (later operating systems) rather might not have been so explicitly social and than applications. What little commercial soft- political as open source, but every effort to ware that was available from outside vendors (as establish a software component’s factory, a opposed to being developed in-house) was gen- chief programmer team, or a new software erally bundled with hardware and was therefore engineering methodology carried with it not purchased as such. deeply embedded assumptions about organiza- In the first decades of electronic computing, tional structure, professional status and author- even software developed internally was often ity, and individual autonomy. freely distributed (in both meanings of the Are software developers skilled professionals word) by user groups such as SHARE (IBM) and or factory laborers? Active participants in the the Univac Scientific Exchange (USE).3 It was planning and design process, or mere subordi- not until the late 1960s, with the IBM nates to managers and analysts? Is computer 102 IEEE Annals of the History of Computing programming art, science, or routinized indus- References and notes trial work? In many ways, open source can only 1. S. Weber, The Success of Open Source, Harvard be understood as the most recent chapter in a Univ. Press, 2004. long-running debate that encompasses the 2.
Recommended publications
  • Retrocomputing As Preservation and Remix
    Retrocomputing as Preservation and Remix Yuri Takhteyev Quinn DuPont University of Toronto University of Toronto [email protected] [email protected] Abstract This paper looks at the world of retrocomputing, a constellation of largely non-professional practices involving old computing technology. Retrocomputing includes many activities that can be seen as constituting “preservation.” At the same time, it is often transformative, producing assemblages that “remix” fragments from the past with newer elements or joining together historic components that were never combined before. While such “remix” may seem to undermine preservation, it allows for fragments of computing history to be reintegrated into a living, ongoing practice, contributing to preservation in a broader sense. The seemingly unorganized nature of retrocomputing assemblages also provides space for alternative “situated knowledges” and histories of computing, which can sometimes be quite sophisticated. Recognizing such alternative epistemologies paves the way for alternative approaches to preservation. Keywords: retrocomputing, software preservation, remix Recovering #popsource In late March of 2012 Jordan Mechner received a shipment from his father, a box full of old floppies. Among them was a 3.5 inch disk labelled: “Prince of Persia / Source Code (Apple) / ©1989 Jordan Mechner (Original).” Mechner’s announcement of this find on his blog the next day took the world of nerds by storm.1 Prince of Persia, a game that Mechner single-handedly developed in the late 1980s, revolutionized computer games when it came out due to its surprisingly realistic representation of human movement. After being ported to DOS and Apple’s Mac OS in the early 1990s the game sold 2 million copies (Pham, 2001).
    [Show full text]
  • The Past, Present, and Future of Software Evolution
    The Past, Present, and Future of Software Evolution Michael W. Godfrey Daniel M. German Software Architecture Group (SWAG) Software Engineering Group School of Computer Science Department of Computer Science University of Waterloo, CANADA University of Victoria, CANADA email: [email protected] email: [email protected] Abstract How does our system compare to that of our competitors? How easy would it be to port to MacOS? Are users still Change is an essential characteristic of software devel- angry about the spyware incident? As new features are de- opment, as software systems must respond to evolving re- vised and deployed, as new runtime platforms are envis- quirements, platforms, and other environmental pressures. aged, as new constraints on quality attributes are requested, In this paper, we discuss the concept of software evolu- so must software systems continually be adapted to their tion from several perspectives. We examine how it relates changing environment. to and differs from software maintenance. We discuss in- This paper explores the notion of software evolution. We sights about software evolution arising from Lehman’s laws start by comparing software evolution to the related idea of software evolution and the staged lifecycle model of Ben- of software maintenance and briefly explore the history of nett and Rajlich. We compare software evolution to other both terms. We discuss two well known research results of kinds of evolution, from science and social sciences, and we software evolution: Lehman’s laws of software evolution examine the forces that shape change. Finally, we discuss and the staged lifecycle model of Bennett and Rajlich. We the changing nature of software in general as it relates to also relate software evolution to biological evolution, and evolution, and we propose open challenges and future di- discuss their commonalities and differences.
    [Show full text]
  • A Brief History of Software Engineering Niklaus Wirth ([email protected]) (25.2.2008)
    1 A Brief History of Software Engineering Niklaus Wirth ([email protected]) (25.2.2008) Abstract We present a personal perspective of the Art of Programming. We start with its state around 1960 and follow its development to the present day. The term Software Engineering became known after a conference in 1968, when the difficulties and pitfalls of designing complex systems were frankly discussed. A search for solutions began. It concentrated on better methodologies and tools. The most prominent were programming languages reflecting the procedural, modular, and then object-oriented styles. Software engineering is intimately tied to their emergence and improvement. Also of significance were efforts of systematizing, even automating program documentation and testing. Ultimately, analytic verification and correctness proofs were supposed to replace testing. More recently, the rapid growth of computing power made it possible to apply computing to ever more complicated tasks. This trend dramatically increased the demands on software engineers. Programs and systems became complex and almost impossible to fully understand. The sinking cost and the abundance of computing resources inevitably reduced the care for good design. Quality seemed extravagant, a loser in the race for profit. But we should be concerned about the resulting deterioration in quality. Our limitations are no longer given by slow hardware, but by our own intellectual capability. From experience we know that most programs could be significantly improved, made more reliable, economical and comfortable to use. The 1960s and the Origin of Software Engineering It is unfortunate that people dealing with computers often have little interest in the history of their subject.
    [Show full text]
  • The History of Computing in the History of Technology
    The History of Computing in the History of Technology Michael S. Mahoney Program in History of Science Princeton University, Princeton, NJ (Annals of the History of Computing 10(1988), 113-125) After surveying the current state of the literature in the history of computing, this paper discusses some of the major issues addressed by recent work in the history of technology. It suggests aspects of the development of computing which are pertinent to those issues and hence for which that recent work could provide models of historical analysis. As a new scientific technology with unique features, computing in turn can provide new perspectives on the history of technology. Introduction record-keeping by a new industry of data processing. As a primary vehicle of Since World War II 'information' has emerged communication over both space and t ime, it as a fundamental scientific and technological has come to form the core of modern concept applied to phenomena ranging from information technolo gy. What the black holes to DNA, from the organization of English-speaking world refers to as "computer cells to the processes of human thought, and science" is known to the rest of western from the management of corporations to the Europe as informatique (or Informatik or allocation of global resources. In addition to informatica). Much of the concern over reshaping established disciplines, it has information as a commodity and as a natural stimulated the formation of a panoply of new resource derives from the computer and from subjects and areas of inquiry concerned with computer-based communications technolo gy.
    [Show full text]
  • An Overview of Software Evolution
    An Overview of Software Evolution CPRE 416-Software Evolution and Maintenance-Lecture 2 1 Software Evolution • What is it? • How important is it? • What to do about it? 2 An early history of software engineering • The following slides provide a condensation of the ideas of Robert L. Glass in his book "In the Beginning: Recollections of Software Pioneers" about the history of software engineering. 3 The Pioneering Era (1955-1965) • New computers were coming out every year or two. • Programmers did not have computers on their desks and had to go to the "machine room". • Jobs were run by signing up for machine time. Punch cards were used. • Computer hardware was application-specific. Scientific and business tasks needed different machines. 4 The Pioneering Era (1955-1965) • High-level languages like FORTRAN, COBOL, and ALGOL were developed. • No software companies were selling packaged software. • Academia did not yet teach the principles of computer science. 5 The Stabilizing Era (1965-1980) • Came the IBM 360. • This was the largest software project to date. • The 360 also combined scientific and business applications onto one machine. 6 The Stabilizing Era (1965-1980) • Programmers had to use the job control language (JCL) to tell OS what to do. • PL/I, introduced by IBM to merge all programming languages into one, failed. • The notion of timesharing emerged. • Software became a corporate asset and its value became huge. • Academic computing started in the late 60's. • Software engineering discipline did not yet exist. 7 The Stabilizing Era (1965-1980) • High-hype disciplines like Artificial Intelligence emerged.. • Structured Programming burst on the scene.
    [Show full text]
  • The History of Unix in the History of Software Haigh Thomas
    The History of Unix in the History of Software Haigh Thomas To cite this version: Haigh Thomas. The History of Unix in the History of Software. Cahiers d’histoire du Cnam, Cnam, 2017, La recherche sur les systèmes : des pivots dans l’histoire de l’informatique – II/II, 7-8 (7-8), pp77-90. hal-03027081 HAL Id: hal-03027081 https://hal.archives-ouvertes.fr/hal-03027081 Submitted on 9 Dec 2020 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. 77 The History of Unix in the History of Software Thomas Haigh University of Wisconsin - Milwaukee & Siegen University. You might wonder what I am doing The “software crisis” and here, at an event on this history of Unix. the 1968 NATO Conference As I have not researched or written about on Software Engineering the history of Unix I had the same question myself. But I have looked at many other The topic of the “software crisis” things around the history of software and has been written about a lot by profes- this morning will be talking about how sional historians, more than anything some of those topics, including the 1968 else in the entire history of software2.
    [Show full text]
  • The Value of Source Code to Digital Preservation Strategies
    School of Information Student Research Journal Volume 2 Issue 2 Article 5 January 2013 Consider the Source: The Value of Source Code to Digital Preservation Strategies Michel Castagné The University of British Columbia, [email protected] Follow this and additional works at: https://scholarworks.sjsu.edu/ischoolsrj Part of the Library and Information Science Commons Recommended Citation Castagné, M. (2013). Consider the Source: The Value of Source Code to Digital Preservation Strategies. School of Information Student Research Journal, 2(2). https://doi.org/10.31979/2575-2499.020205 Retrieved from https://scholarworks.sjsu.edu/ischoolsrj/vol2/iss2/5 This article is brought to you by the open access Journals at SJSU ScholarWorks. It has been accepted for inclusion in School of Information Student Research Journal by an authorized administrator of SJSU ScholarWorks. For more information, please contact [email protected]. Consider the Source: The Value of Source Code to Digital Preservation Strategies Abstract One of the major challenges in the digital preservation field is the difficulty of ensuring long-term access to digital objects, especially in cases when the software that was used to create an object is no longer current. Software source code has a human-readable, documentary structure that makes it an overlooked aspect of digital preservation strategies, in addition to a valuable component for the records of modern computing history. The author surveys several approaches to software preservation and finds that, yb supporting open source initiatives, digital libraries can improve their ability to preserve access to their collections for future generations. Keywords source code, open source, digital preservation, software preservation About Author Michel Castagné is a Master of Library and Information Studies candidate at the University of British Columbia.
    [Show full text]
  • Javascript Affogato
    JavaScript Afogato: Programming a Culture of Improvised Expertise Brian Lennon Pennsylvania State University ABSTRACT: This essay attempts a philological—meaning a both technically and socially attentive—historical study of an individual computer programming language, JavaScript. From its introduction, JavaScript’s reception by software developers, and its importance in web development as we now understand it, was structured by a con- tinuous negotiation of expertise. I use the term “improvised expertise” to describe both conditions for and effects of the unanticipated de- velopment of JavaScript, originally designed for casual and inexpert coders, into a complex of technical artifacts and practices whose range and complexity of use has today propelled it into domains previously dominated by other, often older and more prestigious languages. “Im- provised expertise” also marks the conditions for and effects of three specific developmental dynamics in JavaScript’s recent history: first, the rapidly accelerated development of the language itself, in the ver- sions of its standard specification; second, the recent, abruptly emerg- ing, yet rapid growth of JavaScript in server-side networking, data pro- cessing, and other so-called back-end development tasks previously off limits to it; third, the equally recent and abrupt, yet decisive emer- gence of JavaScript as the dominant language of a new generation of dynamic web application frameworks and the developer tool chains or tooling suites that support them. Introduction 2016 was an inconspicuously transitional year for the information space once commonly referred to as the World Wide Web. Those Configurations, 2018, 26:47–72 © 2018 by Johns Hopkins University Press and the Society for Literature, Science, and the Arts.
    [Show full text]
  • A Survey of the Practice of Computational Science
    A Survey of the Practice of Computational Science Prakash Prabhu Thomas B. Jablin Arun Raman Yun Zhang Jialu Huang Hanjun Kim Nick P. Johnson Feng Liu Soumyadeep Ghosh Stephen Beard Taewook Oh Matthew Zoufaly David Walker David I. August Princeton University fpprabhu,tjablin,rarun,yunzhang,[email protected] fhanjunk,npjohnso,fengliu,soumyade,[email protected] ftwoh,mzoufaly,dpw,[email protected] ABSTRACT even for computer scientists [33]. Given this background, Computing plays an indispensable role in scientific research. this paper seeks to answer the question: How are scientists Presently, researchers in science have different problems, coping with the growing computing demands? needs, and beliefs about computation than professional pro- Recently, an online survey conducted a broad study of the grammers. In order to accelerate the progress of science, programming practices of a wide range of researchers, re- computer scientists must understand these problems, needs, vealing many potential problems encountered in correctly and beliefs. To this end, this paper presents a survey of writing scientific programs [30, 43]. Continuing in the same spirit, this paper presents an in-depth study of the practice of scientists from diverse disciplines, practicing computational 1 science at a doctoral-granting university with very high re- computational science at Princeton University, a RU/VH search activity. The survey covers many things, among institution. This study is conducted through a survey of them, prevalent programming practices within this scien- researchers from diverse scientific disciplines. This survey tific community, the importance of computational power in covers important aspects of computational science including different fields, use of tools to enhance performance and soft- programming practices commonly employed by researchers, ware productivity, computational resources leveraged, and the importance of computational power, and the perfor- prevalence of parallel computation.
    [Show full text]
  • Science Gateways: the Long Road to the Birth of an Institute
    Proceedings of the 50th Hawaii International Conference on System Sciences | 2017 Science Gateways: The Long Road to the Birth of an Institute Sandra Gesing Katherine Lawrence University of Notre Dame University of Michigan Notre Dame, USA Ann Harbor, USA Linda B. Hayden [email protected] [email protected] Elizabeth City State University Elizabeth City, USA Nancy Wilkins-Diehr Michael Zentner [email protected] University of California Purdue University San Diego, USA West Lafayette, USA [email protected] [email protected] Suresh Marru Indiana University Maytal Dahan Marlon E. Pierce Bloomington, USA University of Texas Indiana University [email protected] Austin, USA Bloomington, USA [email protected] [email protected] Abstract community-based access to shared, distributed Nowadays, research in various disciplines is enhanced resources and services - telescopes, sensor arrays, via computational methods, cutting-edge technologies supercomputers, digital repositories, software as a and diverse resources including computational service, collaboration environments, and more. infrastructures and instruments. Such infrastructures Gateways enable the formation of scientific are often complex and researchers need means to communities, accelerating and transforming the conduct their research in an efficient way without discovery process, and engaging citizens and students getting distracted with information technology in the scientific process. They represent a fundamental nuances. Science gateways address such demands and social and technological change in how science is offer user interfaces tailored to a specific community. being conducted. Creators of science gateways face a breadth of topics Since gateways form end-to-end solutions tailored and manifold challenges, which necessitate close to the communities’ needs, the creators of science collaboration with the domain specialists but also gateways are concerned with a diversity of topics and calling in experts for diverse aspects of a science have to tackle various challenges.
    [Show full text]
  • Brief History of Computer and Their Application
    Brief History Of Computer And Their Application Displeased and well-meant Mort parbuckle her aerodynes wale or ceases globularly. Ira is lubberly transformative after disquisitional Knox rook his fibs cumulatively. Unblissful Silvester exonerating some funnel-webs and unknit his etherealisation so anes! From adversely affecting other and their instructions Apple computer history of applications emerge that you can be used. The computer industry to their cursor control readers are needed networking, special offers color monitor. Among computer and computational physics, and users could play a military. She is history of application to search and brief history of software that honour goes further. In computer industry might already gone their appreciation to calculate predicted tide levels. This and application may request that he began working in bedrock and his machine to continuously. This brief content and their locations and card, are partially sponsored by comparing long does cctv solutions more. In their way to left to store one application, practical use buffers that could now about greater speed and forwarding of computable. Still be hosted within a computer system level format on their computers. Nothing could perform addition to applications include the history of computable functions of. Zuse and its use and history of computer and brief sketch of. In a universal use similar experiments and brief history. As computer history, computing applications written in brief history of application software that. Languages in europe, you hear about greater amount of application of computer history and brief, helped their use today, microsoft windows xp, the unix as the routers in these data that.
    [Show full text]
  • SHORT HISTORY of SOFTWARE METHODS by David F. Rico This Short History Identifies 32 Major Classes of Software Methods That Have Emerged Over the Last 50 Years
    SHORT HISTORY OF SOFTWARE METHODS by David F. Rico This short history identifies 32 major classes of software methods that have emerged over the last 50 years. There are many variations of each major class of software method, which renders the number of software methods in the hundreds. This short history contains a brief synopsis of each of the 32 major classes of software methods, identifying the decade and year they appeared, their purpose, their major tenets, their strengths, and their weaknesses. The year each software method appeared corresponds to the seminal work that introduced the method based on extensive bibliographic research and the strengths and weaknesses were based on scholarly and empirical works to provide an objective capstone for each method. Mainframe Era Midrange Era Microcomputer Era Internet Era Personalized Era 1960s 1970s 1980s 1990s 2000s Flowcharting Structured Design Formal Specification Software Estimation Software Reliability Iterative/Incremental Software Inspections Structured Analysis Software Testing Configuration Control Quality Assurance Project Management Defect Prevention Process Improvement CASE Tools Object Oriented Software Reuse Rapid Prototyping Concurrent Lifecycle Software Factory Domain Analysis Quality Management Risk Management Software Architecture Software Metrics Six Sigma Buy versus Make Personal Processes Product Lines Synch-n-Stabilize Team Processes Agile Methods Market Conditions Market Conditions Market Conditions Market Conditions Market Conditions y Mainframe computer y Computer
    [Show full text]