Investigating Emulation As a Service for Reproducible Research at Yale

Total Page:16

File Type:pdf, Size:1020Kb

Investigating Emulation As a Service for Reproducible Research at Yale Investigating Emulation as a Service for Reproducible Research at Yale Limor Peer Associate Director for Research, Yale ISPS Ethan Gates Software Preservation Analyst, YUL Librarians Building Momentum for Reproducibility A Virtual Conference January 28, 2020 Institution for Social and Policy Studies ISPS was founded in 196 as an inter! disciplinary center to support social science and public policy research at Yale "niversity# $he ISPS Data Archive provides open access to digital collections of social science e'perimental data, metadata( code, and associated files produced by ISPS researchers for the purpose of https*++isps#yale#edu+research+data replication of research findings, further analysis( and teaching# 2 ,omputational reproducibility refers to changes in scienti)c practice and reporting standards to accommodate the use of computational technology###in particular whether the same results can be obtained from the data and code used in the original study# Stodden( -# ./0112# Reproducing statistical results# &nnual Review of Statistics and Its &pplication( /.12( 1319# https*++doi#org/10#1146+annurev!statistics!010 14!0/01/5 3 %ata Quality Review 7ramewor8 7I9E RE-IE@ %OC RE-IE@ %&$& RE-IE@ ,A%E RE-IE@ Peer( 9#( :reen( &#( ; Stephenson( E# ./0142# ,ommitting to data quality review# International =ournal of %igital ,uration( 9.12# https*++doi#org/10#//1 +i>dc#v9i1#315 4 Software!dependent reproducibility problems Original code tied to legacy software 9egacy software that is no longer available Proprietary software that is difficult to pac8age with reproducibility pac8aging tools $he pac8aging runtime .e#g# %oc8er( Reprozip2 is no longer supported on modern operating systems 5 6 A -ery Special $han8s to our 7unders.## 7 Project Goal Deploy and scale infrastructure and services for software emulation, including distributed management, sharing, documentation/discovery, and access. https://www.softwarepreservationnetwork.org/eaasi 8 What is Emulation-as- a!Service .EaaS2C 9 Simpli)es access to various emulators EaaS Clockwise from top: FS-UAE (Amiga), LinApple (Apple II), VICE (Commodore), Mini vMac (Macintosh Plus), SheepShaver (PowerPC Macs), BeebEm (BBC Micro), QEMU (x86 PCs), Hatari (Atari) 10 Enables management of persistent emulation environments 11 12 Emulation-as-a! Service In development by the bwFLA team ○ at the University of Freiburg since 2011 (now commercially maintained by OpenSLX) Since 2017 CiTAR builds RDM ○ workflows to repeat, replicate, reproduce or reuse software based research on top of EaaS Since 2018 the EaaSI project 13 ○ 14 %001 7ield Date* 2006 &rchive Date: 2010 15 Approach #1: Manually “Rebuild” ,omputing Environment 16 17 Approach D/* "-I 18 19 Approach D?* ,ontainer/Pac8age Import 20 Provided by User: File system + user files Runtime configuration External dependencies Depend on: Vendor/Tool Runtime Provided by combination of Linux OS vendor and user - Hardware unstable 21 After EaaS Import: File system + user files Runtime configuration External dependencies Depend on: Generic Runtime Provided by EaaS – Linux OS Emulator stable 22 23 Than8 you! ethan#gatesIyale#edu I$heJK7AA9 limor#peerIyale#edu Il_peer https*++www.softwarepreservationnetwor8#org+eaasi https*++isps#yale#edu+research+data 24.
Recommended publications
  • How Do Fixes Become Bugs?
    How Do Fixes Become Bugs? A Comprehensive Characteristic Study on Incorrect Fixes in Commercial and Open Source Operating Systems Zuoning Yin‡, Ding Yuan‡, Yuanyuan Zhou†, Shankar Pasupathy∗, Lakshmi Bairavasundaram∗ ‡Department of Computer Science, Univ. of Illinois at Urbana-Champaign, Urbana, IL 61801, USA {zyin2, dyuan3}@cs.uiuc.edu †Department of Computer Science and Engineering, Univ. of California, San Diego, La Jolla , CA 92093, USA [email protected] ∗NetApp Inc., Sunnyvale, CA 94089, USA {pshankar, lakshmib}@netapp.com ABSTRACT Keywords: Incorrect fixes, software bugs, bug fixing, hu- Software bugs affect system reliability. When a bug is ex- man factor, testing posed in the field, developers need to fix them. Unfor- tunately, the bug-fixing process can also introduce errors, 1. INTRODUCTION which leads to buggy patches that further aggravate the damage to end users and erode software vendors’ reputa- 1.1 Motivation tion. As a man-made artifact, software suffers from various er- This paper presents a comprehensive characteristic study rors, referred to as software bugs, which cause crashes, hangs on incorrect bug-fixes from large operating system code bases or incorrect results and significantly threaten not only the including Linux, OpenSolaris, FreeBSD and also a mature reliability but also the security of computer systems. Bugs commercial OS developed and evolved over the last 12 years, are detected either during testing before release or in the investigating not only the mistake patterns during bug-fixing field by customers post-release. Once a bug is discovered, but also the possible human reasons in the development pro- developers usually need to fix it.
    [Show full text]
  • Openbsd Gaming Resource
    OPENBSD GAMING RESOURCE A continually updated resource for playing video games on OpenBSD. Mr. Satterly Updated August 7, 2021 P11U17A3B8 III Title: OpenBSD Gaming Resource Author: Mr. Satterly Publisher: Mr. Satterly Date: Updated August 7, 2021 Copyright: Creative Commons Zero 1.0 Universal Email: [email protected] Website: https://MrSatterly.com/ Contents 1 Introduction1 2 Ways to play the games2 2.1 Base system........................ 2 2.2 Ports/Editors........................ 3 2.3 Ports/Emulators...................... 3 Arcade emulation..................... 4 Computer emulation................... 4 Game console emulation................. 4 Operating system emulation .............. 7 2.4 Ports/Games........................ 8 Game engines....................... 8 Interactive fiction..................... 9 2.5 Ports/Math......................... 10 2.6 Ports/Net.......................... 10 2.7 Ports/Shells ........................ 12 2.8 Ports/WWW ........................ 12 3 Notable games 14 3.1 Free games ........................ 14 A-I.............................. 14 J-R.............................. 22 S-Z.............................. 26 3.2 Non-free games...................... 31 4 Getting the games 33 4.1 Games............................ 33 5 Former ways to play games 37 6 What next? 38 Appendices 39 A Clones, models, and variants 39 Index 51 IV 1 Introduction I use this document to help organize my thoughts, files, and links on how to play games on OpenBSD. It helps me to remember what I have gone through while finding new games. The biggest reason to read or at least skim this document is because how can you search for something you do not know exists? I will show you ways to play games, what free and non-free games are available, and give links to help you get started on downloading them.
    [Show full text]
  • How Do Fixes Become Bugs?
    How Do Fixes Become Bugs? A Comprehensive Characteristic Study on Incorrect Fixes in Commercial and Open Source Operating Systems Zuoning Yin‡, Ding Yuan‡, Yuanyuan Zhou†, Shankar Pasupathy∗, Lakshmi Bairavasundaram∗ ‡Department of Computer Science, Univ. of Illinois at Urbana-Champaign, Urbana, IL 61801, USA {zyin2, dyuan3}@cs.uiuc.edu †Department of Computer Science and Engineering, Univ. of California, San Diego, La Jolla , CA 92093, USA [email protected] ∗NetApp Inc., Sunnyvale, CA 94089, USA {pshankar, lakshmib}@netapp.com ABSTRACT Keywords: Incorrect fixes, software bugs, bug fixing, hu- Software bugs affect system reliability. When a bug is ex- man factor, testing posed in the field, developers need to fix them. Unfor- tunately, the bug-fixing process can also introduce errors, 1. INTRODUCTION which leads to buggy patches that further aggravate the damage to end users and erode software vendors’ reputa- 1.1 Motivation tion. As a man-made artifact, software suffers from various er- This paper presents a comprehensive characteristic study rors, referred to as software bugs, which cause crashes, hangs on incorrect bug-fixes from large operating system code bases or incorrect results and significantly threaten not only the including Linux, OpenSolaris, FreeBSD and also a mature reliability but also the security of computer systems. Bugs commercial OS developed and evolved over the last 12 years, are detected either during testing before release or in the investigating not only the mistake patterns during bug-fixing field by customers post-release. Once a bug is discovered, but also the possible human reasons in the development pro- developers usually need to fix it.
    [Show full text]
  • Improving Software Quality with Programming Patterns Tung Thanh Nguyen Iowa State University
    Iowa State University Capstones, Theses and Graduate Theses and Dissertations Dissertations 2013 Improving software quality with programming patterns Tung Thanh Nguyen Iowa State University Follow this and additional works at: https://lib.dr.iastate.edu/etd Part of the Computer Engineering Commons Recommended Citation Nguyen, Tung Thanh, "Improving software quality with programming patterns" (2013). Graduate Theses and Dissertations. 13576. https://lib.dr.iastate.edu/etd/13576 This Dissertation is brought to you for free and open access by the Iowa State University Capstones, Theses and Dissertations at Iowa State University Digital Repository. It has been accepted for inclusion in Graduate Theses and Dissertations by an authorized administrator of Iowa State University Digital Repository. For more information, please contact [email protected]. Improving software quality with programming patterns by Tung Thanh Nguyen A dissertation submitted to the graduate faculty in partial fulfillment of the requirements for the degree of DOCTOR OF PHILOSOPHY Major: Computer Engineering Program of Study Committee: Tien N. Nguyen, Major Professor Suraj C. Kothari Manimaran Govindarasu Akhilesh Tyagi Samik Basu Iowa State University Ames, Iowa 2013 Copyright ⃝c Tung Thanh Nguyen, 2013. All rights reserved. ii TABLE OF CONTENTS LIST OF TABLES . vi LIST OF FIGURES . vii ACKNOWLEDGEMENTS . ix ABSTRACT . xi CHAPTER 1. INTRODUCTION . 1 1.1 Software Quality Problem . 1 1.2 Reuse Practice and Reuse-related Bugs . 3 1.3 Programming Patterns . 8 1.3.1 GROUM: Graph-based object usage model . 10 1.3.2 SLAMC: Statistical semantic language model for source code . 14 1.4 Related Publications and Dissertation Outline . 16 1.4.1 Related publications .
    [Show full text]
  • Accelerating Instruction Set Emulation Using Reconfigurable Hardware
    Accelerating Instruction Set Emulation using Reconfigurable Hardware and Trace Based Optimization Andreas Erik Hindborg Kongens Lyngby 2013 IMM-MSc-2013-96 DTU Compute Technical University of Denmark Building 321, DK-2800 Kongens Lyngby, Denmark Phone +45 45253351, Fax +45 45882673 [email protected] www.compute.dtu.dk IMM-MSc-2013-96 Summary The speed of instruction set emulation is essential when researching new in- struction sets or changes to current instruction sets. It is also essential when executing programs for which the originally targeted platform is no longer avail- able. Software-based instruction set emulators are used extensively in computer ar- chitecture development. They allow researchers to evaluate performance im- plications of changes to the instruction set without going through the effort of implementing the instruction set in silicon. They also allow software devel- opers to develop and debug software for hardware architectures for which the hardware model is not yet finished. However, there is an inherent limit to the amount of instructions that can be emulated in a given time frame for emulators implemented in software. This report presents a method to implement instruction set emulation by using a reconfigurable hardware accelerator combined with a conventional processor. A significant part of the proposed system is designed and implemented. The system aims to emulate the Motorola 68000 instruction set. The hardware part of the implemented solution is capable of operating at a clock frequency of 237 MHz. ii Preface This thesis was prepared at DTU Compute at the Technical University of Den- mark in fulfilment of the requirements for acquiring an M.Sc.
    [Show full text]
  • Bygone Battles
    LINUX USER Retro-Gaming Emulating Legacy Game Platforms Bygone Battles Do you miss your trusty Sinclair Spectrum? Do you long for the Commodore you know only in your history books? Old platforms come alive using the tools of the retro-gamers. BY IAN POINTER efore the computer industry set- tled on the IBM PC, there were Bmany different types of computers with exotic-sounding names like Enter- prise, Oric, Dragon, Electron, Spectrum, and Amiga. Although these machines are no longer with us, most of these legacy systems sill have ardent fans that keep their memory alive. These fans prefer the simplicity of the older era – when pro- grams had to fit inside tiny quantities of memory and programmers had to use Gavin Banns,Gavin www.visipix.com every trick they could imagine to get the most out of a computer – to the fast processors and gigabytes storage of today. These enthusiasts are more common than you might think; the coming of the Internet has allowed people from all across the world to reminisce about the past, and for the last eight years, a Clas- can even use Linux to develop new pro- found at http://www.libsdl.org. It is sic Gaming Expo (http://www.cgexpo. grams for these old computers. probably best to download the source com) has been held in America, with and build it manually, so you can be sure exhibitions from big arcade firms like Sinclair Spectrum it doesn’t use older graphics systems like Midway and Konami, plus lectures from The Spectrum, released in 1982, was the svgalib.
    [Show full text]
  • Volume 158 March, 2020 Pclinuxos Family Hhaappppyy Member Spotlight: Tunnelrat Mind Your Step: Vintage Computing on Pclinuxos Sstt
    Volume 158 March, 2020 PCLinuxOS Family HHaappppyy Member Spotlight: tunnelrat Mind Your Step: Vintage Computing On PCLinuxOS SStt.. PPaattrriicckk''ss Short Topix: Google Chrome To Start Blocking Downloads GIMP Tutorial: DDaayy Photo Editing Revisited PCLinuxOS Recipe Corner: Chicken Gloria Casserole ms_meme's Nook: When I'm Sixty-Five A Very Bad Time For Android Apps? Or Just Cleaning Up The Mess? Racing Back To The Past: Horizon Chase Turbo On PCLinuxOS! PCLinuxOS Puzzled Partitions PCLinuxOS Magazine And more inside! Page 1 In This Issue ... 3 From The Chief Editor's Desk... 5 Mind Your Step: Vintage Computing on PCLinuxOS The PCLinuxOS name, logo and colors are the trademark of 11 Screenshot Showcase Texstar. 12 A Very Bad Time For Android Apps? The PCLinuxOS Magazine is a monthly online publication containing PCLinuxOS-related materials. It is published Or Just Cleaning Up The Mess? primarily for members of the PCLinuxOS community. The magazine staff is comprised of volunteers from the 14 PCLinuxOS Recipe Corner: Chicken Gloria Casserole PCLinuxOS community. 15 Screenshot Showcase Visit us online at http://www.pclosmag.com 16 ms_meme's Nook: Sentimental Forum This release was made possible by the following volunteers: 17 Short Topix: Google Chrome To Start Blocking Downloads Chief Editor: Paul Arnote (parnote) Assistant Editor: Meemaw 21 Screenshot Showcase Artwork: Sproggy, Timeth, ms_meme, Meemaw Magazine Layout: Paul Arnote, Meemaw, ms_meme 22 GIMP Tutorial: Photo Editing Revisited HTML Layout: YouCanToo 24 PCLinuxOS Family Member
    [Show full text]
  • Emutos and Atari 16/32 Bit Machines
    EMUTOS AND ATARI 16/32 BIT MACHINES Very briefly ;-) Christian Zietz – September 2020 1985 Atari ST • 68000 CPU @ 8 MHz • Initially 512 kB RAM, later up to 4 MB • 2 color modes and a high-res (640 x 400) monochrome mode • Initially separate floppy drive, later builtin 720k drive • MIDI Atari 1040STF – © Bill Bertram, 2006 1985 TOS • GEM UI and GEMDOS originally licensed from Digital Research • But independently developed further by Atari • Entirely in ROM • Single-task • GUI with desktop metaphor • Text mode for command line applications also available 1989 1990/1991 1992 Atari STE Atari TT & MegaSTE Atari Falcon • More colors • Workstations • 68030 • PCM sound • MegaSTE: 16 MHz, • DSP • TOS 1.06/1.62 FPU, VME bus • True-color graphics • TT: 68030, FPU, more • TOS 4 RAM, VME bus, high- res up to 1280 x 960 • TOS 2 & 3 Sea Of Colour demo by Dead Hackers Society on Atari STE Atari TT – by Tim Kovack Atari Falcon – © Wikipedia user LosHawlos 1996 1999 2001 Atari Corp. ceases Caldera releases PC EmuTOS development operations GEM under GPL begins • IP rights go to game • Shares a common • Born out of necessity: company Hasbro / ancestor with TOS bundle a legal TOS Infogrames / Atari with emulators • But they diverged • Atari TOS is still • Based on PC GEM copyrighted • E.g. restrictions code imposed by an Apple lawsuit • Own development of low level BIOS/XBIOS for Atari HW • Many improvements since! 2020: EMUTOS 1.0 What makes EmuTOS special? Supports all Atari computers and some non-Atari machines (even Amiga!) Also great for emulators, e.g., API to Aranym and Hatari Provided in many variants (ROM & RAM versions) in several languages Built-in hard disk driver with PC (FAT16) partition and filesystem support Built-in command line interface (EmuCON) Support for 3rd party hardware, e.g.
    [Show full text]
  • FS-UAE and MIDI for Bars and Pipes and Other AMIGA Midi Software
    FS-UAE and MIDI For Bars and Pipes and Other AMIGA midi Software. Written by :- Warren Vercueil Email:- [email protected] INTRODUCTION This Tutorial is dedicated to Alfred Faust and Frode Solheim. Thank you both for your innovative software and hard work. This is the first draft of this tutorial and will be expanded later on. SOFTWARE REQUIREMENTS FOR THIS TUTORIAL FS-UAE SOFTWARE Installing FS-UAE from the FS-UAE web site for:- 1. Ubuntu distributions 2. Debian 9.0 (stretch) UBUNTU Install from the FS-UAE repository Link:- https://fs-uae.net/download#ubuntu For Ubuntu, run the following commands to install FS-UAE and configure it for automatic updates: sudo apt-add-repository ppa:fengestad/stable sudo apt-get update sudo apt-get install fs-uae fs-uae-launcher fs-uae-arcade Alternatively, you can manually download .deb files instead. Debian 9.0 (stretch) For Debian 9.0, run the following as root to install FS-UAE and configure it for automatic updates: Link:- https://fs-uae.net/download#debian echo "deb http://download.opensuse.org/repositories/home:/FrodeSolheim:/stable/ Debian_9.0/ /" > /etc/apt/sources.list.d/FrodeSolheim-stable.list apt-get update apt-get install fs-uae fs-uae-launcher fs-uae-arcade To avoid security warnings when installing the packages, you can import the key used to sign the packages: wget http://download.opensuse.org/repositories/home:FrodeSolheim:stable/Debian_9.0/ Release.key apt-key add - < Release.key Alternatively, you can manually download .deb files instead. 1 KX-STUDIO I advise you to install KX-Studio software Repositories.
    [Show full text]
  • General Information Mac Os Emulator for Linux About
    Emulator Mac For Linux General information Dolphin is an emulator for Wii and GameCube developed in 2008. Most importantly, the team behind the emulator is still active even to this day. The emulator is designed to work for Mac, Windows, and Linux. Another thing that’s worth mentioning is that the emulator has a lot of documentation behind it. Apr 22, 2013 Mac-on-Mac: A port of the Mac on Linux project to Mac OS X PearPC - PowerPC Emulator PearPC is an architecture independent PowerPC platform emulator capable of running most PowerPC operating systems. Playstation 2 games is playable on PC/Linux & Mac with Emulators, There are 3 PlayStation 2/PS2 Emulators: PCSX2 (R), PS2emu, NeotrinoSX2. What is SheepShaver? SheepShaver is a MacOS run-time environment for BeOS and Linux that allows you to run classic MacOS applications inside the BeOS/Linux multitasking environment. This means that both BeOS/Linux and MacOS applications can run at the same time (usually in a window on the BeOS/Linux desktop) and data can be exchanged between them. If you are using a PowerPC-based system, applications will run at native speed (i.e. with no emulation involved). There is also a built-in PowerPC emulator for non-PowerPC systems. Mac Os Emulator For Linux SheepShaver is distributed under the terms of the GNU General Public License (GPL). However, you still need a copy of MacOS and a PowerMac ROM image to use SheepShaver. If you're planning to run SheepShaver on a PowerMac, you probably already have these two items. Supported systems SheepShaver runs with varying degree of functionality on the following systems: Unix with X11 (Linux i386/x86_64/ppc, NetBSD 2.x, FreeBSD 3.x) Mac OS X (PowerPC and Intel) Windows NT/2000/XP BeOS R4/R5 (PowerPC) Some of SheepShaver's features Runs MacOS 7.5.2 thru 9.0.4.
    [Show full text]
  • Overlay Window Management: User Interaction with Multiple Security Domains
    TECHNISCHE UNIVERSITAT¨ DRESDEN Fakultat¨ Informatik TUD–FI04–02–Marz¨ 2004 Norman Feske and Christian Technische Berichte Helmuth Institute for System Architecture, Operating Technical Reports Systems Group ISSN 1430-211X Overlay Window Management: User interaction with multiple security domains Technische Universitat¨ Dresden Fakultat¨ Informatik D-01062 Dresden Germany URL: http://www.inf.tu-dresden.de/ Overlay Window Management: User interaction with multiple security domains Norman Feske and Christian Helmuth Abstract one physical computer system into multiple protection do- mains where each domain can be an entirely different oper- Graphical user interfaces for high-assurance systems must ating system. Hartig¨ [15] presents an overview of such ar- fulfill a range of security requirements such as pro- chitectures and emphasizes the trend of wide application of tected and reliable presentation, prevention of unautho- these techniques in system design. Virtual machines lead rized cross-domain talk, and prevention of user-input to an unmatched flexibility and availability of user applica- eavesdropping. Additionally, it is desirable to support tions. As described in [14], the latests efforts with secure legacy applications running in confined compartments. booting techniques—namely TCPA [6]—pushed the appli- Standard isolation methods such as virtual-machine mon- cation area of these approaches even further. Even though itors provide one frame buffer per security domain, where the known approaches are technically different, they have each frame buffer is managed by one legacy window sys- one drawback in common that shrinks the application area tem. This raises the question of how to safely integrate significantly. There exists virtually no model for secure multiple (legacy) window systems and protect the dis- user interaction with multiple security domains.
    [Show full text]
  • Preservation of Dynamic and Interactive Content By
    Project Number IST-2006-033789 Project Title Planets Title of Deliverable Preservation of Dynamic & Interactive Content by use of Binary Translation and Virtualisation – a Methodology for Experimentation Deliverable Number TB/6-D1F (PA/6-D12) Contributing Sub-project TB/6, PA/6 and Work-package Deliverable External Dissemination Level Deliverable Nature Final Report Contractual Delivery Date 31st March 2010 Actual Delivery Date 6th April 2010 Author(s) HATII Abstract This report presents a study that moves beyond migration and emulation, by exploring the possibilities of binary translation and virtualisation to preserve dynamic and interactive content. The Planets community has generated a range of information on planning, characterisation and strategies that can be used to address the challenges that these types of material pose to long- term digital preservation. However, experimentation with preservation solutions specifically for software artefacts has either not been extensively conducted or its focus has been narrow. The objective of this study has been to design, conduct and analyse results from a series of experiments that utilise existing Planets infrastructure in order to investigate the preservation potential of binary translation and virtualisation. The results from the experiments contribute towards determining the viability of the proposed preservation action, by (a) measuring the quality of the results generated by the Planets Testbed; and (b) gauging the impact of binary translation and virtualisation on digital preservation
    [Show full text]