DOCSLIB.ORG

Accelerating Transition to Virtual Research Organisation in Social Science (AVROSS)

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Accelerating Transition to Virtual Research Organisation in Social Science (AVROSS) Ref. Ares(2013)2950606 - 30/08/2013 Accelerating Transition to Virtual Research Organisation in Social Science (AVROSS) Deliverable M4 Final Report title & no. Deliverable Final report, full draft, v2-2.doc Version: Date: 27.10.2007 Contract: A study on requirements and options for accelerating the transition from traditional research to virtual research organisations through e-Infrastructure EU Service Contract No. 30-CE-0066163/00-39 Issued by: Information Society and Media Directorate General, Commission of the European Communities Consortium: School of Business, University of Applied Sciences Northwestern Switzerland (FHNW), Olten, Switzerland (lead contractor) empirica GmbH, Bonn, Germany National Centre for e-Social Science (NCeSS), Manchester, UK National Opinion Research Center at the University of Chicago (NORC), Chicago, USA Coordination: Franz Barjak School of Business University of Applied Sciences Northwestern Switzerland Riggenbachstrasse 16 CH-4600 Olten Switzerland [email protected] phone +41 62 287 7825, fax: +41 62 287 7845 Final report, full draft, v2-2.doc AVROSS Table of content Executive summary IV 1. Introduction 1 1.1 Current e-Infrastructure use in the social sciences and humanities 1 1.2 Definition of e-Infrastructures in this study 2 1.3 Contents of this deliverable 3 2. Theoretical framework of the study 5 2.1 Different models of technological innovation 5 2.2 The social shaping of e-Infrastructures 6 2.2.1 Technology and user communities 8 2.2.2 Scientific shaping of technology 9 2.2.3 Funding and staff 11 2.2.4 Relationship to institutional practices and disciplinary cultures 12 3. Stock-taking of e-Infrastructures in the social sciences and humanities 16 3.1 Explanation of the empirical approach 16 3.2 Background information on respondents 18 3.2.1 Differences in origin 18 3.2.2 Activity profiles of time use 20 3.2.3 Collaborators 21 3.2.4 Respondents’ involvement and experience with e-Infrastructure 21 3.3 Background information on projects 26 3.3.1 Disciplines represented 26 3.3.2 Project funding and size 27 3.3.3 Technological features of the projects 32 3.3.4 Project outcomes and user constituency 36 3.4 e-Infrastructure adoption 44 3.4.1 Sources of information contributing to e-Infrastructure use 44 3.4.2 Potential catalysts in the adoption of e-Infrastructure technology 49 3.4.3 Potential barriers in the adoption of e-Infrastructure technology 53 3.5 Positive and negative lessons learned during the realisation of an e-Infrastructure project 57 3.5.1 Responses on positive and negative lessons learned 57 3.5.2 Lessons learned by characteristics of respondents 62 3.6 Summary 68 3.6.1 e-Infrastructure projects 68 3.6.2 e-Infrastructure adoption 70 3.6.3 Positive and negative lessons learned in e-Infrastructure projects 71 4. Promising approaches to using e-Infrastructures in the social sciences and humanities 73 4.1 Case study approach 73 4.1.1 Identification of the eight most promising approaches 73 4.1.2 Case study method and guidelines 75 II M4 Final Report 4.2 Case studies on e-Infrastructure initiatives 76 4.2.1 Access Grid Support Centre – AGSC 76 4.2.2 Modelling and Simulation for e-Social Science – MoSeS 86 4.2.3 Communication Data – ComDAT (pseudonym) 95 4.2.4 Simulation Portal – SPORT (pseudonym) 101 4.2.5 Understanding New Forms of Digital Records for e-Social Science (Digital Records) – DReSS 107 4.2.6 Dokumentation Bedrohter Sprachen [Documentation of Endangered Languages] - DoBeS 111 4.2.7 TextGrid 114 4.2.8 FinGrid (pseudonym) 118 4.3 Synthesis of the investigated cases 125 4.3.1 Technology 132 4.3.2 User communities and involvement 133 4.3.3 Funding and staff 134 4.3.4 Relationship to established practices 135 4.3.5 Impact on research and learning 136 5. Policy recommendations 138 5.1 Introduction 138 5.2 Capacity building 140 5.2.1 Broaden the base of scientists and technicians trained on e-Infrastructures 140 5.2.2 Provide resources for e-Infrastructure development 141 5.3 Tool development 143 5.4 Facilitating adoption 145 5.5 Raising awareness 148 References 151 Appendix I: Early adopters survey 156 Appendix I.1: The questionnaire 156 Appendix I.2: The Email 171 Appendix I.3: Tables 172 Appendix I.4: Verbatims 181 Appendix I.5: Code system for the positive and negative lessons (QD3 and QD4) 192 Appendix II: Case studies 195 Appendix II.1: Criteria for rating the e-Infrastructure initiatives 195 Appendix II.2: Informants in case studies 196 Appendix II.3: Contact letter for e-Science experts worldwide 197 Appendix II.4: Interview Guideline 198 III AVROSS Executive summary This report is the fourth deliverable of the AVROSS study (Accelerating Transition to Virtual Research Organisation in Social Science, AVROSS) aimed at delivering “A study on requirements and options for accelerating the transition from traditional research to virtual research organisations through e-Infrastructures” to the EC under EU Service Contract No. 30-CE-0066163/00-39. The study responds to a European Commission call to report on the state of the art in applying e-Infrastructure to social science and humanities (SSH) in at least four fields. The aim of the study was to research, select and analyse a significant number of the most promising applications of e-Infrastructure which can trigger transition to virtual research organisations and motivate sustained e-Infrastructure use in these disciplines. It also is focussed on paying special attention to opportunities for computer-supported collaborative learning (CSCL). The ultimate goal was to provide recommendations as to the possible scenarios for a large scale roll out of technologies and applications supporting virtual research organisations and novel services for students based on CSCL. The reason for this focus is that it is clear that "soft" sciences have both much to gain and a key role to play in promoting e-Infrastructure uptake across the disciplines, but to date have not been the fastest adopters of advanced grid-based e-Infrastructure. Our recommendations to EU policy-makers can be expected to point the way to changing this situation, promoting e-Infrastructure in Europe in these disciplines, with clear requirements to developers and expected impact in several other disciplines with related requirements, such as e-Health. Theoretical framework Previous theoretic and empirical work identified four factors likely to be influential in shaping the use of e-Infrastructures in the social sciences and humanities. These are illustrated in Figure I and include: 1. Technological frames and communities: Technological paradigms of developers and users which are shaped by the capabilities of previous technologies and the demands of the user communities constitute an influential frame on which the introduction and spread of e-Infrastructures takes place. Technological constraints limit the extent to which user needs can be implemented. 2. Scientific shaping of technology: Scientific progress for instance in computer science and computer linguistics is still a pre-condition for producing applications for the social sciences and humanities and dealing with confidentiality and privacy problems which are particularly virulent in the social sciences. 3. Funding and staff: In addition to funding needs for the sustainable development and provision of e-Infrastructures there are other resource-related issues: learning costs, availability of qualified staff, and training of personnel and prospective users on the capabilities of the technology. 4. Relationship to institutional practices and disciplinary cultures: Technologies may have inbuilt political purposes and the activities of political institutions and intermediaries – in science for instance research and higher education ministries, research foundations, scholarly societies – shape their spread and use. Moreover, they need to be integrated into proven work routines, institutional practices and disciplinary cultures which requires functioning cross- disciplinary communication and collaboration between engineers and domain scientists. IV M4 Final Report Figure I: Social shaping of e-Infrastructures in the social sciences and humanities Technology Scientific limitations Obtaining e-Infra- Funding veggie structure and staff food in SSH Communities Institutional practices and disciplinary cultures Source: AVROSS. Adoption of e-Infrastructures in the social sciences and humanities in Europe, the USA and beyond The first part of the empirical work in AVROSS consisted of an exploratory survey among the early adopters of e-Infrastructures in the social sciences and humanities that was carried out to provide a stock-taking of e-Infrastructure projects in Europe and beyond. The survey was sent in the spring of 2007 to roughly 2,000 individuals who had been identified as potentially involved in e-Infrastructure work. The aim was to cast a very wide net to generate the maximum number of responses, and over 560 responses were received - 448 usable responses (23.4% of the sample). The survey yielded several striking findings on e-Infrastructure adoption in social sciences and humanities and the type of e-Infrastructure projects carried out so far. e-Infrastructure adoption There are some regional differences in length of experience with e-Infrastructure (Figure II). Most strikingly, US respondents to the survey are on average more experienced than their colleagues from other regions, with an average over more than 10 years experience and more than 4 projects. Despite the fact that there are currently numerous e-Infrastructure projects in the UK, the relatively recent nature of this phenomenon is evidenced by the fact that the typical e-Infrastructure user has a relatively short experience with e-Infrastructure, and has worked on relatively few projects. A couple of other findings on adoption are interesting: First, survey respondents identified a number of key sources of information about e-Infrastructure and stressed the importance of other scientists in spreading information (see table I).
Load more

Recommended publications
  • 9<HTOFPA=Hjdjfd>
    34 Computer Science Springer News 6/2008 springer.com/booksellers P. Abrahamsson, VTT, Finland; R. Baskerville, W. Abramowicz, Poznan University of Economics, R. Adams, Nanaimo, BC, Canada; S. Gibson, Georgia State University, Atlanta, GA, USA; Poznan, Poland; D. Fensel, STI Innsbruck, Austria University of Victoria, VIC, Canada; S. Müller Arisona, K. Conboy, Lero, NUI Galway, Ireland; B. Fitzgerald, (Eds.) University of California, Santa Barbara, CA, USA (Eds.) L. Morgan, X. Wang, Lero, University of Limerick, Ireland (Eds.) Business Information Systems Transdisciplinary Digital Art. Agile Processes in Software 11th International Conference, Sound, Vision and the New BIS 2008, Innsbruck, Austria, Screen Engineering and Extreme May 5–7, 2008, Proceedings Programming Digital Art Weeks and Interactive Futures 2006/2007, Zürich, Switzerland and Victoria, 9th International Conference, XP 2008, BC, Canada, Selected Papers Limerick, Ireland, June 11–14, 2008, This book contains the refereed proceedings of the 11th International Conference on Business Proceedings Information Systems, BIS 2008, held in Innsbruck, Austria, in May 2008. This volume collects selected papers from the The 41 revised full papers were carefully reviewed past two instances of Digital Art Weeks (Zurich, This book constitutes the refereed proceedings and selected inclusion in the book. The contri- Switzerland) and Interactive Futures (Victoria, BC, of the 8th International Conference on Agile butions cover research trends as well as current Canada), two parallel festivals of digital media art. Processes in Software Engineering and eXtreme achievements and cutting edge developments in The work represented in Transdisciplinary Digital Programming, XP 2008, held in Limerick, Ireland, the area of modern business information systems. Art is a confirmation of the vitality and breadth in June 2008.
    [Show full text]
  • Balloons Could Outperform Spacecraft by Surfing the Stratosphere. We Go
    AVIATION WORKFORCE 40 SPACE POWER 34 ROBOTICS 12 Attract the best and brightest Meet ROSA, the Roll Out Solar Array The case for telepresence at Mars Satellite envy Balloons could outperform spacecraft by surfi ng the stratosphere. We go deep on one company’s plan. PAGE 24 OCTOBER 2017 | A publication of the American Institute of Aeronautics and Astronautics | aerospaceamerica.aiaa.org CALL FOR TECHNICAL BRIEFINGS The AIAA Defense and Security Forum (AIAA DEFENSE 2018) brings together the contractor, acquisition, and R&D communities for classifi ed and unclassifi ed discussions of critical technical, programmatic, and policy topics in a SECRET/NoFORN unbiased, nonpartisan environment. Nearly 200 experts will present the latest innovative technological breakthroughs that will integrate with current and next-generation defense systems. Advanced Prototypes Aerospace and Defense Computing Systems Countermeasures Directed Energy Weapons Estimation, Guidance, Navigation and Control Hypersonic Systems and Technologies Innovative Concepts and Technologies Missile Defense Robotic and Unmanned Weapon Systems Space Systems Strategic Missile Systems – Ground Based Strategic Missile Systems – Sea Based Deterrent Survivability Systems and Decision Analysis for National Security Tactical Missiles Weapon System Performance Analysis, Modeling and Simulation Weapon System Test and Evaluation Abstract Deadline: 30 November 2017 FEATURES | October 2017 MORE AT aerospaceamerica.aiaa.org 16 34 24 Ka-boom! Unrolling innovation Stratosphere surfi ng How a mission to smash a spacecraft Meet the solar array that could One company says its balloons can do into a moonlet may help defend Earth disrupt the spacecraft market. from asteroids and comets. what conventional satellites can do, By Debra Werner and then some.
    [Show full text]
  • Using CMMI Together with Agile Software Development
    Information and Software Technology 58 (2015) 20–43 Contents lists available at ScienceDirect Information and Software Technology journal homepage: www.elsevier.com/locate/infsof Using CMMI together with agile software development: A systematic review ⇑ Fernando Selleri Silva a,b, , Felipe Santana Furtado Soares a,c, Angela Lima Peres a,d, Ivanildo Monteiro de Azevedo a,b, Ana Paula L.F. Vasconcelos a,b, Fernando Kenji Kamei a,e, Silvio Romero de Lemos Meira a,c a Center of Informatics (CIn), Federal University of Pernambuco (UFPE), Recife, PE, Brazil b Computer Science Course (FACET), Mato Grosso State University (UNEMAT), Barra do Bugres, MT, Brazil c Recife Center of Advanced Studies and Systems (C.E.S.A.R), Recife, PE, Brazil d Cesmac University Center, Maceió, AL, Brazil e Federal Institute of Alagoas (IFAL), Arapiraca, AL, Brazil article info abstract Article history: Background: The search for adherence to maturity levels by using lightweight processes that require low Received 18 April 2014 levels of effort is regarded as a challenge for software development organizations. Received in revised form 21 August 2014 Objective: This study seeks to evaluate, synthesize, and present results on the use of the Capability Matu- Accepted 27 September 2014 rity Model Integration (CMMI) in combination with agile software development, and thereafter to give an Available online 6 October 2014 overview of the topics researched, which includes a discussion of their benefits and limitations, the strength of the findings, and the implications for research and practice. Keywords: Methods: The method applied was a Systematic Literature Review on studies published up to (and Software process improvement including) 2011.
    [Show full text]
  • A Framework for Maturing in Agile Software Development
    The Journal of Systems and Software 102 (2015) 88–108 Contents lists available at ScienceDirect The Journal of Systems and Software journal homepage: www.elsevier.com/locate/jss Progressive Outcomes: A framework for maturing in agile software development Rafaela Mantovani Fontana a,b,∗, Victor Meyer Jr. a, Sheila Reinehr a, Andreia Malucelli a a Pontifical Catholic University of Paraná (PUCPR), R. Imaculada Conceição, 1155, Prado Velho, 80215-901 Curitiba, PR, Brazil b Federal University of Paraná (UFPR), R. Dr. Alcides Vieira Arcoverde, 1225, Jd. das Américas, 81520-260 Curitiba, PR, Brazil article info abstract Article history: Maturity models are used to guide improvements in the software engineering field and a number of maturity Received 25 August 2014 models for agile methods have been proposed in the last years. These models differ in their underlying Revised 2 December 2014 structure prescribing different possible paths to maturity in agile software development, neglecting the Accepted 15 December 2014 fact that agile teams struggle to follow prescribed processes and practices. Our objective, therefore, was to Availableonline22December2014 empirically investigate how agile teams evolve to maturity, as a means to conceive a theory for agile software Keywords: development evolvement that considers agile teams nature. The complex adaptive systems theory was used Maturity as a lens for analysis and four case studies were conducted to collect qualitative and quantitative data. As a Agile software development result, we propose the Progressive Outcomes framework to describe the agile software development maturing Software process improvement process. It is a framework in which people have the central role, ambidexterity is a key ability to maturity, Complex adaptive systems and improvement is guided by outcomes agile teams pursue, instead of prescribed practices.
    [Show full text]
  • Agile Processes in Software Engineering and Extreme
    Juan Garbajosa · Xiaofeng Wang Ademar Aguiar (Eds.) Agile Processes in Software Engineering and Extreme Programming LNBIP 314 19th International Conference, XP 2018 Porto, Portugal, May 21–25, 2018 Proceedings Lecture Notes in Business Information Processing 314 Series Editors Wil M. P. van der Aalst RWTH Aachen University, Aachen, Germany John Mylopoulos University of Trento, Trento, Italy Michael Rosemann Queensland University of Technology, Brisbane, QLD, Australia Michael J. Shaw University of Illinois, Urbana-Champaign, IL, USA Clemens Szyperski Microsoft Research, Redmond, WA, USA More information about this series at http://www.springer.com/series/7911 Juan Garbajosa • Xiaofeng Wang Ademar Aguiar (Eds.) Agile Processes in Software Engineering and Extreme Programming 19th International Conference, XP 2018 Porto, Portugal, May 21–25, 2018 Proceedings Editors Juan Garbajosa Ademar Aguiar Technical University of Madrid University of Porto Madrid, Madrid Porto Spain Portugal Xiaofeng Wang Free University of Bozen-Bolzano Bolzano Italy ISSN 1865-1348 ISSN 1865-1356 (electronic) Lecture Notes in Business Information Processing ISBN 978-3-319-91601-9 ISBN 978-3-319-91602-6 (eBook) https://doi.org/10.1007/978-3-319-91602-6 Library of Congress Control Number: 2018944291 © The Editor(s) (if applicable) and The Author(s) 2018. This book is an open access publication. Open Access This book is licensed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license and indicate if changes were made.
    [Show full text]
  • OPEN SOURCE ARCHIVE Towards Open and Sustainable Digital Archives
    OPEN SOURCE ARCHIVE Towards open and sustainable digital archives Liisa Uosukainen (ed.) Publisher: Mikkeli University of Applied Sciences Publication serie: A Research Reports - Tutkimuksia ja raportteja 94 University of Appl ied Sciences OPEN SOURCE ARCHIVE Towards open and sustainable digital archives Liisa Uosukainen (ed.) MIKKELI UNIVERSITY OF APPLIED SCIENCES MIKKELI 2014 A: RESEARCH REPORTS - TUTKIMUKSIA JA RAPORTTEJA 94 1 © Authors and Mikkeli University of Applied Sciences Cover picture: Manu Eloaho Cover layout: Advertising agency Nitro ID Layout and printing: Tammerprint Oy ISBN: 978-951-588-455-8 (nid.) ISBN: 978-951-588-456-5 (PDF) ISSN: 1795-9438 (nid.) [email protected] 2 CONTENTS Authors 4 Questions, sources And contexts – digitAl Archiving As A fAcilitAtor in AcQuiring new informAtion And providing services 5 A winning model built At mAmk: tAilored services from A common plAtform 8 two ApproAches to digitAl long-term storAge And preservAtion At the nAtionAl Archives of sweden (nAs) And the chAllenge of file formAt stAndArds 24 An open source Archiving system for mAnAging business Archives 45 working together with fedorA commons: sustAinAble digitAl repository solutions 51 the hArmonizAtion of digitAl contents: benefits And reQuirements 54 web-ApplicAtion development in the open source Archive project 63 ArchivAl ui – An old relic or modern And novel? 72 open source in mAmk’s it educAtion 78 open movement – A megAtrend of our time 86 3 AuThOrS Alm Olli, Master of Arts, Information Services and Development Manager, Central Archives for Finnish Business Records Awre Chris, BSc (Hons) Biochemistry, MSc Information Science, Head of Information Management, University of Hull and Co-chair, Fedora UK & Ireland Fedora User Group Drake Karl-Magnus, Ph.D.
    [Show full text]
  • Measuring Coding Challenge Competence with APPS
    Measuring Coding Challenge Competence With APPS Dan Hendrycks∗ Steven Basart* Saurav Kadavath Mantas Mazeika Akul Arora UC Berkeley UChicago UC Berkeley UIUC UC Berkeley Ethan Guo Collin Burns Samir Puranik Horace He UC Berkeley UC Berkeley UC Berkeley Cornell Dawn Song Jacob Steinhardt UC Berkeley UC Berkeley Abstract While programming is one of the most broadly applicable skills in modern society, modern machine learning models still cannot code solutions to basic problems. Despite its importance, there has been surprisingly little work on evaluating code generation, and it can be difficult to accurately assess code generation performance rigorously. To meet this challenge, we introduce APPS, a benchmark for code gen- eration. Unlike prior work in more restricted settings, our benchmark measures the ability of models to take an arbitrary natural language specification and generate sat- isfactory Python code. Similar to how companies assess candidate software devel- opers, we then evaluate models by checking their generated code on test cases. Our benchmark includes 10;000 problems, which range from having simple one-line solutions to being substantial algorithmic challenges. We fine-tune large language models on both GitHub and our training set, and we find that the prevalence of syntax errors is decreasing exponentially as models improve. Recent models such as GPT-Neo can pass approximately 20% of the test cases of introductory problems, so we find that machine learning models are now beginning to learn how to code. As the social significance of automatic code generation increases over the coming years, our benchmark can provide an important measure for tracking advancements.
    [Show full text]
  • Measuring Coding Challenge Competence with APPS
    Measuring Coding Challenge Competence With APPS Dan Hendrycks∗ Steven Basart* Saurav Kadavath Mantas Mazeika Akul Arora UC Berkeley UChicago UC Berkeley UIUC UC Berkeley Ethan Guo Collin Burns Samir Puranik Horace He UC Berkeley UC Berkeley UC Berkeley Cornell Dawn Song Jacob Steinhardt UC Berkeley UC Berkeley Abstract 1 While programming is one of the most broadly applicable skills in modern society, 2 it is unclear how well state-of-the-art machine learning models can write code. De- 3 spite its importance, there has been surprisingly little work on evaluating code gen- 4 eration, and it can be difficult to assess code generation performance in an accurate 5 and rigorous manner. To meet this challenge, we introduce APPS, a benchmark for 6 code generation. Unlike prior work in more restricted settings, our benchmark mea- 7 sures the ability of models to take an arbitrary natural language specification and 8 generate satisfactory Python code. Similar to how companies assess candidate soft- 9 ware developers, we evaluate models by checking their generated code on test cases. 10 Our benchmark includes 10;000 problems, which range from having simple one- 11 line solutions to being substantial algorithmic challenges. We fine-tune large lan- 12 guage models on both GitHub and our training set, and we find that the prevalence 13 of syntax errors is decreasing exponentially as models improve. Recent models such 14 as GPT-Neo can pass approximately 20% of the test cases of introductory problems, 15 so we find that machine learning models are now beginning to learn how to code.
    [Show full text]
  • Reflective Model Driven Engineering with The
    Model-Driven Development of Model Transformations Citation for published version (APA): van Gorp, P. M. E. (2008). Model-Driven Development of Model Transformations. Universiteit van Antwerpen. Document status and date: Published: 01/01/2008 Document Version: Publisher’s PDF, also known as Version of Record (includes final page, issue and volume numbers) Please check the document version of this publication: • A submitted manuscript is the version of the article upon submission and before peer-review. There can be important differences between the submitted version and the official published version of record. People interested in the research are advised to contact the author for the final version of the publication, or visit the DOI to the publisher's website. • The final author version and the galley proof are versions of the publication after peer review. • The final published version features the final layout of the paper including the volume, issue and page numbers. Link to publication General rights Copyright and moral rights for the publications made accessible in the public portal are retained by the authors and/or other copyright owners and it is a condition of accessing publications that users recognise and abide by the legal requirements associated with these rights. • Users may download and print one copy of any publication from the public portal for the purpose of private study or research. • You may not further distribute the material or use it for any profit-making activity or commercial gain • You may freely distribute the URL identifying the publication in the public portal. If the publication is distributed under the terms of Article 25fa of the Dutch Copyright Act, indicated by the “Taverne” license above, please follow below link for the End User Agreement: www.tue.nl/taverne Take down policy If you believe that this document breaches copyright please contact us at: [email protected] providing details and we will investigate your claim.
    [Show full text]
  • FEB 2 4 2005 Massachusetts Institute of Technology February 2005 L 1 10A RI E ©2005 Massachusetts Institute of Technology All Rights Reserved
    A Knowledge Services Roadmap For Online Learning by Anand Rajagopal B.Tech, Civil Engineering Indian Institute of Technology-Bombay, India, 2002 Submitted to the Department of Civil and Environmental Engineering and the Engineering Systems Division in Partial Fulfillment of the Requirements for the Degrees of BARKER Master of Science in Civil and Environmental Engineering and IMA SSACHUSETTS INSTITUTE Master of Science in Technology and Policy OF TECHNOLOGY at the FEB 2 4 2005 Massachusetts Institute of Technology February 2005 L 1 10A R IE ©2005 Massachusetts Institute of Technology All rights reserved, Signature of Author............. .... .... ........................................ Civil and Envi nmental Engineering and Technology and Policy January 14, 2005 Certified by................................... John R. Williams Professor of Civil and E ronmental Engineering and Engineering Systems Thesis Supervisor Accepted by............................. ..................... Dava J. Newman Professor of Aeronautics a d Astronautics and Engineering Systems jr, hnolgy and Policy Program A ccepted by ......................................................................................... Andrew Whittle Chairman, Departmental Committee on Graduate Studies Department of Civil and Environmental Engineering 4 A Knowledge Services Roadmap For Online Learning by Anand Rajagopal Submitted to the Department of Civil and Environmental Engineering and the Engineering Systems Division on January 14, 2005 in Partial Fulfillment of the Requirements
    [Show full text]
  • Towards Resource-Aware Security Testing of Software
    Towards Resource-Aware Security Testing of Software Submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy in Electrical and Computer Engineering Sang Kil Cha B.S., Electrical Engineering, Korea University M.S., Electrical and Computer Engineering, Carnegie Mellon University Thesis Committee: Dr. David Brumley, Chair Dr. Lujo Bauer Dr. David Molnar Dr. Vyas Sekar Carnegie Mellon University Pittsburgh, PA August 10, 2015 Copyright c 2015 Sang Kil Cha For my daughter, Jaen. Abstract As software permeates every facet of life, it is imperative to assure the safety of soft- ware systems. Software vulnerabilities—exploitable software bugs—allow an attacker to destroy privacy, steal identities, and even extort money from victims. Therefore, software bugs must be discovered before an attacker can exploit them. This dissertation presents our work on mutational fuzzing, a software testing tech- nique for finding software bugs. Specifically, we argue that the efficiency of mutational fuzzing can drastically change depending on its parameters, and thus, automatic pa- rameter optimization can help in improving the fuzzing efficiency. We validate this ar- gument by designing, implementing, and evaluating several systems that employ novel techniques optimizing parameter selection for mutational fuzzing. Our specific contri- butions are that (1) we precisely define fuzzing and its parameter space; (2) we analyti- cally study the effectiveness of mutational fuzzing in terms of bug finding probability; (3) we then address three strategies in optimizing mutational fuzzing over the parame- ter space in terms of the number of bugs found; and (4) we finally show a post-fuzzing strategy that enables prioritizing security-relevant bugs under limited resources.
    [Show full text]
  • Wang Uta 2502D 10774.Pdf (527.4
    ADVANCED SOFTWARE TESTING TECHNIQUES BASED ON COMBINATORIAL DESIGN by WENHUA WANG Presented to the Faculty of the Graduate School of The University of Texas at Arlington in Partial Fulfillment of the Requirements for the Degree of DOCTOR OF PHILOSOPHY THE UNIVERSITY OF TEXAS AT ARLINGTON August 2010 Copyright © by Wenhua Wang 2010 All Rights Reserved ACKNOWLEDGEMENTS I am sincerely grateful to Prof. Lei for his tutoring in my PhD program. Through these years, he has always been offering motivation and encouragement to me. Without his mentoring and support, it would not have been possible to make it to this point. I also owe my gratitude to Dr. Che, Dr. Fegaras, Dr. Khalili, and Dr. Kung for their serving in the committee. They instructed me in computer science knowledge and research methodology. Their valuable advice guided me to gain an insight into my research work. In my security testing project, Dr. Csallner and Dr. Liu also instructed me in security knowledge and problem solving skills. I appreciate their tutoring too. During my PhD program, many people in UTA also gave me help, especially Ms. McBride and Ms. Costabile. Thanks for their help! Finally, I would not be in this position without my parents’ continuous support in the last thirty years. I would like to dedicate this work to them. July 15, 2010 iii ABSTRACT ADVANCED SOFTWARE TESTING TECHNIQUES BASED ON COMBINATORIAL DESIGN Wenhua Wang, PhD The University of Texas at Arlington, 2010 Supervising Professor: Yu Lei Combinatorial testing refers to a testing strategy that applies the principles of combinatorial design to the domain of software test generation.
    [Show full text]