Data Management in Dynamic Distributed Computing Environments

Total Page:16

File Type:pdf, Size:1020Kb

Data Management in Dynamic Distributed Computing Environments DATA MANAGEMENT IN DYNAMIC DISTRIBUTED COMPUTING ENVIRONMENTS BY IAN ROBERT KELLEY A dissertation submitted to the faculty of Cardiff University in partial fulfillment of the requirements for the degree of Doctor of Philosophy in Computer Science Cardiff School of Computer Science & Informatics Cardiff University June 2012 Declaration This work has not been submitted in substance for any other degree or award at this or any other university or place of learning, nor is being submitted concur- rently in candidature for any degree or other award. Signed: Date: 30 June 2012 STATEMENT 1 This thesis is being submitted in partial fulfillment of the requirements for the degree of Ph.D. Signed: Date: 30 June 2012 STATEMENT 2 This thesis is the result of my own independent work/investigation, except where otherwise stated. Other sources are acknowledged by explicit references. The views expressed are my own. Signed: Date: 30 June 2012 STATEMENT 3 I hereby give consent for my thesis, if accepted, to be available for photocopying and for inter-library loan, and for the title and summary to be made available to outside organizations. Signed: Date: 30 June 2012 i Acknowledgements The journey leading to this dissertation’s completion has been long, with many challenges and unexpected twists and turns along the way. It all began nearly nine years ago, when the idea to pursue a computer science doctorate was conceived during my time as a research programmer in Berlin. This notion evolved and became a goal of mine, which I pursued during my subsequent move to Louisiana. Two years later, I was accepted into a Ph.D. program at Cardiff University, where I began my research in the field of distributed systems. Throughout this experience, I have made many new friends and colleagues, and I thoroughly enjoyed life at Cardiff University, first as a student and later as a researcher. I would like to thank many of the people I encountered on the road leading here, not only for their help in my research, but most of all for their friendship. First, I would like to recognize Edward Seidel and Gabrielle Allen, who were there in the very beginning and started me on this path. Next, and of special note, are the members of “the group” at Cardiff: Matthew Shields, Andrew Harrison, and my supervisor (and friend) Ian Taylor. Each of you, in your own way, made my time in the U.K. more enjoyable and fruitful. I miss our lively after-work debates and late-night curries. I am grateful to the Cardiff School of Computer Science & Informatics, both for the support its members have shown me and also for making this all possible. I would like to acknowledge my colleagues from the Enabling Desktop Grids for e-Science and European Desktop Grid Initiative projects, who contributed many ideas and helped drive my research. ii Lastly, I appreciate the support given to me over the years by my family and friends. You have constantly reminded me to complete my dissertation, which finally resulted in pen being put to paper (or, rather, fingers to keys) at long last. I would especially like to thank my aunt Victoria Scott and my grandmother, Carolyn Scott, for their exceptional editorial assistance. My grandmother was not only steadfast in her encouragement, but also came out of retirement at age 90 to proofread my dissertation! I dedicate this work to my son Nils and my partner Erica Hammer. At the time of this writing Nils is 11, yet was much younger when it all began. I hope one day he will appreciate the sacrifices that were made so this research could see the light of day. iii Abstract Data management in parallel computing systems is a broad and increasingly im- portant research topic. As network speeds have surged, so too has the movement to transition storage and computation loads to wide-area network resources. The Grid, the Cloud, and Desktop Grids all represent different aspects of this move- ment towards highly-scalable, distributed, and utility computing. This dissertation contends that a peer-to-peer (P2P) networking paradigm is a natural match for data sharing within and between these heterogeneous network architectures. Peer-to-peer methods such as dynamic discovery, fault-tolerance, scalability, and ad-hoc security infrastructures provide excellent mappings for many of the requirements in today’s distributed computing environment. In recent years, volunteer Desktop Grids have seen a growth in data through- put as application areas expand and new problem sets emerge. These increasing data needs require storage networks that can scale to meet future demand while also facilitating expansion into new data-intensive research areas. Current prac- tices are to mirror data from centralized locations, a technique that is not practical for growing data sets, dynamic projects, or data-intensive applications. The fusion of Desktop and Service Grids provides an ideal use-case to re- search peer-to-peer data distribution strategies in a hybrid environment. Desktop Grids have a data management gap, while integration with Service Grids raises new challenges with regard to cross-platform design. The work undertaken here is two-fold: first it explores how P2P techniques can be leveraged to meet the iv data management needs of Desktop Grids, and second, it shows how the same distribution paradigm can provide migration paths for Service Grid data. The result of this research is a Peer-to-Peer Architecture for Data-Intensive Cycle Sharing (ADICS) that is capable not only of distributing volunteer computing data, but also of providing a transitional platform and storage space for migrating Service Grid jobs to Desktop Grid environments. v Contents 1 Introduction1 1.1 Thesis Goals..............................8 1.2 Thesis Overview............................ 12 1.3 Contributions.............................. 14 2 Background, Motivation, and Related Work 16 2.1 Grid Computing............................. 17 2.1.1 Conflicting Views........................ 20 2.1.2 Different Priorities....................... 21 2.1.3 My View of the Grid...................... 23 2.1.4 Service Grids and Desktop Grids Compared........ 24 2.2 Cloud Computing............................ 27 2.2.1 Flexibility and Scalability Benefits............... 28 2.2.2 Cloud Computing as a Business Model........... 29 2.2.3 High Performance versus Highly Scalable Computing... 30 2.3 Volunteer Computing.......................... 31 2.3.1 Berkeley Open Infrastructure for Network Computing... 34 2.3.2 XtremWeb........................... 36 2.3.3 Volunteer Computing Application Profiles.......... 37 2.4 Service and Desktop Grid Interoperability.............. 42 2.4.1 Enabling Grids for E-sciencE (EGEE)............ 43 2.4.2 Enabling Desktop Grids for e-Science (EDGeS)....... 46 2.4.3 Data Management Obstacles................. 49 2.5 Peer-to-Peer Networking........................ 52 vi CONTENTS 2.5.1 The Explosion of P2P File-Sharing.............. 53 2.5.2 Peer-to-Peer File Distribution Taxonomy........... 54 2.5.3 Flat Networks.......................... 55 2.5.4 Centralized/Decentralized................... 57 2.5.5 Distributed Hash Tables.................... 59 2.5.6 Decentralized Super-Peer Topologies............ 61 2.5.7 Tightly Coupled LAN-Oriented File-Sharing Systems.... 63 2.6 Bridging the Data Management Gap................. 65 3 Analysis and Design 70 3.1 Methodology.............................. 71 3.2 Problem Scope and Analysis..................... 72 3.3 Application Environment........................ 74 3.4 Design Considerations......................... 77 3.4.1 Scalability and Network Topology............... 78 3.4.2 Data Integrity and Security.................. 80 3.4.3 User Security and Client-Side Configuration......... 83 3.4.4 Legacy Software Integration.................. 85 3.5 Analysis of P2P Network Architectures................ 87 3.5.1 BitTorrent............................ 88 3.5.2 Super-Peer Topologies..................... 89 3.6 Conclusions............................... 91 4 A Peer-to-Peer Architecture for Data-Intensive Cycle Sharing 94 4.1 Architectural Model........................... 95 4.2 Roles.................................. 97 4.3 Data Sharing Protocol......................... 102 4.3.1 Publishing and Replication.................. 102 4.3.2 Downloading.......................... 104 4.4 Evaluation Against Requirements................... 106 4.4.1 Scalability and Network Topology............... 106 4.4.2 Data Integrity and Security.................. 108 4.4.3 User Security and Client-Side Configuration......... 109 4.4.4 Legacy Software Integration.................. 111 4.5 Validation of Design through Experimentation............ 112 4.6 Summary................................ 124 5 Implementation and Integration with Service and Desktop Grids 127 vii CONTENTS 5.1 Attic................................... 129 5.1.1 Introduction........................... 130 5.1.2 Message Types......................... 134 5.1.3 Component Implementation.................. 136 5.1.4 Role Implementations..................... 140 5.1.5 Downloading.......................... 144 5.1.6 Attic URLs........................... 149 5.1.7 Security............................. 150 5.1.8 Configuration.......................... 151 5.1.9 Summary............................ 154 5.2 Data Migration Using Attic....................... 156 5.2.1 Data Transition from gLite ! DG............... 156 5.2.2 Data Transition from ARC ! DG............... 164 5.2.3 Data Transition from UNICORE ! DG............ 168 5.3 BOINC Integration..........................
Recommended publications
  • Tesi Di Laurea La Solidarietà Digitale
    Tesi di Laurea La Solidarietà Digitale Da Seti@home a Boinc. Ipotesi di una società dell’elaborazione. di Francesco Morello 1 INDICE Introduzione............................................................... 4 Capitolo I Calcolo Vontario....................................... 5 1.1 Dai media di massa al calcolo distribuito......... 5 1.2 Calcolo Distribuito............................................... 6 1.3 Calcolo Volontario............................................... 8 1.3.1 Come funziona il calcolo volontario ?.......... 10 1.3.2 Applicazioni del Calcolo Volontario.............. 11 Capitolo II Analisi di BOINC.................................... 23 2.1 Piattaforma per il calcolo volontario............... 23 2.2 Architettura di BOINC........................................ 25 2.2.1 L'interfaccia di BOINC.................................... 25 2.2.2 Progetti e Volontari......................................... 31 2.2.3 Checkpointing e Work unit............................ 32 2.2.4 Crediti e ridondanza....................................... 32 2.2.5 Gli scopi di BOINC.......................................... 33 Capitolo III Aspetti tecnici del calcolo distribuito 36 3.1 Grid Computing vs Volunteer Computing....... 36 3.2 Hardware e Software per il Distributed Computing38 3.2.1 La Playstation 3 per raggiungere il Petaflop.41 Capitolo IV Aspetti sociali del calcolo volontario 45 4.1 Riavvicinarci alla scienza.................................. 45 2 4.2 Volontari oltre la CPU........................................ 47 4.2.1 Forum, Blog
    [Show full text]
  • BRINGING RESEARCH INTO the CLASSROOM T H E C I T I Z E N S C I E N C E a P P R O a C H I N S C H O O L S a SCIENTIX OBSERVATORY REPORT - APRIL 2019
    BRINGING RESEARCH INTO THE CLASSROOM THE CITIZEN SCIENCE APPROACH IN SCHOOLS A SCIENTIX OBSERVATORY REPORT - APRIL 2019 B R T E C Scientix, the community for science education in Europe, facilitates regular dissemination and sharing of know-how and best practices in science education across the European Union (http://scientix.eu). In order to help the development and dissemination of different science education projects Scientix has set up the Scientix observatory which provides overviews on the state of play of different topics related to science education (http://www.scientix.eu/observatory). Publisher: European Schoolnet Please cite this publication as: Nistor, A. et al. (2019). Bringing Research into the Classroom – The Citizen Science approach in schools. Scientix Observatory report. April 2019, European Schoolnet, Brussels Keywords: Science, Technology, Engineering and Mathematics (STEM); Citizen Science; Participatory Science; School Education Authors: Nistor, A., Clemente-Gallardo, J., Angelopoulos, T., Chodzinska, K., Clemente-Gallardo, M., Gozdzik, A. , Gras-Velazquez, A., Grizelj, A., Kolenberg, K., Mitropoulou, D., Micallef Gatt, A. D., Tasiopoulou, E., Brunello, A., Echard, P., Arvaniti, V., Carroll, S., Cindea, N., Diamantopoulos, N., Duquenne, N. , Edrisy, S., Ferguson, E., Galani, L., Glezou, K., Kameas, A., Kirmaci, H., Koliakou, I., Konomi, E., Kontopidi, E., Kulic, S., Lefkos, I., Nikoletakis, G., Siotou, E., Šimac, A., Sormani, F., Tramonti, M., Tsapara, M., Tsourlidaki, E., Vojinovic, M. Design/DTP: Vanessa James Picture credit: Shutterstock, Pixabay Print run: 500 ISBN: 9789492913852 Published in April 2019. The views expressed in this publication are those of the authors and not necessarily those of EUN Partnership AISBL or the European Commission. The work presented in this document is supported by the European Commission’s Erasmus+ programme – project BRITEC, coordinated by the Institute of Geophysics, PAS and by the European Union’s H2020 research and innovation programme – project Scientix 3 (Grant agreement N.
    [Show full text]
  • Proposta De Mecanismo De Checkpoint Com Armazenamento De Contexto Em Memória Para Ambientes De Computação Voluntária
    UNIVERSIDADE FEDERAL DO RIO GRANDE DO SUL INSTITUTO DE INFORMÁTICA PROGRAMA DE PÓS-GRADUAÇÃO EM COMPUTAÇÃO RAFAEL DAL ZOTTO Proposta de Mecanismo de Checkpoint com Armazenamento de Contexto em Memória para Ambientes de Computação Voluntária Dissertação apresentada como requisito parcial para a obtenção do grau de Mestre em Ciência da Computação Prof. Dr. Cláudio Fernando Resin Geyer Orientador Porto Alegre, Setembro de 2010 CIP – CATALOGAÇÃO NA PUBLICAÇÃO Dal Zotto, Rafael Proposta de Mecanismo de Checkpoint com Armazenamento de Contexto em Memória para Ambientes de Computação Volun- tária / Rafael Dal Zotto. – Porto Alegre: PPGC da UFRGS, 2010. 134 f.: il. Dissertação (mestrado) – Universidade Federal do Rio Grande do Sul. Programa de Pós-Graduação em Computação, Porto Ale- gre, BR–RS, 2010. Orientador: Cláudio Fernando Resin Geyer. 1. Computação voluntária. 2. Mecanismos para Checkpoint. 3. Alto Desempenho. 4. Prevalência de Objetos. I. Geyer, Cláudio Fernando Resin. II. Título. UNIVERSIDADE FEDERAL DO RIO GRANDE DO SUL Reitor: Prof. Carlos Alexandre Netto Vice-Reitor: Prof. Rui Vicente Oppermann Pró-Reitor de Pós-Graduação: Prof. Aldo Bolten Lucion Diretor do Instituto de Informática: Prof. Flávio Rech Wagner Coordenador do PPGC: Profa. Álvaro Freitas Moreira Bibliotecária-chefe do Instituto de Informática: Beatriz Regina Bastos Haro “An education isn’t how much you have committed to memory, or even how much you know. It’s being able to differentiate between what you do know and what you don’t.” —ANATOLE FRANCE AGRADECIMENTOS Nesta etapa final de minha escrita, gostaria de registrar minha gratidão a todos aqueles que participaram direta ou indiretamente dessa caminhada. Muito obrigado pelas conver- sas, apoio e incentivo oferecidos ao longo dessa jornada.
    [Show full text]
  • EDGES Project Meeting
    International Desktop Grid Federation - Support Project Contract number: FP7-312297 Desktop Grids for e-Science Road Map Project deliverable: D5.5.1 Due date of deliverable: 2013-10-31 Actual submission date: 2013-12-27 Lead beneficiary: AlmereGrid Workpackage: WP5 Dissemination Level: PU Version: 1.2 (Final) IDGF-SP is supported by the FP7 Capacities Programme under contract nr FP7-312297. D5.5.1 – Desktop Grids for e-Science Road Map CopyriGht (c) 2013. MemBers of IDGF-SP consortium, see http://IDGF-SP.eu for details on the copyriGht holders. You are permitted to copy and distriBute verBatim copies of this document containinG this copyriGht notice But modifyinG this document is not allowed. You are permitted to copy this document in whole or in part into other documents if you attach the followinG reference to the copied elements: ‘Copyright (c) 2013. Members of IDGF-SP consortium - http://IDGF-SP.eu’. The commercial use of any information contained in this document may require a license from the proprietor of that information. The IDGF-SP consortium memBers do not warrant that the information contained in the deliveraBle is capaBle of use, or that use of the information is free from risk, and accept no liaBility for loss or damaGe suffered By any person and orGanisation usinG this information. WP3 © 2013. Members of IDGF-SP consortium - http://IDGF-SP.eu 2/8 D5.5.1 – Desktop Grids for e-Science Road Map Table of Contents 1 Status and ChanGe History .................................................................................................
    [Show full text]
  • Citizen Science for Environmental Policy: Development of an EU-Wide Inventory and Analysis of Selected Practices
    Citizen science for environmental policy: Development of an EU-wide inventory and analysis of selected practices Bio Innovation Service, in collaboration with Fundación Ibercivis and The Natural History Museum Citizen science for environmental policy Disclaimer The information and views set out in this report are those of the authors and do not necessarily reflect the official opinion of the Commission. The Commission does not guarantee the accuracy of the data included in this study. Neither the Commission nor any person acting on the Commission’s behalf may be held responsible for the use which may be made of the information contained therein. Project team Shailendra Mugdal (BIO Innovation Service) Anne Turbe (BIO Innovation Service) Francisco Sanz (Ibercivis) Jorge Barba (Ibercivis) Maite Pelacho (Ibercivis) Fermin Serrano-Sanz (Ibercivis) Lucy Robinson (Natural History Museum) Margaret Gold (Natural History Museum) Acknowledgments We would like to express our sincere thanks to all citizen science projects that invested their precious time in answering our questions, this study would not have been possible without their support. We also thank the colleagues at the European Commission: Sven Schade and Chrysi Tsinarki (JRC), José Miguel Rubio Iglesias (EEA); Marjan Van Merloo (DG RTD); Izabela Freytag (EASME); Liam Cashman (DG ENV); for their support and comments and Elena Montani (DG ENV) for overall guidance. Citation Bio Innovation Service (2018) Citizen science for environmental policy: development of an EU-wide inventory and analysis of selected practices. Final report for the European Commission, DG Environment under the contract 070203/2017/768879/ETU/ENV.A.3, in collaboration with Fundacion Ibercivis and The Natural History Museum, November 2018.
    [Show full text]
  • Cell Spotting – Let’S Fight Cancer Together!
    View metadata, citation and similar papers at core.ac.uk brought to you by CORE provided by Repositorio Universidad de Zaragoza Image courtesy of the National Institutes Health (NIH) Scanning electron micrograph of an apoptotic HeLa cell Cell spotting – let’s fight cancer together! “Tell me and I forget, teach me and I HeLa cells may remember, involve me and I learn,” HeLa cells are a special hu- Benjamin Franklin once said. Make that man cell line. They originate from a woman called Hen- quote yours and involve your students in a rietta Lacks, who died from cervical cancer in 1951. Her real cancer-research project that will teach doctor took some cells from them more than just genetics and cell death. her tumour and managed to grow them in a culture me- dium, developing the first human cell line. HeLa cells By António J Monteiro, Cândida cells without harming healthy cells. are the most widely used G Silva and José C Villar Existing chemotherapy treatments human cells in biology labs have failed to reach that ideal level of BACKGROUND across the world. fficient cancer drugs need to selectivity, but many research teams E selectively destroy tumour continue to look for compounds that 46 I Science in School I Issue 31 : Spring 2015 www.scienceinschool.org Teach could become the effective and side- the response of HeLa cells to different Biology effect-free drugs of tomorrow. chemical compounds. Biology The search for suitable compounds The Cell Spotting project Technology is performed primarily by robotic Ages 14–18 The Cell Spotting team is testing systems that quickly test and identify This article describes a stu- more than 14 000 chemical com- millions of candidate chemical com- dent-centred activity that pounds in HeLa cells and observing pounds: they put cancer cells together introduces the concept of their reaction using advanced optical with potential drugs and observe efficient cancer drugs and microscopy techniques.
    [Show full text]
  • Toward Crowdsourced Drug Discovery: Start-Up of the Volunteer Computing Project Sidock@Home
    Toward crowdsourced drug discovery: start-up of the volunteer computing project SiDock@home Natalia Nikitina1[0000-0002-0538-2939] , Maxim Manzyuk2[000-0002-6628-0119], Marko Juki´c3;4[0000-0001-6083-5024], Crtomirˇ Podlipnik5[0000-0002-8429-0273], Ilya Kurochkin6[0000-0002-0399-6208], and Alexander Albertian6[0000-0002-6586-8930] 1 Institute of Applied Mathematical Research, Karelian Research Center of the Russian Academy of Sciences, Petrozavodsk, Russia, [email protected] 2 Internet portal BOINC.ru, Moscow, Russia, [email protected] 3 Chemistry and Chemical Engineering, University of Maribor, Maribor, Slovenia 4 Faculty of Mathematics, Natural Sciences and Information Technologies, University of Primorska, Koper, Slovenia [email protected] 5 Faculty of Chemistry and Chemical Technology, University of Ljubljana, Ljubljana, Slovenia, [email protected] 6 Federal Research Center \Computer Science and Control" of the Russian Academy of Sciences, Moscow, Russia, [email protected], [email protected], [email protected] Abstract. In this paper, we describe the experience of setting up a computational infrastructure based on BOINC middleware and running a volunteer computing project on its basis. We characterize the first series of computational experiments and review the project's development in its first six months. The gathered experience shows that BOINC-based Desktop Grids allow to to efficiently aid drug discovery at its early stages. Keywords: Desktop Grid · Distributed computing · Volunteer comput- ing · BOINC · Virtual drug screening · Molecular docking · SARS-CoV-2 1 Introduction Among the variety of high-performance computing (HPC) systems, Desktop Grids hold a special place due to their enormous potential and, at the same time, high availability.
    [Show full text]
  • Desktop Grids for Escience
    Produced by the IDGF-SP project for the International Desktop Grid Federation A Road Map Desktop Grids for eScience Technical part – December 2013 IDGF/IDGF-SP International Desktop Grid federation http://desktopgridfederation.org Edited by Ad Emmen Leslie Versweyveld Contributions Robert Lovas Bernhard Schott Erika Swiderski Peter Hannape Graphics are produced by the projects. version 4.2 2013-12-27 © 2013 IDGF-SP Consortium: http://idgf-sp.eu IDGF-SP is supported by the FP7 Capacities Programme under contract nr RI-312297. Copyright (c) 2013. Members of IDGF-SP consortium, see http://degisco.eu/partners for details on the copyright holders. You are permitted to copy and distribute verbatim copies of this document containing this copyright notice but modifying this document is not allowed. You are permitted to copy this document in whole or in part into other documents if you attach the following reference to the copied elements: ‘Copyright (c) 2013. Members of IDGF-SP consortium - http://idgf-sp.eu’. The commercial use of any information contained in this document may require a license from the proprietor of that information. The IDGF-SP consortium members do not warrant that the information contained in the deliverable is capable of use, or that use of the information is free from risk, and accept no liability for loss or damage suffered by any person and organisation using this information. – 2 – Preface This document is produced by the IDGF-SP project for the International Desktop Grid Fe- deration. Please note that there are some links in this document pointing to the Desktop Grid Federation portal, that requires you to be signed in first.
    [Show full text]
  • Integrated Service and Desktop Grids for Scientific Computing
    Integrated Service and Desktop Grids for Scientific Computing Robert Lovas Computer and Automation Research Institute, Hungarian Academy of Sciences, Budapest, Hungary [email protected] Ad Emmen AlmereGrid, Almere, The Nederlands [email protected] RI-261561 GRID 2010, DUBNA Why Desktop Grids are important? http://knowledgebase.ehttp://knowledgebase.e--irg.euirg.eu RI-261561 GRID 2010, DUBNA Introduction RI-261561 WP4 Author: Robert Lovas, Ad Emmen version: 1.0 Prelude - what do people at home and SME’s think about grid computing Survey of EDGeS project Questionnaires all across Europe Get an idea of the interest in people and SMEs to donate computing time for science to a Grid Get an idea of the interest in running a Grid inside an SME RI-261561 GRID 2010, DUBNA Survey amongst the General Public and SME’s RI-261561 GRID 2010, DUBNA Opinions about Grid computing RI-261561 GRID 2010, DUBNA Survey - Conclusions Overall: there is interest in Desktop Grid computing in Europe. However, that people are willing to change their current practice and say that they want to participate in Grid efforts does not mean that they are actually going to do that. Need to generate trust in the organisation that manages the Grid. People want to donate computing time for scientific applications, especially medical applications. They do not like to donate computing time to commercial or defense applications. People want feedback on the application they are running. No clear technical barriers perceived by the respondents: so this does not need much attention. Overall the respondents were rather positive about donating computing time for a Grid or about running applications on a Grid.
    [Show full text]
  • Secure Volunteer Computing for Distributed Cryptanalysis
    ysis SecureVolunteer Computing for Distributed Cryptanal Nils Kopal Secure Volunteer Computing for Distributed Cryptanalysis ISBN 978-3-7376-0426-0 kassel university 9 783737 604260 Nils Kopal press kassel university press ! "# $ %& & &'& #( )&&*+ , #()&- ( ./0 12.3 - 4 # 5 (!!&& & 6&( 7"#&7&12./ 5 -839,:,3:3/,2;1/,2% ' 5 -839,:,3:3/,2;13,3% ,' 05( (!!<& &!.2&.81..!")839:3:3/2;133 "=( (!!, #& !(( (2221,;2;13/ '12.97 # ?@7 & &, & ) ? “With magic, you can turn a frog into a prince. With science, you can turn a frog into a Ph.D. and you still have the frog you started with.” Terry Pratchett Abstract Volunteer computing offers researchers and developers the possibility to distribute their huge computational jobs to the computers of volunteers. So, most of the overall cost for computational power and maintenance is spread across the volunteers. This makes it possible to gain computing resources that otherwise only expensive grids, clusters, or supercomputers offer. Most volunteer computing solutions are based on a client-server model. The server manages the distribution of subjobs to the computers of volunteers, the clients, which in turn compute the subjobs and return the results to the server. The Berkeley Open Infrastructure for Network Computing (BOINC) is the most used middleware for volunteer computing. A drawback of any client-server architecture is the server being the single point of control and failure. To get rid of the single point of failure, we developed different distribution algorithms (epoch distribution algorithm, sliding-window distribution algorithm, and extended epoch distribution algorithm) based on unstructured peer-to-peer networks. These algorithms enable the researchers and developers to create volunteer computing networks without any central server.
    [Show full text]
  • Fifteen Case Studies Undertaken As Part of the Scishops.Eu Horizon 2020 Project
    ENHANCING THE RESPONSIBLE AND SUSTAINABLE EXPANSION OF THE SCIENCE SHOPS ECOSYSTEM IN EUROPE D2.2 Existing RRI tools and successful participatory community-based research case studies report This project has received funding from the European Union’s Horizon 2020 Research and Innovation Programme under Grant Agreement No 741657. D2.2 Existing RRI tools and successful participatory community-based research case studies report 2 Project Acronym: SciShops.eu Title: Enhancing the Responsible and Sustainable Expansion of the Science Shops Ecosystem in Europe Coordinator: SYNYO GmbH Reference: 741657 Type: Research and Innovation Action Program: HORIZON 2020 Theme: Participatory research and innovation via Science Shops Start: 01. September 2017 Duration: 30 months Website: project.scishops.eu Consortium: SYNYO GmbH (SYNYO), Austria Handelsblatt Research Institute GmbH, Germany University of Hohenheim, Germany KPMG Limited, Cyprus The National Unions of Students in Europe, Belgium Institute of Social Innovations, Lithuania University of Oxford, United Kingdom Katholieke Universiteit, Belgium Universidad Carlos III De Madrid, Spain Universitatea Politehnica Din Bucuresti, Romania Universitá degli Studi di Brescia, Italy Universiteit Leiden, Netherlands International Center for Numerical Methods in Engineering, Spain Institute Jozef Stefan, Slovenia Wuppertal Institute for Climate, Environment and Energy, Germany Vetenskap & Allmänhet, Sweden Bay Zoltán Nonprofit Ltd. For Applied Research, Hungary SciCo Cyprus, Cyprus © 2018 SciShops | Horizon
    [Show full text]
  • Peter Lavin, Neil Whelan
    FightMalaria@Home Distributed biological screening through Volunteer Computing to find useful protein/drug matches for the purpose of malarial drug research Peter Lavin, Neil Whelan Thesis presented to the University of Dublin, Trinity College in partial fulfilment of the requirements for the Degree of Master of Science in Computer Science Department of Computer Science, University of Dublin, Trinity College September 2007 Declaration I declare that the work in this dissertation is, unless otherwise stated, entirely my own work and has not been submitted as an exercise for a degree at this or any other university Signed: _____________ Peter Lavin 14th September 2007 Declaration I declare that the work in this dissertation is, unless otherwise stated, entirely my own work and has not been submitted as an exercise for a degree at this or any other university Signed: _____________ Neil Whelan 14th September 2007 2 Permission to lend and/or copy I agree that Trinity College Library may lend or copy this dissertation upon request. Signed: _____________ Peter Lavin 14th September 2007 Permission to lend and/or copy I agree that Trinity College Library may lend or copy this dissertation upon request. Signed: _____________ Neil Whelan 14th September 2007 3 Acknowledgements Firstly, we would like to thank our supervisor, Dr. Brian Coghlan, for his support and attention throughout this project. We would like to thank Dr. Eamonn Kenny for his advice and technical guidance, and Dr. David O‘Callaghan for providing valuable technical assistance. We would also like to thank Dr. Anthony Chubb from the Royal College of Surgeons in Ireland for his vision in proposing this project.
    [Show full text]