Report on Best Practices in Infrastructure Support
Total Page:16
File Type:pdf, Size:1020Kb
Load more
Recommended publications
-
Tesi Di Laurea La Solidarietà Digitale
Tesi di Laurea La Solidarietà Digitale Da Seti@home a Boinc. Ipotesi di una società dell’elaborazione. di Francesco Morello 1 INDICE Introduzione............................................................... 4 Capitolo I Calcolo Vontario....................................... 5 1.1 Dai media di massa al calcolo distribuito......... 5 1.2 Calcolo Distribuito............................................... 6 1.3 Calcolo Volontario............................................... 8 1.3.1 Come funziona il calcolo volontario ?.......... 10 1.3.2 Applicazioni del Calcolo Volontario.............. 11 Capitolo II Analisi di BOINC.................................... 23 2.1 Piattaforma per il calcolo volontario............... 23 2.2 Architettura di BOINC........................................ 25 2.2.1 L'interfaccia di BOINC.................................... 25 2.2.2 Progetti e Volontari......................................... 31 2.2.3 Checkpointing e Work unit............................ 32 2.2.4 Crediti e ridondanza....................................... 32 2.2.5 Gli scopi di BOINC.......................................... 33 Capitolo III Aspetti tecnici del calcolo distribuito 36 3.1 Grid Computing vs Volunteer Computing....... 36 3.2 Hardware e Software per il Distributed Computing38 3.2.1 La Playstation 3 per raggiungere il Petaflop.41 Capitolo IV Aspetti sociali del calcolo volontario 45 4.1 Riavvicinarci alla scienza.................................. 45 2 4.2 Volontari oltre la CPU........................................ 47 4.2.1 Forum, Blog -
"Challenges and Formal Aspects of Volunteer Computing"
BUDAPEST UNIVERSITY OF TECHNOLOGY AND ECONOMICS FACULTY OF ELECTRICAL ENGINEERING AND INFORMATICS DEPARTMENT OF AUTOMATION AND APPLIED INFORMATICS Attila Csaba Marosi Önkéntes Számítási Rendszerek Kihívásai és Formális Aspektusai Challenges and Formal Aspects of Volunteer Computing Ph.D. Thesis Thesis Advisors: Péter Kacsuk MTA SZTAKI, LPDS Sándor Juhász BME, AUT Budapest, 2016. ‘‘The important thing is not to stop questioning. Curiosity has its own reason for existing. One cannot help but be in awe when he contemplates the mysteries of eternity, of life, of the marvelous structure of reality. It is enough if one tries merely to comprehend a little of this mystery every day. Never lose a holy curiosity.’’ -- Albert Einstein Abstract Volunteer Computing (VC) and Desktop Grid (DG) systems collect and make available the donated the resources from non-dedicated computers like office and home desktops. VC systems are usually deployed to solve a grand compute intensive problem by researchers who either don’t have access to or don’t have the resources to buy a dedicated infrastruc- ture; or simply don’t want to maintain such an infrastructure. VC and DG paradigms seem similar, however they target different use cases and environments: DG systems operate within the boundaries of institutes, while VC systems collect resources from the publicly accessible internet. Evidently VC resembles DGs whereas DGs are not fully equivalent to VC. Contrary to “traditional grids” [1,2] there is no formal definition for the relationship of DG and VC that could be used to categorize existing systems. There are informal at- tempts to categorize them and compare with grid systems [3,4,5]. -
The Social Cloud for Public Eresearch
The Social Cloud for Public eResearch by Koshy John A thesis submitted to the Victoria University of Wellington in fulfilment of the requirements for the degree of Master of Engineering in Network Engineering. Victoria University of Wellington 2012 Abstract Scientific researchers faced with extremely large computations or the re- quirement of storing vast quantities of data have come to rely on dis- tributed computational models like grid and cloud computing. However, distributed computation is typically complex and expensive. The Social Cloud for Public eResearch aims to provide researchers with a platform to exploit social networks to reach out to users who would otherwise be unlikely to donate computational time for scientific and other research ori- ented projects. This thesis explores the motivations of users to contribute computational time and examines the various ways these motivations can be catered to through established social networks. We specifically look at integrating Facebook and BOINC, and discuss the architecture of the functional system and the novel social engineering algorithms that power it. ii Acknowledgments I would first like to thank my parents, John Koshy and Susan John, for their unwavering love and support in all my endeavours. I would like to thank my supervisor, Kris Bubendorfer, for his valuable guidance and support throughout my thesis. Kyle Chard and Ben Palmer have my thanks for their contributions and feedback in the course of au- thoring the IEEE e-Science paper on the Social Cloud for Public eResearch. Many thanks are also due to Andy Linton for his help with managing the development and test server for the Social Cloud for Public eResearch. -
Toward Crowdsourced Drug Discovery: Start-Up of the Volunteer Computing Project Sidock@Home
Toward crowdsourced drug discovery: start-up of the volunteer computing project SiDock@home Natalia Nikitina1[0000-0002-0538-2939] , Maxim Manzyuk2[000-0002-6628-0119], Marko Juki´c3;4[0000-0001-6083-5024], Crtomirˇ Podlipnik5[0000-0002-8429-0273], Ilya Kurochkin6[0000-0002-0399-6208], and Alexander Albertian6[0000-0002-6586-8930] 1 Institute of Applied Mathematical Research, Karelian Research Center of the Russian Academy of Sciences, Petrozavodsk, Russia, [email protected] 2 Internet portal BOINC.ru, Moscow, Russia, [email protected] 3 Chemistry and Chemical Engineering, University of Maribor, Maribor, Slovenia 4 Faculty of Mathematics, Natural Sciences and Information Technologies, University of Primorska, Koper, Slovenia [email protected] 5 Faculty of Chemistry and Chemical Technology, University of Ljubljana, Ljubljana, Slovenia, [email protected] 6 Federal Research Center \Computer Science and Control" of the Russian Academy of Sciences, Moscow, Russia, [email protected], [email protected], [email protected] Abstract. In this paper, we describe the experience of setting up a computational infrastructure based on BOINC middleware and running a volunteer computing project on its basis. We characterize the first series of computational experiments and review the project's development in its first six months. The gathered experience shows that BOINC-based Desktop Grids allow to to efficiently aid drug discovery at its early stages. Keywords: Desktop Grid · Distributed computing · Volunteer comput- ing · BOINC · Virtual drug screening · Molecular docking · SARS-CoV-2 1 Introduction Among the variety of high-performance computing (HPC) systems, Desktop Grids hold a special place due to their enormous potential and, at the same time, high availability. -
Deploying and Maintaining a Campus Grid at Clemson University Dru Sepulveda Clemson University, [email protected]
Clemson University TigerPrints All Theses Theses 8-2009 Deploying and Maintaining a Campus Grid at Clemson University Dru Sepulveda Clemson University, [email protected] Follow this and additional works at: https://tigerprints.clemson.edu/all_theses Part of the Computer Sciences Commons Recommended Citation Sepulveda, Dru, "Deploying and Maintaining a Campus Grid at Clemson University" (2009). All Theses. 662. https://tigerprints.clemson.edu/all_theses/662 This Thesis is brought to you for free and open access by the Theses at TigerPrints. It has been accepted for inclusion in All Theses by an authorized administrator of TigerPrints. For more information, please contact [email protected]. Deploying and Maintaining a Campus Grid at Clemson University A Thesis Presented to the Graduate School of Clemson University In Partial Fulfillment of the Requirements for the Degree Masters Computer Science by Dru Sepulveda May 2009 Accepted by: Sebastien Goasguen, Committee Chair Mark Smotherman Steven Stevenson Abstract Many institutions have all the tools needed to create a local grid that aggregates commodity compute resources into an accessible grid service, while simultaneously maintaining user satisfaction and system security. In this thesis, the author presents a three-tiered strategy used at Clemson University to deploy and maintain a grid infrastructure by making resources available to both local and federated remote users for scientific research. Using this approach virtually no compute cycles are wasted. Usage trends and power consumption statistics collected from the Clemson campus grid are used as a reference for best-practices. The loosely-coupled components that comprise the campus grid work together to form a highly cohesive infrastructure that not only meets the computing needs of local users, but also helps to fill the needs of the scientific community at large. -
Multiagent Social Computing
56 International Journal of Web Portals, 3(4), 56-68, October-December 2011 Multiagent Social Computing Ben Choi, Louisiana Tech University, USA ABSTRACT This article provides a framework for extending social networks to social computing. When people join social networks, such as Facebook and discussion groups, their personal computers can also join the social networks. This framework facilitates sharing of computing resources among friends and groups. Computers of friends and groups act autonomously to help each other perform various tasks. The framework combines many key technologies, including intelligent agents, multi-agent system, object space, and parallel and distributed computing, into a new computing platform, which has been successfully implemented and tested. With this framework, any person will have access to not only the computing power of his or her own personal computer but also the vast computing power of a community of computers. The collective capabilities of humans and computers working in communities will create complementary capabilities of computing to achieve behaviors that transcend those of people and computers in isolation. The future of computing is moving from personal computers to societies of computers. Keywords: Cloud Computing, Intelligent Agents, Multi-Agent System, Parallel Distributed Processing, Social Computing, Social Network INTRODUCTION Internet can join computing communities and so does any networked computers, creating social This article extends the concept of socially computing systems ranging -
Desktop Grids for Escience
Produced by the IDGF-SP project for the International Desktop Grid Federation A Road Map Desktop Grids for eScience Technical part – December 2013 IDGF/IDGF-SP International Desktop Grid federation http://desktopgridfederation.org Edited by Ad Emmen Leslie Versweyveld Contributions Robert Lovas Bernhard Schott Erika Swiderski Peter Hannape Graphics are produced by the projects. version 4.2 2013-12-27 © 2013 IDGF-SP Consortium: http://idgf-sp.eu IDGF-SP is supported by the FP7 Capacities Programme under contract nr RI-312297. Copyright (c) 2013. Members of IDGF-SP consortium, see http://degisco.eu/partners for details on the copyright holders. You are permitted to copy and distribute verbatim copies of this document containing this copyright notice but modifying this document is not allowed. You are permitted to copy this document in whole or in part into other documents if you attach the following reference to the copied elements: ‘Copyright (c) 2013. Members of IDGF-SP consortium - http://idgf-sp.eu’. The commercial use of any information contained in this document may require a license from the proprietor of that information. The IDGF-SP consortium members do not warrant that the information contained in the deliverable is capable of use, or that use of the information is free from risk, and accept no liability for loss or damage suffered by any person and organisation using this information. – 2 – Preface This document is produced by the IDGF-SP project for the International Desktop Grid Fe- deration. Please note that there are some links in this document pointing to the Desktop Grid Federation portal, that requires you to be signed in first. -
Integrated Service and Desktop Grids for Scientific Computing
Integrated Service and Desktop Grids for Scientific Computing Robert Lovas Computer and Automation Research Institute, Hungarian Academy of Sciences, Budapest, Hungary [email protected] Ad Emmen AlmereGrid, Almere, The Nederlands [email protected] RI-261561 GRID 2010, DUBNA Why Desktop Grids are important? http://knowledgebase.ehttp://knowledgebase.e--irg.euirg.eu RI-261561 GRID 2010, DUBNA Introduction RI-261561 WP4 Author: Robert Lovas, Ad Emmen version: 1.0 Prelude - what do people at home and SME’s think about grid computing Survey of EDGeS project Questionnaires all across Europe Get an idea of the interest in people and SMEs to donate computing time for science to a Grid Get an idea of the interest in running a Grid inside an SME RI-261561 GRID 2010, DUBNA Survey amongst the General Public and SME’s RI-261561 GRID 2010, DUBNA Opinions about Grid computing RI-261561 GRID 2010, DUBNA Survey - Conclusions Overall: there is interest in Desktop Grid computing in Europe. However, that people are willing to change their current practice and say that they want to participate in Grid efforts does not mean that they are actually going to do that. Need to generate trust in the organisation that manages the Grid. People want to donate computing time for scientific applications, especially medical applications. They do not like to donate computing time to commercial or defense applications. People want feedback on the application they are running. No clear technical barriers perceived by the respondents: so this does not need much attention. Overall the respondents were rather positive about donating computing time for a Grid or about running applications on a Grid. -
Addressing Selfishness in the Design of Cooperative Systems Guido Lena Cota
Addressing selfishness in the design of cooperative systems Guido Lena Cota To cite this version: Guido Lena Cota. Addressing selfishness in the design of cooperative systems. Computer Science and Game Theory [cs.GT]. Université de Lyon; Università degli studi (Milan, Italie). Convegno di studi (2000 ; Milano), 2017. English. NNT : 2017LYSEI023. tel-02191480 HAL Id: tel-02191480 https://tel.archives-ouvertes.fr/tel-02191480 Submitted on 23 Jul 2019 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. NNT : 2017LYSEI023 DOCTORAL THESIS Cotutelle-de-thèse INSTITUT NATIONAL DES SCIENCES APPLIQUÉES DE LYON ÉCOLE DOCTORALE ED 512 – INFORMATIQUE ET MATHÉMATIQUES DE LYON SPÉCIALITÉ INFORMATIQUE DIRECTOR: PROF. LUCA Q. ZAMBONI UNIVERSITÁ DEGLI STUDI DI MILANO DEPARTMENT OF COMPUTER SCIENCE CORSO DI DOTTORATO IN INFORMATICA (XXVIII CYCLE) – INF/01 COORDINATOR: PROF. PAOLO BOLDI Defended on 24 March 2017, by : Guido LENA COTA Addressing Selfishness in the Design of Cooperative Systems Supervisors: Prof. Lionel BRUNIE INSA de Lyon Prof. Ernesto DAMIANI Università degli Studi di Milano Cosupervisors: Dr. Sonia BEN MOKHTAR INSA de Lyon Dr. Gabriele GIANINI Università degli Studi di Milano EXAMINATION COMMITTEE: Reviewers: Prof. Harald KOSCH Universität Passau, Germany Prof. -
Volunteer Computing at CERN
Volunteer Computing at CERN - sustainability model proposal - Supervisors: Openlab Student: Ben Segal, Daniela Dorneanu, Miika Tuisku, [email protected] Francois Grey version 0.1 September 12, 2011 Contents 1 Executive summary 2 2 Introduction 3 2.1 What is Volunteer Computing? . .3 2.2 What is a Volunteer Cloud? . .3 2.3 Volunteer Cloud characteristics . .4 2.4 Case study objectives . .4 3 Analysis 5 3.1 Surveys and interviews for main stakeholders . .5 3.2 Volunteers Profiles . .5 3.3 Brainstorming . .6 4 Use Cases 7 4.1 Volunteer Cloud for CERN . .8 4.2 Volunteer Cloud for Industry - Openlab Model . 11 4.3 Nonprofit Volunteer Cloud . 13 4.4 Commercial Volunteer Cloud . 17 5 Conclusions and future steps 20 6 Acknowledgements 21 7 Annexes 22 7.1 Annex A - CernVM and CoPilot . 22 7.2 Annex B - Detailed Surveys . 22 7.3 Annex C - Detailed description of The Business Model Canvas . 24 8 References 27 1 1 Executive summary This report provides an analysis and evaluation of the possible sustainability models (business models) for Volunteer Cloud Computing. Currently on one side there are millions of volunteers willing to share their CPU power and on the other side there are scientists who need this CPU power but don't really know how to obtain this from the volunteers. Thus the main purpose of this report is to suggest different institutional arrangements that would lower the entry barrier for scientists to Volunteer Cloud Computing, and in particular present such resources to them as a service that was fully compatible with the way they use their current computing infrastructure. -
BOINC: a Platform for Volunteer Computing
BOINC: A Platform for Volunteer Computing David P. Anderson University of California, Berkeley Space Sciences Laboratory Berkeley, CA 94720 [email protected] December 9, 2018 Abstract “Volunteer computing” is the use of consumer digital devices for high-throughput scientific computing. It can provide large computing capacity at low cost, but presents challenges due to device heterogeneity, unreliability, and churn. BOINC, a widely-used open-source middleware system for volunteer computing, addresses these challenges. We describe its features, architecture, and implementation. Keywords BOINC, volunteer computing, distributed computing, scientific computing, high-throughput computing 1. Introduction 1.1 Volunteer computing Volunteer computing (VC) is the use of consumer digital devices, such as desktop and laptop computers, tablets, and smartphones, for high-throughput scientific computing. Device owners participate in VC by installing a program that downloads and executes jobs from servers operated by science projects. There are currently about 30 VC projects in many scientific areas and at many institutions. The research enabled by VC has resulted in numerous papers in Nature, Science, PNAS, Physical Review, Proteins, PloS Biology, Bioinformatics, J. of Mol. Biol., J. Chem. Phys, and other top journals [1]. About 700,000 devices are actively participating in VC projects. These devices have about 4 million CPU cores and 560,000 GPUs, and collectively provide an average throughput of 93 PetaFLOPS. The devices are primarily modern, high-end computers: they average 16.5 CPU GigaFLOPS and 11.4 GB of RAM, and most have a GPU capable of general-purpose computing using OpenCL or CUDA. 1 The potential capacity of VC is much larger: there are more than 2 billion consumer desktop and laptop computers [2]. -
Projects on BONIC?
PRESENTED BY: SAJIN GEORGE PRIYANKA ANGADI Overview of the talk ● GRID and Cluster computing and what are their differences. ● What is BOINC and how it works ? ● Key features of BOINC. ● Power consumption and Energy consumption. ● Projects that are currently using BOINC ● BONIC interface and Client Software. ● How to setup your own BOINC. GRID COMPUTING A distributed computing environment that uses its own resources to handle computational tasks. Grid VS Cluster Loosely coupled Tightly coupled systems (Decentralization) Single system image Diversity and Dynamism Centralized Job Distributed Job management & scheduling Management & scheduling system Volunteer computing. Volunteer computing is an arrangement in which people (volunteers) provide computing resources to projects, which use the resources to do distributed computing and/or storage. ● Volunteers are typically members of the general public who own Internet-connected PCs. Organizations such as schools and businesses may also volunteer the use of their computers. ● Projects are typically academic (university-based) and do scientific research. But there are exceptions; for example, GIMPS and distributed.net (two major projects) are not academic www.bonic.com What is B.O.I.N.C ? is a massive open-source grid computing tool by the university of berkeley. How BOINC works ? How the software works CREDIT The project's server keeps track of how much work your computer has done; this is called credit. To ensure that credit is granted fairly, most BOINC projects work as follows: ● Each task may be sent to two computers. ● When a computer reports a result, it claims a certain amount of credit, based on how much CPU time was used.