Report on Best Practices in Infrastructure Support
Total Page:16
File Type:pdf, Size:1020Kb
International Desktop Grid Federation – Support Project Contract number: RI-312297 Report on best practices in infrastructure support Project deliverable: D2.3.1 Due date of deliverable: 30/04/2013 Actual submission date: 08/07/2013 Lead beneficiary: MTA SZTAKI Workpackage: WP2 - Supporting infrastructure Dissemination Level: PU (Public) Version: 6.0 (FINAL) IDGF-SP is supported by the FP7 Capacities Programme under contract nr RI-312297. D2.3.1 – Report on best practices in infrastructure support Copyright (c) 2013. Members of IDGF-SP consortium, see http://idgf-sp.eu/partners for details on the copyright holders. You are permitted to copy and distribute verbatim copies of this document containing this copyright notice but modifying this document is not allowed. You are permitted to copy this document in whole or in part into other documents if you attach the following reference to the copied elements: ‘Copyright (c) 2013. Members of IDGF-SP consortium - http://idgf-sp.eu’. The commercial use of any information contained in this document may require a license from the proprietor of that information. The IDGF-SP consortium members do not warrant that the information contained in the deliverable is capable of use, or that use of the information is free from risk, and accept no liability for loss or damage suffered by any person and organisation using this information. WP2 Copyright (c) 2013. Members of IDGF-SP consortium - http://idgf-sp.eu 2/52 D2.3.1 – Report on best practices in infrastructure support 1 Table of Contents 1 Table of Contents ............................................................................................................................ 3 2 Status and Change History .............................................................................................................. 5 3 Glossary ........................................................................................................................................... 6 4 Introduction ..................................................................................................................................... 8 5 Best practices in support tools ......................................................................................................... 9 5.1 Non-DG related tools .............................................................................................................. 9 5.2 DG related tools ..................................................................................................................... 11 6 Best practices in different desktop grid scenarios ......................................................................... 14 6.1 Simple scenarios .................................................................................................................... 14 6.1.1 SZDG BOINC project with the KOPI application ........................................................ 15 6.1.2 edges@home with clouds .............................................................................................. 27 6.2 Complex scenarios ................................................................................................................. 30 6.2.1 University of Westminster Local Desktop Grid ............................................................ 31 6.2.2 Autodock portal + edges@home ................................................................................... 35 6.3 Bridging scenarios ................................................................................................................. 38 6.3.1 Modified Computing Element + edges@home ............................................................. 39 6.3.2 Bridges from DGs to the DesktopGrid VO ................................................................... 43 7 Best practices for security in desktop grid computing................................................................... 44 7.1 Introduction ........................................................................................................................... 44 7.2 Securing servers ..................................................................................................................... 44 7.3 Securing the grid .................................................................................................................... 45 7.4 Making projects reliable ........................................................................................................ 46 8 Further case studies ....................................................................................................................... 47 8.1 DesktopGrid Testbed at JINR................................................................................................ 47 8.2 DIRAC supported by EDGeS@home ................................................................................... 48 8.3 Charity Engine ....................................................................................................................... 48 WP2 Copyright (c) 2013. Members of IDGF-SP consortium - http://idgf-sp.eu 3/52 D2.3.1 – Report on best practices in infrastructure support 8.3.1 How we raise money for great causes -- and the prize draw ......................................... 49 8.3.2 How the prize winner is chosen ..................................................................................... 49 9 Questionnaire for BOINC project operators .................................................................................. 50 10 References ................................................................................................................................. 52 WP2 Copyright (c) 2013. Members of IDGF-SP consortium - http://idgf-sp.eu 4/52 D2.3.1 – Report on best practices in infrastructure support 2 Status and Change History Status: Name: Date: Signature: Draft: Jozsef Kovacs 09/05/13 n.n. electronically Reviewed: Adam Visegradi, Reka 12/06/13 n.n. electronically Makkos Approved: Robert Lovas 5/7/13 n.n. electronically Version Date Section/Part Author Modification 1.0 18/04/13 All sections JK Creation of the initial version 1.1 23/04/13 All sections JK, TK Updating sections 2.0 25/04/13 Section 8 JK, MM Adding case studies 2.1 02/05/13 Section 7 AM Adding section on “best practices for security…” 3.0 06/05/13 Section 1 JK, RL Improving introduction Adding more materials to introduction, shortening Section section 6.1.1, updating references, adding section 4.0 20/05/13 4,6,9,10 JK, RL about the questionnare 5.0 5/06/13 All sections JK Minor corrections 6.0 29/06/13 All sections RL Final version (after review) WP2 Copyright (c) 2013. Members of IDGF-SP consortium - http://idgf-sp.eu 5/52 D2.3.1 – Report on best practices in infrastructure support 3 Glossary 3G Bridge Generic Grid-Grid Bridge APEL Accounting Processor for Event Logs (tool for accounting in EGI) ARC Advanced Resource Connector (grid middleware) CE gLite Computing Element (grid middleware component) CLI Command-Line Interface CO Confidential CREAM Computing Resource Execution And Management (gLite CE) BOINC Berkeley Open Infrastructure for Network Computing DC-API Distributed Computing Application Programming Interface DCI Distributed Computing Infrastructure DEGISCO Desktop Grids for International Scientific Collaboration DG Desktop Grid DoW Description of Work EC European Commission EC2 Amazon Elastic Compute Cloud EDGeS Enabling Desktop Grids for e-Science EDGI European Desktop Grid Initiative EGI European Grid Infrastructure FLOPS FLoating point Operations Per Second GBAC Generic BOINC Application Client GenWrapper Generic Wrapper tool for BOINC applications gLite Middleware for Grid Computing supported by EGI GOCDB Grid Configuration Database GPL General Public License (open-source license) GRID Distributed Computational Network WP2 Copyright (c) 2013. Members of IDGF-SP consortium - http://idgf-sp.eu 6/52 D2.3.1 – Report on best practices in infrastructure support GUI Graphical User Interface gUSE Grid and cloud User Support Environment (web-based portal) IDGF International Desktop Grid Federation mCE modified (gLite) Computing Element MUNIN network/system monitoring application that presents output in graphs NAGIOS Monitoring system in EGI NGI National Grid Initiatives OurGrid Free-to-join peer-to-peer Grid computing platform PU Public REST Representational State Transfer (web-service interface) SAM Service Availability Monitoring SG Service Grid SOAP Simple Object Access Protocol (web-service interface) SVN Apache Subversion UNICORE Uniform Interface to Computing Resources (grid middleware) VO Virtual Organisation WLDG Westminster Local Desktop Grid WM Virtual Machine WMS Workload Management System (gLite component) WN Worker Node (gLite component) WP Workpackage WU WorkUnit (task to be processed by a computational resource) XML Extensible Markup Language (document format) XWHEP XtremWeb for High Energy Physics: Desktop Grid Middleware ZENWorks Software product for computer systems management WP2 Copyright (c) 2013. Members of IDGF-SP consortium - http://idgf-sp.eu 7/52 D2.3.1 – Report on best practices in infrastructure support 4 Introduction The IDGF-Support Project aims to give the IDGF a boost in two important areas. Firstly it helps considerably with increasing the number of citizens that donate computing time to e-Science. It is to be achieved by targeted communication activities and by setting up a network of "ambassadors". Secondly it is to help universities and other organisations to include otherwise idle PCs