Idgf-Sp D221
Total Page:16
File Type:pdf, Size:1020Kb
International Desktop Grid Federation – Support Project Contract number: RI-312297 Production, Development, Test, and Validation Infrastructure Project deliverable: D2.2.1 Due date of deliverable: 31/07/2013 Actual submission date: 31/07/2013 Lead beneficiary: MTA SZTAKI Workpackage: WP2 - Supporting infrastructure Dissemination Level: PU (Public) Version: 1.4 (FINAL) IDGF-SP is supported by the FP7 Capacities Programme under contract nr RI-312297. D2.2.1 – Production, Development, Test and Validation Infrastructure Copyright (c) 2013. Members of IDGF-SP consortium, see http://idgf-sp.eu/partners for details on the copyright holders. You are permitted to copy and distribute verbatim copies of this document containing this copyright notice but modifying this document is not allowed. You are permitted to copy this document in whole or in part into other documents if you attach the following reference to the copied elements: ‘Copyright (c) 2013. Members of IDGF-SP consortium - http://idgf-sp.eu’. The commercial use of any information contained in this document may require a license from the proprietor of that information. The IDGF-SP consortium members do not warrant that the information contained in the deliverable is capable of use, or that use of the information is free from risk, and accept no liability for loss or damage suffered by any person and organisation using this information. WP2 Copyright (c) 2013. Members of IDGF-SP consortium - http://idgf-sp.eu 2/65 D2.2.1 – Production, Development, Test and Validation Infrastructure 1 Table of Contents 1 Table of Contents ............................................................................................................ 3 2 Status and Change History .............................................................................................. 5 3 Glossary .......................................................................................................................... 6 4 Introduction ..................................................................................................................... 8 5 Production infrastructures ................................................................................................ 9 5.1 Desktop grids ........................................................................................................... 9 5.1.1 ABC@home ...................................................................................................... 9 5.1.2 AlmereGrid ...................................................................................................... 12 5.1.3 Charity Engine ................................................................................................. 12 5.1.4 EDGeS@home ............................................................................................... 15 5.1.5 SZTAKI Desktop Grid ...................................................................................... 19 5.1.6 Westminster University Local Desktop Grid ..................................................... 23 5.2 Service grids and bridges ....................................................................................... 24 5.2.1 gLite to DG bridge ........................................................................................... 24 5.2.2 DG to gLite ...................................................................................................... 27 5.3 Science gateways .................................................................................................. 30 5.3.1 Westminter Portal ............................................................................................ 30 5.3.2 Autodock Portal ............................................................................................... 31 5.4 Application Repositories ......................................................................................... 33 5.4.1 DG enabled Applications in the AppDB of EGI ................................................ 33 5.4.2 Super-repository with IDGF supported applications ......................................... 34 5.4.3 EDGI Repository ............................................................................................. 37 5.5 Cloud infrastructure ................................................................................................ 39 5.5.1 LPDS (department-level) Cloud of SZTAKI...................................................... 39 5.5.2 Central Academic Cloud of SZTAKI ................................................................ 40 5.5.3 The University of Westminster Cloud............................................................... 41 WP2 Copyright (c) 2013. Members of IDGF-SP consortium - http://idgf-sp.eu 3/65 D2.2.1 – Production, Development, Test and Validation Infrastructure 5.5.4 Cloud resources behind EDGeS@home ......................................................... 42 5.6 Monitoring and accounting services........................................................................ 46 5.6.1 Monitoring consistency .................................................................................... 46 5.6.2 Monitoring availability ...................................................................................... 47 5.6.3 Monitoring performance................................................................................... 47 5.6.4 Monitoring the availability of the computing elements ...................................... 48 5.6.5 Accounting ...................................................................................................... 49 6 Test infrastructures ........................................................................................................ 55 6.1 EDGI demo BOINC project ..................................................................................... 55 6.1.1 Installed software versions .............................................................................. 55 6.1.2 Installed BOINC applications ........................................................................... 56 6.1.3 Submission to the desktop grid using the 3G Bridge directly ........................... 56 6.2 ABC@home ........................................................................................................... 58 6.3 Power consumption analysis by SONY .................................................................. 59 6.4 DesktopGrid testbed at JINR .................................................................................. 59 7 Development and Validation infrastructure .................................................................... 61 7.5 On-demand DG infrastructure at SZTAKI ............................................................... 61 7.5.1 Overview ......................................................................................................... 61 7.5.2 Short manual of the images ............................................................................. 61 7.6 Application development infrastructure at the University of Westminster ................ 64 7.6.1 Developing and testing BOINC applications .................................................... 64 7.6.2 Developing and testing custom user interfaces for DG applications ................ 64 WP2 Copyright (c) 2013. Members of IDGF-SP consortium - http://idgf-sp.eu 4/65 D2.2.1 – Production, Development, Test and Validation Infrastructure 2 Status and Change History Status: Name: Date: Signature: Draft: Jozsef Kovacs 17/07/13 n.n. electronically Reviewed: Reka Makkos, Robert 30/07/13 n.n. electronically Lovas Approved: Robert Lovas 31/07/13 n.n. electronically Version Date Section/Part Author Modification 1.0 17/07/13 All sections JK Creation of the initial version SZTAKI 1.1 19/07/13 All sections team Adding services from SZTAKI Consortium 1.2 22/07/13 All sections members Integrating materials from other partners 1.3 24/07/13 All sections JK Formatting Minor changes based on review, integrate 1.4 30/07/13 5.1.2, 7.6 RL, TK, AE some updates WP2 Copyright (c) 2013. Members of IDGF-SP consortium - http://idgf-sp.eu 5/65 D2.2.1 – Production, Development, Test and Validation Infrastructure 3 Glossary 3G Bridge Generic Grid-Grid Bridge APEL Accounting Processor for Event Logs (tool for accounting in EGI) ARC Advanced Resource Connector (grid middleware) CE gLite Computing Element (grid middleware component) CLI Command-Line Interface CO Confidential CREAM Computing Resource Execution And Management (gLite CE) BOINC Berkeley Open Infrastructure for Network Computing DC-API Distributed Computing Application Programming Interface DCI Distributed Computing Infrastructure DEGISCO Desktop Grids for International Scientific Collaboration DG Desktop Grid DoW Description of Work EC European Commission EC2 Amazon Elastic Compute Cloud EDGeS Enabling Desktop Grids for e-Science EDGI European Desktop Grid Initiative EGI European Grid Infrastructure FLOPS FLoating point Operations Per Second GBAC Generic BOINC Application Client GenWrapper Generic Wrapper tool for BOINC applications gLite Middleware for Grid Computing supported by EGI GOCDB Grid Configuration Database GPL General Public License (open-source license) GRID Distributed Computational Network WP2 Copyright (c) 2013. Members of IDGF-SP consortium - http://idgf-sp.eu 6/65 D2.2.1 – Production, Development, Test and Validation Infrastructure GUI Graphical User Interface gUSE Grid and cloud User Support Environment (web-based portal) IDGF International Desktop Grid Federation mCE modified (gLite) Computing Element