Glite 3.0 User Guide
Total Page:16
File Type:pdf, Size:1020Kb
WORLDWIDE LHC COMPUTING GRID GLITE 3.0 USER GUIDE MANUALS SERIES Document identifier: CERN-LCG-GDEIS-722398 EDMS id: 722398 Version: 0.1 Date: May 19, 2006 Section: Experiment Integration and Distributed Analysis Document status: PRIVATE Author(s): Stephen Burke, Simone Campana, Anto- nio Delgado Peris, Flavia Donno, Patricia Mendez´ Lorenzo, Roberto Santinelli, Andrea Sciaba` File: gLite-3-UserGuide Abstract: This guide is an introduction to the WLCG/EGEE Grid and to the gLite 3.0 middleware from a user’s point of view. Document Change Record Issue Item Reason for Change 20/04/06 v1.0 First Draft Files Software Products User files PDF https://edms.cern.ch/file/722398/1/gLite-3-UserGuide.pdf PS https://edms.cern.ch/file/722398/1/gLite-3-UserGuide.ps HTML https://edms.cern.ch/file/722398/1/gLite-3-UserGuide.html CERN-LCG-GDEIS-722398 Manuals Series Page 2 CONTENTS 1 INTRODUCTION . 8 1.1 ACKNOWLEDGMENTS . 8 1.2 OBJECTIVES OF THIS DOCUMENT . 8 1.3 APPLICATION AREA . 8 1.4 DOCUMENT EVOLUTION PROCEDURE . 8 1.5 REFERENCE AND APPLICABLE DOCUMENTS . 8 1.6 TERMINOLOGY . 12 1.6.1 Glossary . 12 2 EXECUTIVE SUMMARY . 15 3 OVERVIEW . 16 3.1 PRELIMINARY MATTERS. 17 3.1.1 Code Development . 17 3.1.2 Troubleshooting . 17 3.1.3 User and VO utilities . 17 3.2 THE WLCG/EGEE ARCHITECTURE. 18 3.2.1 Security . 18 3.2.2 User Interface . 19 3.2.3 Computing Element . 19 3.2.4 Storage Element . 20 3.2.5 Information Service . 21 3.2.6 Data Management . 25 CERN-LCG-GDEIS-722398 Manuals Series Page 3 3.2.7 Workload Management . 26 3.3 JOB FLOW . 26 3.3.1 Job Submission . 26 3.3.2 Other operations . 28 4 GETTING STARTED . 29 4.1 OBTAINING A CERTIFICATE . 29 4.1.1 X.509 Certificates . 29 4.1.2 Requesting the Certificate . 29 4.1.3 Getting the Certificate . 30 4.1.4 Renewing the Certificate . 31 4.2 REGISTERING WITH WLCG/EGEE. 31 4.2.1 The Registration Service . 31 4.2.2 Virtual Organisations . 32 4.3 SETTING UP THE USER ACCOUNT . 32 4.3.1 The User Interface . 32 4.3.2 Checking a Certificate . 33 4.4 PROXY CERTIFICATES . 35 4.4.1 Proxy Certificates . 35 4.4.2 Virtual Organisation Membership Service . 37 4.4.3 Proxy Renewal . 40 5 INFORMATION SERVICE . 43 5.1 THE MDS . 43 5.1.1 lcg-infosites . 43 5.1.2 lcg-info . 47 CERN-LCG-GDEIS-722398 Manuals Series Page 4 5.1.3 The Local GRIS . 49 5.1.4 The Site GIIS/BDII . 53 5.1.5 The top BDII . 55 5.2 R-GMA . 58 5.2.1 R-GMA concepts . 58 5.2.2 The R-GMA Browser . 59 5.2.3 The R-GMA CLI . 60 5.2.4 R-GMA APIs . 63 5.3 MONITORING . 63 5.3.1 GridICE . 64 6 WORKLOAD MANAGEMENT . 66 6.1 INTRODUCTION . 66 6.2 JOB DESCRIPTION LANGUAGE . 66 6.3 THE COMMAND LINE INTERFACE . 71 6.3.1 Job Submission . 72 6.3.2 Job Operations . 75 6.3.3 The BrokerInfo . 79 6.3.4 Interactive Jobs . 80 6.3.5 Checkpointable Jobs . 84 6.3.6 MPI Jobs . 85 6.3.7 Advanced Command Options . 89 7 DATA MANAGEMENT . 92 7.1 INTRODUCTION . 92 CERN-LCG-GDEIS-722398 Manuals Series Page 5 7.2 STORAGE ELEMENTS . 92 7.2.1 Data Channel Protocols . 92 7.2.2 The Storage Resource Manager interface . 93 7.2.3 Types of Storage Elements . 93 7.3 FILES NAMING CONVENTION IN GLITE 3.0 . 94 7.4 FILE CATALOGS IN GLITE 3.0. 95 7.4.1 LFC Commands . 96 7.5 FILE TRANSFER SERVICE . ..