TEAM LinG - Live, Informative, Non-cost and Genuine! ffirs.qxd 10/11/2004 3:44 PM Page i A NETWORKING APPROACH TO GRID COMPUTING TEAM LinG - Live, Informative, Non-cost and Genuine! ffirs.qxd 10/11/2004 3:44 PM Page ii TEAM LinG - Live, Informative, Non-cost and Genuine! ffirs.qxd 10/11/2004 3:44 PM Page iii A NETWORKING APPROACH TO GRID COMPUTING DANIEL MINOLI Managing Director Leading-Edge Networks Incorporated A JOHN WILEY & SONS, INC., PUBLICATION TEAM LinG - Live, Informative, Non-cost and Genuine! ffirs.qxd 10/11/2004 3:44 PM Page iv Copyright © 2005 by John Wiley & Sons, Inc. All rights reserved. Published by John Wiley & Sons, Inc., Hoboken, New Jersey. Published simultaneously in Canada. No part of this publication may be reproduced, stored in a retrieval system or transmitted in any form or by any means, electronic, mechanical, photocopying, recording, scanning or otherwise, except as permitted under Section 107 or 108 of the 1976 United States Copyright Act, without either the prior written permission of the Publisher, or authorization through payment of the appropriate per-copy fee to the Copyright Clearance Center, Inc., 222 Rosewood Drive, Danvers, MA 01923, (978) 750-8400, fax (978) 646-8600, or on the web at www.copyright.com. Requests to the Publisher for permission should be addressed to the Permissions Department, John Wiley & Sons, Inc., 111 River Street, Hoboken, NJ 07030, (201) 748-6011, fax (201) 748-6008. Limit of Liability/Disclaimer of Warranty: While the publisher and author have used their best efforts in preparing this book, they make no representation or warranties with respect to the accuracy or completeness of the contents of this book and specifically disclaim any implied warranties of merchantability or fitness for a particular purpose. No warranty may be created or extended by sales representatives or written sales materials. The advice and strategies contained herein may not be suitable for your situation. You should consult with a professional where appropriate. Neither the publisher nor author shall be liable for any loss of profit or any other commercial damages, including but not limited to special, incidental, consequential, or other damages. For general information on our other products and services please contact our Customer Care Department within the U.S. at 877-762-2974, outside the U.S. at 317-572-3993 or fax 317-572-4002. Wiley also publishes its books in a variety of electronic formats. Some content that appears in print, however, may not be available in electronic format. Library of Congress Cataloging-in-Publication Data is available. ISBN 0-471-68756-1 Printed in the United States of America. 10987654321 TEAM LinG - Live, Informative, Non-cost and Genuine! ffirs.qxd 10/11/2004 3:44 PM Page v For Anna, Emma, Emile, Gabrielle, Gino, Angela, and Peter TEAM LinG - Live, Informative, Non-cost and Genuine! ffirs.qxd 10/11/2004 3:44 PM Page vi TEAM LinG - Live, Informative, Non-cost and Genuine! ftoc.qxd 10/11/2004 3:48 PM Page vii Contents About the Author xiii Preface xv Acknowledgments xvii 1 Introduction 1 1.1 What Is Grid Computing And What Are The Key Issues? 1 1.2 Potential Applications and Financial Benefits of Grid Computing 10 1.3 Grid Types, Topologies, Components, and Layers— 13 A Preliminary View 1.4 Comparison with Other Approaches 21 1.5 A First Look at Grid Computing Standards 24 1.6 A Pragmatic Course of Investigation 27 2 Grid Benefits and Status of Technology 31 2.1 Motivations for Considering Computational Grids 31 2.2 Brief History of Computing, Communications, and Grid Computing 38 Communication 44 Computation 46 Grid Technology 47 2.3 Is Grid Computing Ready for Prime Time? 47 2.4 Early Suppliers and Vendors 51 2.5 Possible Economic Value 53 2.5.1 Possible Economic Value: One State’s Positioning 53 2.5.2 Possible Economic Value: Extrapolation 56 2.6 Challenges 56 3 Components of Grid Computing Systems and Architectures 63 3.1 Overview 63 3.2 Basic Constituent Elements—A Functional View 71 Portal/User Interface Function/Functional Block 85 The Grid Security Infrastructure: User Security 75 Function/Functional Block vii TEAM LinG - Live, Informative, Non-cost and Genuine! ftoc.qxd 10/11/2004 3:48 PM Page viii viii CONTENTS Node Security Function/Functional Block 76 Broker Function/Functional Block and Directory 76 Scheduler Function/Functional Block 77 Data Management Function/Functional Block 78 Job Management And Resource Management 78 Function/Functional Block User/Application Submission Function/Functional Block 79 Resources 79 Protocols 80 3.3 Basic Constituent Elements—A Physical View 81 Networks 81 Computation 84 Storage 85 Scientific Instruments 90 Software and licenses 91 3.4 Basic Constituent Elements—Service View 91 4 Standards Supporting Grid Computing: OGSI 101 4.1 Introduction 104 4.2 Motivations for Standardization 109 4.3 Architectural Constructs 113 4.3.1 Definitions 113 4.3.2 Protocol Perspective 115 4.3.3 Going From “Art” To “Science” 123 4.4 What is OGSA/OGSI? A Practical View 125 4.5 OGSA/OGSI Service Elements and Layered Model 129 4.5.1 Key Aspects 129 4.5.2 Ancillary Aspects 132 4.5.3 Implementations of OGSI 136 4.6 What is OGSA/OGSI? A More Detailed View 139 4.6.1 Introduction 139 4.6.2 Setting the Context 140 4.6.3 The Grid Service 145 4.6.4 WSDL Extensions and Conventions 145 4.6.5 Service Data 146 4.6.6 Core Grid Service Properties 149 4.6.7 Other Details 151 4.7 A Possible Application of OGSA/OGSI to Next-Generation 151 Open-Source Outsourcing 4.7.1 Opportunities 151 4.7.2 Outsourcing Trends 151 5 Standards Supporting Grid Computing: OGSA 155 5.1 Introduction 156 5.2 Functionality Requirements 158 TEAM LinG - Live, Informative, Non-cost and Genuine! ftoc.qxd 10/11/2004 3:48 PM Page ix CONTENTS ix 5.2.1 Basic Functionality Requirements 159 5.2.2 Security Requirements 160 5.2.3 Resource Management Requirements 161 5.2.4 System Properties Requirements 162 5.2.5 Other Functionality Requirements 163 5.3 OGSA Service Taxonomy 164 5.3.1 Core Services 166 5.3.2 Data Services 168 5.3.3 Program Execution 169 5.3.4 Resource Management 173 5.4 Service Relationships 173 5.4.1 Service Composition 174 5.4.2 Service Orchestration 175 5.4.3 Types of Relationships 176 5.4.4 Platform Services 176 5.5 OGSA Services 177 5.5.1 Handle Resolution 177 5.5.2 Virtual Organization Creation and Management 178 5.5.3 Service Groups and Discovery Services 178 5.5.4 Choreography, Orchestrations and Workflow 180 5.5.5 Transactions 180 5.5.6 Metering Service 181 5.5.7 Rating Service 182 5.5.8 Accounting Service 182 5.5.9 Billing and Payment Service 182 5.5.10 Installation, Deployment, and Provisioning 183 5.5.11 Distributed Logging 183 5.5.12 Messaging and Queuing 184 5.5.13 Event 186 5.5.14 Policy and Agreements 187 5.5.15 Base Data Services 188 5.5.16 Other Data Services 190 5.5.17 Discovery Services 191 5.5.18 Job Agreement Service 192 5.5.19 Reservation Agreement Service 192 5.5.20 Data Access Agreement Service 193 5.5.21 Queuing Service 193 5.5.22 Open Grid Services Infrastructure 193 5.5.23 Common Management Model 195 5.6 Security Considerations 196 5.7 Examples of OGSA Mechanisms in Support of VO Structures 197 6 Grid System Deployment Issues, Approaches, and Tools 201 6.1 Generic Implementations: Globus Toolkit 201 6.1.1 Globus Toolkit tools and APIs 203 TEAM LinG - Live, Informative, Non-cost and Genuine! ftoc.qxd 10/11/2004 3:48 PM Page x x CONTENTS 6.1.2 Details on Key Tookit Protocols 207 6.1.3 Globus Toolkit Version 3 213 6.1.4 Applications 216 6.2 Grid Computing Environments 217 6.2.1 Introduction 217 6.2.2 Portal Services 219 6.3 Basic Grid Deployment and Management Issues 220 6.3.1 Products Categories 221 6.3.2 Business Grid Types 221 6.3.3 Deploying a Basic Computing Grid 223 6.3.4 Deploying More Complex Computing Grids 224 6.3.5 Grid Networking Infrastucture Required for Deployment 226 6.3.6 Grid Operation—Basic Steps 230 6.3.7 Deployment Challenges and Approaches 231 6.4 Grid Security Details—Deployment Peace of Mind 234 6.4.1 Basic Approach and Mechanisms 234 6.4.2 Additional Perspectives 236 6.4.3 Conclusion 249 7 Grid System Economics 251 7.1 Introduction 252 7.2 Grid Economic Services Architecture 255 7.2.1 Introduction 255 7.2.2 Overview 256 7.2.3 The Chargeable Grid Service (CGS) 258 7.2.4 The Grid Payment System 267 7.2.5 GPSHold Service 274 7.2.6 The Grid CurrencyExchange Service 275 7.2.7 An Example 277 7.2.8 Security Considerations 280 8 Communication Systems for Local Grids 281 8.1 Introduction and Positioning 281 8.2 SAN-Related Technology 284 8.2.1 Fibre Channel Technology—Native Mode 285 8.2.2 Fibre Channel Technology—Tunneled Modes 298 8.3 LAN-Related Technology 303 8.3.1 Standards 303 8.3.2 Key concepts 307 9 Communication Systems for National Grids 313 9.1 Multilink Frame Relay 313 9.1.1 Motivations and Scope 315 9.1.2 Multilink Frame Relay Basics 319 TEAM LinG - Live, Informative, Non-cost and Genuine! ftoc.qxd 10/11/2004 3:48 PM Page xi CONTENTS xi 9.2 MPLS Technology 321 9.2.1 Approaches 322 9.2.2 MPLS Operation 324 9.2.3 Key Mechanisms Supporting MPLS 328 9.2.4 Service Availability 332 10 Communication Systems for Global Grids 333 10.1 The Basics of Layer 2 and layer 3 VPNs 334 10.2 The Layer 3 Approach 334 10.3 Layer 2 MPLS VPNs-A Different Philosophy 336 10.4 Which Works Better Where? 337 10.5 A Grid Computing Application 338 References 339 Glossary 353 Index 365 TEAM LinG - Live, Informative, Non-cost and Genuine! ftoc.qxd 10/11/2004 3:48 PM Page xii TEAM LinG - Live, Informative, Non-cost and Genuine! fbetw.qxd 10/11/2004 3:51 PM Page xiii About the Author Daniel Minoli has many years of IT, telecom, and networking experience for end users and carriers, including work at AIG, ARPA think tanks, Bell Telephone Lab- oratories, ITT, Prudential Securities, Bell Communications Research (Bellcore/Tel- cordia), and AT&T (1975–2001).