Grid Networks Enabling Grids with Advanced Communication Technology Franco Travostino, Nortel, USA Joe Mambretti, Northwestern University, USA Gigi Karmous-Edwards, MCNC, USA Grid Networks Grid Networks Enabling Grids with Advanced Communication Technology Franco Travostino, Nortel, USA Joe Mambretti, Northwestern University, USA Gigi Karmous-Edwards, MCNC, USA Copyright © 2006 John Wiley & Sons Ltd, The Atrium, Southern Gate, Chichester, West Sussex PO19 8SQ, England Telephone (+44) 1243 779777 Email (for orders and customer service enquiries): [email protected] Visit our Home Page on www.wiley.com All Rights Reserved. No part of this publication may be reproduced, stored in a retrieval system or transmitted in any form or by any means, electronic, mechanical, photocopying, recording, scanning or otherwise, except under the terms of the Copyright, Designs and Patents Act 1988 or under the terms of a licence issued by the Copyright Licensing Agency Ltd, 90 Tottenham Court Road, London W1T 4LP, UK, without the permission in writing of the Publisher. Requests to the Publisher should be addressed to the Permissions Department, John Wiley & Sons Ltd, The Atrium, Southern Gate, Chichester, West Sussex PO19 8SQ, England, or emailed to [email protected], or faxed to +44 1243 770620. This publication is designed to provide accurate and authoritative information in regard to the subject matter covered. It is sold on the understanding that the Publisher is not engaged in rendering professional services. If professional advice or other expert assistance is required, the services of a competent professional should be sought. Other Wiley Editorial Offices John Wiley & Sons Inc., 111 River Street, Hoboken, NJ 07030, USA Jossey-Bass, 989 Market Street, San Francisco, CA 94103-1741, USA Wiley-VCH Verlag GmbH, Boschstr. 12, D-69469 Weinheim, Germany John Wiley & Sons Australia Ltd, 42 McDougall Street, Milton, Queensland 4064, Australia John Wiley & Sons (Asia) Pte Ltd, 2 Clementi Loop #02-01, Jin Xing Distripark, Singapore 129809 John Wiley & Sons Canada Ltd, 6045 Freemont Blvd, Mississauga, Ontario, Canada, L5R 4J3 Library of Congress Cataloging in Publication Data Grid networks : enabling grids with advanced communication technology / [edited by] Franco Travostino, Joe Mambretti, Gigi Karmous-Edwards. p. cm. Includes bibliographical references. ISBN-13: 978-0-470-01748-7 ISBN-10: 0-470-01748-1 1. Computational grids (Computer systems) 2. Computer networks—Design and construction. 3. Wireless communication systems—Design and construction. 4. Optical communications—Design and construction. I. Travostino, Franco. II. Mambretti, Joel, 1948– III. Karmous-Edwards, Gigi. QA76.9.C58G7559 2006 004.36—dc22 2006016095 British Library Cataloguing in Publication Data A catalogue record for this book is available from the British Library ISBN-13: 978-0-470-01748-7 ISBN-10: 0-470-01748-1 Typeset in 10/12pt Garamond by Integra Software Services Pvt. Ltd, Pondicherry, India Printed and bound in Great Britain by Antony Rowe Ltd, Chippenham, Wiltshire This book is printed on acid-free paper responsibly manufactured from sustainable forestry in which at least two trees are planted for each one used for paper production. Dedication For Franco, To Suely, Giulia and Matteo For Joe, To Catherine For Gigi, To Layah, Kamila, and Tony Contents Editors and Contributors xix Contributors xxi Foreword xxv Acknowledgments xxvii Introduction: The Grid and Grid Networks xxix 1 The Grid and Grid Network Services 1 Joe Mambretti 1.1 Introduction 1 1.2 Network Resources as First-class Grid Entities 1 1.2.1 What is a Grid? 2 1.3 The General Attributes of Grids 3 1.3.1 The Grid and Design Abstraction 5 1.3.2 The Grid as an Enabler of Pervasive, Programmable Utility Services 6 1.4 Types of Grids 7 1.4.1 Grids and Grid Networks 8 1.4.2 Attributes of Grid Networks 9 1.5 Grid Networks and Emerging Communication Technologies 14 References 14 2 Grid Network Requirements and Driver Applications 17 2.1 Introduction 17 2.2 Grid Network Requirements for Large-scale Visualization and Collaboration 18 Jason Leigh, Luc Renambot, and Maxine Brown 2.2.1 Large-scale Visualization and Collaboration Application Drivers 18 2.2.2 Current Limitations to Advanced Visualization and Collaboration 19 viii Contents 2.2.3 Enabling Advanced Visualization and Collaboration with the Optiputer 20 2.2.4 Future Challenges in Large-scale Visualization and Collaboration 22 Acknowledgments 23 2.3 Large-scale E-science 24 Peter Clarke 2.3.1 Data Management for the Large Hadron Collider Project 25 2.3.2 Large-scale Computational Science 26 2.3.3 Summary 30 Acknowledgments 30 2.4 Data Mining 30 Robert Grossman 2.4.1 Important Steps in the Data Mining Process 31 2.4.2 Main Steps in Distributed Data Mining Using Commodity Networks 31 2.4.3 Main Steps in Distributed Data Mining Using Optical Grids 32 2.5 CineGrid, a Grid for Digital Cinema 33 Tom DeFanti, Laurin Herr, and Natalie Van Osdol 2.5.1 Trends 34 2.5.2 CineGrid Cinema-centric Research 34 2.5.3 CineGrid Consortium 36 2.6 Distributed Aircraft Maintenance Environment (DAME) 36 Tom Jackson, Jim Austin, and Martyn Fletcher 2.6.1 Use Case Introduction 36 2.6.2 Dame Customers 37 2.6.3 Scenarios 37 2.6.4 Resources Involved 39 2.6.5 Functional Requirements 39 2.6.6 Security Considerations 40 2.6.7 Performance Considerations 40 2.6.8 Use Case Situation Analysis 40 Acknowledgments 41 2.7 Financial Services: Regulatory and Market Forces Motivating a Move to Grid Networks 41 Robert B. Cohen 2.7.1 New Challenges for Financial Institutions and Networks 41 2.7.2 Factors Driving Banks to Adopt Grids and High-speed Networks 41 2.7.3 How Financial Institutions will Use Networks to Facilitate Grid Computing 43 2.7.4 Globalization of Financial Markets 44 2.7.5 Migration of Financial Institutions to Grid Networks 45 2.7.6 Conclusions 46 2.8 Summary of Requirements 47 References 47 Contents ix 3 Grid Network Requirements and Architecture 49 Joe Mambretti and Franco Travostino 3.1 Introduction 49 3.2 Requirements 50 3.2.1 Requirements and Coexistence of Diverse Network User Communities 50 3.2.2 Abstraction/Virtualization 52 3.2.3 Resource Sharing and Site Autonomy 53 3.2.4 Flexibility Through Programmability 54 3.2.5 Determinism 54 3.2.6 Decentralized Management and Control 56 3.2.7 Dynamic Integration 56 3.2.8 Resource Sharing 57 3.2.9 Scalability 57 3.2.10 High Performance 58 3.2.11 Security 59 3.2.12 Pervasiveness 59 3.2.13 Customization 59 3.3 Translating Requirements to Architecture 60 3.3.1 IETF RFC 2768 60 3.3.2 Service-oriented Architecture 61 3.3.3 A Multitier Architecture for Grids 61 3.3.4 Introducing Grid Network Services 63 Acknowledgment 65 References 65 4 Relevant Emerging Network Architecture from Standards Bodies 67 Franco Travostino 4.1 Introduction 67 4.2 Global Grid Forum (GGF) 68 4.3 Enterprise Grid Alliance (EGA) 69 4.4 Organization for the Advancement of Structured Information Standards (OASIS) 70 4.5 World Wide Web Consortium (W3C) 71 4.6 The IPSphere Forum 71 4.7 MPI Forum 71 4.8 Internet Engineering Task Force (IETF) 71 4.9 Distributed Management Task Force (DMTF) 73 4.10 International Telecommunication Union (ITU-T) 74 4.11 Optical Internetworking Forum (OIF) 75 4.12 Infiniband Trade Association (IBTA) 75 4.13 Institute of Electrical and Electronics Engineers (IEEE) 76 References 77 x Contents 5 Grid Network Services and Implications for Network Service Design 81 Joe Mambretti, Bill St. Arnaud, Tom DeFanti, Maxine Brown, and Kees Neggers 5.1 Introduction 81 5.2 Traditional Communications Services Architecture 82 5.3 Grid Architecture as a Service Platform 82 5.3.1 Grid Network Services Architecture 83 5.4 Network Services Architecture: An Overview 84 5.4.1 Services Architecture Benefits 84 5.5 Grid Network Services Implications 86 5.6 Grid Network Services and Network Services 86 5.6.1 Deterministic Networking and Differentiated Services 87 5.7 Grid Network Service Components 88 5.7.1 Network Service Advertisements and OGSA 88 5.7.2 Web Services 89 5.7.3 Web Services Definition Language (WSDL) 89 5.7.4 Universal Description, Discovery, and Integration (UDDI) 90 5.7.5 Web Services-Inspection Language (WSIL) 90 5.7.6 Network Service Design and Development Tools 90 5.8 New Techniques for Grid Network Services Provisioning 91 5.8.1 Flexible Communication Services Provisioning 91 5.8.2 Partitionable Network Environments 91 5.8.3 Services Provisioning and Signaling 92 5.9 Examples of Grid Network Services Prototypes 92 5.9.1 A Layer 3 Grid Network Services Prototype 93 5.9.2 APIS and Signaling for Dynamic Path Provisioning 93 5.9.3 A Layer 2 Grid Network Services Prototype 94 5.9.4 Services-oriented Architecture for Grids Based on Dynamic Lightpath Provisioning 94 5.9.5 Optical Dynamic Intelligent Network Services (ODIN) 95 5.9.6 User-Controlled Lightpath Provisioning 95 5.10 Distributed Facilities for Services Oriented Networking 96 5.10.1 Provisioning Grid Network Services 97 References 97 6 Grid Network Services: Building on Multiservice Networks 99 Joe Mambretti 6.1 Introduction 99 6.2 Grid Network Services and Traditional Network Services 100 6.2.1 The Grid and Network Quality of Service 100 6.3 Network Service Concepts and the End-to-end Principle 101 6.3.1 Network Quality of Service and Applications Quality of Service 102 6.4 Grid Architecture and the Simplicity Principle 102 Contents xi 6.4.1 Network Design and State Information 103 6.4.2 Internet Best Effort Services 104 6.5 Grids and Internet Transport Layer Services 105 6.6 IETF Differentiated