WP3 – D3.1 Grid Component Specification Report Project Number: FP6 – 2005 - IST5 - 033634 Project Title: Grid Economics and Business Models D3.1: Grid Component Specification Deliverable Number and Title: Report Contractual Date of Delivery to EC: M7 2007 Actual Date of Delivery to EC: M9 2007 WP contributing to the Deliverable: WP3 Nature of the Deliverable: R Deliverable Security Class: PU Editor: IU IU, ICL, GISP, RTEL, LCMG, AUEB, Contributors: ATC Current Version: V36 Abstract: The aim of this report is: - To gather and determine existing key Grid software components that are relevant for an economic Grid. - To define Grid components that are economics-aware. - To find and consider design parameters that have an impact on the applicability of modelling results. - To specify those Grid components that can be adapted to become economics- aware or specify new Grid components. And finally to choose Grid components that represent and reflect the needs and expertise of the consortium partners. © Copyright by the GridEcon Consortium WP3 – D3.1: Grid Component Specification Report Executive Summary There are many Grid technologies and middleware available today. However, these do not provide the basic functionality needed to support the economic mechanisms of an economics-aware Grid. From the view point of an economics-aware operation of Grids, the existing tools are therefore inadequate for compute resource markets. The objective of this deliverable d3.1 (i.e. Task3.1 of work package 3.1) is to analyze existing Grid technologies and their capabilities (chapter 2). This will demonstrate the lack of economic components in the existing Grid technologies today. The missing functionality will be identified and, then, the new economics-aware components will be described (chapter 3). The missing functionality will then be mapped to the new components; thereby justifying the need for them (chapter 4). The development of new components is done with two markets in mind. The first is a basic resource market, in which customers are able to buy compute resources according to their needs. The second market will be built on top of this market and is used to sell composite Grid services, which are used to integrate quality requirements to Grid resources. This approach allows us to provide a common infrastructure for different kinds of applications. Once the market components have been further specified and developed, Grid computing will become the enabler of new lucrative business models in a market- managed, service-oriented economy. IST – 033634 GRIDECON 2 WP3 – D3.1: Grid Component Specification Report List of Abbreviations Acronym Explanation A4C Authentication Authorization Accounting and Charging CA Certification Authority DGAS Distributed Grid Accounting System EGEE Enabling Grids for e-Science GLUE Grid Laboratory for Uniform Environment GMA Grid Monitoring Architecture GRAM Globus Resource Allocation Manager GSI Grid Security Infrastructure LCG Worldwide Large Hadron Collider Computing Grid OGSA Open Grid Services Architecture OGSI Open Grid Service Interface PBS Portable Batch System R-GMA Relational Grid Monitoring Architecture SGAS Swedish Grid Accounting System SLA Service Level Agreements VO Virtual Organization WS-DAI Web Services Data Access and Integration WSRF Web Services Resource Framework IST – 033634 GRIDECON 3 WP3 – D3.1: Grid Component Specification Report Table of Contents EXECUTIVE SUMMARY ...........................................................................................2 LIST OF ABBREVIATIONS........................................................................................3 Table of Contents...........................................................................................................4 Table of Figures .............................................................................................................6 1 Introduction............................................................................................................7 2 Grid Middleware....................................................................................................9 2.1 Public Domain Grid Middleware.................................................................9 2.1.1 Globus....................................................................................................9 2.1.2 gLite .....................................................................................................10 2.1.3 GRIA....................................................................................................11 2.1.4 Gridbus.................................................................................................12 2.1.5 GridSAM..............................................................................................18 2.2 Commercial Grid Middleware ...................................................................18 2.2.1 SUN N1 Grid Engine...........................................................................18 2.2.2 GigaSpaces Grid Engine......................................................................19 2.2.3 Univa....................................................................................................21 2.2.4 Datasynapse (Grid Server / Fabric Server) ..........................................22 2.2.5 Gemstone .............................................................................................22 2.2.6 Altair PBS Professional .......................................................................23 2.2.7 Tangosol...............................................................................................24 2.2.8 g-Eclipse ..............................................................................................24 2.2.9 Grid MP...............................................................................................25 2.3 Commercial Grid Middleware and Grid Resources...................................25 2.3.1 Amazon Elastic Compute Cloud..........................................................26 2.3.2 Sun Grid Compute Utility....................................................................28 2.4 Programming Frameworks for Service-Oriented Architectures ................30 2.4.1 GigaSpaces’s Rio Architecture............................................................30 2.5 Shortcomings of Existing Grid Middleware..............................................31 2.5.1 Public domain Grid middleware ..........................................................32 2.5.2 Commercial middleware......................................................................33 2.5.3 Main shortcomings...............................................................................34 3 Grid Architecture.................................................................................................35 3.1 General Grid Computing Architecture.......................................................35 3.1.1 Resources layer....................................................................................36 3.1.2 Grid resource service layer ..................................................................37 3.1.3 Grid software service layer ..................................................................37 3.1.4 User and application layer ...................................................................38 3.2 Functional Analysis of the GridEcon Reference Business Models ...........38 3.2.1 Reference Business Model: Economically Efficient Utility Computing 38 3.2.2 Reference Business Model: Software as a Service (SaaS) ..................40 3.3 GridEcon Reference Architecture..............................................................42 4 Specification of Economic-Aware Grid Components .........................................45 4.1 Billing Stack...............................................................................................46 IST – 033634 GRIDECON 4 WP3 – D3.1: Grid Component Specification Report 4.1.1 Metering, Monitoring and Mediation Service .....................................46 4.1.2 Accounting Service..............................................................................47 4.1.3 Pricing Service.....................................................................................48 4.1.4 Charging Service..................................................................................49 4.1.5 Billing Service .....................................................................................50 4.1.6 Payment Service...................................................................................51 4.2 Market Service...........................................................................................52 4.2.1 Web Service Market ............................................................................54 4.2.2 Grid Resource Market..........................................................................56 4.3 Service Level Agreement Service..............................................................60 4.4 Capacity Planning Service .........................................................................67 4.5 Broker Service...........................................................................................69 4.5.1 Risk Broker..........................................................................................70 4.5.2 Software Broker (ICL).........................................................................71 4.5.3 Resource Broker...................................................................................73 4.6 Job Handling..............................................................................................75