Introduction to GRID com p uting a nd ov e rv ie w of th e E urop e a n Da ta Grid P roj e ct The European DataGrid Project http: / / w w w . edg . org Overview What is GRID computing ? What is a GRID ? Why GRIDs ? GRID pr oj e cts w or l d w id e T he E ur ope an Data Gr id Overview of EDG goals and organization Overview of th e EDG m iddleware c om p onents Introduction to GRID Computing and the EDG 2 The Grid Vision The GRID: networked data p roc es s i ng c entres and Res earc hers p erf orm thei r ” m i ddl eware” s of tware as the ac ti v i ti es reg ardl es s “ g l u e” of res ou rc es . g eog rap hi c al l oc ati on, i nterac t wi th c ol l eag u es , s hare and ac c es s data c i enti f i c i ns tru m ents and e! p eri m ents p rov i de hu g e am ou nt of data Federico.C a rm in a t i@cern .ch Introduction to GRID Computing and the EDG 3 What is GRID computing : coordinated resource sharing and problem solving in dy namic, multi-institutional virtual organiz ations. [ I.Foster] A V O i s a c ol l ec ti on of sers sh a ri n g si m i l a r n eed s a n d re! i rem en ts i n th ei r a c c ess to p roc essi n g " d a ta a n d d i stri # ted reso rc es a n d p rs i n g si m i l a r g oa l s. Ke y c o n c e p t : ability to negotiate resource-sh aring arrangem ents am ong a set of p articip ating p arties p ro! id ers and consum ers" and th en to use th e resulting resource p ool f or som e p urp ose [I.Foster] Introduction to GRID Computing and the EDG 4 The GRID distributed computing idea 1/2 Once upon a time…….. mma a iinnf f rra a mmee MMiiccrrooccoommppuutteerr MMiinnii CCoommppuutteerr CClluusstteerr (by Christophe J a c q u et, a f ter N . O . W . ) Introduction to GRID Computing and the EDG 5 The GRID distributed computing idea 2/2 …and today (by Christophe Jacquet) Introduction to GRID Computing and the EDG 6 Di erences between grids and distribu ted ap p ! icatio ns Distributed applications already exist, but they tend to be specialised system s intended f or a sing le purpose or user g roup G rids g o f urther and tak e into account: Different kinds of resources $ot alwa%s the same hardware" data and applications Different kinds of intera ction & ser g ro ps or applications want to interact with g rids in dif f erent wa%s Dy na m ic na ture ' eso rces and & ser G ro ps added( remov ed( chang ed f re! entl% Introduction to GRID Computing and the EDG 7 "ain characteristics o a grid architecture )ervice providers Publish the availability of their services via information systems S uch services may come-a n d -g o or ch a n g e d ynamically E . g . a testbed site that offers x C PU s and y G B of storag e )ervice # ro* ers eg ister and categ ori! e p ublished services and p rovid e search cap abilities E . g . " # E $ G esource B ro% er selects the best site for a & ' ob( 2) C atalog ues of d ata held at each testbed site )ervice re! est ers S ing le sig n)on* log into the g rid once U se bro% ering services to find a need ed service and emp loy it E . g . C + S p hysicists submit a simulation ' ob that need s " , C PU s for - hours and " . G B / hich g ets sched uled 0 via the esource B ro% er0 on the C E 1 testbed site Introduction to GRID Computing and the EDG 8 GRID securit# Resource providers are essentially “opening themselves up” to itinerant users S ecure access to resources is req uired +.,-. / #lic 0e% Infrastr ct re U ser’ s identity has to b e certif ied b y ( mutually recogni ed! national " ertif ication # uthorities ( " # s! Resources ( node machines! have to b e certif ied b y " # s $ emporary delegation f rom users to processes to b e e% ecuted “in user’ s name” ( pro% y certif icates ! " ommon agreed policies f or accessing resource and handling user’ s rights across dif f erent domains & ithin ' irtual ( rgani ations Introduction to GRID Computing and the EDG 9 Wh# G R I D s Scale of the problems frontier research in man% different fields toda% re! ires world1wide colla# orations 2 i. e. m lti1domain access to distri# ted reso rces3 ) R * D s prov i d e a c c ess to lar g e d at a p r o ces s i n g p o w er a n d h u g e d at a s t o r ag e p o s s i b i li t i es A s the g rid g rows its sef lness increases 2 more reso rces av aila# le3 + a rg e c ommu n i ti es of possi ble ) R * D u sers , 4 ig h E nerg % / h%sics E nv ironmental st dies5 E arth! a* es forecast" g eolog ic and climate chang es" oz one monitoring 6 iolog %" G enetics" E arth O # serv ation A strop h%sics" $ ew comp osite materials research A strona tics" etc. Introduction to GRID Computing and the EDG 1 0 $igh %nerg# &h#sics The LHC Detectors CMS A T L A S ~ 6 -8 P eta B y tes / y ea r 8 ~ 1 0 ev en ts/ y ea r 3 ~ 1 0 b a tch a n d i n tera cti v e u sers ¤ ¤ ¢ ¤ ¤ ¤ ¦ £ ¡ © ¡ £ ¡ ¡ £ © £ ¦¨§ ¥ © ¡ ¥ ¡ L H Cb Introduction to GRID Computing and the EDG 1 1 %arth Observation ESA missions: 7 a b ou t 1 0 0 G b y t e s of d a t a p e r d a y (ER S 1 / 2 ) 7 5 0 0 G b y t e s, f or t h e ne t E! " # SA$ mission (2 0 0 2 ) % & a t a G r id ' ont r ib u t e t o E( : 7 e nh a n' e t h e a b i) it y t o a ' ' e ss h i* h ) e + e ) p r od u ' t s 7 a ) ) o, r e p r o' e ssin* of ) a r * e h ist or i' a ) a r ' h i+ e s 7 imp r o+ e Ea r t h s' ie n' e ' omp ) e a p p ) i' a t ions (d a t a f u sion, d a t a minin* , mod e ) ) in* - ) ource! " # $ u% co& ' une 2 0 0 1 Fe d e r i c o .C a r m i n a t i , E U r e v i e w p r e s e n t a t i o n , 1 M a r c h 2 0 0 2 Introduction to GRID Computing and the EDG 1 2 'io!og# ( 'ioI n or m a t ic s Introduction to GRID Computing and the EDG 1 3 GRID pro)ects wor!d wide -U EDG 2 E& 1I ) 8 3 9 ' : D E& G' I D p r o ; e c t [ w w w . e d g . o r g ] < r o s s G' I D 9 = o ) 9 i n t e r a c t i v e a p p s . [ w w w . c r o s s g r i d . o r g ] Da t a 8 A G 1 i n t e r 1o p e r a # i l i t % 2 E& 1& ) A 3 [ w w w . d a t a t a g . o r g ] > < G 9 8 h e > 4 < < o m p t i n g G' I D 9 De p l o % m e n t [ c e r n . c h (l c g ] 8 h e n e w ? @ " A 6 E r o E& V I F r a m e w o r * / r o g . GEA $ 8 # a s e d G' I D p r o ; e c t s US # Gr i / h % $ i V DG> 1V D8 v ? / / DG 2 $ ) F " Do E 3 [ w w w . g r i p h % n . o r g ] [ w w w . i d v g l . o r g ] [ w w w . p p d g . o r g ] # s i a A p Gr i d / r a g m a 2 & ) A 1A s i a 3 [ w w w . a p g r i d .