HPC Centers, Grids, and Clouds - the DEISA Experience –
Total Page:16
File Type:pdf, Size:1020Kb
HPDC 2009 Garching, June 9 - 13, 2009 Sustainable HPC Infrastructures HPC Centers, Grids, and Clouds - The DEISA Experience – - Your Research and the Big Picture - Wolfgang Gentzsch DEISA & OGF gentzsch at rzg.mpg.de Contents ¾ Service Infrastructures ¾ Components: HPC Centers, Grids, and Clouds ¾ Examples: Research e-Infrastructures ¾ Example, Research: DEISA Ecosystem for HPC ¾ Example, Industry: Telecoms and the Cloud Service Infrastructures Electrical Power Grid Ancient Rome: 10 aqueducts, Infrastructure 150,000 m3 water each day Transportation EGEE – Enabling Grids Grid in E-SciencE HPDC 2009 Wolfgang Gentzsch, DEISA 3 RI-222919 HPC Centers • HPC Centers are service providers, for past 35 years • Computing, storage, applications, data, etc IT services • Serve (local) research, education, and industry • Very professional: to end-users, they look (almost) like Cloud services (Amazon Cloud definition: easy, secure, flexible, on demand, pay per use, self serve) HPDC 2009 Wolfgang Gentzsch, DEISA 4 RI-222919 RoadRunner, Breaking the Petaflop/s Barrier • 1986, Cray-2 breaking the Gigaflop/s barrier • 1997, Intel ASCI Red, breaking Teraflop/s barrier • 2008, IBM RoadRunner, breaking Petaflop/s - At DOE’s Los Alamos National Laboratory - 1.026 Linpack Petaflop/s solving 2 Mio equations - 6912 dual-core Opteron & 12960 IBM Cell eDP - #1 on Top500 of June 2008 HPDC 2009 Wolfgang Gentzsch, DEISA 5 RI-222919 Grids 1998: The Grid: Blueprint for a New Computing Infrastructure: “. hardware and software infrastructure . dependable, consistent, pervasive, inexpensive access to high-end computational capabilities.” 2002: The Anatomy of the Grid: “. coordinated resource sharing and problem solving in dynamic,Quotes: multi-institutional Ian Foster, Carl Kesselman, virtual Steve Tuecke organizations.” HPDC 2009 Wolfgang Gentzsch, DEISA 6 RI-222919 Grids (in 2001) Departmental Enterprise Global Grids Grids Grids HPDC 2009 Wolfgang Gentzsch, DEISA 7 RI-222919 Research Grids work: Grid5000 HPDC 2009 Wolfgang Gentzsch, DEISA 8 RI-222919 Industry Grids work: HPDC 2009 Wolfgang Gentzsch, DEISA 9 RI-222919 Cloud... X as a Service Cloud: dynamically scalable and virtualized resources provided as a service over the Internet z Accessible online, anytime, Infrastructure (IaaS) anywhere z Pay for what you use z Available on demand Platform (PaaS) z Service Level Agreements z Automated: z Scalability z Failover Software (SaaS) z Concurency management HPDC 2009 Wolfgang Gentzsch, DEISA 10 RI-222919 The Cloud of Cloud Companies •Amazon •Akamai • Google • Areti Internet •Salesforce •Enki •Microsoft • Fortress ITX •Sun • Joyent •IBM • Layered Technologies •Oracle • Rackspace •EMC • Terremark • Cloudera •Xcalibre • Cloudsoft • Manjrasoft • HPDC 2009 Wolfgang Gentzsch, DEISA 11 RI-222919 Example: ANEKA Cloud platform SaaS Cloud applications Social computing, Enterprise, ISV, Scientific, CDNs, ... Aneka Cloud Platform Cloud Programming Models & SDK Task Thread Map Reduce Workflow Third Party Model Model Model Model Models Core Cloud Services SLA QoS PaaS Pricing Billing Metering Management Negotiation Job Execution Admission Data Monitoring Scheduling Management Control Storage VM VM Virtual Machines Management Deployment Windows Mac with Mono Linux with Mono Amazon Private Cloud Microsoft Google Sun IaaS Courtesy: Raj Buyya LAN network Data Center Grids Lab HPDC 2009 Wolfgang Gentzsch, DEISA 12 RI-222919 The Challenges for e-Infrastructures Sustainable TECHNICAL Competitive Advantage CULTURAL LEGAL & REGULATORY HPDC 2009 Wolfgang Gentzsch, DEISA 13 RI-222919 e-Infrastructure Challenges • Sensitive data, sensitive applications (med.patient records) • Different organizations have different ROI • Accounting, who pays for what (sharing!) • Security policies: consistent and enforced across the grid ! • Interoperability of components and grids (standards ?) • Current IT culture is not predisposed to sharing resources • Not all applications are grid-ready or grid-enabled • Open source is not equal open source (read the little print) • SLAs based on open source (liability?) • “Static” licensing model don’t embrace grid • Protection of intellectual property • Legal issues (FDA, HIPAA, multi-country grids) HPDC 2009 Wolfgang Gentzsch, DEISA 14 RI-222919 Examples of a successful Research e-Infrastructures NEESGrid Realtime access to earthquake Shake table experiments at remote sites. HPDC 2009 Wolfgang Gentzsch, DEISA 16 RI-222919 BIRN – Biomedical Information HPDC 2009 Wolfgang Gentzsch, DEISA 17 RI-222919 Geological Information Grid Portal HPDC 2009 Wolfgang Gentzsch, DEISA 18 RI-222919 Mesoscale Meteorology NSF LEAD project - making the tools that are needed to make accurate predictions of tornados and hurricanes. - Data exploration and Grid workflow HPDC 2009 Wolfgang Gentzsch, DEISA 19 RI-222919 Renci Bio Portal Providing access to biotechnology tools running on a back-end Grid. - leverage state-wide investment in bioinformatics - undergraduate & graduate education, faculty research - another portal soon: national evolutionary synthesis center HPDC 2009 Wolfgang Gentzsch, DEISA 20 RI-222919 Nanohub - nanotechnology HPDC 2009 Wolfgang Gentzsch, DEISA 21 RI-222919 X-Ray Crystallography HPDC 2009 Wolfgang Gentzsch, DEISA 22 RI-222919 ServoGrid Portal HPDC 2009 Wolfgang Gentzsch, DEISA 23 RI-222919 Belfast Gene Grid Portal HPDC 2009 Wolfgang Gentzsch, DEISA 24 RI-222919 MyGrid - Bioinformatics HPDC 2009 Wolfgang Gentzsch, DEISA 25 RI-222919 Example of a successful Research e-Infrastructure: The DEISA Ecosystem for HPC Grand-Challenge Applications Distributed European Infrastructure for Supercomputing Applications Local and regional supercomputers Mario Campolargo European Commission OGF23, June 2008 HPDC 2009 Wolfgang Gentzsch, DEISA 27 RI-222919 DEISA: Vision and Mission Vision: Persistent European HPC ecosystem integrating Tier-1 (Tflop/s) centres and European Tier-0 (Pflop/s) centres. Mission: Enhance Europe’s capability in computing and science by integrating most powerful supercomputers into a European HPC e-infrastructure. Built European Supercomputing Service on top of existing national services, based on the deployment and operation of a persistent, production quality, distributed supercomputing environment with continental scope. HPDC 2009 Wolfgang Gentzsch, DEISA 28 RI-222919 DEISA Partners DEISA1: May 1st, 2004 – April 30th, 2008 DEISA2: May 1st, 2008 – April 30th, 2011 HPDC 2009 Wolfgang Gentzsch, DEISA 29 RI-222919 DEISA dedicated high speed network on GEANT2 and the NRENs FUNET SURFnet DFN UKERNA GARR 1 Gb/s GRE tunnel RENATER 10 Gb/s wavelength RedIris 10 Gb/s routed 10 Gb/s switched HPDC 2009 Wolfgang Gentzsch, DEISA 30 RI-222919 RI-222919 requests configuration offers service Operations Applications t t r o p Categories of DEISA servicesoduc p pr u s s r s e t f s requests development e of u offers technology q e r HPDC 2009 Wolfgang Gentzsch, DEISA 31 Technologies DEISA Service Layers Multiple Common Presen‐ Workflow ways to production tation managemnt access environmnt layer Co‐ Single Job manag. Job reservation monitor layer and rerouting and co‐ system monitor. allocation Data WAN Data Data staging transfer shared manag. tools tools File system layer Network Unified DEISA Network and AAA Sites connectivity AAA layers HPDC 2009 Wolfgang Gentzsch, DEISA 32 RI-222919 CINECA usDEISAer UNICORE Infrastructure Gateway Gateway IDRIS Gateway Gateway FZJ HLRS Gateway job job ECMWF HPCX Gateway Gateway CSC LRZ NJS Gateway LRZ user IDRIS IBM P6 Gateway CINECA NJS NJS RZG FZJ IBM HLRS NEC SX8 IDB UUDB Gateway Gateway BSC IDB UUDB IDB UUDB SARA NJS ECMWF IBM P5 NJS AIX LL-MC HPCX Cray XT4 IDB UUDB Super-UX NQS II AIX IDB UUDB LL-MC P FT rid G AIX LL UNICOS/lc NJS PBS Pro NJS CSC Cray XT4/5 LRZ SGI ALTIX IDB UUDB UNICOS/lc PBS Pro IDB UUDB LINUX PBS Pro NJS CINECA IBM P5 AIX LL-MC AIX IDB UUDB LL-MC LINUX LINUX NJS Maui/Slurm LL RZG IBM NJS NJS IDB UUDB BSC IBM PPC SARA IBM HPDCIDB 2009UUDB IDB UUDB Wolfgang Gentzsch, DEISA 33 RI-222919 DEISA Global File System IBM P6 & BlueGene/P IBM P6 & BlueGene/P NEC SX8 AIX, Linux LL-MC Super-UX AIX, Linux NQS II LL-MC P FT IBM P6 rid G Cray XT4 AIX LL UNICOS/lc PBS Pro Cray XT4/5 UNICOS/lc PBS Pro SGI ALTIX LINUX PBS Pro AIX LL-MC IBM P5 AIX, Linux LL-MC LINUX LINUX Maui/Slurm LL IBM P5+ / P6 IBM P6 & BlueGene/P IBM PPC Global transparent file system based on the Multi-Cluster General Parallel File System (MC-GPFS of IBM) HPDC 2009 Wolfgang Gentzsch, DEISA 34 RI-222919 Management of users in DEISA • A dedicated LDAP-based distributed repository administers DEISA users • Trusted LDAP servers are authorized to access each other (based on X.509 certificates) and encrypted communication is used to maintain confidentiality SARA SARA BSC CINECA CSC ECMWF EPCC FZJ HLRS IDRIS LRZ RZG HPDC 2009 Wolfgang Gentzsch, DEISA 35 RI-222919 Common User Administration • Each partner is responsible for the registration of users affiliated to the partner (home organization) • Other partners update local user administration (LDAP, NIS, /etc/passwd) with data from other sites on a daily basis. Based on trust between partners! Administrators at site B, C … LDAP server create local accounts Site A based on ldap query user added to LDAP server at site A HPC system at Site B HPDC 2009 Wolfgang Gentzsch, DEISA 36 RI-222919 DEISA Extreme Computing Initiative (DECI) • DECI launched in 2005: complex, demanding, innovative simulations requiring the exceptional capabilities of DEISA • Multi-national proposals encouraged • Proposals reviewed by national