RCUK Review of E-Science 2009: Building a UK Foundation for the Transformative Enhancement of Research Innovation

Total Page:16

File Type:pdf, Size:1020Kb

RCUK Review of E-Science 2009: Building a UK Foundation for the Transformative Enhancement of Research Innovation UCLA Publications Title RCUK Review of e-Science 2009: Building a UK foundation for the transformative enhancement of research innovation Permalink https://escholarship.org/uc/item/891056g2 Authors Atkins, D. E. Borgman, Christine L. Bindhoff, N. et al. Publication Date 2010-05-21 License https://creativecommons.org/licenses/by-nc-nd/4.0/ 4.0 Peer reviewed eScholarship.org Powered by the California Digital Library University of California RCUK Review of e-Science 2009 BUILDING A UK FOUNDATION FOR THE TRANSFORMATIVE ENHANCEMENT OF RESEARCH AND INNOVATION Report of the International Panel for the 2009 Review of the UK Research Councils e-Science Programme International Panel for the 2009 RCUK Review of the e-Science Programme Anders Ynnerman (Linköping University, Sweden) Paul Tackley (ETH Zürich, Switzerland) Albert Heck (Utrecht University, Netherlands) Dieter Heermann (University of Heidelberg, Germany) Ian Foster (ANL and University of Chicago, USA) Mark Ellisman (University of California, San Diego, USA) Wolfgang von Rüden (CERN, Switzerland) Christine Borgman (University of California, Los Angeles, USA) Daniel Atkins (University of Michigan, USA) Alexander Szalay (John Hopkins University, USA) Julia Lane (US National Science Foundation) Nathan Bindoff (University of Tasmania, Australia) Stuart Feldman (Google, USA) Han Wensink (ARGOSS, The Netherlands) Jayanth Paraki (Omega Associates, India) Luciano Milanesi (National Research Council, Italy) Table of Contents Table of Contents Executive Summary About this Report 1 Background: e-Science and the Core Programme 1 Current Status of the Programme and its Impacts 1 Future Considerations 2 Responses to Evidence Framework Questions 3 Major Conclusions and Recommendations 4 Table of Acronyms and Acknowledgements Table of Acronyms 7 Acknowledgements 9 1. Introduction and Background Purpose of the Review 11 Structure of the Review 11 Review Panel Activities 12 Attribution of Credit 13 Background on the UK e-Science Programme 13 2. Current Status of the UK e-Science Programme Introduction 17 Phased Development and Status of the Core Programme 18 Phase One (2001-2004) 18 Phase Two (2004-2006) 18 Phase Three (2006 - present) 18 Academic Scientific Research 19 Platform for Research Enhancement 20 Software 20 Hardware 21 Human Capital 22 Community, Organisations, Institutions 23 Data and Information Stewardship 23 Services 24 More on the Challenge of Sustaining and Improving the Platform 25 Economic Impact 25 Direct Economic Impact on the Science Community 26 Direct Impact on Industry 26 Secondary Effects 27 3. Future Considerations: Vision, Opportunities, Risks, Timescales and Response Introduction 29 Crossing the Chasm 29 Sustaining Requirements and Resources 30 Superior networking 30 Distributed computing 30 GRID architecture 30 Data curation, sharing and management 30 Storage management 31 Semantic technology 31 Process and workflow management 31 Web technology 31 Investments and Adoption 31 Building a UK Foundation for the Transformative Enhancement of Research and Innovation Table of Contents The Next 5 Years: From Research to Sustainability 32 Maintain critical-size centres already established 32 Dramatically expand community involvement 32 Provide mid-term career paths for current personnel 32 Build stronger bridges to the high performance computing (HPC) community 32 Develop shared infrastructure that is reliable, mature and sustainable 32 The Next 5 Years: Sustain and Grow the Emerging Community 32 Strong national leadership, stable cross-council coordination 32 Community building and training 33 Systematic dissemination of best practice 33 Packaged and hosted service-based e-Science 33 The Next 10 Years: Evolutionary Challenges 33 Keep up with emerging and evolving new technologies 33 Transformations in different disciplines will not happen at the same time 33 Stable hierarchical distribution of resources 33 The Next 10 Years: Data Challenges 33 Data sets: new kinds of instruments 33 Self-amplification of data 33 Simulations larger and in more disciplines 34 Data growth beyond any current imagination 34 Special Opportunities for the UK in e-Science and Social Sciences 34 A Foundation for More Effective Pursuit of Key Challenges 35 Stretching the Vision and Elevating the Response 36 4. Brief Responses to the Questions in the e-Science Evidence Framework Introduction 39 Did the UK e-Science Programme build a Platform which enables e-Science tools, 39 infrastructure and practises to become incorporated into mainstream research in the UK? How does UK e-Science activity compare globally? 41 What has been the impact (accomplished and potential) of the UK e-Science Programme? 43 What are the future opportunities for UK e-Science? 46 How did the Programme Strategy (having a Core and individual Research Council 48 Programmes, developing tools and applications in parallel) affect the outputs from UK e-Science? 5. Major Conclusions and Major Recommendations Major Conclusions 51 Major Recommendations for Action 52 1. Structure and leadership 52 2. Industry-academic collaboration 52 3. RCUK e-Science Centre network 52 4. Sustaining advanced e-infrastructure 52 5. Supporting complementary roles 53 6. Sharing for cost and science effectiveness 53 7. Role for arts and humanities 53 8. Role for social sciences 54 9. Crossing the chasm; refreshing innovation 54 10. Data stewardship at enormous scale 54 11. Openness as a general policy 54 12. Towards functionally complete, four-quadrant, research environments 55 Building a UK Foundation for the Transformative Enhancement of Research and Innovation Table of Contents Annexes Annex A: Brief Biographies of Panel Members 57 Professor Daniel Atkins 57 Professor Nathan Bindoff 57 Professor Christine Borgman 58 Professor Mark Ellisman 58 Dr Stuart Feldman 59 Professor Ian Foster 60 Professor Albert Heck 60 Professor Dieter Heermann 61 Professor Julia Lane 61 Professor Luciano Milanesi 61 Dr Jayanth Gopinath Paraki 62 Dr Wolfgang von Rüden 62 Professor Alexander Szalay 63 Professor Paul Tackley 63 Mr Han Wensink 63 Professor Anders Ynnerman 64 Annex B: Review Week Itinerary 65 Annex C: Supporting Evidence and Information Provided to the Panel 67 Building a UK Foundation for the Transformative Enhancement of Research and Innovation Executive Summary Executive Summary About this Report assessment structure. These changes could be used in concert to further strengthen an ongoing strategic This is the report of an international Panel of 16 e-Science Programme. experts convened by an RCUK Steering Committee on behalf of all UK Research Councils to review the RCUK Current Status of the Programme and its e-Science Programme. The Review focussed on e- Impacts Science as a whole, across all Research Councils’ remits. It focussed on the added value from the The inaugural goals of the e-Science Core Programme Programme as a whole rather than separately (eSCP) were to assist the development of essential, reviewing each individual element. The Steering well engineered, generic Grid middleware usable to Committee in concert with the Chair also (1) agreed both e-Scientists and industry; provide necessary on a set of questions to guide the assessment process infrastructure support for UK e-Science projects; termed the “e-Science Evidence Framework”; (2) collaborate with the international e-Science and Grid selected the 63 projects from 24 institutions to be communities; and develop a framework in visited by the Panel; (3) selected background data to collaboration with scientists, computer scientists and be provided to the Panel; (4) created the agenda for industry to promote the emergence of robust, the review week; (5) received a preliminary briefing industrial-strength Grid middleware. The from the Panel at the end of the review week; and (6) complementary goals of the individual Research orchestrated the disposition and use of this final Councils’ e-Science investments were to support and report. leverage the Core Programme investments in service of their disciplinary and interdisciplinary mission of Background: e-Science and the Core research excellence, impact, public engagement, Programme training and provision of world-class research facilities. In 2001, the UK Research Councils launched one of The most obvious and expected impacts of the the earliest multidisciplinary “e-Science” initiatives, Programme are in academia. Perhaps the largest and recognising that the push of technology – the most important academic impact is in the enormous and growing capacity of computing, interdisciplinary efforts that have gone into most of storage, communication and software systems – the projects and that have fostered new social offered the opportunity not only to automate science academic networks and spawned new collaborations. but also to apply new methods that could The Programme was a forerunner to many other revolutionise how science was performed. e-Science similar programmes worldwide, put the UK at the was defined as “research done through distributed forefront of the development of e-Science, and global collaborations enabled by the Internet, using contributed to the acceptance of e-Science as a valid very large data collections, terascale computing research paradigm. resources and high performance visualisation.” The Programme was ring-fence funded, allocated between e-Science serves as a platform for research an “e-Science Core” – a matrix structure spanning all enhancement, including systems (shared software with Councils – and the disciplinary Councils.
Recommended publications
  • Developing High Performance Computing Resources for Teaching Cluster and Grid Computing Courses
    University of Huddersfield Repository Holmes, Violeta and Kureshi, Ibad Developing High Performance Computing Resources for Teaching Cluster and Grid Computing courses Original Citation Holmes, Violeta and Kureshi, Ibad (2015) Developing High Performance Computing Resources for Teaching Cluster and Grid Computing courses. Procedia Computer Science, 51. pp. 1714-1723. ISSN 1877-0509 This version is available at http://eprints.hud.ac.uk/id/eprint/24529/ The University Repository is a digital collection of the research output of the University, available on Open Access. Copyright and Moral Rights for the items on this site are retained by the individual author and/or other copyright owners. Users may access full items free of charge; copies of full text items generally can be reproduced, displayed or performed and given to third parties in any format or medium for personal research or study, educational or not-for-profit purposes without prior permission or charge, provided: • The authors, title and full bibliographic details is credited in any copy; • A hyperlink and/or URL is included for the original metadata page; and • The content is not changed in any way. For more information, including our policy and submission procedure, please contact the Repository Team at: [email protected]. http://eprints.hud.ac.uk/ This space is reserved for the Procedia header, do not use it Developing High Performance Computing Resources for Teaching Cluster and Grid Computing courses Violeta Holmes1 and Ibad Kureshi2 1 University of Huddersfield, Huddersfield, UK [email protected] 2 Durham University, Durham, UK [email protected] Abstract High-Performance Computing (HPC) and the ability to process large amounts of data are of paramount importance for UK business and economy as outlined by Rt Hon David Willetts MP at the HPC and Big Data conference in February 2014.
    [Show full text]
  • Newsletter Volume 5 Issue 1, Spring 2009
    ...enhancing the student experience ISSN 1745-8447 (Print) in chemistry, physics, ISSN 1745-8455 (Online) astronomy and forensic science within the university sector Volume 5, Issue 1 Wavelength is the newsletter of the Higher Education Academy Physical Sciences Centre. It is issued twice yearly in Spring and Autumn. WavelengthWavelength This issue... In this issue we have a number of articles activities, specialist topics such as covering: java applets for physics and a database of inorganic compounds and The National Grid Service, or NGS as other resources such as experimental it is more commonly known, which simulations. provides ‘free at point of use’ access to an extensive distributed computing Development project reports from 3 of resource for UK researchers. the projects which recently completed their work; two covering computer An update on the progress with the based assessment and one looking at reviews of the Student Learning ways to support students with Experience undertaken by the Centre Asperger’s Syndrome. last year. The reports will provide a comprehensive snapshot of the Finally we include some news from learning experiences of full-time the Higher Education Academy; one chemistry and physics undergraduates detailing a seminar series which aims in UK universities in 2008. to support access and success for all students; the other looking at a recent Information about the new Science survey of academic staff with regard to Diploma. The Diploma aims to provide the rewards within institutions for learning in an applied and work- teaching. focused context. In the context of the Science Diploma this means the students will learn about what scientists do as well as about science.
    [Show full text]
  • RCUK Review of E-Science 2009
    RCUK Review of e-Science 2009 BUILDING A UK FOUNDATION FOR THE TRANSFORMATIVE ENHANCEMENT OF RESEARCH AND INNOVATION Report of the International Panel for the 2009 Review of the UK Research Councils e-Science Programme International Panel for the 2009 RCUK Review of the e-Science Programme Anders Ynnerman (Linköping University, Sweden) Paul Tackley (ETH Zürich, Switzerland) Albert Heck (Utrecht University, Netherlands) Dieter Heermann (University of Heidelberg, Germany) Ian Foster (ANL and University of Chicago, USA) Mark Ellisman (University of California, San Diego, USA) Wolfgang von Rüden (CERN, Switzerland) Christine Borgman (University of California, Los Angeles, USA) Daniel Atkins (University of Michigan, USA) Alexander Szalay (John Hopkins University, USA) Julia Lane (US National Science Foundation) Nathan Bindoff (University of Tasmania, Australia) Stuart Feldman (Google, USA) Han Wensink (ARGOSS, The Netherlands) Jayanth Paraki (Omega Associates, India) Luciano Milanesi (National Research Council, Italy) Table of Contents Table of Contents Executive Summary About this Report 1 Background: e-Science and the Core Programme 1 Current Status of the Programme and its Impacts 1 Future Considerations 2 Responses to Evidence Framework Questions 3 Major Conclusions and Recommendations 4 Table of Acronyms and Acknowledgements Table of Acronyms 7 Acknowledgements 9 1. Introduction and Background Purpose of the Review 11 Structure of the Review 11 Review Panel Activities 12 Attribution of Credit 13 Background on the UK e-Science Programme
    [Show full text]
  • Gridpp: Development of the UK Computing Grid for Particle Physics
    INSTITUTE OF PHYSICS PUBLISHING JOURNAL OF PHYSICS G: NUCLEAR AND PARTICLE PHYSICS J. Phys. G: Nucl. Part. Phys. 32 (2006) N1–N20 doi:10.1088/0954-3899/32/1/N01 RESEARCH NOTE FROM COLLABORATION GridPP: development of the UK computing Grid for particle physics The GridPP Collaboration P J W Faulkner1,LSLowe1,CLATan1, P M Watkins1, D S Bailey2, T A Barrass2, N H Brook2,RJHCroft2, M P Kelly2, C K Mackay2, SMetson2, O J E Maroney2, D M Newbold2,FFWilson2, P R Hobson3, A Khan3, P Kyberd3, J J Nebrensky3,MBly4,CBrew4, S Burke4, R Byrom4,JColes4, L A Cornwall4, A Djaoui4,LField4, S M Fisher4, GTFolkes4, N I Geddes4, J C Gordon4, S J C Hicks4, J G Jensen4, G Johnson4, D Kant4,DPKelsey4, G Kuznetsov4, J Leake 4, R P Middleton4, G N Patrick4, G Prassas4, B J Saunders4,DRoss4, R A Sansum4, T Shah4, B Strong4, O Synge4,RTam4, M Thorpe4, S Traylen4, J F Wheeler4, N G H White4, A J Wilson4, I Antcheva5, E Artiaga5, J Beringer5,IGBird5,JCasey5,AJCass5, R Chytracek5, M V Gallas Torreira5, J Generowicz5, M Girone5,GGovi5, F Harris5, M Heikkurinen5, A Horvath5, E Knezo5, M Litmaath5, M Lubeck5, J Moscicki5, I Neilson5, E Poinsignon5, W Pokorski5, A Ribon5, Z Sekera5, DHSmith5, W L Tomlin5, J E van Eldik5, J Wojcieszuk5, F M Brochu6, SDas6, K Harrison6,MHayes6, J C Hill6,CGLester6,MJPalmer6, M A Parker6,MNelson7, M R Whalley7, E W N Glover7, P Anderson8, P J Clark8,ADEarl8,AHolt8, A Jackson8,BJoo8, R D Kenway8, C M Maynard8, J Perry8,LSmith8, S Thorn8,ASTrew8,WHBell9, M Burgon-Lyon9, D G Cameron9, A T Doyle9,AFlavell9, S J Hanlon9, D J Martin9, G McCance
    [Show full text]
  • JIF08 Delegate List
    JISC Innovation Forum 2008 Keele University 15 July 2008 Delegate List Name Organisation Mark Abrams Coventry University Fereshteh Afshari Imperial College London Mabel Agbenorto University of Hertfordshire Rob Allen JISC Advisory Services BCE Team Will Allen Netskills Theo Andrew EDINA Patrick Andrews University of Leicester Gillian Armitt University of Manchester Marzieh Asgari-Targhi NCESS Paula Aucott University of Portsmouth Chris Awre University of Hull Gaynor Backhouse Intelligent Content Ltd Dick Bacon University of Surrey Mark Baker University of Reading Balbir Barn Middlesex University Malcolm Batchelor JISC Chris Batt Chris Batt Consulting David Beards SFC Theresa Beattie JISC RSC Yorkshire and Humber Julian Beckton University of Lincoln Emma Beer JISC Exec - Dev/Innovation Helen Beetham JISC Anne Bell University of Warwick Caroline Bell Royal Veterinary College Patrick Bellis JISC InfoNet Greg Benfield Oxford Brookes University Peter Bird Manchester Metropolitan University Tobias Blanke AHeSSC Naomi Boneham University of Cambridge, Scott Polar Research Institute Steve Boneham Netskills Lynne Brandt Derby College Rob Bristow JISC Exec - Dev/Innovation Helen Broomhead JISC Christopher Brown University of Southampton Matthew Brown The National Archives Zoe Browne University of East London Rachel Bruce JISC Exec - Dev/Innovation Pete Burnap Cardiff School of Computer Science Peter Burnhill EDINA Luis Carrasqueiro British Universities Film and Video Council Jackie Carter MIMAS John Casey EDINA David Chadwick University of Kent
    [Show full text]
  • JISC Inform: Pooling Resources, Providing Tools for Collaboration In
    Research goes virtual: developing collaborative environments Give and take with JORUM JISC informissue 10 summer 2005 PPoolingooling resresourcesources PPrroovviiddiinngg ttoooollss ffoorr ccoollllaabboorraattiioonn iinn eedduuccaattiioonn he magazine of the Joint Information Systems Committee ISSN 1476-7619 ISSN Committee Systems the Joint Information he magazine of T aanndd rreesseeaarrcchh Supporting institutions An interview with Paul Ramsden, Chief Executive, Higher Education Academy JISC inform summer 2005 ‘The future JISC depends on organisations collaborating to inform be successful’ 3Digimap steps back in time 4: Interview with A familiar resource becomes historic Paul Ramsden 4Supporting institutions An interview with Paul Ramsden, Chief Executive, Higher Education Academy 8The National Grid Service builds up steam Sharing facilities on the Grid 10 Sharing resources Pioneering digital repositories 11 Making effective use of JISC e-resources How JISC e-resources can enrich education and research 12 Diagram: the JISC Model Licence and its benefits 15 Research goes virtual Developing collaborative environments 18 Give and take with Jorum A unique new service is set to take its bow 20 Spreading expertise RSC helps colleges prepare for inspection 22 Impact and integration JISC 2005 conference in pictures JISC inform is produced by the Joint Editor Tell us what you think Information Systems Committee (JISC) to raise Philip Pothen awareness of the use of Information and Your feedback on this publication, Communications Technology (ICT) to support Production Coordinator including suggestions for contributions, further and higher education in the UK. Greg Clemett Contributing authors include members of the is most welcome. Please contact JISC JISC family of services and initiatives, the Designer Communications and Marketing: JISC’s partners and staff working in the FE Kelvin Reeves email [email protected] and HE sectors.
    [Show full text]
  • Developing High Performance Computing Resources for Teaching Cluster and Grid Computing Courses
    Procedia Computer Science Volume 51, 2015, Pages 1714–1723 ICCS 2015 International Conference On Computational Science Developing High Performance Computing Resources for Teaching Cluster and Grid Computing courses Violeta Holmes1 and Ibad Kureshi2 1 University of Huddersfield, Huddersfield, UK [email protected] 2 Durham University, Durham, UK [email protected] Abstract High-Performance Computing (HPC) and the ability to process large amounts of data are of paramount importance for UK business and economy as outlined by Rt Hon David Willetts MP at the HPC and Big Data conference in February 2014. However there is a shortage of skills and available training in HPC to prepare and expand the workforce for the HPC and Big Data research and development. Currently, HPC skills are acquired mainly by students and staff taking part in HPC-related research projects, MSc courses, and at the dedicated training centres such as Edinburgh Universitys EPCC. There are few UK universities teaching the HPC, Clusters and Grid Computing courses at the undergraduate level. To address the issue of skills shortages in the HPC it is essential to provide teaching and training as part of both postgraduate and undergraduate courses. The design and development of such courses is challenging since the technologies and software in the fields of large scale distributed systems such as Cluster, Cloud and Grid computing are undergoing continuous change. The students completing the HPC courses should be proficient in these evolving technologies and equipped with practical and theoretical skills for future jobs in this fast developing area. In this paper we present our experience in developing the HPC, Cluster and Grid modules including a review of existing HPC courses offered at the UK universities.
    [Show full text]
  • The UK National Grid Service and EGEE
    Enabling Grids for E-sciencE The UK National Grid Service and EGEE David Meredith and Andrew Richards 10 May 2007 Manchester www. eu-egee.org EGEE-II INFSO-RI-031688 EGEE and gLite are registered trademarks Mission of the UK NGS Enabling Grids for E-sciencE The Mission of the National Grid Service • To provide coherent electronic access for UK researchers to compp,utational and data resources, and to (scientific) facilities required to carry out their research. • Do this Independently of resource or user location. EGEE-II INFSO-RI-031688 UK National Grid Service and EGEE: OGF20 2 Who is the NGS? Enabling Grids for E-sciencE • The National Grid Service, funded by JISC, EPSRC and CCLRC ((),now STFC), was created in October 2003 and the service entered full production in September 2004 • The NGS is led and coordinated by the STFC in collaboration with the University of Manchester, the University of Oxford, the University of Edinburgh and the White Rose Grid at the University of Leeds EGEE-II INFSO-RI-031688 UK National Grid Service and EGEE: OGF20 3 History of the UK NGS Enabling Grids for E-sciencE • 2001 - e-Science Grid Program started in UK – Inc. GridPP and others • 2003 - Initial grid service ITT – 4 independent clusters to investigate provision of a grid service • Apr il 2004 - NGS pre-prodiduction servi ce – EGEE, GridPP-2 • August 2004 – GOSC proposed – Coordinating NGS and providing central services • September 2004 - NGS production service / GOSC • April 2006 – NGS/GOSC phase 1 review • May 2006 - NGS phase-2 approved – More integrated programme – EGEE-2 started in April • Oct ob er 2006 – NGS p hase-2 EGEE-II INFSO-RI-031688 UK National Grid Service and EGEE: OGF20 4 NGS Key Themes Enabling Grids for E-sciencE • Provide the users what they need – aim to do this with as low an ‘access barrier’ as possible • “Content” – Services user driven in demand (data + computation services at present, but also bring online additional services such as visualisation).
    [Show full text]
  • The National Grid Service Guy Warner [email protected]
    http://www.nesc.ac.uk/training http://www.ngs.ac.uk The National Grid Service Guy Warner [email protected] http://www.pparc.ac.uk/ http://www.eu-egee.org/ Policy for re-use • This presentation can be re-used for academic purposes. • However if you do so then please let training- [email protected] know. We need to gather statistics of re-use: no. of events, number of people trained. Thank you!! 2 Acknowledgements • Some NGS slides are taken from talks by Stephen Pickles and Andy Richards • Also slides from Malcolm Atkinson on the UK e- Science programme 3 Overview • e-Infrastructure in the UK • The National Grid Service 4 e-Science Centres in the UK e-Science Centres Digital Curation Centre Centres of Excellence Lancaster NeSC Other Centres York Newcastle Access Grid Belfast Support Centre Manchester Leicester National Centre for Text Mining National Centre for National Institute for e-Social Science Environmental e-Science Daresbury Cambridge Birmingham Oxford National Grid Service Cardiff Bristol RAL Reading Open Middleware Infrastructure Institute Southampton London London 5 Edinburgh 6 OMII-UK nodes EPCC & National e-Science Centre School of Computer Science University of Manchester Edinburgh School of Electronics and Computer Science University of Southampton Manchester Southampton 7 UK e-Infrastructure Users get common access, tools, information, http://www.nesc.ac.uk/training Nationally supported services, throughhttp://www.ngs.ac.uk NGS HPCx + HECtoR Regional and Campus grids Community Grids Integrated internationally LHC VRE, VLE, IE ISIS TS2 http://www.pparc.ac.uk/ http://www.eu-egee.org/ The National Grid Service 9 The National Grid Service • The core UK grid, resulting from the UK's e-Science programme.
    [Show full text]
  • Grid Initiatives Wolfgang Gentzsch
    Grid Initiatives Wolfgang Gentzsch Grid Initiatives: Lessons Learned and Recommendations *) Version 2.0 With a Summary from the 2nd International Workshop on Campus and Community Grids, held in Manchester, UK on 7th May 2007, as part of OGF20 Wolfgang Gentzsch RENCI, Duke & D-Grid, January 21, 2007 1 Introduction The aim of the following study of six major grid projects is to better understand, design, build, manage and operate national and community grids, based on the experience of early adopters and on case studies and lessons learned from selected grid projects. For this purpose, we have selected and analyzed a few major grid projects and grid infrastructures around the world, namely the UK e-Science Programme, the US TeraGrid, Naregi in Japan, the ChinaGrid, the European EGEE, and the German D-Grid initiative. In the following, we briefly describe these projects, summarize Lessons Learned, and provide Recommendations for those who intend to build national or community grids in the near future. Our research so far is based on information from project Web sites and reports, and from interviews with major representatives of these grid initiatives. Major focus of our research and of the interviews was on applications and strategic direction, government and industry funding, national and international cooperation, and on strengths and weaknesses of the grid projects as described by the interviewees. The interviewees answered questions about their role in the project, successful and less successful approaches, sustainability of the resulting grid infrastructure, integration of individual results into the bigger picture, available funding, international collaboration, commercial services, and the future of e-Science.
    [Show full text]
  • The National Grid Service Guy Warner [email protected]
    http://www.nesc.ac.uk/training http://www.ngs.ac.uk The National Grid Service Guy Warner [email protected] http://www.pparc.ac.uk/ http://www.eu-egee.org/ Policy for re-use • This presentation can be re-used for academic purposes. • However if you do so then please let training- [email protected] know. We need to gather statistics of re-use: no. of events, number of people trained. Thank you!! 2 Acknowledgements • Some NGS slides are taken from talks by Stephen Pickles and Andy Richards • Also slides from Malcolm Atkinson on the UK e- Science programme 3 Overview • e-Infrastructure in the UK • The National Grid Service 4 e-Science Centres in the UK e-Science Centres Digital Curation Centre Centres of Excellence Lancaster NeSC Other Centres York Newcastle Access Grid Belfast Support Centre Manchester Leicester National Centre for Text Mining National Centre for National Institute for e-Social Science Environmental e-Science Daresbury Cambridge Birmingham Oxford National Grid Service Cardiff Bristol RAL Reading Open Middleware 5 Infrastructure Institute Southampton London London Edinburgh 6 OMII-UK nodes EPCC & National e-Science Centre School of Computer Science University of Manchester Edinburgh School of Electronics and Computer Science University of Southampton Manchester Southampton 7 UK e-Infrastructure Users get common access, tools, information, http://www.nesc.ac.uk/training Nationally supported services,http://www.ngs.ac.uk through NGS HPCx + HECtoR Regional and Campus grids Community Grids Integrated internationally LHC VRE, VLE, IE ISIS TS2 http://www.pparc.ac.uk/ http://www.eu-egee.org/ The National Grid Service 9 The National Grid Service • The core UK grid, resulting from the UK's e-Science programme.
    [Show full text]
  • Edinburgh Bits [ Bulletin of C&IT Services
    [ edinburgh bits [ bulletin of C&IT services JUNE 2005 VOLUME 15 ISSUE 10 Continuity testing – averting disasters [ While most of us were easing gently into the New Year, the EUCS Network CONTENTS Team was carrying out a radical test of the procedures which keep the [ University’s data network running. On 3rd January, the King’s Buildings router – a critical component of EdLAN Continuity testing 1 – was switched off to simulate a major malfunction, and crucial services were restored on (cheaper) backup equipment. This was to simulate a catastrophic Upgrade for MIS desktop 1 failure in the network backbone. Within its limited scope, the test was a success, in that critical services Records management award 2 were restored in the allotted time. Several important lessons were learned. First, significant differences in configuration commands on the backup Secure Electronic Delivery 2 equipment were found to be a major slowing factor. Second, the network has changed considerably since the backup equipment was installed, in the Get to grips with the GRID 3 number of Gigabit connections and the extensive use of Virtual Networks, which the backup equipment was not designed to cope with. This led to an Workshop on high-speed networks 3 investigation into a different way of routing, and a realisation that backup equipment will have to be replaced more frequently than originally planned. EUCLID Project: Phase 1 3 Finally, some interesting logistical issues emerged, from overcoming the security system to gain access on a holiday to the fire alarms going off in Storage consolidation 4 the middle for what was a real fire in another part of the building.
    [Show full text]