RES updates, resources and Access European HPC ecosystem Sergi Girona RES Coordinator RES: HPC Services for Spain •The RES was created in 2006. •It is coordinated by the Barcelona Supercomputing Center (BSC-CNS). •It forms part of the Spanish “Map of Unique Scientific and Technical Infrastructures” (ICTS). RES: HPC Services for Spain RES is made up of 12 institutions and 13 supercomputers. BSC MareNostrum CESGA FinisTerrae CSUC Pirineus & Canigo BSC MinoTauro UV Tirant UC Altamira UPM Magerit CénitS Lusitania & SandyBridge UMA PiCaso IAC La Palma UZ CaesarAugusta SCAYLE Caléndula UAM Cibeles 1 10 100 1000 TFlop/s (logarithmiC sCale) RES: HPC Services for Spain • Objective: coordinate and manage high performance computing services to promote the progress of excellent science and innovation in Spain. • It offers HPC services for non-profit, open R&D purposes. • Since 2006, it has granted more than 1,000 Million CPU hours to 2,473 research activities. Research areas Hours granted per area 23% AECT 30% Mathematics, physics Astronomy, space and engineering and earth sciences BCV FI QCM 19% 28% Life and health Chemistry and sciences materials sciences RES supercomputers BSC (MareNostrum 4) 165888 cores, 11400 Tflops Main processors: Intel(R) Xeon(R) Platinum 8160 Memory: 390 TB Disk: 14 PB UPM (Magerit II) 3920 cores, 103 Tflops Main processors : IBM Power7 3.3 GHz Memory: 7840 GB Disk: 1728 TB UMA (Picasso) 4016 cores, 84Tflops Main processors: Intel SandyBridge-EP E5-2670 Memory: 22400 GB Disk: 720 TB UV (Tirant 3) 5376 cores, 111,8 Tflops Main processors: Intel SandyBridge-EP E5-2670 Memory: 10752 GB Disk: 14 + 10 TB CSUC (Pirineus) 2784 cores, 283,66 Tflops Main processors: Intel(R) Xeon(R) Platinum 8160 Memory: 12000 GB Disk: 200 TB CSUC (Canigo) 384 cores, 33,2 Tflops Main processors: Intel(R) Xeon(R) Platinum 8160 Memory: 9000 GB Disk: 200 TB RES superComputers CénitS (Lusitania 2) 800 cores, 33,2 Tflops Main processors Intel Xeon E5-2660v3, 2.6GHz Memory: 10 GB Disk: 328 TB CénitS (SandyBridge) 2688 cores, 56 Tflops Main processors Intel Sandybridge Xeon Memory: 5376 GB Disk: 328 TB BSC (MinoTauro) 624 cores, 251 Tflops Main processor: 39x 2 Intel Xeon E5-2630 v3 Memory: 20 TB Disk: 14PB (shared with MN4) CESGA (FinisTerrae 2) 7712 cores, 328,3Tflops Main processor: Intel Xeon E5-2680v3 Memory: 40 TB Disk: 960 TB UC (Altamira 2+) 5120 cores, 105 Tflops Main processor: Intel SandyBridge Memory: 15,4 TB Disk: 2PB UZ (Caesaraugusta) 2014 cores, 80.5 Tflops Main processor: Intel E5-2680v3, 2.5GHz Memory: 5400 GB RAM memory Disk: 219TB RES supercomputers SCAYLE (Caléndula) 2432 cores, 50,6 Tflops Main processor: Intel SandyBridge Xeon Memory: 4864 GB Disk: 600 TB UAM (Cibeles) 368 cores, 14,1 Tflops Main processor: Intel Xeon E5-2630 v3, 2.40GHz Memory: 896 GB Disk: 80 TB UAM (SandyBridge) – coming soon – 2688 cores, 56Tflops Main processor: Intel SandyBridge Xeon, 2.60GHz Memory: 5376 GB Disk: 80 TB IAC (LaPalma) 4032 cores, 83,85 Tflops Main processor: Intel SandyBrigde Memory: 8064 GB Disk: 60 TB Resources granted: CPU hours 400.000 350.000 300.000 140mh available 250.000 200.000 Hours x 1000 x Hours 150.000 100.000 50.000 0 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 Requested hours Awarded hours (A+B) How to apply? • RES resources are open to researchers and spin-offs: o Computing resources: CPU hours and storage o Technical support: application analysis, porting of applications, search for the best algorithm… to improve performance and ensure the most effective use of HPC resources. o Free of cost at the point of usage Next deadline: • Three open competitive calls per year. January 2019 Deadline for Period Starting date applications P1 January 1st March P2 May 1st July P3 September 1st November How to apply? RES intranet: https://www.bsc.es/res-intranet • Researchers present a proposal which includes research project description, technical requirements and research group experience. • Accepted proposals have access to RES supercomputers for 4 months. • Granted time can be: hours with priority (hours A) or without priority (hours B) Proposal evaluation Formal Technical evaluation evaluation Submit Access committee Scientific experts panel Final report of accepted activities Activity length • Accepted proposals have access to RES supercomputers for 4 months. If your activity needs more time to be properly developed, you can ask for a continuation activity: New activity Report dissemination (4 months) information Continuation activity Report dissemination (4 months) information • The application form is simplified • Are preferably allocated to the same machine Continuation activities • In the evaluation, one reviewer is kept from the previous activity and the second reviewer changes RES Users’ Committee • CURES aims to provide advice and feedback to RES coordinators: o Promotes optimal use of high performance computing facilities o Shares information about users’ experiences o Voices user concerns • You can contact CURES through RES intranet: Which is/could be the main impediment to apply to RES resources? Ø I don't know how to write a strong application Ø I'm not sure if I can apply Ø Lack of HPC expertise in my research group Ø Too much paperwork Ø Not enough resources for my project Tips to write a strong proposal • Read carefully all the protocols, guides and FAQs in: https://www.res.es/en/access-to-res • Project description section: highlight the importance of your project, not only from the scientific point of view but also from the return to society. Ø Why do you think that your project should deserve the resources requested? Tips to write a strong proposal • Activity description section: specify clearly why do you need supercomputing resources. Write as accurate as possible the flowchart of the simulations. Indicate that you have your own human resources in your group to run and process the output of all the simulations you propose. Ø Why do you need to carry out the simulations in the selected machine? Ø Is the amount of computing resources requested adjusted to your needs and properly justified? • Doubts about software/HPC resources: ask support team! Ø Are your jobs adequate for parallel computing? [email protected] Which is/could be the main impediment to apply to RES resources? Ø I don't know how to write a strong application Ø I'm not sure if I can apply Ø Lack of HPC expertise in my research group Ø Too much paperwork Ø Not enough resources for my project Who can apply? • RES resources are aimed at open R+D+I activities: o Researchers from academia and public R&D institutions o Spin-offs during their first 3 years from its creation o Collaboration projects between private companies and research groups from academia or public institutions o Open to international applicants, but we recommend the collaboration with researchers from Spanish institutions Which is/could be the main impediment to apply to RES resources? Ø I don't know how to write a strong application Ø I'm not sure if I can apply Ø Lack of HPC expertise in my research group Ø Too much paperwork Ø Not enough resources for my project RES events: technical training These workshops are organized by the RES nodes and aim to provide the knowledge and skills needed to use and manage the supercomputing facilities. • Check the agenda in RES website: https://www.res.es/en/events?event_type=technical_training • PATC courses in BSC (PRACE Advanced Training Center): https://www.bsc.es/education/training/patc-courses RES events: networking opportunities Scientific seminars The RES promotes scientific seminars which address supercomputing technology applications in specific scientific areas. These events are mainly organized by RES users and are open to the entire research community. In 2017: ü 5 scientific seminars ü More than 300 attendees Sep Next Generation Sequencing and Supercomputing: life as a couple 27 CBMSO-UAM (Madrid) Agenda 2018: www.res.es/en/events RES events: networking opportunities RES Users’ Meeting: 20 September 2018 - Valencia The agenda includes: • Information about RES and the European HPC ecosystem • Plenary session: Research Open Data • Parallel scientific sessions • Poster session • Networking opportunities • Evening social event www.res.es/users-conference-2018 Funded by the EC: 2017 - 2021 ü Mobility grants for researchers using HPC resources ü Short stays to visit scientific hosts (3 weeks – 3 months) ü Funds for travel and living allowance ü Access to European HPC facilities Next deadline: 20 September http://www.hpc-europa.eu/ Which is/could be the main impediment to apply to RES resources? Ø I don't know how to write a strong application Ø I'm not sure if I can apply Ø Lack of HPC expertise in my research group Ø Too much paperwork Ø Not enough resources for my project RES forms In the RES we try to keep the administrative procedures short and simple for researchers: • New activity application form: 10 pages on average • Continuation activity application form: simplified • Dissemination form: 3 pages on average o Brief description of results (1-2 paragraphs) o Publications o Figures / pictures o Optional: patents, PhD students… • Intermediate reports: 1-2 sentences (“Everything is ok”) • Resubmission of non-accepted activities: one click Which is/could be the main impediment to apply to RES resources? Ø I don't know how to write a strong application Ø I'm not sure if I can apply Ø Lack of HPC expertise in my research group Ø Too much paperwork Ø Not enough resources for my project PRACE HPC Access • Call for Proposals