Compute Canada — Calcul Canada a Proposal to the Canada Foundation for Innovation – National Platforms Fund
Total Page:16
File Type:pdf, Size:1020Kb
Compute Canada — Calcul Canada A proposal to the Canada Foundation for Innovation – National Platforms Fund Hugh Couchman (McMaster University, SHARCNET) Robert Deupree (Saint Mary’s University, ACEnet) Ken Edgecombe (Queen’s University, HPCVL) Wagdi Habashi (McGill University, CLUMEQ) Richard Peltier (University of Toronto, SciNet) Jonathan Schaeffer (University of Alberta, WestGrid) David S´en´echal (Universit´ede Sherbrooke, RQCHP) Executive Summary The Compute/Calcul Canada (CC) initiative unites the academic high-performance comput- ing (HPC) organizations in Canada. The seven regional HPC consortia in Canada —ACEnet, CLUMEQ, RQCHP, HPCVL, SciNet, SHARCNET and WestGrid— represent over 50 institutions and over one thousand university faculty members doing computationally-based research. The Compute Canada initiative is a coherent and comprehensive proposal to build a shared distributed HPC infrastructure across Canada to best meet the needs of the research community and en- able leading-edge world-competitive research. This proposal is requesting an investment of 60 M$ from CFI (150 M$ with matching money) to put the necessary infrastructure in place for four of the consortia for the 2007-2010 period. It is also requesting operating funds from Canada’s research councils, for all seven consortia. Compute Canada has developed a consensus on national governance, resource planning, and resource sharing models, allowing for effective usage and man- agement of the proposed facilities. Compute Canada represents a major step forward in moving from a regional to a national HPC collaboration. Our vision is the result of extensive consultations with the Canadian research community. 1 Introduction High Performance Computing (HPC) is transforming research in Canadian universities and industry. Computer simulations and models now supplement or even supplant traditional field or laboratory experiments in many disciplines. Massive data-sets from large-scale field experiments are being manipulated, stored and shared. Numerical laboratories open up otherwise inaccessible realms and enable insights that were inconceivable a few years ago. Research worldwide has seen a dramatic increase in the demand for HPC in the traditional areas of science and engineering, as well as in medicine and the social sciences and humanities. In 1999, Canada occupied an inconsequential position in HPC-based research, but that year saw the first funding of HPC by the Canada Foundation for Innovation. The subsequent combination of federal, provincial and industrial funding is enabling Canada to develop a strong foundation in HPC research, train highly qualified personnel and attract international experts. 1.1 Background In 1995, thirty Canadian researchers met in Ottawa to discuss the inadequate computing fa- cilities available in Canada for academic researchers. The action plan arising from this meeting eventually led to the creation of C3.ca (www.c3.ca) in 1997, a national organization for advocating research in high-performance computing. C3.ca represents the imagination, good will and shared vision of more than 50 institutions and thousands of researchers, post-doctoral fellows, graduate students, and support personnel. C3.ca’s vision is to create “a Canadian fabric of interwoven technologies, applications and skills based on advanced computation and communication systems applied to national needs and opportunities for research innovation in the sciences, engineering and the arts.” This vision is still relevant today. The creation of C3.ca fortuitously aligned with a new government of Canada initiative: the Canada Foundation for Innovation (CFI). Since the first CFI competition in 1998 (with results announced in 1999) and subsequent announcements in 2000, 2002 and 2004, Canadian researchers have actively pursued building competitive HPC infrastructure across the country. This has been facilitated by the creation of seven regional consortia of research universities with the mandate to apply for, acquire and operate HPC facilities that would be shared among researchers in their respective consortia. The consortia details are given in Table 1.1, while Table 1.2 lists the major research organizations that have partnered with the consortia. The number of faculty members using HPC has increased from a few hundred in 2000 to over one thousand in 2006 (and that number is growing). Maintaining the HPC infrastructure required multiple CFI applications to be approved each funding cycle. This led to the desire for a more stable and coordinated source of funding. In response, a two-year-long effort culminated in the October 2005 publication of the C3.ca Long- Range Plan (LRP) for high performance computing in Canada (Engines of Discovery: The 21st Century Revolution1), jointly funded by C3.ca, the National Research Council, CFI, NSERC, CIHR, SSHRC and CANARIE. CFI created the National Platforms Fund (NPF) program, in part as a response to the Long Range Plan. It recognized the large funds invested by CFI in shared consortia-based HPC infrastructure, as well as the significant investments made in research-group- specific, non-shared facilities. 1.2 Vision Our vision is for a national collaboration to acquire and support world-class fully-shared HPC in- frastructure across the country, creating an environment that fosters and enables new research insights and advances. 1 The plan is available at www.c3.ca/LRP – 1 – Consortium Provinces Members ACEnet Newfoundland, Dalhousie U., Memorial U., Mount Allison U., www.ace-net.ca Nova Scotia, New St. Francis Xavier U., St. Mary’s U., U. of New Brunswick, Prince Brunswick, U. of Prince Edward Island. Edward Island Soon to join: Acadia U., Cape Breton U. CLUMEQ Qu´ebec McGill U., U. Laval, UQAM, and all others branches www.clumeq.mcgill.ca and institutes of l’Universit´edu Qu´ebec: UQAC, UQTR, UQAR, UQO, UQAT, ETS, ENAP and INRS RQCHP Qu´ebec Bishop’s U., Concordia U., Ecole´ Polytechnique, U. www.rqchp.qc.ca de Montr´eal,U. de Sherbrooke HPCVL Ontario Carleton U., Loyalist College, Queen’s U., Royal www.hpcvl.org Military College, Ryerson U., Seneca College, U. of Ottawa SciNet Ontario U. of Toronto www.scinet.utoronto.ca SHARCNET Ontario Brock U., Fanshawe College, U. of Guelph, Lakehead www.sharcnet.ca U., Laurentian U., Sir. Wilfrid Laurier U., McMaster U., Ontario College of Art and Design, U. Ontario Institute of Technology, Sheridan College, Trent U., U. of Waterloo, U. of Western Ontario, U. of Windsor, York U. WestGrid Alberta, Athabasca U., Brandon U., Simon Fraser U., U. of www.westgrid.ca British Columbia, Alberta, U. of British Columbia, U. of Calgary, U. of Manitoba, Lethbridge, U of Manitoba, U. of Northern British Saskatchewan Columbia, U. of Regina, U. of Saskatchewan, U. of Victoria, U. of Winnipeg Table 1.1. Academic consortia membership (research hospitals affiliated with many institutions above are full partners in their respective consortia.) National Institute for Nanotechnology Sudbury Neutrino Observatory Canada Light Source Perimeter Institute for Theoretical Physics TRIUMF Fields Institute for Mathematical Sciences NRC Herzberg Institute for Astrophysics Robarts Research Institute Ouranos Centre de recherches math´ematiques Natural Resources Canada Banff Centre Institut de recherche d’Hydro-Qu´ebec Table 1.2. Major research partners. This proposal responds fully to CFI’s integrated strategy for HPC investments. Our proposal calls for a strengthening of the Canadian HPC collaboration and a metamorphosis of C3.ca into Compute Canada (Calcul Canada in French), reflecting the priority investment recommended in the LRP. Compute Canada will serve the HPC needs of Canadian University researchers, regardless of their affiliation. It represents a major (and evolutionary) leap forward in two significant ways. First, instead of thinking regionally we are thinking nationally; all seven consortia are full partners – 2 – in this proposal to create a national initiative. Second, CFI funds have historically been targeted towards meeting the computational needs of individual consortia (with a CFI requirement for 20% sharing with the rest of Canada). All the consortia are working together to build a world-class fully shared national infrastructure for computational-based research in Canada. We anticipate that the HPC community and this proposal will continue to evolve to meet the needs of Canadian research in the future. Thus, the partners will continue working with the research community to refine and improve the vision. 1.3 Application Process This proposal is based on an extensive consultation with the Canadian academic research community. The formal process began in October 2005 with a CFI-sponsored workshop. However, the consultations began much earlier in preparation for the next CFI application cycle. The proposal has been co-authored by the National Initiatives Committee (NIC), consisting of one representative from each consortium. High-level decisions were approved by the National Steering Committee (NSC), consisting of a Vice President (Research) from each consortium. Consultation with the research community included surveys, submissions, and interviews. Every attempt was made to engage as much of the research community as possible. Although this is a national proposal, the requested infrastructure is targeted to giving four of the consortia a much-needed technology refresh. CLUMEQ was last funded by CFI in 2000, while RQCHP, SciNet and WestGrid were last funded in 2002. These four consortia represent 61% of the faculty members