DOCSLIB.ORG

The Eastern Regional Network (Ern): Simplifying Multi-Campus Research Collaborations

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
The Eastern Regional Network (Ern): Simplifying Multi-Campus Research Collaborations THE EASTERN REGIONAL NETWORK (ERN): SIMPLIFYING MULTI-CAMPUS RESEARCH COLLABORATIONS Barr von Oehsen Associate Vice President, Office of Advanced Research Computing Rutgers, The State University of New Jersey TABLE OF CONTENTS • Eastern Regional Network Vision and Mission • Science Drivers • History • Proof of Concept • Commercial Cloud • perfSONAR • Future Projects • ERN Partners [ 2 ] Eastern Regional Network (ERN) • Vision: To simplify multi-campus collaborations and partnerships that advance the frontiers of research, pedagogy, and innovation. • Mission: Through a partnership of educational institutions, research facilities, regional network providers, and Internet2, the ERN will provide layered and transparent access to shared data and computing facilities for research projects located at and between partner sites. The resulting regional research and education platform will support a diverse set of science drivers and emergent educational opportunities and offer the educational research community access to a broad range of collaborative multi-institutional resources that are not available on any one campus alone. [ 3 ] Solving Challenges Related to: • Supporting and enabling research collaborations that span multiple universities • Sharing and accessing data (containerized workflows) • Building, managing, supporting, and sharing distributed federated resources/infrastructure that spans multiple campuses and commercial cloud designed to enable research • Creating performant, software-configurable, and intelligent networks to enable access to research resources • Creating testbeds around new and emerging technologies, software stacks, etc., being asked for by the research community • Having a safe space for Central IT to experiment with new and emerging technologies without the worry of breaking enterprise infrastructure • Sharing expertise and building collaborations across both research and IT silos • Workforce development, especially for schools that don’t typically have access to campus cyberinfrastructure, research testbeds, new and emerging technologies, etc. • Writing broader impact statements on grant proposals [ 4 ] What Are The Science Drivers? • Cryo-EM • Precision Health • Proteomics • Systems Biology • Genomics • Computational Social Science • Brain Imaging • Computer Science • Climate Research • Network Research • High Energy Physics • Multi-Scale Modeling • Digital Humanities • Chemistry • Social Sciences • Marine and Coastal Science • Medical/Clinical Research [ 5 ] ERN Origins and Evolution • Germ of an idea: at 2017 National Research Platform meetings Can the regional research platform idea work in the Northeast? Rutgers, OSHEAN, KINBER • Coalition of the Willing: January 2018 gathering at Rutgers-Newark Can we find something of common interest to work on? KINBER, Rutgers, OSHEAN, MGHPCC, Internet2, NYSERnet • Resource Federation Proof of Concept: Can we work together to prototype a potentially beneficial resource federation idea? Rutgers, MGHPCC, Syracuse, NJ Edge, U Maine, Google, Internet2 “Early if not elegant” approach; emphasis on getting people to work together Used Rutgers Federated Ecosystem as model [ 6 ] Federated Computing Across New Jersey – ERN Model State-wide multi-campus, distributed NYSERNet, I2 HPC and storage, fast, low-latency network that is part of global Science Newark HPC DMZs: Local Storage DTN HPC • NSF CC* Funded (OAC-1659232) Local • SDN Based 100 Gbps Network DTN DTN Storage New Brunswick Core PE I2, NJEdge, MagPi, KINBER Central Storage Repository • Data Transfer Nodes (FIONA) HPC • Advanced Computing and Storage Camden Local DTN Storage • Performance and monitoring support (perfSONAR, XDMoD) • Testbed as a service • Federated across campuses • Policy driven [ 7 ] Origins and Evolution • Northeast perfSONAR Mesh: Can we work together toward a regional science DMZ? Federation sites plus • BU, Brown, Colby, CEN, KINBER, Network Maine, OSHEAN, UNH Less-specialized technology allows expanded participation • Growing interest: Maybe we really can do this? [in progress] expanded steering committee; per-project working groups All of the above plus • U Delaware, NJIT, U Buffalo, Bucknell, UMass Amherst, Yale, Princeton, BTAA, U Kentucky, Case Western Reserve [ 8 ] Resource Federation Proof of Concept § Six sites, five states § Ability to launch containerized (Singluarity) jobs as well as traditional HPC jobs, from any site to any other site including commercial cloud, via SLURM scheduler. § Working with Google, Cisco, Internet2, SchedMD (SLURM), and OSG on enhancements § InCommon authentication and authorization § Policy based federation of computing resources § Reserving slices of the network § Cloud bursting § OSG federation with containerized SLURM Recipe for joining: (slurmd) https://github.com/rutgers-oarc/ern-poc § Testing different data sharing approaches as well as filesystems [ 9 ] Resource Federation Proof of Concept [ 10 ] Federation with Commercial Cloud • Partnership with Google Cloud and SchedMD (SLURM) to develop federated hybrid environment • Allows federation across resources (including cloud services) • Allows us to offer one stop shop for users • Allows on demand elastic computing • Initial Proof of Concept • Set up federated environment between Rutgers and Google Cloud • Google Cloud instance is set up similar to local resource, includes SLURM • Connection through Internet2 between both environments • Able to submit jobs directly from Rutgers HPC to Google Cloud using SLURM submit script • Elasticity/bursting capability now being tested • Next steps: Extend to Jetstream, OSG [ 11 ] ERN perfSONAR Mesh • 23 nodes, 14 sites, six states • New sites welcome • Still in teething phase • Improves visibility on connectivity/bandwidth/delay • Starting point for connectivity improvements (where they matter) • Prerequisite for a regional data DMZ Site: http://mesh.hpc.rutgers.edu/maddash-webui/ Recipe for joining: https://github.com/rutgers-oarc/ern-poc [ 12 ] Community Ownership • ERN is not a Rutgers project, it is a community project • Loosely based on the condo model • Proof of concepts led by partner campuses, regional network providers, industry, etc. • Test out new ideas to address challenges • Can be funded or lead to funding • For the greater good of the community • Using CaRCC stakeholders document as a guide • Steering Committee (10 members) • ERN Council in process • Leverages other community projects [ 13 ] Looking ahead – Some Possibilities • Regional technology testbeds • Regional Science DMZ (Data DMZ) • Common interface to resources, independent of provider (Atrio?) • Campus resources, national resources, commercial cloud • Resource bartering system/Marketplace • Advanced network technologies (experiment->pilot->production) • Simplified engagement with national resources and commercial cloud • National Research Platform (NRP) • Open Storage Network (OSN) • Big Data Hubs • Open Science Grid • National Resources (XSEDE, GENI, Cloudlab, Chameleon) • Commercial cloud providers (Azure, AWS) • Regional infrastructure proposals (NSF CC*, CICI, Mid-Scale, etc.) • Improve competitiveness on larger solicitations • Mosaic of smaller proposals that benefit the whole • New security models • Zero trust? Google BeyondCorp [ 14 ] ERN Partners • University of Kentucky • University of Maine-Orono Universities: • University of Massachusetts-Amherst • Brown University • University of Michigan • Case Western Reserve • University of New Hampshire • Columbia University Network Providers: • Franklin and Marshall • CAAREN • George Washington University • CEN • Indiana University • Internet2 • NJIT • KINBER • Penn State University • NetworkMaine • Princeton University • NJEdge • Rutgers University • NYSERNET • Syracuse University • OARnet • Yale University • OSHEAN • University of Chicago Organizations: • University of Delaware MGHPCC • University of Illinois Northeast Big Data Innovation Hub [ 15 ].
Load more

Recommended publications
  • QUILT CIRCLE2020 a Letter from the President
    THE QUILT CIRCLE2020 A Letter From the President This 2020 Quilt Circle edition commemorates the 20th Anniversary of The Quilt. The fabric of our research and education (R&E) networking community has never been stronger. While our Quilt community has evolved in new and exciting ways in the past two decades, we have also been faced with a number of challenges which we take head-on and always with the spirit of collaboration. As we address the unprecedented challenges presented by the current global public health crisis due to the COVID-19 pandemic, the work of our members is more important than ever to the missions of their member communities. U.S. higher education institutions rely on R&E networks to give them a competitive edge in the most impactful scientific research initiatives which is essential in this crisis. We connect the educational institutions that support university medical centers and their associated hospitals. R&E networks also connect tens of thousands of other community anchor institutions, including K-12 schools, public libraries, local/state government, research sites, cultural institutions, public safety, and tribal lands. Being responsive and providing vital networking infrastructure and resources right now to address immediate needs is who we are and what we do. R&E networks are part of our nation’s critical infrastructure. This year’s edition of The Quilt Circle showcases several examples of the key role of R&E network members in both providing and facilitating the use-network infrastructure to further scientific discovery and collaborations at higher education institutions of all sizes.
    [Show full text]
  • Internet2: a Comparative Study and Technological Solution to Achieve High Speed Networks
    Himanshu Agarwal / Indian Journal of Computer Science and Engineering Vol 1 No 3, 157-160 INTERNET2: A COMPARATIVE STUDY AND TECHNOLOGICAL SOLUTION TO ACHIEVE HIGH SPEED NETWORKS HIMANSHU AGARWAL Department of Computer Science & Information Technology, Moradabad Institute of Technology, Moradabad-244001 (Uttar Pradesh), India Email: [email protected] Abstract In current Indian scenario whenever it is required to access very large amount of data such as games or some commercial applications through commodity internet (internet1), speed becomes hurdle. It becomes tolerable for some applications but no one wants to bother in case of education and research. Now the world becomes commercialized and don’t want to bother with speed. Therefore the next generation of Internet infrastructure known as Internet2 or UCAID (University Corporation for Advance Internet Development) for 21st century comes in the focus of scientists, to improve quality of life through research and education. In this paper thorough analysis and comparative study of various educational networks, market scenario and Internet2 has been done, so all pros and cons become visualized to get the effect of internet2 in industries, research and development. Keywords: Internet2; Abilene network; gigapops; high speed networks. 1. Introduction Internet2 is a second generation network serving universities and research institutes by moving the data at a rate of 10 gigabits per second and more ,compared with 5.1 or so megabits old fashioned commodity internet. Internet2 moves data 100 to 1,000 times faster than internet1. Its GigaPoPs (points of presence) provide regional high-performance aggregation points; for member institutions, typically local campus networks provide no less than 100 Mbps to the desktop.
    [Show full text]
  • 1117 M. Stahl Obsoletes Rfcs: 1062, 1020, 997, 990, 960, 943, M
    Network Working Group S. Romano Request for Comments: 1117 M. Stahl Obsoletes RFCs: 1062, 1020, 997, 990, 960, 943, M. Recker 923, 900, 870, 820, 790, 776, 770, 762, SRI-NIC 758, 755, 750, 739, 604, 503, 433, 349 August 1989 Obsoletes IENs: 127, 117, 93 INTERNET NUMBERS Status of this Memo This memo is an official status report on the network numbers and the autonomous system numbers used in the Internet community. Distribution of this memo is unlimited. Introduction This Network Working Group Request for Comments documents the currently assigned network numbers and gateway autonomous systems. This RFC will be updated periodically, and in any case current information can be obtained from Hostmaster at the DDN Network Information Center (NIC). Hostmaster DDN Network Information Center SRI International 333 Ravenswood Avenue Menlo Park, California 94025 Phone: 1-800-235-3155 Network mail: [email protected] Most of the protocols used in the Internet are documented in the RFC series of notes. Some of the items listed are undocumented. Further information on protocols can be found in the memo "Official Internet Protocols" [40]. The more prominent and more generally used are documented in the "DDN Protocol Handbook" [17] prepared by the NIC. Other collections of older or obsolete protocols are contained in the "Internet Protocol Transition Workbook" [18], or in the "ARPANET Protocol Transition Handbook" [19]. For further information on ordering the complete 1985 DDN Protocol Handbook, contact the Hostmaster. Also, the Internet Activities Board (IAB) publishes the "IAB Official Protocol Standards" [52], which describes the state of standardization of protocols used in the Internet.
    [Show full text]
  • Annual Report
    2015 Annual Report ANNUAL 2015 REPORT CONTENTS i Letter from the President 4 ii NYSERNet Names New President 6 iii NYSERNet Members Institutions 8 iv Membership Update 9 v Data Center 10 vi VMWare Quilt Project 11 vii Working Groups 12 viii Education Services 13 ix iGlass 14 x Network 16 xi Internet Services 17 xii Board Members 18 xiii Our Staff 19 xiv Human Face of Research 20 LETTER FROM THE PRESIDENT Dear Colleagues, I am pleased to present to you NYSERNet’s 2015 Annual Report. Through more than three decades, NYSERNet’s members have addressed the education and research community’s networking and other technology needs together, with trust in each other guiding us through every transition. This spring inaugurates more change, as City. The terrible attack of Sept. 11, 2001, we welcome a new president and I will step complicated achievement of that goal, made down from that position to focus on the it more essential, and taught a sobering research community’s work and needs. lesson concerning the importance of communication and the need to harden the By itself, working with NYSERNet’s infrastructure that supports it. We invested extraordinary Board and staff to support in a wounded New York City, deploying fiber and building what today has become a global exchange point at “ These two ventures formed pieces 32 Avenue of the Americas. In the process, we forged partnerships in a puzzle that, when assembled, that have proved deep and durable. benefited all of New York and beyond.” Despite inherent risks, and a perception that New York City the collective missions of our members institutions might principally benefit, for the past 18 years has been a privilege NYSERNet’s Board unanimously supported beyond my imagining.
    [Show full text]
  • Download Vol 3, No 3&4, Year 2010
    The International Journal on Advances in Networks and Services is published by IARIA. ISSN: 1942-2644 journals site: http://www.iariajournals.org contact: [email protected] Responsibility for the contents rests upon the authors and not upon IARIA, nor on IARIA volunteers, staff, or contractors. IARIA is the owner of the publication and of editorial aspects. IARIA reserves the right to update the content for quality improvements. Abstracting is permitted with credit to the source. Libraries are permitted to photocopy or print, providing the reference is mentioned and that the resulting material is made available at no cost. Reference should mention: International Journal on Advances in Networks and Services, issn 1942-2644 vol. 3, no. 3 & 4, year 2010, http://www.iariajournals.org/networks_and_services/ The copyright for each included paper belongs to the authors. Republishing of same material, by authors or persons or organizations, is not allowed. Reprint rights can be granted by IARIA or by the authors, and must include proper reference. Reference to an article in the journal is as follows: <Author list>, “<Article title>” International Journal on Advances in Networks and Services, issn 1942-2644 vol. 3, no. 3 & 4, year 2010, <start page>:<end page> , http://www.iariajournals.org/networks_and_services/ IARIA journals are made available for free, proving the appropriate references are made when their content is used. Sponsored by IARIA www.iaria.org Copyright © 2010 IARIA International Journal on Advances in Networks and Services Volume
    [Show full text]
  • Broadband for Education: the National Internet2 K20 Initiative’S and WICHE’S Recommendations to the FCC
    Broadband for Education: The National Internet2 K20 Initiative’s and WICHE’s Recommendations to the FCC Who are we? Internet2: We bring together Internet2’s world-class network and research community members with innovators from colleges and universities, primary and secondary schools, libraries, museums and other educational institutions, the full spectrum of America’s education community, including both formal and informal education. The National K20 Initiative extends new technologies, applications, and rich educational content to all students, their families and communities – no matter where they’re located. We have had immense success connecting the institutions above – in fact, over 65,000 institutions are now connected to the National Internet2 network – but to realize fully the potential of Internet2 all institutions must have adequate bandwidth. What follows are principles we endorse and urge the FCC to adopt. We divide our recommendations into two interrelated categories: connectivity and e-rate support. Western Interstate Commission for Higher Education (WICHE): WICHE and its 15 member states work to improve access to higher education and ensure student success. Our student exchange programs, regional initiatives, and our research and policy work allow us to assist constituents in the West and beyond. Equitable access to broadband technology and, in particular, technology-enabled education, is among our strategies. At present much of the West, particularly the “frontier West,” has little or no access to adequate bandwidth. Many of our institutions are not among those connected by and participating in the Internet2 K20 Initiative. The principles and recommendations below would remedy this situation. Our recommendations: (1) Connectivity • Elementary schools, secondary schools, and branch libraries should be connected at 100 Mbps to 10 Gbps.
    [Show full text]
  • Network Working Group S. Kirkpatrick Request for Comments: 1166 M
    Network Working Group S. Kirkpatrick Request for Comments: 1166 M. Stahl Obsoletes RFCs: 1117, 1020, 997, 990, 960, 943, M. Recker 943, 923, 900, 870, 820, 790, 776, 770, 762, July 1990 758, 755, 750, 739, 604, 503, 433, 349 Obsoletes IENs: 127, 117, 93 INTERNET NUMBERS Status of this Memo This memo is a status report on the network numbers and autonomous system numbers used in the Internet community. Distribution of this memo is unlimited. Table of Contents Introduction.................................................... 1 Network Numbers................................................. 4 Class A Networks................................................ 7 Class B Networks................................................ 8 Class C Networks................................................ 47 Other Reserved Internet Addresses............................... 100 Network Totals.................................................. 101 Autonomous System Numbers....................................... 102 Documents....................................................... 111 Contacts........................................................ 115 Security Considerations......................................... 182 Authors' Addresses.............................................. 182 Introduction This Network Working Group Request for Comments documents the currently assigned network numbers and gateway autonomous systems. This RFC will be updated periodically, and in any case current information can be obtained from Hostmaster at the DDN Network Information
    [Show full text]
  • May 2013 Report APPENDIX D
    APPENDIX D 2013 ESINet Steering Committee Report to the 130th General Assembly Technical Standards Subcommittee INFRASTRUCTURE EVALUATION An examination of the readiness of the state’s current technology infrastructure to support a statewide emergency services internet protocol network for Next Generation 9-1-1 Services. 0 | P a g e Table of Contents PURPOSE ....................................................................................................................................................... 2 EXISTING TECHNOLOGY INFRASTRUCTURE .................................................................................................. 2 OHIO OFFICE OF INFORMATION TECHNOLOGY ............................................................................................ 3 OIT Telecommunications .............................................................................................................................. 3 Procurement ................................................................................................................................................. 3 DAS Network Contract Management Services ............................................................................................. 4 Contracts by Service ...................................................................................................................................... 4 Reach…. ......................................................................................................................................................... 5 Capacity
    [Show full text]
  • Uen Provides Bandwidth on Demand for the Research Community
    UEN PROVIDES BANDWIDTH ON DEMAND FOR THE RESEARCH COMMUNITY What Our Customers Working with the University of Utah, the Are Saying Utah Education Network has connected the “We were able to start deploying 100G wavelengths alongside our research community with a super-fast, 100G existing 10G wavelengths right transport infrastructure built on Ciena’s 6500 away, giving us a tenfold uplift in available bandwidth capacity for the Packet-Optical Platform. local research community.” The Utah Education Network (UEN) connects all universities, school districts, schools, “It costs the same to buy and turn libraries, and anchor institutions across the state. To meet the needs of super users at up a wavelength on the Ciena the University of Utah and other research institutions, the organization needed to infrastructure as it costs to lease an upgrade its existing 10G network infrastructure. equivalent service from a third-party provider for one year. After that, we Working with the University of Utah and Ciena, with local project support from Ciena only have maintenance costs to partner CenturyLink, UEN deployed new 100G wavelengths to connect the university’s think about, which means we high-performance computing center with its new data center in downtown Salt Lake achieve major ongoing savings.” City. A third 100G connection links the university to the U.S. national research and education network, Internet2. Kevin Quire Manager of Network Engineering The new metro optical network, which is built on Ciena’s 6500, provides virtually Utah Education Network unlimited, on-demand bandwidth for the research community. It will support the diverse research portfolio of researchers and students across Utah for many years to come, offering robust scientific computing and visualization capabilities in the areas of biomedicine, genomics, geophysics, combustion, molecular dynamics, fluid dynamics, and climate modeling.
    [Show full text]
  • Description of Omnipop for Proposals
    Description of OmniPoP for Proposals Summary The OmniPoP is a collaborative effort between 12 of the member universities of the Big Ten Academic Alliance. Together, these institutions have pooled their efforts to create a high performance shared infrastructure based in the Chicago area. This infrastructure was designed to complement and augment the shared fiber infrastructure that the Big Ten Academic Alliance members had previously purchased. The OmniPoP operates a high capacity switching infrastructure that supports 10 gigabit and 100 gigabit connections to its member institutions and equivalent high capacity links to national research and education networks such as Internet2, ESnet, and Starlight. This allows OmniPoP connections to be leveraged to provide services to large data flows in support of multi-institutional cooperative research efforts. Efforts supported today include interconnections between the Large Hadron Collider (LHC) Tier 2 efforts at the member institutions and the Midwest Openflow Crossroads Initiative (MOXI) project which links several midwest regional networks to the GENI backbone. OmniPoP Infrastructure and Peerings The Omnipop infrastructure consists of a redundant pair of 100 gigabit capable switches. These switches operate from geographically diverse co-location facilities within the Chicago metropolitan areas. These facilities also serve as Points of Presence (PoPs) for other major networks such as Internet2, ESnet (Department of Energy’s Energy Sciences Network), and Starlight (the international peering exchange), enabling seamless cross connections to the major national and international research and education networks that support much of the academic research community. An additional benefit to these facilities is that they offer the opportunity for Big Ten Academic Alliance members to co-locate additional network related equipment in support of their own projects independent of the OmniPoP core infrastructure.
    [Show full text]
  • The Internet ! Based on Slides Originally Published by Thomas J
    15-292 History of Computing The Internet ! Based on slides originally published by Thomas J. Cortina in 2004 for a course at Stony Brook University. Revised in 2013 by Thomas J. Cortina for a computing history course at Carnegie Mellon University. A Vision of Connecting the World – the Memex l Proposed by Vannevar Bush l first published in the essay "As We May Think" in Atlantic Monthly in 1945 and subsequently in Life Magazine. l "a device in which an individual stores all his books, records, and communications, and which is mechanized so that it may be consulted with exceeding speed and flexibility" l also indicated the idea that would become hypertext l Bush’s work was influential on all Internet pioneers The Memex The Impetus to Act l 1957 - U.S.S.R. launches Sputnik I into space l 1958 - U.S. Department of Defense responds by creating ARPA l Advanced Research Projects Agency l “mission is to maintain the technological superiority of the U.S. military” l “sponsoring revolutionary, high-payoff research that bridges the gap between fundamental discoveries and their military use.” l Name changed to DARPA (Defense) in 1972 ARPANET l The Advanced Research Projects Agency Network (ARPANET) was the world's first operational packet switching network. l Project launched in 1968. l Required development of IMPs (Interface Message Processors) by Bolt, Beranek and Newman (BBN) l IMPs would connect to each other over leased digital lines l IMPs would act as the interface to each individual host machine l Used packet switching concepts published by Leonard Kleinrock, most famous for his subsequent books on queuing theory Early work Baran (L) and Davies (R) l Paul Baran began working at the RAND corporation on secure communications technologies in 1959 l goal to enable a military communications network to withstand a nuclear attack.
    [Show full text]
  • Nysernet Staff Sector, Like Energy, Climate, and Health Care, We Have Engaged New York’S Cor- Sharon M
    NYSERNet Board of Directors Jeanne Casares Voldemar Innus David E. Lewis Chief Information Officer Vice President & CIO Vice Provost & CIO Rochester Institute of Technology Buffalo State College University of Rochester Brian Cohen Robert W. Juckiewicz Marilyn McMillan Associate Vice Chancellor & CIO Vice President for IT Vice President for IT & Chief IT Officer City University of New York Hofstra University for NYU NY Campus, New York University Elias Eldayrie John E. Kolb Mark Reed Associate Vice President & CIO VP for Information Services and Associate Vice President for IT University at Buffalo Technology and CIO Binghamton University Rensselaer Polytechnic Institute Candace Fleming Richard Reeder Vice President & CIO Vace Kundakci Director of IT & CIO Columbia University Assistant Vice President Stony Brook University for IT & CIO Armand Gazes City College of New York Gary O. Roberts Director, Information Technology Director Information Technology Services Operations and Network Security Timothy L. Lance Alfred University The Rockefeller University President NYSERNet Christopher M. Sedore Christine Haile Vice President for IT & CIO Chief Information Officer Francis C. Lees Syracuse University University at Albany Chief Information Officer American Museum of Natural History David Sturm Vice President & CIO The New York Public Library William Thirsk Vice President for IT & CIO Marist College R. David Vernon Director of Information Technology Cornell University Robert Wood Director of Government Relations Clarkson University 2 Dear Colleagues, I am pleased to present NYSERNet’s 2009 annual report. One might ask why, in our silver anniversary year, this is the first such report. The answer lies in our evolution. From its beginning, NYSERNet has had an engaged, active Board.
    [Show full text]