DOCSLIB.ORG

Data Transfer Performance for the Earth System Grid Federation (PDF)

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Data Transfer Performance for the Earth System Grid Federation (PDF) Data Transfer Performance for the Earth System Grid Federation Mary Hester, ESnet Lawrence Berkeley National Laboratory Internet2 Global Summit Denver, CO April 8, 2014 Topics • Network Goals • Implementing the Project Plan • Motivation • Current Status 4/8/14 2 Lawrence Berkeley National Laboratory U.S. Department of Energy | Office of Science Network Specific Goals for ESGF Proposal Sites: ANU/NCI, BADC, DKRZ, KNMI, PCMDI Goal: 500MB/sec (4Gbps) sustained data transfer rate, disk to disk, between sites Stretch goal: 1GB/sec (8Gbps) disk to disk by August 2015 Timeline: • March 2014: deploy perfSONAR systems • May 2014: deploy 10GE data servers • May 2014: achieve 500MB/sec (4Gbps) network performance • August 2014: achieve 500MB/sec (4Gbps) disk to disk 4/8/14 3 Lawrence Berkeley National Laboratory U.S. Department of Energy | Office of Science Location of International Sites 4/8/14 4 Lawrence Berkeley National Laboratory U.S. Department of Energy | Office of Science Project Network Map AARNet Router at Pac Wave Seattle 10GE KNMI BADC AARNet 40G Trans Pacific Backbone (7-10Gbps allocation) KNMI Data Node 100GE 10GE 10GE 10GE Pacific Wave Exchange 10GE 10GE Seattle Rutherford Lab BADC AARNet Router (RAL) 10GE Data Nodes (6) at ANU ESnet test 10GE 10GE PNWG-CR5 DTNs (3) SURFnet 100GE 10GE 10GE NCI Network Janet ESnet5 100GE 100GE 100G Backbone 30G (3x10GE) 10GE 10GE AOFA-CR5 MANLAN Trans Exchange Atlantic New York LLNL-MR2 100GE GEANT 100GE ANU/NCI 20G 10GE Data Nodes (3) (2x10GE) Trans SUNN-CR5 100GE Atlantic 10GE WASH-CR5 WIX Exchange LLNL Border Washington DC DFN Router PCMDI Data Nodes (4) 10GE 1ge LLNL Campus 3.5Gbps 3.5Gbps Network DKRZ 1ge 10GE Data Nodes (6) 10GE DKRZ 4/8/14 5 Lawrence Berkeley National Laboratory U.S. Department of Energy | Office of Science Plan of Action 1. Start a working group within ESGF 2. Deploy perfSONAR boxes at the participating sites 3. Deploy/upgrade data transfer nodes (DTNs) 4. Gather metrics to track progress 5. Documentation Long-term: other ESGF sites will be incorporated into this effort (the working group) after these first few sites (via the EYR program) get up and running. 4/8/14 6 Lawrence Berkeley National Laboratory U.S. Department of Energy | Office of Science Motivation: We Know This Works Network engineering efforts typically result in 10x to 500x performance increase Three stages of performance engineering: 1. Network • Sufficient bandwidth capacity • Clean network paths (no packet loss!) 2. Facility • Systems • Storage • Tools (e.g. Globus) 3. User • Systems • Storage • Tools 4/8/14 7 Lawrence Berkeley National Laboratory U.S. Department of Energy | Office of Science Small Packet Loss Leads to Huge TCP Performance Problems Local With loss, high performance (LAN) beyond metro distances is essentially impossible International Metro Area Regional Continental Measured (TCP Reno) Measured (HTCP) Theoretical (TCP Reno) Measured (no loss) 4/8/14 Lawrence Berkeley National Laboratory U.S. Department of Energy | Office of Science Current Status at Each Site CEDA: Physical and VM perfSONAR hosts deployed • Physical host is up – good test data already obtained • Collaboration with JANET ongoing • Collaboration with GEANT established DKRZ: Physical perfSONAR host deployed • Good test data already obtained • Collaboration with DFN and GEANT established NCI: perfSONAR host deployment in progress • Collaboration with AARNet established 4/8/14 9 Lawrence Berkeley National Laboratory U.S. Department of Energy | Office of Science Current Status at Each Site KNMI: Just upgraded to 10G connection • Working on purchasing a perfSONAR host PCMDI: perfSONAR host up – needs filter adjustments • Science DMZ design meeting • DTN upgrades planned • Some hardware fixes required – work ongoing Looking forward: • All sites should be up and running with perfSONAR shortly • Performance verification – good progress is being made • DTNs are next 4/8/14 10 Lawrence Berkeley National Laboratory U.S. Department of Energy | Office of Science perfSONAR Dashboard: Packet Loss 4/8/14 11 Lawrence Berkeley National Laboratory U.S. Department of Energy | Office of Science perfSONAR Dashboard: Throughput Tests 4/8/14 12 Lawrence Berkeley National Laboratory U.S. Department of Energy | Office of Science Performance Between LLNL and DKRZ Washington ESnet Router WIX Exchange Frankfurt GEANT Router Frankfurt DFN Router 100G 100G 3x10G 100G GEANT Wa sh. to DFN = 0.7 Gbps 100G 100G DFN to Wash = 0.6 Gbps RTT = 108 ms DFN ESnet 2x10G LLNL ESnet DKRZ Router LLNL to DKRZ = 0.5 Gbps Border Router 10G DKRZ to LLNL = 0.7 Gbps 2x10G RTT = 166 ms 4/8/14 13 Lawrence Berkeley National Laboratory U.S. Department of Energy | Office of Science Performance Between LLNL and CEDA New York MANLAN Amsterdam London ESnet Router Exchange GEANT Router GEANT Router 100G 100G 3x10G 100G GEANT 100G 100G Janet ESnet 10G LLNL ESnet Rutherford Lab Router Border Router LLNL to RAL = 0.5 Gbps 40G 10G RAL to LLNL = 0.5 Gbps RTT = 156 ms 4/8/14 14 Lawrence Berkeley National Laboratory U.S. Department of Energy | Office of Science Thanks! Mary Hester: [email protected] Visit: es.net Networking Knowledge Base: fasterdata.es.net .
Load more

Recommended publications
  • Internet2: a Comparative Study and Technological Solution to Achieve High Speed Networks
    Himanshu Agarwal / Indian Journal of Computer Science and Engineering Vol 1 No 3, 157-160 INTERNET2: A COMPARATIVE STUDY AND TECHNOLOGICAL SOLUTION TO ACHIEVE HIGH SPEED NETWORKS HIMANSHU AGARWAL Department of Computer Science & Information Technology, Moradabad Institute of Technology, Moradabad-244001 (Uttar Pradesh), India Email: [email protected] Abstract In current Indian scenario whenever it is required to access very large amount of data such as games or some commercial applications through commodity internet (internet1), speed becomes hurdle. It becomes tolerable for some applications but no one wants to bother in case of education and research. Now the world becomes commercialized and don’t want to bother with speed. Therefore the next generation of Internet infrastructure known as Internet2 or UCAID (University Corporation for Advance Internet Development) for 21st century comes in the focus of scientists, to improve quality of life through research and education. In this paper thorough analysis and comparative study of various educational networks, market scenario and Internet2 has been done, so all pros and cons become visualized to get the effect of internet2 in industries, research and development. Keywords: Internet2; Abilene network; gigapops; high speed networks. 1. Introduction Internet2 is a second generation network serving universities and research institutes by moving the data at a rate of 10 gigabits per second and more ,compared with 5.1 or so megabits old fashioned commodity internet. Internet2 moves data 100 to 1,000 times faster than internet1. Its GigaPoPs (points of presence) provide regional high-performance aggregation points; for member institutions, typically local campus networks provide no less than 100 Mbps to the desktop.
    [Show full text]
  • Broadband for Education: the National Internet2 K20 Initiative’S and WICHE’S Recommendations to the FCC
    Broadband for Education: The National Internet2 K20 Initiative’s and WICHE’s Recommendations to the FCC Who are we? Internet2: We bring together Internet2’s world-class network and research community members with innovators from colleges and universities, primary and secondary schools, libraries, museums and other educational institutions, the full spectrum of America’s education community, including both formal and informal education. The National K20 Initiative extends new technologies, applications, and rich educational content to all students, their families and communities – no matter where they’re located. We have had immense success connecting the institutions above – in fact, over 65,000 institutions are now connected to the National Internet2 network – but to realize fully the potential of Internet2 all institutions must have adequate bandwidth. What follows are principles we endorse and urge the FCC to adopt. We divide our recommendations into two interrelated categories: connectivity and e-rate support. Western Interstate Commission for Higher Education (WICHE): WICHE and its 15 member states work to improve access to higher education and ensure student success. Our student exchange programs, regional initiatives, and our research and policy work allow us to assist constituents in the West and beyond. Equitable access to broadband technology and, in particular, technology-enabled education, is among our strategies. At present much of the West, particularly the “frontier West,” has little or no access to adequate bandwidth. Many of our institutions are not among those connected by and participating in the Internet2 K20 Initiative. The principles and recommendations below would remedy this situation. Our recommendations: (1) Connectivity • Elementary schools, secondary schools, and branch libraries should be connected at 100 Mbps to 10 Gbps.
    [Show full text]
  • May 2013 Report APPENDIX D
    APPENDIX D 2013 ESINet Steering Committee Report to the 130th General Assembly Technical Standards Subcommittee INFRASTRUCTURE EVALUATION An examination of the readiness of the state’s current technology infrastructure to support a statewide emergency services internet protocol network for Next Generation 9-1-1 Services. 0 | P a g e Table of Contents PURPOSE ....................................................................................................................................................... 2 EXISTING TECHNOLOGY INFRASTRUCTURE .................................................................................................. 2 OHIO OFFICE OF INFORMATION TECHNOLOGY ............................................................................................ 3 OIT Telecommunications .............................................................................................................................. 3 Procurement ................................................................................................................................................. 3 DAS Network Contract Management Services ............................................................................................. 4 Contracts by Service ...................................................................................................................................... 4 Reach…. ......................................................................................................................................................... 5 Capacity
    [Show full text]
  • Uen Provides Bandwidth on Demand for the Research Community
    UEN PROVIDES BANDWIDTH ON DEMAND FOR THE RESEARCH COMMUNITY What Our Customers Working with the University of Utah, the Are Saying Utah Education Network has connected the “We were able to start deploying 100G wavelengths alongside our research community with a super-fast, 100G existing 10G wavelengths right transport infrastructure built on Ciena’s 6500 away, giving us a tenfold uplift in available bandwidth capacity for the Packet-Optical Platform. local research community.” The Utah Education Network (UEN) connects all universities, school districts, schools, “It costs the same to buy and turn libraries, and anchor institutions across the state. To meet the needs of super users at up a wavelength on the Ciena the University of Utah and other research institutions, the organization needed to infrastructure as it costs to lease an upgrade its existing 10G network infrastructure. equivalent service from a third-party provider for one year. After that, we Working with the University of Utah and Ciena, with local project support from Ciena only have maintenance costs to partner CenturyLink, UEN deployed new 100G wavelengths to connect the university’s think about, which means we high-performance computing center with its new data center in downtown Salt Lake achieve major ongoing savings.” City. A third 100G connection links the university to the U.S. national research and education network, Internet2. Kevin Quire Manager of Network Engineering The new metro optical network, which is built on Ciena’s 6500, provides virtually Utah Education Network unlimited, on-demand bandwidth for the research community. It will support the diverse research portfolio of researchers and students across Utah for many years to come, offering robust scientific computing and visualization capabilities in the areas of biomedicine, genomics, geophysics, combustion, molecular dynamics, fluid dynamics, and climate modeling.
    [Show full text]
  • Description of Omnipop for Proposals
    Description of OmniPoP for Proposals Summary The OmniPoP is a collaborative effort between 12 of the member universities of the Big Ten Academic Alliance. Together, these institutions have pooled their efforts to create a high performance shared infrastructure based in the Chicago area. This infrastructure was designed to complement and augment the shared fiber infrastructure that the Big Ten Academic Alliance members had previously purchased. The OmniPoP operates a high capacity switching infrastructure that supports 10 gigabit and 100 gigabit connections to its member institutions and equivalent high capacity links to national research and education networks such as Internet2, ESnet, and Starlight. This allows OmniPoP connections to be leveraged to provide services to large data flows in support of multi-institutional cooperative research efforts. Efforts supported today include interconnections between the Large Hadron Collider (LHC) Tier 2 efforts at the member institutions and the Midwest Openflow Crossroads Initiative (MOXI) project which links several midwest regional networks to the GENI backbone. OmniPoP Infrastructure and Peerings The Omnipop infrastructure consists of a redundant pair of 100 gigabit capable switches. These switches operate from geographically diverse co-location facilities within the Chicago metropolitan areas. These facilities also serve as Points of Presence (PoPs) for other major networks such as Internet2, ESnet (Department of Energy’s Energy Sciences Network), and Starlight (the international peering exchange), enabling seamless cross connections to the major national and international research and education networks that support much of the academic research community. An additional benefit to these facilities is that they offer the opportunity for Big Ten Academic Alliance members to co-locate additional network related equipment in support of their own projects independent of the OmniPoP core infrastructure.
    [Show full text]
  • Redclara: Regional Network in Latin America
    RedCLARA: regional network in Latin America I2MM Spring 2009 Michael Stanton [email protected] Chair, CLARA Techical Committee CLARA and CKLN/ C@ribnet • CLARA is the regional association of NRENs in Latin America (LA) • CLARA operates the LA regional R&E network – RedCLARA – which joins together NRENs from several countries bordering on the Caribbean • Many of our international links cross the Caribbean • We would like to offer our support for R&E networking initiatives in the Caribbean The LA experience in advanced R&E networking • After the establishment of Internet2 in 1996, “advanced networks” became a new paradigm to be pursued by the Reasearch and Education (R&E) community • The first steps in LA were taken by Mexico, with cross-border connections to the US, and by the AMPATH project at FIU, Miami, which began linking South American networks to the US Internet2 Connectivity in Latin America by 2002 AMPATH • used new submarine cable • connected Argentina, Brazil (2), Chile, Venezuela • 45 Mbps AMPATH • all connections are point to point from Miami, and thence to Abilene Mexico • cross-border connections to USA (Texas and California) State of Latin American NRENs in 2002 Established education and research networks: • With dedicated Internet2 connections: Argentina, Brazil, Chile, Mexico, Venezuela • Some with dedicated int’l connectivity: Cuba, Uruguay Education and research networks were being re-established (present nat’l/int’l connectivity through commercial ISPs) • Bolivia, Colombia, Costa Rica, Ecuador, Guatemala, Panama, Peru, Paraguay, El Salvador No education/research network (most connected to Internet via commercial ISPs): Nicaragua, Honduras Europe and the @LIS iniciative • Through GÉANT, the European R&E community enjoyed high bandwidth connectivity with N.
    [Show full text]
  • Connecticut Education Network (CEN)
    Customer Story SCIENTISTS AND STUDENTS DISCOVER AND LEARN WITH FAST, RELIABLE ACCESS FROM THE 100 GBPS CONNECTICUT EDUCATION NETWORK Summary The Connecticut Education Network (CEN) delivers reliable, high-speed Internet access, data transport, and a broad range of network and cloud services to its Company: members throughout Connecticut at affordable rates. Established in 2000, CEN Connecticut Education Network helps deliver on the promise of digital equity in education by providing affordable (CEN) access to technologies for schools and libraries. CEN connects 200 K-12 schools, 150 libraries, 39 higher education institutions, 100 municipalities, and 10 Industry: government agencies across the state. CEN was the first statewide K-12 and higher Education education network built exclusively using state-of-the-art fiber optics, and CEN Business Challenges: continues to provide leading-edge network services. • Provide affordable Internet and network services to higher Business Challenge education, K-12 schools, Data-intensive collaboration was growing across Connecticut’s research and libraries, and municipalities education community and with peers at national and international institutions. • Support data-intensive University of Connecticut (UConn), CEN, and Internet2 wanted to upgrade the research and scientific Science DMZ connection between UConn’s main campus in Storrs, CT and the collaboration across institutions UConn Health Center in Farmington, about 35 miles away. Technology Solution: “We wanted to enhance the capabilities of researchers to host data and share data • QFX10002 and QFX5100 with researchers in other institutions, which can benefit a larger community of Switches researchers,” says Ryan Kocsondy, director of CEN. • EX4600 and EX3400 Ethernet Switches A Science DMZ is a portion of the network, built at the campus network edge, that’s • MX960 and MX480 5G designed to support high-performance applications, rather than general-purpose Universal Routing Platforms business systems.
    [Show full text]
  • About Internet2
    Basic Research & the Development of the Internet Chinese – American Networking Symposium Chengdu, China September 21, 2015 9/21/15 1 Overview • Welcome • Introduction • Background • Science and Computation • The Internet • Policy Issues • Implications for Our Partnership 2 9/21/15 Welcome • Wonderful to join CANS again! – My last CANS in person was in 2008. • Impressed with progress over the years • CANS is important to science and education in the US and China – More than 400 US-China collaborative research projects across a wide variety of disciplines – Increasing collaboration and interaction in education 9/21/15 Introduction • Looking to the future, what have we learned? – What are some key lessons from our past? • The Internet and its applications had their origins in our community. – Primarily in support of basic research and education • How should we sustain the Internet’s development and enhance its health? 9/21/15 USA Background • WW II role of science – Nuclear fission – Medicine (penicillin, blood substitutes, anti-malarials) – Radar • Post-war – Science – the Endless Frontier by Vannevar Bush – National Science Foundation – National Institutes of Health – Atomic Energy Commission • Renewed funding in the post Sputnik era – National Aeronautics and Space Administration – Advanced Research Projects Agency 9/21/15 Research and Development in the US • Basic research and applied research -> development • Scientific community – Research universities (~ 75) – Major federal laboratories (~20) – Corporate laboratories – ~4 million
    [Show full text]
  • Governor Scott Walker June 10, 2011 115 East Capitol State Capitol Madison, WI 53702
    Governor Scott Walker June 10, 2011 115 East Capitol State Capitol Madison, WI 53702 Dear Governor Walker, Today we write to ask for your leadership in removing sections 23-26 of the University Omnibus legislation. For the United States to be a leader in the global economy, it is critical that government policy does not stifle innovation. One way to inadvertently undermine state and national economic competitiveness goals is to bar those who have been successful in the past from continuing to innovate while creating bureaucratic rules to limit who is eligible to provide services to the marketplace. And, without question, the University of Wisconsin’s initiatives and Wisconsin’s not for profit Wiscnet have been resounding successes that have changed the lives of citizens in Wisconsin and throughout the world. Draft language Bars Innovation and Reduces Market Choice The University of Wisconsin has long been recognized as one of the critical contributors responsible for the creation of the Internet. It was the University’s faculty leaders who championed the idea of interlinked networks over distance and who prototyped those ideas in real-world settings that evolved into the Internet1. Even as telephone providers steadfastly argued that the concept of the Internet would fail, faculty leaders at the University of Wisconsin built the large-scale innovation prototypes that led to the development of the global Internet. It would be the height of irony if sections 23-26 of the University Omnibus legislation were passed, as those provisions would prohibit the University from being directly involved in proving out further developments of innovations in the Internet that it helped create.
    [Show full text]
  • Before the FEDERAL COMMUNICATIONS COMMISSION Washington, DC 20554
    Before the FEDERAL COMMUNICATIONS COMMISSION Washington, DC 20554 In the matter of ) ) Preserving the Open Internet ) GN Docket No. 09-191 ) Broadband Industry Practices ) WC Docket No. 07-52 COMMENTS OF THE Association of Research Libraries, EDUCAUSE, Internet2, NYSERNet, and ACUTA The Association of Research Libraries1 (ARL), EDUCAUSE,2 Internet2,3 NYSERNet,4 and ACUTA5 welcome this rulemaking to preserve the openness of the Internet. Higher 1 The Association of Research Libraries (ARL) is a nonprofit organization of 124 research libraries in North America. ARL’s members include university libraries, public libraries, government and national libraries. ARL influences the changing environment of scholarly communication and the public policies that affect research libraries and the diverse communities they serve. ARL member libraries make up a large portion of the academic and research library marketplace, spending $1.3 billion every year on library materials and resources. 2 EDUCAUSE is a nonprofit association whose mission is to advance higher education by promoting the intelligent use of information technology. The current membership comprises more than 2,000 colleges, universities, and educational organizations, including 200 corporations, with 15,000 active members. 3 Internet2 is a not-for-profit partnership of 208 universities, 70 companies, and 51 affiliated organizations, including some federal agencies and laboratories. Its mission is to advance the state of the Internet, primarily by operating for its members a very advanced, private, ultra-high-speed research and education network that enables millions of researchers, faculty, students and staff to “live in the future” of advanced broadband. 4 NYSERNet is a private not-for-profit corporation founded in 1985 by a consortium of visionary public and private New York State institutions to provide high-speed network connectivity to advance research and educational initiatives in the Empire State.
    [Show full text]
  • National Lambdarail : Press Releases
    7/15/2010 National LambdaRail : Press Releases RSS The Network for Advanced Research and Innovation Owned by the U.S. research and education community, NLR is the ultra high-performance, 12,000-mile innovation platform for a wide range of academic disciplines and public-private Search partnerships. Learn more... HOME ABOUT US MEMBERS SERVICES RESEARCH SUPPORT PRESS ROOM CONTACT US PRESS ROOM Press Room Press Releases Press Resources National Research and Education Partnership Awarded $62.5 Million Recovery Act Grant for 100 NLR and National Broadband Gigabit Community Anchor Backbone Network NLR in the New s Featured Research New U.S. Unified Community Anchor Network will connect community anchor institutions across the U.S. with advanced broadband capabilities Ann Arbor, MI, July 2, 2010 -- The National Telecommunications and Information Administration (NTIA) today awarded more than $62.5 million in federal stimulus funding through its Broadband Technology Opportunities Program (BTOP) to a group of national research and education networking organizations including Internet2 (also known as University Corporation for Advanced Internet Development), National LambdaRail (NLR), Indiana University, the Northern Tier Network Consortium. In collaboration with technology companies Ciena, Cisco, Infinera, and Juniper Networks, the group proposes the construction of the United States Unified Community Anchor Network (U.S. UCAN), an advanced 100 Gigabit per second network backbone that will link regional networks across the nation, including other
    [Show full text]
  • 2,240+ $8 $47+ 300+ 700+
    oar.net + + + + 2,240 $8 $47 300 700 miles million million campuses schools of high-speed savings to Ohio savings through of college, in public network backbone education virtualization university & K–12 sector program branch partners OARnet: Delivering Ohio’s technology-based solutions Community-driven and collaboratively focused, upstream internet providers and connectivity to public the Ohio Academic Resources Network (OARnet) internet exchange points to optimize internet costs delivers technology-based solutions to Ohio’s while maintaining the highest standard of reliability. education, health care, public broadcasting IntraOhio Content Subscription and government organizations affordably and efficiently. OARnet’s communities participate As part of the new fee structure in FY2017, OARnet in its shared services programs because of the will debut a new shared subscription service for benefits and value-added services they receive. IntraOhio, offering streaming services at $1 per Mb, resulting in a savings between 50 to 84 percent per As a founding member of the Ohio Technology Mb from the previous year. This service will move Consortium, a division of the Ohio Department content items off Internet1, providing customers of Higher Education, OARnet provides Ohioans with more bandwidth for every dollar spent and access to a comprehensive technology positioning our clients to be better able to meet the infrastructure unmatched in any other state. ever-increasing demand for bandwidth. OARnet Our Driving Principles will work with each institution to determine the correct IntraOhio content subscription needed. • Increase access to affordable broadband service. • Reduce technology costs via aggregate purchasing. Internet2 • Maximize shared-service opportunities. OARnet is Ohio’s Internet2 Connector, fostering collaboration possibilities for researchers among OARnet Services institutions including seeking funding sources for OARnet delivers high-speed solutions throughout research, such as the National Science Foundation.
    [Show full text]