10th CEF Networks Workshop 2019
KREONET/KREONet2 optical network Contents
1. R&E Network Trends on 100Gbps Optical Network
2. KREONET/KREONet2 Optical Footprint
3. Applications on KREONET/KREONet2 Period of time to deploy first 5,000 units
40G 100G 200G 400G 0.75 years 2.75 years 2.0 years 4.5 years 1172 156 10690 3612 996 260 860 00 6 6 16 135406802170834906102 17 160 53415193738 9 10 82 702 0 0 0
2H17 1H18 2H18 1H14 2H14 1H15 2H15 1H16 1H10 2H10 1H11 2H11 1H12 2H12 1H05 2H05 1H06 2H06 1H07 2H07 1H08 2H08 1H09 2H09
Increasingly aggressive early adoption of new coherent technology to meet capacity requirements 400G-capable technology will ramp 3 times faster than 100G
Source. Ciena Higher baud rate, higher complexity modulations, advanced multi-dimensional coding
@35Gbaud @56Gbaud Capacity ROSNR CD Capacity ROSNR CD Bits/Baud Bits/Baud (Gb/s) (dB, 0.1 nm) (ns/nm) (Gb/s) (dB, 0.1 nm) (ns/nm) 100 10.3 579 4 100 9.5 226/435 2.5 150 14.3 579 6 150 11.9 226/435 3.75 200 18.3 579(*) 8 200 14.2 226/435 5 250 22.9 579(*) 10 250 17.1 226/435 6.25 300 19.2 226/435 7.5 (*) at this capacity, reach will be limited ROSNR, not CD 350 21.6 226(*) 8.75 400 24.5 226(*) 10
400G 300G 200G At up to 200G Metro/Local Interconnect Regional Interconnect Terrestrial Long Haul Next Gen Submarine 300km 1000km 3000km 14,000km
Data Center Data Center City A City B
Source. Ciena Capacity vs Terrestrial Reach Estimates
Capacity/Modem (Gb/s) 700 7. 3 6. 300G 75Gbaud 600 6 6. 325G H 500 0 5. I 4 4. 350G g 57Gbaud 400 8 h 4.2 375G 4.8 3.6 300 C 4.0 b/s/Hz 400G a 5.33 b/s/Hz 3.2 b/s/Hz 200 2.4 425G p 35Gbaud 4.0 b/s/Hz 2.67 b/s/Hz 450G 100 b/s/Hz 0 0 500 1000 1500 2000 2500 3000 3500 4000 4500 Nominal Reach (kms)
Optical technology trend is moving forward for Higher capacity, Lower power, Longer reach…and flexibility
Source. Ciena Linking the world with lambda =>Global Cyber-infrastructure, supporting Collaborative Scientific R&D project
2. KREONET/KREONet2 Optical Footprint KREONET/KREONet2 (AS1237/ AS17579) - KREONET (Korea Research Environment Open Network) - Korea’s National Science & Research Network, managed and operated by KISTI since 1988 - GLORIAD-KR, Core Member of GLORIAD project since 2005 - Advanced Research Network in “Utilization and Promotion of National Supercomputing” Act (implemented in 2011 in Korea) - 17 Domestic Regional GigaPoPs and 4 International GigaPoPs - 200 connected R&E organizations : National Research Institute and Lab, University, University Hospital, Research Institute of Company, library, Public Sector etc. - 365*24 NOC (Network Operation Center) Service - Linking internet exchanges (KT, SKB, Sejoing Telecom) and Clouds (Amazon, Microsoft) - L1 Lightpath, L2 Carrier Ethernet Service, L3 R&E IP service
KRLight - GLIF Open Lightpath Exchange (GOLE), managed and operated by KISTI - Transcontinental GOLE (GLIF Open Lightpath Exchange) : Asia – North America - Europe - Distributed GOLE: Daejeon/KR, Hong Kong/CN, Seattle/US, Chicago/US, Amsterdam/NL - Integrated with R&E IP network : KREONet2 (AS17579) MAP OF KREONET 2018
KOREA RESEARCH ENVIRONMENT OPEN NETWORK
Seattle
Chicago Gangneung Seoul Incheon
Songdo 100G Suwon 10G 200G United States of America LHCOPN Cheonan 100G Sejong Ochang
IX Internet eXchange – 10G Daejeon
Pohang Amsterdam Daegu Jeonju CERN Ulsan 100G Hong Kong 100G 100G Changwon Busan Europe Gwangju
China
10G KREONET POP - National-wide 100Gbps National Research Network 100G KRLIGHT POP - 18 Domestic GigaPoPs, 4 International GigaPoPs - KREONET Backbone Availability: 99.99%(‘18) - KREONet2/GLORIAD Backbone Availability: 99.53%(‘18)
Jeju - User: about 200 national research institutes, universities etc. (500,000 users) 추이 TeraBytesTraffic KREONET TRAFFIC (2008~2018)
160,000
140,000 136,265
120,000 - GLORIAD 10G->100G (Daejeon-Chicago) - KREONET 100,000 100G (Daejeon-Seoul)
83,478 80,000
70,858
60,000
40,000 35,171 31,265 33,069 31,578 31,282 28,487 29,019
20,000 18,234
- 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 General IP Routed
L3 Routing L3VPN : VRF, .. L2 Ethernet/CE Frame switching L2VPN : IP over Ethernet/CE L1 OTN switching L1VPN : IP over Optic (DWDM, ROADM, + OTN) L0 ƛ switching
Layer Network Service Layering Source. TeleGeography, 2019 Seattle, US Chicago, US L2/L3 @Westin Building @ Northwestern University equipment (col-located PacWave) (Co-located StarLight) (SEA2r)
100GE x 2ea 100GE x 2ea 10GE x 12ea 10GE x 12ea Optical 1GE x 12ea 1GE x 12ea Transport equipment Optical (CHI1) Transport equipment L2/L3 equipment Optical (SEA1) (CHI2r) Transport equipment (HK1) 10Gbps 10Gbps 10Gbps 100Gbps 100Gb 100GE x 2ea ps 10GE x 12ea 10Gbps Optical Optical 1GE x 12ea Transport Transport equipment equipment (DJ1) (DJ2)
10GE x 12ea 100GE x 3ea 100GE x 2ea 10G 1GE x 12ea 10GE x 12ea 10GE x 12ea E x Optical L2/L3 equipment E x 4ea 4e a Transport 10G (HK2r) L2/L3 100GE x2ea L2/L3 equipment equipment equipment (AMS1) L2/L3 equipment (DJ3r) (DJ4r) MX960(AMS2r)
100GE x 3ea 100GE x 2ea Amsterdam, NL Hong Kong, CN 10GE x 12ea 10GE x 12ea @Mega-i Advantage @Interxion Science Park (Co-located Netherlight)
Daejeon, KR @KISTI (KRLight) MAP OF KREONET 2019
KOREA RESEARCH ENVIRONMENT OPEN NETWORK
10G Seattle Chuncheon 20G Chicago 20G Gangneung 100G Seoul Incheon 20G 20G 100G Suwon 300G United States of America
Cheonan G 0
1 100G 20G Ochang N Sejong P 10G O 30G C
40G LH Internet eXchange – up to 10G IX 40G Daejeon
20G 100G Pohang 100G Amsterdam Daegu 30G Jeonju CERN 100G 30G Ulsan Hong Kong 100G Changwon Europe Busan Gwangju China
40G - National-wide 100Gbps National Research Network 10G KREONET POP - 17 Domestic GigaPoPs, 4 International GigaPoPs 100G KRLIGHT POP - 100G upgrade for international network: Seattle, Hong Kong - New GigaPoP in Korea: Chuncheon - User: about 200 national research institutes, universities etc. Jeju (500,000 users) KT Regional PoP KT Optical Transport Node (with Repeater) • Partners : China Unicom and China Netcom (which are consilidated as China Unicom), China Telecom, Verizon Business, Korea Telecom, Chunghwa Telecom, NTT, AT&T • Korea-China-Taiwan-Japan-United States (5 countries) • Cable Length: Total 26,000 Km, 17,784Km (Chican-US) • Cable Capacity : 2.52 Tbps (10Gbps lambda) -> 9.6Tbps (100Gbps lambda, Ciena's GeoMesh 100G submarine solutions) • Ready for Service Date (RFS) : September 30, 2008
Chicago
KREONet2’s 100Gbps international circuit between Daejeon, Korea – Chicago, US Seattle
KREONet2’s 100Gbps international circuit Hillsboro Pusan Maruyama (USA) (Korea) between Daejeon, Korea – Seattle, US Chongming (Japan) (China) Nanhui (China) Toucheng (Taiwan)
• Partners : Chunghwa Telecom, KT Corporation, China Telecom, China Mobile, China Unicom and a US based company • Korea-China-Taiwan-Japan-United States (5 countries) • Cable Length: 14,000 Km • Cable Capacity : 80 Tbps • Ready for Service Date (RFS) : February, 2018
) TPE (100G
APG (100G) [RTT: 34ms]
[RTT: 40ms]
[RTT: 104.51ms]
[RTT: 102.84ms]
[RTT: 102.84ms]
[RTT: 121ms]
[RTT: 53ms]
[RTT: 58ms] KREONet2 10Gbps to Chicago KREONet2 10Gbps to Hong Kong
KREONet2 100Gbps to Chicago KREONet2 10Gbps to Seattle KREONet2 100Gbps to Hong Kong KREONet2 100Gbps to Seattle Seattle (US) [S]10GE*1EA 10GE*1EA [S]10GE*1EA 10GE*1EA 1GE*4EA 10GE*2EA A 10GE*2EA
10GE*1EA 10G 1GE*4EA 10GE*1EA Cisco Nexus *1E E E*1EA 9508 10G 1GE*4EA Alcatel-lucent 7750SR
1GE*4EA 1GE*4EA Juniper MX960 10GE*6EA 10GE*6EA 100GE*2EA
[P] 100GE*1EA 100GE*2EA [LANPYE]10GE*1EA 100GE*2EA Ciena 10GE*6EA ActiveFlex6500 A 1GE*4EA
A EA Ciena E*12E *1 OME6500 GE 10G 100GE*2EA 00 1 Ciena 100GE*3E [P] CE8700 100GE*2E
100GE* A 10G *4EA A *10E A E* 2E 1GE E 2E 12EA A 10G E* 1GE*4EA 100G 10GE*4EA 10GE*10EA [P]10GE*1EA
10GE*1EA 1GE*4EA 100GE*1EA [P] 100GE*1EA
A
*2E 4EA E * E
10G 1G
10GE*2EA [S]10GE*1EA 10GE*1EA 1GE*4EA 1GE*8EA [S]10GE*1EA 10GE* 1EA Amsterdam Hong Kong (China) Daejeon (South Korea) Chicago (US) (Netherland) KRLight Daejeon PoP Daejeon, South Korea (@new Supercomputing Building, KISTI)
KRLight Hong Kong PoP KRLight Seattle PoP KRLight Chicago PoP KRLight Amsterdam PoP Hong Kong, China Seattle, USA Chicago, USA Amsterdam, Netherland (@Megai- Advantage) (collocated with Pacific Wave) (collocated with StarLight) (@Interxion) HKOX CA*net4, Internet2, PNWGP, CENIC UltraLight, ESnet, AARNET, REANNZ Hong Kong 100Gbit/s KAREN, NORDUnet Univ. of Hong Kong Seattle 10Gbit/s Seoul 1Gbit/s GRP
(KREONet2) CANARIE, Internet2, CERNET Seattle, USA ESnet, ASGCnet , CERN, MREN, TWAREN, 100Gbit/s 10Gbit/s 100Gbit/s+ 10Gbps
10Gbit/s Chicago 10Gbit/s 100Gbit/s+ 100Gbps 10Gbps Google (KREONet2) (KREONet2) 100Gbit/s+ Hong Kong, CN Daejeon, KR 10Gbps 10Gbit/s 10Gbit/s*2 100Gbit/s (KREONet2) Chicago, USA 100Gbit/s 100Gbit/s*n (KREONet2) Amsterdam, NL Hong Kong 10Gbit/s
Daejeon 10Gbit/s Hong Kong KIAE 10Gbit/s Russia HKOEP TransPAC, CUHK, APAN-JP, JGN-X, GEANT, NORDUnet, Microsoft, Hong Kong ASNet, NUS … SURFnet Amsterdam KRLight Topology – July, 2019 (Buseung Cho, [email protected])
Peering with KREONet2 GOLE (L2 transit) NetherLight, GEANT, NORDUnet, KIAE Amsterdam, NL
ANA(Internet2, NORDUnet, SURFnet, CANARIE, GEANT) StarLight, ANA-300G, Chicago, US CANARIE, Internet2, ESnet, AMLight CAE-1: NORDUnet/GEANT/TEIN/S GRP ingAREN/AARNet/SURFnet Seattle, US PacificWave, APR, TEIN, HK-IX, CANARIE, HKOK, CSTNET, Daejeon, KR Internet2, ESnet, CERNET CENIC Hong Kong, CN
10Gbps 100Gbps London Amsterdam Seattle Montreal CERN Chicago Paris Daejeon New York (Korea) Washington Tokyo Hong LA Kong Miami Taipei Hawaii
Singapore
Brazil RNP Australia
New Zealand
KREONet2, KOREN, Internet2/SingAREN, TransPAC, SXTransport, SINET, AMLight Exp, AGGCnet, APR(SingAREN/JGN), NEAAR, ANA(Internet2, NORDUnet, SURFnet, CANARIE, GEANT), Esnet, CAE-1, GRP 3. Applications on KREONET/KREONet2 Enabling Science Discovery - New particle, “Higgs” in CERN LHC - Gravitational Wave in LIGO High Energy Physics & Fusion Energy Science - Blackhole Event Horizon in Astronomy Supermassive black hole in the heart of galaxy M87
Bio/Genome Research Astronomy & Climate & Medical Science Changes
Advanced Scientific Education & e-Culture Computing Research
Future Internet & Construction Europe
▷ (Swiss) CERN LHC ▷ (France) ITER Grid ▷ JIVE: European VLBI Network ▷ (Norway) Satellie Data Receiver (MoU) SURFnet ▷ (UK) SKA (Square Kilometre
Private network connecting Tier0 and Tier1s - 20 R&E networks - 14 Tier1s and ~70 Tier2s in 5 continents
- ~250 perfSONAR instances Asia North America - 6 collaborations
South America
Europe
§ e-KVN: Korean e-VLBI(electronic Very Long Baseline Interferometry) Network
=> Toward Real-time e-VLBI observation with real-time correlation among observatories
Korea-Japan Correlation Center (KJCC) @Daejeon
100G @East Asia @Europe Yonsei Astronomy Observatory 40G (+1G) @Seoul Daejeon 100G
KREONet2
Seoul
10G(+1G) Jeju 10G(+1G) Ulsan Sejong 10G @Australia
Tamna Astronomy Observatory @ Jeju Ulsan Astronomy Observatory @Ulsan
VLBI antenna @ Sejong Space Geodetic Observation Center KREONET Sejong Center
KREONET Daejeon Center 10 MHz, 1PPS
D001(NG72) 24km/63,64
5Km H maser KREONET 8.6Km Daejeon PoP Dunsan Eojin R1 KREONET Sejong PoP (KISTI) Bidirectional Single-core fiber KRISS SGOC Bukdaejeon Kumnam R1 5.9Km 8Km Sintanjin Bugang R2 Atomic clock 0002(NG72) 0001(NG72) 13km/53,54 0001(NG72) 16km/63,64 H maser 15km/13,14 1st phase (‘16) 10Gbps
Satellite Data 2nd phase (’17~’18)
10Gbps
Genome Data To bring together experts from industry and academia, in a bid to test their software across servers located in various countries (Australia, Japan, Singapore, Korea, USA) that are connected by 100G international networks.
• Showcase challengers by having them compete in deploying the best software tools on Data Transfer Nodes (DTNs) that are set up within current international Research and Education Networks (RENs) across the globe. • To bring together a community of experts in DTN deployments and operations To bring together experts from industry and academia, in a bid to test their software across servers located in various countries (Australia, Japan, Singapore, Korea, USA) that are connected by 100G international networks.
• Showcase challengers by having them compete in deploying the best software tools on Data Transfer Nodes (DTNs) that are set up within current international Research and Education Networks (RENs) across the globe. • To bring together a community of experts in DTN deployments and operations • “Global Petascale to Exascale Science Workflows Accelerated by Next Generation SDN Architectures and Applications” led by Harvey Newman • KISTI Focus on real LSST data from Chile to real user of Korea via US KASI (Korea Astronomy and Space Science Institute), one of the international contributors on behalf of the LSST Korea with 100G DTN at KASI and KISTI in Daejeon (Working on a scenario)
KASI/ KISTI 100Gbps @Daejeon 100Gbps SC18@ Dallas
60Gbps
LLST Base Site @La Serena KASI/ KISTI 100Gbps @Daejeon 100Gbps SC18@ Dallas
60Gbps
LLST Base Site @La Serena KASI/KISTI(Korea) – FIU(US) KASI/KISTI(Korea) – LSST Base Site (Chile)
…, During the course of the LSST and AmLight SC18 demonstrations, Dark Energy Camera (DECam) public data from the AURA site in Chile arrived via AmLight at both the KISTI and Caltech booths in Dallas, where it was mirrored and carried across SCinet, Starlight, KRLight and KREONet2 to DTNs at KISTI and KASI in Korea, as shown in the figure below. Using Caltech's Fast Data Transfer (FDT) application, throughputs of 58 Gbps were achieved across the 60 Gbps path from the telescope site to the KISTI booth, and a remarkable 99.7 Gbps on the 100 Gbps path between Dallas and Daejeon.…
Press release: http://supercomputing.caltech.edu/index.html KRLight facilities was located at 1st floor, KISTI’s Main Building 30 years old room
KRLight facilites was moved to 2st floor at KISTI’s new Supercomputing Center Building KRLight facilities was located at 1st floor, KISTI’s Main Building 30 years old room
KRLight facilites was moved to 2st floor at KISTI’s new Supercomputing Center Building • Data Intensive Science, Big Data era. • 100Gbps Global R&E Network • KREONET/KREONet2 Optical System Upgraded • New optical system deployed • New 100Gbps international circuit btw. Daejeon and Seattle enabled using new submarine cable system, NCP • end-to-end 100Gbps network • Application on KREONET/KREONet2 • LHCOPN, LHCONE • East-Asian VLBI Network, World-wide Geodetic VLBI network, e-KVN • Time Synchronization on Ultra-stable Frequency Reference Transfer • QKD Network, Data Mover Challenge in SCA19 & SCA20, SC18 • Global Research Network & Collaboration • High Performance Global Research Networking • Global Science Gateway for Data Intensive Science [email protected]