DevOps and Software Defined Networking (SDNs) and Software Defined Exchanges (SDXs) Joe Mambretti, Director, ([email protected]) International Center for Advanced Internet Research (www.icair.org) Northwestern University Director, Metropolitan Research and Education Network (www.mren.org) Director, StarLight, PI StarLight IRNC SDX,Co-PI Chameleon, PI-iGENI, PI- OMNINet (www.startap.net/starlight) MAGIC Meeting Washington DC October 3, 2018 Introduction to iCAIR: Accelerating Leading Edge Innovation and Enhanced Global Communications through Advanced Internet Technologies, in Partnership with the Global Community • Creation and Early Implementation of Advanced Networking Technologies - The Next Generation Internet All Optical Networks, Terascale Networks, Networks for Petascale and Exascale Science • Advanced Applications, Middleware, Large-Scale Infrastructure, NG Optical Networks and Testbeds, Public Policy Studies and Forums Related to Optical Fiber and Next Generation Networks • Three Major Areas of Activity: a) Basic Research b) Design and Implementation of Prototypes and Research Testbeds, c) Operations of Specialized Communication Facilities (e.g., StarLight, Specialized Science Networks/Science Research Platforms) StarLight – “By Researchers For Researchers” StarLight is an experimental optical infrastructure and proving ground for network services optimized for high-performance applications Multiple 10GE+100 Gbps StarWave Multiple 10GEs Over Optics – World’s “Largest” 10G/100G Exchange First of a Kind Enabling Interoperability Abbott Hall, Northwestern University’s At L1, L2, L3 View from StarLight Chicago Campus Global Research Platform: Based On The Global Lambda Integrated Facility Visualization courtesy of Bob Patterson, NCSA; data compilation by Maxine Brown, UIC. www.glif.is IRNC: RXP: StarLight SDX A Software Defined Networking Exchange for Global Science Research and Education Joe Mambretti, Director, ([email protected]) International Center for Advanced Internet Research (www.icair.org) Northwestern University Director, Metropolitan Research and Education Network (www.mren.org) Co-Director, StarLight (www.startap.net/starlight) PI IRNC: RXP: StarLight SDX Co-PI Tom DeFanti, Research Scientist, ([email protected]) California Institute for Telecommunications and Information Technology (Calit2), University of California, San Diego Co-Director, StarLight Co-PI Maxine Brown, Director, ([email protected]) Electronic Visualization Laboratory, University of Illinois at Chicago Co-Director, StarLight Co-PI Jim Chen, Associate Director, International Center for Advanced Internet Research, Northwestern University National Science Foundation International Research Network Connections Program ;-- ------, I .A.rH~r&- 1 : : - -Research- - - _ N_E_AA_ -R- - : [-Ge~;()~~-: l (Chicago) I On Demand ---F~.:'.C~P-N: (::;:::) (NowYo<k) •i•--•9-1! GE~ !14•....-------,! -------- : I (Ottawa) (London) I I r !CT Testbed Researdl and l (Chicago) 1 _ J ~ ~o~e_!:) _ _ _ __ _ _ ___ (London) _ _ _ _ __ I OevelopmentPromot.lon Cente, I [[email protected]§J: AC .:• ] I 1 1 1 1 I ~ 1 I ••~- JGN I I • I SINET : ~ Cl ~ : 1 : 1=--~ ~---_...,_ ,~----------,~----2_x_1_o_o_G_~,-~,~--,--i ~ ! I I 1 (Japan) 1 (Japan) : (Tokyo) : I I I ,~ I 1 (Los Angeles) 1 (Los Angeles) I (Seattle) I I I 40G I I - - - - - - - - - y- 'f. -------- I l 1I (G eneva ) 1I 10G :Mon~ Open :1i~G (- --- 11 111___ : I~ Light :1 • 1 :1• ~ '+----+' man Lan . •--+•: NX100G I - I canane I 1 I I I (New York) I I (Canada) I '- -- ---- - (Amsterdan) I 1I :I (Chicago) [- l~t; r~a~i~n~I-] l_ j ~ ~ ag~ __ I [I .uCERN ET I 10G ,- --- -1 - ------ I SON Networks I I I I I lfJ I14•....----)1,9-1 1~ 1 & Testbeds 1.,_ 1 1 : (China) : PACIFIC WAVE I.... 1- 2x_1_o_O_G__ .....1J'------'T'---' I I 1 (Los Angeles) 1 (Chicago) I (Chicago) I I I (Seattle) 1 NX100G I i ________ , I M 1 (L(Sos Angeles)) ~ - __ ~~1 ~~G- 3~~0_9 ~ _ ~~100G 1 - - - - 1 1,..,.... T\.ANOCCROSSAOM>S r l 1 1 1 I unnyva e 1 1 \ 1 p r 1 1 1 S~n gA,REN : '----+---- S T~f,: R L I GHT ... :2x 1ooG : 1NT NET® 1:••--• MAX/WIX : NORDUnet I , I .. I The Opt ical STAR TAP - I• • J I ~- _ J~~}___ I I I r--------,~ SOX Switches 1 1 ~--------... I : (Singapore) I I I (Chicago) I I (Chicago) I 2x1 0G (Nordic) 1 (Los Angeles) I GRPNet I '-- - -- - - - - - - -- _J 1--------1 (Chicago) I I I 1 t.... _.._ ____ _ -------- I r I : (Chicago) : I I (Seattle) I .-------' I I I 2x10G 10G 10 1 ( Honolulu) ___ J__ __ l I l f l f l J (Mauna) ] [ Southern Light ] I r/.iii I ----i--- RE AN N Z : :@ :!~~~: : OpenTransits : AtlanticWave 1 1 1 I : KRt.e_)JET : 1 Network 1 • : CSTNET : (Miami) ~ : ,---- ---, I I I I I RN p: I I I (Atlanta) I I I (New Zealand) 1 (Taiwan) (Taiwan) : (S. Korea) : : (China) : 1 (France) 1 (D.C.) I 1 (Brazil) I :O aarnet: (Auckland) I (Chicago) (Chicago) I (Chicago) I 1 (Chicago) 1 1 (Chicago) 1 _ J_N~~y~~)__ I l_ i_S~o!~u~l_ _r I I ___ t ___ _ 1 ( Australia) J I (Seattle) 1• r------------------------------------, ANA300 • ---• I Overlay Network [ I (Los Angeles) I 1 Federal Agency Networks, Regional Network 1 I I 1 State Wide Networks, University Neworks, Testbed Networks 1 I~------------------------------------ (Chicago) I Emerging US SDX Interoperable Fabric IRNC SDX GENI SDX IRNC SDX IRNC SDX UoM SDX GENI IRNC SDX SDX IRNC SDX LHCONE: A global infrastructure for the High Energy Physics (LHC and Belle II) data management ; I..,_..,.,,..\. CANARIE Canada g •' CERNetZ/ \ f ,1 CSTNet ! TRIUMF-Tt C', , China _, ---\-- >NET ~ '- IHEP-CMS -- _., .,,,,., ~ ' IHEP -ATLAS r I .I- '"' -........ , N Wn ., ........ ( nm. ' f.J_P roposed}} "-w.1-' CERN ~~ UWisc PurU Vanderbilt PIC-T1 l!!.!Y UFlorida Catania CNAF-Tl Frascati Legnaro INFN INFN Mi lano Pisa Napoli .,~~\ Roma1 ,. .. CUDI ".., Torino Mexico \ l __ ,_.,,.---.. -- ' ,,, 5 Ap ril 2015 - WEJohnston, ESnet, [email protected] \ 1 ...__UNAM ..,_,r - ~ t I_ _ _ RNP __ , .,. , " jH EPGridl Brazil pAMP~ ~ I LPHIIE 1 Distributed site C) LHCONE VRF domain/aggresrator UChi LHC Tier l/2/3 ALTAS and CMS } yellow ouWne <, L(UER!l I -- 1l U~ J., .;' indicates Qtflal"llli .. OARR i_'.=~_: _J Belle II Tier 1/2 Pending LHCONE 9 Network provider / e)(change point router LHCtBelle II - ~' ... - -- - , ., connection ~ p~ Cross-border router ""N LHC ALICE or LHCb site .,., _ Sites connected ~ at 40G-100G Regional R&E communication nexus ~ Sites that are standalone VRFs, • w/ switch providing VLAN connections _.,._ Also see ht1p://lhcone.ne1 for details 0 Broadcast VlAN 0 '"' ~ Communication links: 1/10. 20/30/40. and 100Gb/s Peta Trans : Petascale Sciences Data Transfer Siingapore Sydney/Bri sbane Daejeon CIERN ~- --------, / --------- / - ---·----·- , / - ' { ( \ t \ ( 1 I DTN I ___,. I___,.. I I : I I I I ,.__.,.,....... T.. I I @100G I I I I I I I I I I I I j I I -..Vi~ NC.. 1(!)•·- ', ~ I : : I I I '!(·,,Si' ·. ' . ·. ,, ., 1~, 11 1 " ... , '· . L-- ~ . J '--------- - , ____ ---- ✓ ' ------ · --- - -✓ SeaUle/L.A JSun nyVille .,,,, ---------, f I I I I ......_, __,____ ,____ _ ,. I I I I Warsaw 1, PRP Siites I ,, - --·-------, ----- · --- ✓ \ I I -·--------- I ~'11":'1 I / \ I ---- I l~~ I I I ~-t II J --------- ✓ Am1sterdam I / -- ...,, I t \ I J I I I I I I ·• I I I I Chicago 1 _ I I cuzna J I , ~ . I ' ---------- I C -,-..-., ~ \ ..._ __ .5 _____~ _) Denver Ottawa , _ _ .,;;_T_' _"-!!.. __ ✓ Washington D.C. Persistence 1OOG IDTNI Services Bevond SC17 Montreal Emerging Topics In Advanced Networking • Transition From Legacy Networks To Networks That Take Full Advantage of IT Architecture and Technology • Extremely Large Capacity (Multi-Tbps Streams) • Specialized Network Services, Architecture and Technologies for Data Intensive Science • High Degrees of Communication Services Customization • Highly Programmable Networks • Network Facilities As Enabling Platforms for Any Type of Service • Network Virtualization • Tenet Networks • Network Virtualization • Network Programming Languages (e.g., P4) API (e.g., Jupyter) • Disaggregation • Orchestrators • Highly Distributed Signaling Processes • Network Operations Automation (Including Through AI/Machine Learning) • SDN/SDX/SDI/OCX/SDC/SDE ~ ~ CHAMELEO A LARG SCALE RE . ONFIGU · BLE EX~E ·1ME TA INST U _ENT FOR O _p TER SCI ENCE K te Keah y Joe Ma mb ett , ·i erre Rltea , Pa u R th, Da · Sta Zli10 ne I_) T ·CC ursA your 201 logo ~- - -~ ~ ? \ ~ r G n mi I I u ivi I I I I 1I ..-, i L3 Euro · (T iiw . n~ date track 15 A Disagg111e_gatedl SCinet Op1tical Layrer IReconfigura · on o;p.tions A. Booth to boolli 1oonneotions B. Booth to WAN conneotiollS C. Booth to switch or muteir 1oonneotio:llS D. WAN to S'll\l1h::h Olr rower COfllllleciiOfllS DWDM IE:xam;p'.les A. B-B Transi anders a. Boo1h UUI 1-1 to 11[1[12 - 1 via optical laye ir b. 1Boo1h 11[l[l l -1 to 11[1[14 -3 via OLS5 optical la ),11 e-ir (asSl!lm es OLS2 to Op1tical Vendor C OLS4 path) B. Booth to WAN LiniH a. 1Boo1h 11[l[l l -2 to PoP1-1 via Systems ? OLS6 OLS2-2 and OLS1-1--- b. Boo1h 1[1[11-2 to PoP2-B1 ·via OLS2-2 , OlS4., OLS6 and OLS5-11 C. Booth to switcWrooter DWDM a. 1Boo1h 1[1[11-3 to S 1-A 1- Tirans, onde111's b. 1Boo1h 11[1[13-1 to RTR·1[-A5 (asSl!lme-s OlS4 to, OLS6 p.alli) D. WAN to s'll\l1tchlrouter a. PoP2-A.1 (WAN2) to SW1 -3 via OLSJ-11and OLS4-3 - b. IPoP2-A2 (WAN2) to RlR11-3 ·via OLSJ-2 and OLS4-7 Nlo'lies DWD 1 : 1) TroHponders· could be. from mult1iple veru::fors [but for near term the Ii ll'il.lics would DD Med to be bui It wirilih 1i101tch i~ tmnspo:m:1.ers:.