Devops and Software Defined Networking (Sdns) and Software Defined Exchanges (Sdxs)

DevOps and Software Defined Networking (SDNs) and Software Defined Exchanges (SDXs)

Joe Mambretti, Director, ([email protected]) International Center for Advanced Internet Research (www.icair.org) Northwestern University Director, Metropolitan Research and Education Network (www.mren.org) Director, StarLight, PI StarLight IRNC SDX,Co-PI Chameleon, PI-iGENI, PI- OMNINet (www.startap.net/starlight)

MAGIC Meeting Washington DC October 3, 2018 Introduction to iCAIR:

Accelerating Leading Edge Innovation and Enhanced Global Communications through Advanced Internet Technologies, in Partnership with the Global Community

• Creation and Early Implementation of Advanced Networking Technologies - The Next Generation Internet All Optical Networks, Terascale Networks, Networks for Petascale and Exascale Science • Advanced Applications, Middleware, Large-Scale Infrastructure, NG Optical Networks and Testbeds, Public Policy Studies and Forums Related to Optical Fiber and Next Generation Networks • Three Major Areas of Activity: a) Basic Research b) Design and Implementation of Prototypes and Research Testbeds, c) Operations of Specialized Communication Facilities (e.g., StarLight, Specialized Science Networks/Science Research Platforms)

StarLight – “By Researchers For Researchers”

StarLight is an experimental optical infrastructure and proving ground for network services optimized for high-performance applications Multiple 10GE+100 Gbps StarWave Multiple 10GEs Over Optics – World’s “Largest” 10G/100G Exchange First of a Kind Enabling Interoperability Abbott Hall, Northwestern University’s At L1, L2, L3 View from StarLight Chicago Campus Global Research Platform: Based On The Global Lambda Integrated Facility

Visualization courtesy of Bob Patterson, NCSA; data compilation by Maxine Brown, UIC. www.glif.is IRNC: RXP: StarLight SDX A Software Defined Networking Exchange for Global Science Research and Education Joe Mambretti, Director, ([email protected]) International Center for Advanced Internet Research (www.icair.org) Northwestern University Director, Metropolitan Research and Education Network (www.mren.org) Co-Director, StarLight (www.startap.net/starlight) PI IRNC: RXP: StarLight SDX Co-PI Tom DeFanti, Research Scientist, ([email protected]) California Institute for Telecommunications and Information Technology (Calit2), University of California, San Diego Co-Director, StarLight Co-PI Maxine Brown, Director, ([email protected]) Electronic Visualization Laboratory, University of Illinois at Chicago Co-Director, StarLight Co-PI Jim Chen, Associate Director, International Center for Advanced Internet Research, Northwestern University

National Science Foundation International Research Network Connections Program ;------,

I .A.rH~r&- 1 : : - -Research- - - _ N_E_AA_ -R- - : [-Ge~;()~~-: l (Chicago) I On Demand

---F~.:'.C~P-N: (::;:::) (NowYo

I ~ 1 I ••~- JGN I I • I SINET : ~ Cl ~ : 1 : 1=--~ ~---_...,_ ,~------,~----2_x_1_o_o_G_~,-~,~--,--i ~ ! I I 1 (Japan) 1 (Japan) : (Tokyo) : I I I ,~ I 1 (Los Angeles) 1 (Los Angeles) I (Seattle) I I I 40G I I ------y- 'f. ------I l 1I (G eneva ) 1I

10G :Mon~ Open :1i~G (- --- 11 111___ : I~ Light :1 • 1 :1• ~ '+----+' man Lan . •--+•: NX100G I - I canane I 1 I I I (New York) I I (Canada) I '------(Amsterdan) I 1I :I (Chicago) [- l~t; r~a~i~n~I-] l_ j ~ ~ ag~ __ I [I .uCERN ET I 10G ,- --- -1 ------I SON Networks I I I I I lfJ I14•....----)1,9-1 1~ 1 & Testbeds 1.,_ 1 1 : (China) : PACIFIC WAVE I.... 1- 2x_1_o_O_G__ .....1J'------'T'---' I I 1 (Los Angeles) 1 (Chicago) I (Chicago) I I I (Seattle) 1 NX100G I i ______, I M 1 (L(Sos Angeles)) ~ - __ ~~1 ~~G- 3~~0_9 ~ _ ~~100G 1 - - - - 1 1,..,.... T\.ANOCCROSSAOM>S r l 1 1 1 I unnyva e 1 1 \ 1 p r 1 1 1 S~n gA,REN : '----+---- S T~f,: R L I GHT ... :2x 1ooG : 1NT NET® 1:••--• MAX/WIX : NORDUnet I , I .. I The Opt ical STAR TAP - I• • J I ~- _ J~~}___ I I I r------,~ SOX Switches 1 1 ~------... I : (Singapore) I I I (Chicago) I I (Chicago) I 2x1 0G (Nordic) 1 (Los Angeles) I GRPNet I '------_J 1------1 (Chicago) I I I 1 t.... _..______------I r I : (Chicago) : I I (Seattle) I .------' I I I 2x10G 10G 10 1 ( Honolulu) ___ J__ __ l I l f l f l J (Mauna) ] [ Southern Light ] I r/.iii I ----i--- RE AN N Z : :@ :!~~~: : OpenTransits : AtlanticWave 1 1 1 I : KRt.e_)JET : 1 Network 1 • : CSTNET : (Miami) ~ : ,------, I I I I I RN p: I I I (Atlanta) I I I (New Zealand) 1 (Taiwan) (Taiwan) : (S. Korea) : : (China) : 1 (France) 1 (D.C.) I 1 (Brazil) I :O aarnet: (Auckland) I (Chicago) (Chicago) I (Chicago) I 1 (Chicago) 1 1 (Chicago) 1 _ J_N~~y~~)__ I l_ i_S~o!~u~l_ _r I I ___ t ___ _ 1 ( Australia) J I (Seattle) 1• r------, ANA300 • ---• I Overlay Network [ I (Los Angeles) I 1 Federal Agency Networks, Regional Network 1 I I 1 State Wide Networks, University Neworks, Testbed Networks 1 I~------(Chicago) I Emerging US SDX Interoperable Fabric

IRNC SDX GENI SDX IRNC SDX

IRNC SDX UoM SDX GENI IRNC SDX SDX IRNC SDX LHCONE: A global infrastructure for the High Energy Physics (LHC and Belle II) data management

; I..,_..,.,,..\. CANARIE Canada g •' CERNetZ/ \ f ,1 CSTNet ! TRIUMF-Tt C', , China _, ---\-- >NET ~ '- IHEP-CMS -- _., .,,,,., ~ ' IHEP -ATLAS r I .I- '"' -...... , N Wn

., ...... ( nm. ' f.J_P roposed}} "-w.1-'

CERN ~~

UWisc PurU

Vanderbilt PIC-T1 l!!.!Y UFlorida Catania CNAF-Tl Frascati Legnaro INFN INFN Mi lano Pisa Napoli .,~~\ Roma1 ,. .. CUDI ".., Torino l Mexico \ __ ,_.,,.---.. -- ' ,,, 5 Ap ril 2015 - WEJohnston, ESnet, [email protected] \ 1 ...__UNAM ..,_,r - ~ t I_ _ _ RNP __ , .,. , " jH EPGridl Brazil pAMP~ ~ I LPHIIE 1 Distributed site C) LHCONE VRF domain/aggresrator UChi LHC Tier l/2/3 ALTAS and CMS } yellow ouWne <, L(UER!l I -- 1l U~ J., .;' indicates Qtflal"llli .. OARR i_'.=~_: _J Belle II Tier 1/2 Pending LHCONE 9 Network provider / e)(change point router LHCtBelle II - ~' ... - -- - , ., connection ~ p~ Cross-border router ""N LHC ALICE or LHCb site .,., _ Sites connected ~ at 40G-100G Regional R&E communication nexus ~ Sites that are standalone VRFs, • w/ switch providing VLAN connections _.,._ Also see ht1p://lhcone.ne1 for details 0 Broadcast VlAN 0 '"' ~ Communication links: 1/10. 20/30/40. and 100Gb/s Peta Trans : Petascale Sciences Data Transfer Siingapore Sydney/Bri sbane Daejeon CIERN ~------, / ------/ - ---·----·- , / - ' { ( \ t \ ( 1 I DTN I ___,. I___,.. I I : I I I I ,.__.,.,...... T.. I I @100G I I I I I I I I I I I I j I I -..Vi~ NC.. 1(!)•·- ', ~ I : : I I I '!(·,,Si' ·. . . ' . ·. . . ,, ., 1~, 11 1 " ... , '· . . L-- ~ . J '------, ____ ---- ✓ ' ------· --- - -✓ SeaUle/L.A JSun nyVille .,,,, ------, f I I I I ...... _, __,____ ,____ _ ,. I I I I Warsaw 1, PRP Siites I ,, - --·------, ----- · --- ✓ \ I I -·------I ~'11":'1 I / \ I ---- I l~~ I I I ~-t II J ------✓ Am1sterdam I / -- ...,, I t \ I J I I I I I I ·• I I I I Chicago 1 _ I I cuzna J I , ~ . I ' ------I C -,-..-., ~ \ ..._ __ .5 _____~ _) Denver Ottawa , _ _ .,;;_T_' _"-!!.. __ ✓ Washington D.C. Persistence 1OOG IDTNI Services Bevond SC17 Montreal Emerging Topics In Advanced Networking

• Transition From Legacy Networks To Networks That Take Full Advantage of IT Architecture and Technology • Extremely Large Capacity (Multi-Tbps Streams) • Specialized Network Services, Architecture and Technologies for Data Intensive Science • High Degrees of Communication Services Customization • Highly Programmable Networks • Network Facilities As Enabling Platforms for Any Type of Service • Network Virtualization • Tenet Networks • Network Virtualization • Network Programming Languages (e.g., P4) API (e.g., Jupyter) • Disaggregation • Orchestrators • Highly Distributed Signaling Processes • Network Operations Automation (Including Through AI/Machine Learning) • SDN/SDX/SDI/OCX/SDC/SDE

~ ~ CHAMELEO A LARG SCALE RE . ONFIGU · BLE EX~E ·1ME TA INST U _ENT FOR O _p TER SCI ENCE

K te Keah y

Joe Ma mb ett , ·i erre Rltea , Pa u R th, Da · Sta Zli10 ne

I_) T ·CC ursA your 201 logo

~- - -~ ~ ? \ ~ r G n mi I I u ivi I I I I 1I ..-, i

L3 Euro

· (T iiw . n~

date track 15 A Disagg111e_gatedl SCinet Op1tical Layrer IReconfigura · on o;p.tions A. Booth to boolli 1oonneotions B. Booth to WAN conneotiollS C. Booth to switch or muteir 1oonneotio:llS D. WAN to S'll\l1h::h Olr rower COfllllleciiOfllS

DWDM IE:xam;p'.les A. B-B Transi anders a. Boo1h UUI 1-1 to 11[1[12 - 1 via optical laye ir b. 1Boo1h 11[l[l l -1 to 11[1[14 -3 via OLS5 optical la ),11 e-ir (asSl!lm es OLS2 to Op1tical Vendor C OLS4 path) B. Booth to WAN LiniH a. 1Boo1h 11[l[l l -2 to PoP1-1 via Systems ? OLS6 OLS2-2 and OLS1-1--- b. Boo1h 1[1[11-2 to PoP2-B1 ·via OLS2-2 , OlS4., OLS6 and OLS5-11 C. Booth to switcWrooter DWDM a. 1Boo1h 1[1[11-3 to S 1-A 1- Tirans, onde111's b. 1Boo1h 11[1[13-1 to RTR·1[-A5 (asSl!lme-s OlS4 to, OLS6 p.alli) D. WAN to s'll\l1tchlrouter a. PoP2-A.1 (WAN2) to SW1 -3 via OLSJ-11and OLS4-3 - b. IPoP2-A2 (WAN2) to RlR11-3 ·via OLSJ-2 and OLS4-7

Nlo'lies DWD 1 : 1) TroHponders· could be. from mult1iple veru::fors [but for near term the Ii ll'il.lics would DD Med to be bui It wirilih 1i101tch i~ tmnspo:m:1.ers:. ti} .c 2) Corrtrotllers and Ol"'CMS"hr'ation s,s,tems, 15 arc not shown lb1!!11t ,oll Tp111dr/ 'OLS Q 1• D1 1nl2 1• 00 1D04 1 JS Ill 5Ystems must be ,conlil.ected . ST RLIGHT SM Starlight SOX Geoscience Research Workflow

lnptJt para mete1r 1.Date 2. Tim e(00/06/12/18) 1--oo,;10 li t :•'

n.etCDF png Convert mp4 Sele· t Data Transfer ... .. Display to video Data To Other DTN ..~ -- -

- ANA.300

1,ooobps 10Gbps. ESA Service Prototype

·~ ST RLIGHT SM Source Corby Schmidt ~ 9;18 TA TESTBED Oatla!i,lhpc ifX r!$J)l!e$.

~ '\ l>.I\IJ\al{lS\~ \

Still Largely Refl ects SC 17 Conflg in SL booth.!! tin~ r1 .com/SC 18,-JBD T SCinet L1I SCine~ 11 To request changes, please SCinet L1I leave a co ment

See also ~

Oiena 8180

••• I

Arista 400G SW

1000-l.1!14

1000-BR4

- 1000-DAC -- olOO --!IW .z . I ~ ,Cl -- 100

-.. 1&

09/02/20 8 starligh Boo h 2851 Demonstrations, of 4,00 Gbps D skMto lsk SC 7 WA lie 17ransfers us, ng IWAR and VMe Drives, An SCl 7 Col lalborative In iti.a tive A1mong1 NASA and Severa I Pa rtlne rs

( Sta1rUg ht/M REN ...-- SC17 @ • e:nver, co C2 -C30 SCl1net NOC 13ootti # 061 C 4 -CU

X200NVME 24-NVME DISKS. \.....______NA:S..A. demo ·S.tarlLi gh lr.l OCCJiCAIR Exlh I B0(ltt) #11653 SC inet 2 4 -NVME DISKS X'.1 4 DCI HEN x• I X400NVME

BROCADE LX-9240 WASH-CR.5 !.egend

lrOO-GE

Cl4•Cl.6 NA AJ~ FC-ow ned ( A'&D Pa,rtners ) :K3

-.... ( L@V•@B/ I ESnet ( N 5 A/G SF C 24-NVM E DISKS - ::-,,1 ST~ .R LIGHT · .A A MeUa ·ox Gree nbe It HECN .~ r r:-r.t-1 1r.1n1 nn 1F"R MD ' X200NVME ~ ~ CenturyL. ink- 11,:ii\~liiao SAJA.C~~Lef ~ ~ · ·. · :;:;.:? tr, E ~~ ~ "r,,gii;; Sl;it1,r:1;11-c; DELL 2 100 S:inet ARISTA • 1:!{1f11il» X2 X2 MAX Ec kingt,on · l' NASAIGSFC Hlr;i h Bnd Co put er Netwo I r;i (HECN I Te Dla . am b~ B" Fin I Paul La g - B/1412017 !Dynam ic Distributed ID1 ata Proce,ssing Chicago 1L Naval R,es,earcti Laboratory Software De fined Center for Comp tat im11a l Scienoe .Ad d'I Exchange SCl7 Demonstration Data Pipelines

INR L will d,emonstrat e: "' Dynamic diistribut,ed process 1i ng of large !.l'ol:uimes of data "' Across. geogrn:phirolly U.S.NAVAL dispersed HPC andi ne ork - ESEARc ~- reso 'U roes ORA OR "'Ab! e, to rapidly·change resources to mee a ppl'ication dema ndis. RL

"' Software Defined 1etworlcii n.g (SID 1) P'rocessi ng & Da1talr,an.sfeir "' Pii p61in ed 2 Gbps, reall-time, 11j deo pmcess:i n.g workflows P ooes1i g1 coexi1st ii n.g wi a h bul · da oodemancl transf,ers between proc,essi 111,g nodes.

"' 3,- mo1 Gb ps ,connections, DC to-SC 7 fl o m p!uiS 00 Gb P5 co nnectio ns to Chicag:o and 12 G'bps- NRL, Waslm1gton, DC Oakla nd! 4Kx60fps elective Dat a Disp lay Processing & & User Interaction "lnten::mmecteri am:J interlocking problems:" Dat a1Tr,amfer call for a high periormance dynamic D,eirve·l', c,o, Booth 165,3, distributed data Gentric infiastructuire vFerm1lab

~OAKRIDGE ~National Laboratory

~l ~ KISTi C l'fWl'I , li.e.

fN ' .

~ ST RLIGHT SM 1 Transferring Lar 1ge,Scale Airline Data E2E A1cr 10.ss WANs Using DTN.s •' , :21 E 20

~ I 'IL.,l)j~_,;!

-'I I_~ , till_, •=, ,._ ,, -EM !;, It : /oil rnll 'i,11,-. b .. DTN ~ IJ'.IA ~T'S MX j: ID.200.a!t 11

VIA~20J!I 1'1.Ml 2ro8 'A/IN~ '111\.N-t 21}3.!. ,~_ DTN06r.l1U ii. 1/0XY IQ ir.l;r -HJ 10.!i:02l!. 07 'ANl2:ro!

\II.AN :!l:>311 I I D"IN&'l.nll,5 -tl K ,Tl 10",. J81

AdlM,1u1l ,urn li i;..gn,o, - eur111 n!I:, ll'wll Ail»-dil«!!ln !In.• n INMlli' ae~ · ""'0G~ 111111 !:rmfl..- • E11.p n;i "11 tu • QI.F n1 &: t i or

~ ST RLIGHT ""' GENI – iCAIR P4 Testbed – Integrated With GENI StarLight SDX

• In Partnership With The GENI Initiative, iCAIR Is Developing a P4 Testbed for Computer Science Research. • The Testbed Will Be Integrated With the GENI SDX At StarLight • P4 (Programming Protocol-Independent Packet Processors). • An Emerging Networking Programming Language, • A Domain Specific Language for Network Protocols. • Highly Flexible In Contrast To OpenFlow • Testbed Based on Tofino (Barefoot Networks) Switches • Compiler (V16) Enables Rules To Be Dynamically Implemented In Chip Other Notable iCAIR Suported Testbeds

• International AI Testbed (Currently Being Designed) • International DTN Testbed • LHC P2P Service • High Performance Digital Media Network (HPDMnet) • Geophysical Sciences Testbed • Content Routing Network • AutoGOLE • MEICAN/Network Service Interface (NSI) • AmoebaNet • Cisco Information Centric Networking Testbed (ICN) • SD-WAN Testbed • ToMaTo • Et Al 1111 • • a ~ 1. • • • • •I • • • I

jl• •' •~ • I••! ' "~ •• •

Bu Id ng the Open Storage Netvvork

Alex Szalay The Johns Hoplkins University

nslllute or Data lnlerslve Englnee Ing and Science idit2::1 www.startap.net/starlight

Thanks to the NSF, DOE, DARPA, NIH, USGS, NASA, Universities, National Labs, International Partners, and Other Supporters

"Any opinions, findings, conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the Networking and Information Technology Research and Development Program."

The Networking and Information Technology Research and Development (NITRD) Program

Mailing Address: NCO/NITRD, 2415 Eisenhower Avenue, Alexandria, VA 22314

Physical Address: 490 L'Enfant Plaza SW, Suite 8001, Washington, DC 20024, USA Tel: 202-459-9674, Fax: 202-459-9673, Email: [email protected], Website: https://www.nitrd.gov