PIONIER Organizational model of e-infrastructure for research and new services development

Robert Pękal [email protected]

. 20th years of Polish e-Infrastructure for Science • 1993 – starting academic MANs based on own fibers (FDDI) • 1995 – MANs’ transition to ATM • 1997 – POL-34, 155, 622 • 1999 – joining to TEN-155 (precursor of GÉANT) network • 2000 – PIONIER take-of • 2001 – dark fiber deployment & 1st EU funded project: ATRIUM • 2003 – 10GE • 2004 – multi-lambda • 2006 – PIONIER2 strategy • 2008 – PLATON project • 2009 – NEWMAN project • 2011 – 100NET project • 2013 – CBPIO project

Polish e-Infrastructure

• 21 Academic Optical Based MAN (Metropolitean Area Network) • 5 HPC (High Performance Computing) Centers • Connected with owned fiber infrastructure – PIONIER network (Polish Optical ) • Science Services Platform - PLATON • Digital Libraries Federation • National Data Storage

European & Polish Models of e-Infrastructure

European Model Polish Model Responsible Intitutions MAN activity

• Local dark fibre investment and ownership • Delivering IP based & VPN services • Cost sharing (recovery) model for academic community • Testbeds in new technologies • Taking part in Regional Development Plan setup • R&D regional IT infrastructure development coordination

Every academic MAN:

• Is acting under the umbrella of the legal entity of university or R&D institution

• Is obliged to service regional academic community

• Has a legal permission to act as IT operator or ISP

• Is authorized to apply for Ministry of Science grants to develop new services

• Is co-operating closely with local community

• Is a member of the Polish national PIONIER Consortium Example of MAN – POZMAN

220 km of own Fiber Optic Cables in the city of Poznań

• 600k city population • 105 connections to R&D institutions & Univ. • Transmission technologies 10 Gigabit Ethernet with MPLS • Users access 10 Mbps, 100 Mbps, 155 Mbps, 1 Gbps Wi-Fi access Wireless Poznań (+ EDUROAM) – a joint project Poznań City Hall and PSNC Example of HPC Center - PSNC

Environment: •300+ sqm of data center •Air, liquid coolled systems •Video monitoring, fire protection •24h monitoring

PSNC is part of: •European HPC infrastructure (PRACE) •European and national grid infrastructure (EGI, PL-GRID) •National (Platon, NDS) and European data infrastructure (EUDAT)

4xTOP500, actual 298 pos. Total peak performance 300+ TFlops, 15K CPU cores, disk arrays 1+ PB, storage capacity ~4 PB National Research and Education Network - PIONIER (topology) 2013

• Area 312k sq km • Population 38M • Main academic centers 21 • State universities 165+ • Students 2M+

• R&D institutions and Univ. interconnected via PIONIER network 700+

6494 km of fiber infrastructure in 763 km of fiber in Germany (IRU) 7257 km of fiber in total

21 MANs and 5 HPC Centers in PIONIER Consortium with PSNC as Operator Models of development & ownership

pipes and cables ownership (mutual investment)

fibers in a common cable

fiber cable ownership PIONIER fiber optics technologies

ground

power distribution system ground, along railways PIONIER transmission

RUSSIA (Kaliningrad) 1 x 10 Gb/s

GDAŃSK LITHUANIA 1 x 10 Gb/s Elbląg Suwałki

OLSZTYN BIELARUS 1 x 10 Gb/s BIAŁYSTOK Gorzów TORUŃ

Hamburg (GLIF, Surfnet, Nordunet) POZNAŃ 4x10 Gb/s

Sochaczew GÉANT2 10+10 Gb/s WARSZAWA ZIELONA GÓRA

ŁÓDŹ

PUŁAWY WROCŁAW CZĘSTOCHOWA

KIELCE 2 x 10 Gb/s (2 lambdas) Zamość

CBDF 10Gb/s KATOWICE UKRAINE 1x10 Gb/s Colorless, directionless and contentionless Bielsko-Biała 80ch DWDM system RZESZÓW KRAKÓW

PIONIER network node

CESNET; SANET 2x10 Gb/s Network Operation Center

• Operate 24 / 7 / 365 • 2 Network Operation Centers – Poznan – Lodz • Out-of-band management • Monitoring facilities • Full set of measurement equipment

Result: 99,99% reliability in Pionier Measurement Equipment

• EXFO FTB-5500B - Polarization Dispersion Analyzer Based on the Interferometric method

• EXFO FTB-5800 - Chromatic Dispersion Analyzer Based on the phase-shift method

• EXFO FLS-5800A - Broadband Light Source modulated, polarized, high-power SLED

Testing through EDFAs Measurement Equipment

• EXFO FTB-5240BP - Optical Spectrum Analyzer

• EXFO FTB-7500E - OTDR

• EXFO FOT-930 - Multi Function Loss Tester

• EXFO FIP-400 - Fiber Inspection Probe

• Attenuator

Measurement Equipment

• Optical Modulation Analyzer EXFO PSO-200 Design and optimization of system band on phase and amplitude modulation schemes at rates 0,8 Tbit/s and beyond IP Measurement Equipment

• Agilent N2X • Test interfaces • 2x10GE (LAN/WAN PHY) • 2xGE (combo - 10/100/1000Mbps copper, SFP) • Software licences • IPv4/IPv6 routing (OSPF/ISIS/BGP) • Multicast (PIM/IGMP/MLD) • MPLS (LDP/RSVP) • L2VPNs (VPLS, VLL) • GMPLS

IP Measurement Equipment (planned upgrade)

• Need to extend network tester capabilities • Larger chassis (100Gbps ready) • New test modules • 100G • dense 10G • Keep current functionality • Emulation of full protocol suite • Leading vendors able to meet new requirements • IXIA • SPIRENT

PIONIER & MAN’s environment

• Science institutions – 198

• Universities – 165

• Public institutions– 158 • include: Police offices – 18, Fire Guard offices – 10, public TV offices – 11

• Public authorities – 105, include: • Marshall offices – 13 • Voivodship offices – 13 • City Hall offices – 20 • Białystok (6), Bydgoszcz (8), (2), Koszalin (2), Kraków (10), Lublin (3), Łódź (11), Opole (2), Poznań (16), Wrocław (2), Zielona Góra (3)

• Colleges and comprehensive schools – 115

• Libraries, Museums, Archieves – 134

• Hospitals – 95 PIONIER organization

• PIONIER is a consortium of 22 academic MANs and HPCs

• PIONIER is supervised by PIONIER Board consisting of 22 representatives, 4 from them creates Executive Committee

• PIONIER network is financed from the member fee

• Member fee is based on the cost sharing model

• Each year PIONIER Board take a decision about the framework and parameters of a cost sharing model

• One member is selected to play the role of the PIONIER network operator (PSNC) Cross Border Fibers Cross Border Fibers Effect International connectivity: GEANT & GLIF

• GÉANT network • GLIF • Cross Border Dark Fiber • Access to IXP • Access to Commodity Internet NEWMAN Project Advanced MPLS/IP and DWDM platform

• Project co-funded from Structural Funds • Nation scale deployment of MPLS/IP platform for all MANs and PIONIER • Last mile is provided for most of users • Full portoflio of offered services: IPV4, IPv6, MPLS, VPLS, multicasts, QoS,… • New generation DWDM with automatic restoration (GMPLS) • 100G ready • Colorless, Directionless and Contentionless functions implemented • All nodes support p2p 10G transmission without regeneration

MPLS/IP platform DWDM platform

Core switches 191 nodes 79 Access switches 365 ROADMs 143 10 GE interfaces 4 416 1 GE interfaces 21 680 10GE interfaces 396

PLATON Project Service Platform for e-Science

• HD Videoconference services

• Deployment of eduroam services

• Applications on Demand for campuses

• Archiving on Demand

• Science HDTV services service coordinator

main service node

service partner 100NET Project Migration to Coherent 100 Gb/s DWDM and HPC switching

• Project co-funded from Structural Funds • Deployment of supercore 100Gbps network between HPC centers • New generation of coherent 100 Gbps optical technology planned to be deployed in supercore • Scalable switches with terabit capacity and 100Gbps interfaces will be deployed in HPC centers • Synergy with GÈANT 100Gbps • Support for Future Internet projects with ultracapacity requirements

100Net nodes 100Net Topology (Conception) New Laboratories

• Green ICT Laboratory • Visualization and Tele-immersion Laboratory • Virtual e-Science Laboratory • Telemedicine Laboratory • SOA Laboratory

• Integrated Speech and Language Processing Systems Laboratory • Cybersecurity and e-infrastructure Protection Laboratory • Advanced Communication Technologies Laboratory

www.man.poznan.pl Innovations based on e-infrastructure (backup slides) Digital Libraries Federation

1

Basic facts: 1 2

• ± 80 digital libraries 1 1

1 1 • Several hundreds of scientific 1 1 2 and cultural institutions 1

• About 1 million of digital 3 19 1 objects 1 3 1 1 • Cooperation with Europeana 1 3 3 • Single access point based on 1 1 1 1 automated metadata aggregation 1 2 •Digital Libraries Federation 9 1 1 http://fbc.pionier.net.pl 1 1 National Data Storage

• Sites dispersed geographically, data replicated over these sites • Safe & easy user access to service • Storage resouces both for capacity and performance: • Capacity: 12,5 PB of tapes – in 5 sites • Performance: 2 PB of disks – in 5 sites Virtual Laboratory for Interactive Teaching

Platform for nature science education focusing on phenology, chemistry of the environment and water. It allows to introduce an innovative learning process thanks to the usage of new technologies including a live stream from a video camera and automatically taken, daily pictures of the annual development of trees.

Examples of e-Education: National Inaugaration of School Year in the Primary School in Jarocin

Interactive Technologies:

• History Lessons • Nationwide Internet HD TV • 16K wall (64 HD monitors) for ultrahigh resolution visualisation system

• English Lessons • Digital Libraries • Remote chat with native-speaker using HD VC system

• Nature Lessons • Augemnted reality: three-dimensional, interactive models of astronomical objects • Virtual laboratory and interactive touch table for collaborative work of students getting to know natual environment Telemedicine & e-Health

Teleconsultations E-Health applications in Future Internet • store-and-forward teleconsultations • patient-oriented medical information • management in content aware networks videoconferencing • • technical, semantic and organizational telemedical process management in service interoperability of telemedicine oriented environments • usability of distributed telemedical Medical teleeducation applications • educational registry of medical cases Supporting activity of the elderly • live transmission of surgical operations • health safety, novel communication and • high definition and 3D multimedia courses out-of-home support

• innovative care services in urban areas

e-Government

• Multimedia City Guide, developed since 1998 in co-operation with the Poznan Municipal Office: http://www.poznan.pl • Platform servicing the City Hall, its departments and units – 1000+ editors, managing information and services

• The platform of e-Government services for citizens and businesses • Examples of eServices – For SMEs (e.g. online business registration) – For education (e.g. Intake via Internet) – For citizens (Registry of Vital Statistics) – For open and transparent democracy (e.g. On-line consultation platform) – The city map (with Interactive maps and searching of cemeteries)

• Public Internet Access Points (PIAPs) Challenges: Augmented Reality

• TEFPOL - AugmenTed rEality collaborative workspace using Future Internet videoconferencing Platform for remote education and Learning

• eLearning 3.0/3D experiment - Future Internet videoconferencing platform for remote education using advanced collaborative augmented reality and advanced real-time visualization

Challenges: New Media

• iTVP Project − LARGE SCALE access to „live and „on-demand high quality multimedia ia streams over broadband IP networks • 2010 FIFA World Cup • 64 matches live + VoD coverage • more than 1,5 mln unique users • 17,4 mln page views • 4,5 mln streams served • Netradio Project –New approach to radio broadcast tuned to individual user needs and expectations –Rich audio content repository •music, news, reports, … •various independent content providers •high quality live and on-demand content • HDVIPER Project –High Definition Videoconferencing over Internet Protocol EnviRonment •Pilot scenarios for schools and hospitals in Poznań Challenges: 4k/3D node in PSNC Stereoscopic Stereoscopic HD TV projection system LG 47LD950 2x SONY SRX-T105 4K projectors

HDMI Content storage (48TB) and distribution center Video converter 3x SUN Fire x4540 BlackMagic HDLink3D Two synchronized 4K Content Stereoscopic HD-SDI (R3D) Cinematografic Camera HD/4K HD/4K RED One 4K Content Streaming Two synchronized Post-production station (TIFF, J2K, (JPEG2000 Stereoscopic 4K Mac Pro with Final Cut Pro MXF, DCP or JPEG) 8xHD-SDI and Adobe Production etc.) Analog supported by Neo3D or digital 8ch Sound Graphics AES 10GbE PIONIER workstation EBU 4K Live extension system Optical network For software real-time For RED One camera JPEG decoding (Frame grabber) RED Rocket accelerated Sound mixing system Tascam DM-3200 HD/4K +AES/EBU active JBL loudspeakers Professional 3D rig Content For 2x RED One 4K cameras

JPEG2000 4K Decoder intoPIX SYX-JP4K with 2x Pristine4

HD/4K Streaming D-Cinema To or from Packages Other Nodes (MXF/DCP) JPEG2000 4K Encoder HD live cameras 8xHD-SDI Streaming Server HPDMNet With HDSDI 1080 output intoPIX SYX-JP4K CineGrid SONY PMW EX3 and GLIF Panasonic AG-3DA1 4K Player GEANT HD stereo Player 4K LCD 56” monitor … Doremi DSV-J2 Content storage and retrieving (TIFF, J2K, MXF, DCP, etc.) Astro DM-3400 + digital sound HD/4K live 2D or 3D streaming Challenges: 16K/3D node in PSNC

Ultra high visualization -16K: • 64 Full HD LCDs • 4 PC with ATI cards • Advanced scientific visualization • Molecular structures (bio- and nanotechnology) • Geografical data Software: SAGE, Vitrall, etc. A new GPU cluster:

• 160TFlops in total, • about 220 nodes • 2x AMD 12-core per node • nVidia Tesla M2070 acceleration • Infiniband QDR FatTree • Applications: radioastronomy, physics, visualizations