Netnod: the Successful Case of the First Swedish Internet Exchange Point

Total Page：16

File Type：pdf, Size：1020Kb

Netnod: the Successful Case of the First Swedish Internet Exchange Point Patrik Fältström Head of Research and Development Netnod What is Netnod? • A company owned by a foundation • Not for profit Luleå • Runs: • IX in 6 locations Sundsvall • DNS on 45 locations Stockholm • Distributes time Göteborg Malmö Traditional view Service A Service B Service C Transport A Transport B Transport C Each service have its own transport Today, with Internet Service A, B and C Internet Transport Abstraction is key! Service Independence! Internet Transport Sharing is caring Competition Service Internet Transmission Fiber Ducts Sharing Ground Sharing is caring Service Internet Competition Transmission Sharing Fiber Ducts Ground Sharing is caring Service Competition Internet Sharing Transmission Fiber Ducts Ground Sharing is caring Service Internet Transmission Competition Fiber Sharing Ducts Ground Example questions to ask? • Is there interest from ISPs to compete with that product? • Will ISPs together save money if the product is shared? • Will provider of the service compete with its customers, the ISPs? The Netnod story... Summer of 1991 Sunet Telia Tele2 Tele2 was the first commercial ISP in Sweden! Tele2 and Telia wanted to exchange traffic Sunet Telia Tele2 n(n - 1) Connections will with n nodes be 2 SUNET offered a solution at KTH Sunet Telia Tele2 Easy to do as there where dark fiber to rent! With central services Sunet Services Telia Tele2 For example, first root server outside of the USA The model did grow Sunet ISP B ISP A Netnod Telia Tele2 ISP C ...and Netnod was created Same structure at every location 5:th generation (today) Stockholm C Stockholm B 10GE 10GE ISP A ISP B ISP C Bunkers • Regulator PTS owns the bunkers • Specifically built for telecom • Only used for approved critical infrastructure Bergrum Bergrum Division of labour 1991 • Swedish University Network bring • People, electricity, colocation, switch, services • City of Stockholm brought • Fiber via STOKAB • ISPs bring • Traffic Plan of 1996 • Swedish Government bring via The Knowledge Foundation initial money for the TU-Foundation • TU Foundation create and own Netnod • Netnod provide people, electricity, colocation, switch and services • Regulator PTS provide bunker for colocation • City of Stockholm provide fiber via STOKAB • ISPs bring traffic, pay for connections Division of labour 2012 • TU Foundation own Netnod • Netnod provide people, electricity, colocation, switch and services • Netnod rent colo space from regulator PTS • Netnod rent fiber from STOKAB • ISPs pay Netnod for IX connections • ccTLDs pay Netnod for DNS hosting Investments • Netnod got initial seed money of €500k in 1996 • Do not charge for root server or time • Do not get any help with funding • Charge for IX and DNS hosting • Regulator PTS have during the years made various investments, 1996-2004 €10M/year, later years less • STOKAB is carrying its own cost for fiber investments , and had 2011 26% revenue Patrik Fältström [email protected] e http://www.netnod.se/.

Copy Link

Recommended publications

Rock-Solid Internet Infra Structure. (Yeah, We Keep Our Stuff in Bunkers.)
Rock-solid Internet infra structure. (Yeah, we keep our stuff in bunkers.) WHO DO YOU TRUST TO GET THE JOB DONE? Innovation at the core of the Internet Netnod operates the largest IXPs in the Nordics and When it comes to Internet provides a secondary DNS service to TLDs, part- services, you need a partner ners and enterprises throughout the world. If these terms are new to you, take a look at the fact box to you can trust. Netnod brings see how these crucial parts of the Internet work. you all the benefits that come 20 years of stability and security from choosing one of the We are innovators at the core of the Internet with most respected organisations a worldwide reputation for our services and the expertise of our staff. For more than 20 years, we working in the Internet today. have been ensuring the stability and security of critical Internet infrastructure by: • running the largest IXPs in the Nordics with the IXP: Internet DNS: Domain NTP: Network highest traffic per peer in Europe Exchange Point Name System Time Protocol • providing secondary DNS services to some of An IXP is a physical intercon- The DNS is the distributed NTP is the most commonly the largest TLDs in the world nection point where networks database which every Internet used protocol for synchronising • operating i.root-servers.net, one of the world’s such as Internet Service Provid- application uses to transform the time on computer systems. 13 root name servers ers (ISPs) and Content Delivery human-readable names such as An accurate, NTP-based system • distributing Swedish national time through NTP Networks (CDNs) come together www.netnod.se into the nu- is essential not only for individ- to exchange traffic (peer).
[Show full text]
Netnod Internet Exchange
Netnod Internet Exchange RIPE 56 May 2008 Nurani Nimpuno http://www.netnod.se What’s Netnod? • Non-profit, neutral exchange – Started out at KTH-NOC (1992) • Netnod founded 1996 – Owned by the TU foundation Luleå • National infrastructure • Need for high availability Sundsvall • Operate 6 IXPs in 5 cities – 2 switches in Stockholm Stockholm – 51 peers connected Göteborg Malmö http://www.netnod.se Underground bunkers http://www.netnod.se http://www.netnod.se http://www.netnod.se Common infrastructure services • Official Swedish time through NTP – In Malmö, Sundsvall, Gothenburg and one bunker in Stockholm • i.root-servers.net • .SE TLD-service • A number of TLDs in Stockholm – Among others Verisign's .com and .net, .DK, .NL, .DE, .NO etc. • Copy of RIPE routing registry • TPTEST – Consumer broadband test http://www.netnod.se Connecting to Netnod • Stockholm – Charges include the cost of two separately routed fiber pairs – One to each bunker • Other cities – ISP have to find a fiber provider themselves • Coordination needed to patch through to us http://www.netnod.se Pricing structure (further reduced in 2008) • Stockholm* – Outer city • 2x10GE: 350k SEK (~37,5k !) • 2x1GE: 280k SEK (~30k !) *Note: – Inner city: Stockholm fees include 2 connections • 2x10GE: 265k SEK (~28,4k !) & 2 separate fiber • 2x1GE: 195k SEK (~19,8k !) pairs • Malmö/Gothenburg/Sundsvall • 10GE: 110k SEK (~11,8k !) • 1GE: 75k SEK (~8k !) http://www.netnod.se Top ISPs (Highest average last 24h) N o I S P A S Traffic 1 B2 Bredband AB 2119 9.77 Gb/ s 2 Com Hem AB 39651 8.31 Gb/ s 3 TeliaSonera AB Networ k s 3301 6.67 Gb/ s 4 Skycom AB 29518 5.70 Gb/ s 5 Bahnhof AB 8473 5.06 Gb/ s 6 Port80/Rix Telecom AB 16150 4.23 Gb/ s 7 IP-Only Telecommunication AB 12552 3.59 Gb/ s 8 Cogent Communications Deutschl 1 7 4 2.79 Gb/ s 9 TDC Sverige AB 3292 2.77 Gb/ s 1 0 Lidero Network AB 13189 2.24 Gb/ s 1 1 DNA Services Lt d 16086 1.99 Gb/ s 1 2 RETN Lt d .
[Show full text]
Netnod Internet Exchange SIG-IX Presentation APRICOT 2005
Netnod Internet Exchange SIG-IX presentation APRICOT 2005 Kurtis Lindqvist <[email protected]> © 2005 - Netnod AB http:// 2005-02-23 www.netnod.se/ History • Netnod was formed from then D-GIX at KTH-NOC in 1996 / 1997 • Reason for creating Netnod was to create an independent and resilient exchange infrastructure • Early on focus was on redundant systems – Also from a national infrastructure point-of- view © 2005 - Netnod AB http:// 2005-02-23 www.netnod.se/ History • At the time of creation – Government report that cited Internet as critical national infrastructure – That some of that infrastructure was more important than other • Design of Netnod was influenced by the view on national security © 2005 - Netnod AB http:// 2005-02-23 www.netnod.se/ Physical separation / redundancy • Early on it was decided that the exchange of traffic had to work even in times of national crisis – Stockholm would not be a focus point – Any backup site had to survive on it’s own • Search for suitable locations started – And turned out to be a fairly complex process © 2005 - Netnod AB http:// 2005-02-23 www.netnod.se/ Locating sites Criteria that had to be met • Population / Traffic volume • “Carrier capacity”! – It had to be fairly easy to get to – Preferably most where already present – Was probably the hardest criteria to meet…. • Somewhat spread across the country • Existing Mountain cave… © 2005 - Netnod AB http:// 2005-02-23 www.netnod.se/ © 2005 - Netnod AB http:// 2005-02-23 www.netnod.se/ Other effects of the diversity • Early on local exchange of
[Show full text]
Nordic Internet Infrastructure Development 1988–2007 Peter Graham, Yngve Sundblad
Nordic Internet Infrastructure Development 1988–2007 Peter Graham, Yngve Sundblad To cite this version: Peter Graham, Yngve Sundblad. Nordic Internet Infrastructure Development 1988–2007. 4th History of Nordic Computing (HiNC4), Aug 2014, Copenhagen, Denmark. pp.205-214, 10.1007/978-3-319- 17145-6_23. hal-01301412 HAL Id: hal-01301412 https://hal.inria.fr/hal-01301412 Submitted on 12 Apr 2016 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. Distributed under a Creative Commons Attribution| 4.0 International License Nordic Internet Infrastructure Development 1988-2007 Peter Graham¹ and Yngve Sundblad² Computer Science and Communication, KTH, Stockholm, Sweden ¹[email protected] ²[email protected] Abstract. In the development, introduction and spread of the Internet, Nordic researchers have had a pioneering and central role. Already in the 1970s Norway hosted and developed the first ARPAnet node outside North America. In the 1980s pioneers in the Nordic countries started na- tional computer networks and joined forces into the Nordic academic network NORDUnet, developed and operated from the KTH Network Operation Centre, KTHNOC. Its DGIX (Distributed Global Internet eXchange) node be- came central in the global Internet in the mid 1990s, with about 40 Inter- net operators connected.
[Show full text]
The History of Internet Exchanges in Sweden
The history of Internet Exchanges in Sweden Kurtis Lindqvist <[email protected]> 2007-04-04 © 2007 - Netnod AB www.netnod.se/ Who am I anyway? • Ålcom (EUnet Finland) -> 1997 • EUnet Sverige 1997-1998 • KPNQwest Sweden 1998-2000 • KPNQwest 2000-2002 • 2002- Consultant (Netnod) • Other things... – Current chairman of the board for Euro-IX – IETF WG chair for shim6 and v6ops – Chair of RIPE NCC Services WG – Chair of the Swedish Operator Forum – Member of the Internet Architecture Board – Chair of IAOC – Member of the IETF ops-directorate – Various consultational groups to governments 2007-04-04 © 2007 - Netnod AB www.netnod.se/ Early history... • D-GIX located at KTH in Stockholm – Started in 1992 – From the beginning this was a 10/100 Mbps Ethernet Switch • Was later complemented with an FDDI switch • During 1996 there was a discussion inside SOF and the Swedish Internet community to discuss the future... – Netnod was created in 1997 – Yet another FDDI switch was installed – The goal was a structure that could guarantee independence and continuity – The IX was considered critical national infrastructure 2007-04-04 © 2007 - Netnod AB www.netnod.se/ History • 1999 the Swedish traffic had outgrown existing FDDI switches – This led to delay and packet loss • At a SOF meeting future technologies where discussed – Gigabit Ethernet – Cisco DPT 2007-04-04 © 2007 - Netnod AB www.netnod.se/ History • The operators jointly decided to go on with DPT – GigE jumboframes was not available then – Operators wanted to avoid the possibility of head-of- line blocking • DPT was (is) a Cisco technology that was later called ”Redundant Packet Rings” (RPR).
[Show full text]
Netnod Internet Exchange SIG-IX Presentation APRICOT 2006
Netnod Internet Exchange SIG-IX presentation APRICOT 2006 Kurtis Lindqvist <[email protected]> 2006-03-02 © 2006 - Netnod AB http:// www.netnod.se/ History • Netnod was formed from then D-GIX at KTH- NOC in 1996 / 1997 • Reason for creating Netnod was to create an independent and resilient exchange infrastructure • Early on focus was on redundant systems • Also from a national infrastructure point-of-view 2006-03-02 © 2006 - Netnod AB http:// www.netnod.se/ History • At the time of creation • Government report that cited Internet as critical national infrastructure • That some of that infrastructure was more important than other • Design of Netnod was influenced by the view on national security 2006-03-02 © 2006 - Netnod AB http:// www.netnod.se/ Physical separation / redundancy • Early on it was decided that the exchange of traffic had to work even in times of national crisis • Stockholm would not be a focus point • Any backup site had to survive on it’s own • Search for suitable locations started • And turned out to be a fairly complex process 2006-03-02 © 2006 - Netnod AB http:// www.netnod.se/ Locating sites Criteria that had to be met • Population / Traffic volume • “Carrier capacity”! • It had to be fairly easy to get to • Preferably most where already present • Was probably the hardest criteria to meet…. • Somewhat spread across the country • Existing telecommunication bunkers 2006-03-02 © 2006 - Netnod AB http:// www.netnod.se/ 2006-03-02 © 2006 - Netnod AB http:// www.netnod.se/ Other effects of the diversity • Early on local exchange of traffic was seen as a possible “Good thing™” • However turned out to be somewhat harder than first thought • Until around 1999 traffic was still sent through Stockholm even for ISPs connected to Gothenburg • This slowly changed • Today a lot of traffic is exchanged locally" • Gives overall better performance 2006-03-02 © 2006 - Netnod AB http:// www.netnod.se/ Connecting to Netnod • In Stockholm the charges for connecting to Netnod includes the cost for two separately routed fiber pairs.
[Show full text]
Netnod IX Update
Netnod IX update RIPE 55 EIX October 2007 Nurani Nimpuno http://www.netnod.se What’s Netnod? • Non-profit, neutral exchange – Started out at KTH-NOC • Netnod founded 1996 Luleå – Owned by the TU foundation • National infrastructure Sundsvall • Need for high availability • Operate 6 IXPs in 5 cities Stockholm Göteborg – 2 switches in Stockholm Malmö http://www.netnod.se Underground bunkers http://www.netnod.se http://www.netnod.se http://www.netnod.se Common infrastructure services • Official Swedish time through NTP – In Malmö, Sundsvall, Gothenburg and one bunker in Stockholm • i.root-servers.net • .SE TLD-service – Stockholm, Gothenburg, Sundsvall • A number of TLDs in Stockholm – Among others Verisign's .com and .net ･.DK, .NL, .DE, .NO etc. • Copy of RIPE routing registry • TPTEST – Consumer broadband test http://www.netnod.se Connecting to Netnod • Stockholm – Charges include cost of two separately routed fiber pairs – One to each bunker • Other cities – ISP have to find a fiber provider themselves • Co-ordination needed to patch through to us http://www.netnod.se Pricing structure (new this year) • Stockholm outer city – Outer city • 2x10GE: 410k SEK ($58.6k) • 2x1GE: 310k SEK ($44.4k) – Inner city: • 2x10GE: 325k SEK ($46.5k) • 2x1GE: 225k SEK ($32.2k) • Malmö/Gothenburg/Sundsvall • 10GE: 140k SEK ($20k) • 1GE: 90k SEK ($12.9k) http://www.netnod.se Customers per site City 1 G 10 G Stockholm 27 (29) 18 (16) Göteborg 9 5 Malmö 9 7 Sundsvall 7 (12) 6 (4) Luleå 3 - http://www.netnod.se News • Signicicant increase in 10GB ports • Started
[Show full text]
The IETF and Pervasive Monitoring in a Post-Snowden Internet Netnod
netnod news – issue 2 – 2014 Netnod launches COMIX – the distributed IXP, connecting Copenhagen and Malmö! page 5–8 The IETF and pervasive monitoring in a post-Snowden Internet – an interview with IETF chair Jari Arkko page 10–11 Work meets pleasure What is at stake at Busan? – your travel guide to the – Perspective on the future upcoming industry events challenges in Internet governance no freaking paper, PAGE 16–18 PAGE 13–15 i want it on my smartphone. Word from the CEO happens, one of the first points of active in the Euro-IX twinning programme. presence we established outside Through that program, larger and more Stockholm was actually in Copenhagen. mature IXPs help smaller and developing This made sense with the closely linked IXPs to become members of Euro-IX and business environments in Sweden and thereby gain access to the vast amount of Denmark, and it was reflected in experience and best practice knowledge customer demand. Now, 16 years later, of the collective Euro-IX members. these ties remain as close as ever, and it’s apposite that Netnod has taken the step Netnod has, for a few years, been to acquire the COPHIX sites in Copenhagen approached by several Danish ISPs, and fully integrated them with our requesting our help in getting easy access expanded Netnod Malmö sites to create to Netnod Malmö. Netnod, believing that Netnod COMIX. there is a great value in local traffic staying local, saw potential value in this. Netnod has always believed that creating At the same time, the IXP market in local Internet Exchange Points adds value Copenhagen and Malmö had become for the local community, builds capacity very fragmented, with five IXPs operating and knowledge locally, and creates a in the region, and Netnod’s long-held more resilient and robust infrastructure.
[Show full text]
Netnod Presentation
www.netnod.se WELCOME TO NETNOD! www.netnod.se ABOUT NETNOD - Based in Stockholm - Non-profit foundation - Founded in 1997 - 19 employees - Operates IXPs in Sweden and Denmark - 124 connected networks (March 2015) - Manages i.root-servers.net, one of the 13 logical Internet DNS root name servers in the world - DNS anycast and unicast slave services to TLDs world- wide CEE-Peeringday, Bratislava, 2015-03-18, Martin Eriksson www.netnod.se 2014 Another year of record growth! • +13 new members in Stockholm, +12 new members at COMIX • +6 100GE Ports in Stockholm, +17 new 10GE ports in Stockholm • +6 10GE ports at COMIX, +4 1GE ports at COMIX An expanded board for Netnod Several new staff members CEE-Peeringday, Bratislava, 2015-03-18, Martin Eriksson www.netnod.se Stockholm- Our main hub in Sweden - IXP with 2 switches (A+B always connected) - Placed in secure underground facilities - Telecity and InterXion connected with WDM systems to each location - On-net sites in select places in Stockholm CEE-Peeringday, Bratislava, 2015-03-18, Martin Eriksson www.netnod.se COMIX - Malmö and Copenhagen - Our IXP in Denmark and south of Sweden - Best way to get access to the Danish region - 31 connected networks CEE-Peeringday, Bratislava, 2015-03-18, Martin Eriksson www.netnod.se Gothenburg - Our IXP in the second largest city in Sweden CEE-Peeringday, Bratislava, 2015-03-18, Martin Eriksson www.netnod.se Sundsvall - One of our IXP´s in the north of Sweden CEE-Peeringday, Bratislava, 2015-03-18, Martin Eriksson www.netnod.se Luleå - One of our IXP´s
[Show full text]
Netnod EIX Update RIPE53 - Amsterdam [email protected]
Netnod EIX update RIPE53 - Amsterdam [email protected] 2006-10-05 © 2006 - Netnod AB http:// www.netnod.se/ So who are we anyway? • Netnod is owned by the TU-Foundation • Largest Internet Exchange in Scandinavia • We operate exchanges in five cities in Sweden • The locations are not interconnected 2006-10-05 © 2006 - Netnod AB http:// www.netnod.se/ Examples of operator connected •Tele2 •TeliaSonera •B2 •Telenor •SUNET •Banhof •Internet5 •Song •Chello •MCI WorldCom •GlobalCrossing •+ 40 more 2006-04-27 © 2006 - Netnod AB http:// www.netnod.se/ Connecting to Netnod • Locations are in secure communication bunkers • In Stockholm there are two sites • Netnod will provide the fiber between the bunkers and the ISP location • Fibers are included in the price 2006-10-05 © 2006 - Netnod AB http:// www.netnod.se/ 2006-04-27 © 2006 - Netnod AB http:// www.netnod.se/ Common Services at Netnod • Official Swedish time through NTP – In Malmö, Sundsvall, Gothenburg and one cave in Stockholm • i.root-servers.net – Location in Sweden not disclosed – Can also be run from all caves • .SE TLD-service – Stockholm, Gothenburg, Sundsvall • A number of TLDs in Stockholm – Among others Verisign's .com and .net – .DK, .NL, .DE, .NO, .CZ etc. • Copy of RIPE routing registry in Stockholm 2006-10-05 © 2006 - Netnod AB http:// www.netnod.se/ News since last • 10 GE demand still rising • Connected ISPs still growing • New platform for Gothenburg and Malmö installed • Visited all customers for one-on-one talks • Foundry RX-16 will be installed in Stockholm • STH-C: 2006-10-05
[Show full text]
Providing Time & Frequency at Scale
Providing time & frequency at scale Michael “MC” Cardell Widerkrantz 2020-03-12 Michael “MC” Cardell Widerkrantz Research & Development at Netnod. Contact: [email protected] https://www.netnod.se/ Personal: https://hack.org/mc/ Netnod Internet Exchange Internet infrastructure organisation founded in 1997. 30 employees. 100% owned by a foundation. Netnod Internet Exchange Largest Internet Exchange Point operator in the Nordics (>160 connected networks in Stockholm). Manages the i.root-servers.net DNS server carrying the DNS root zone. DNS anycast services to ccTLDs, enterprises and partners. Time and frequency services. Netnod’s Internet Exchange Internet Exchange with ≈ 200 ASNs. WDM transport throughout the Nordics between IX points. Metro access between datacenters. Netnod’s Internet Exchange Presence Time & frequency @ Netnod I From 1993 Peter Löthberg provided NTP to the public from an atomic clock. Since at least 2003 Netnod has provided NTP services. Under contract with Swedish Post and Telecom Authority (PTS). Time & frequency @ Netnod II 4 sites. Working on #5. Cesium clocks, 2x at each site. Local time scales traceable to UTC (SP) within ± 250 ns. NTP servers in hardware! PTP on request. Operational in this setup since 2015. https://www.netnod.se/ntp/ Xilinx VC709 NTP Server Full wirespeed (4 x 10 GigE) NTP at once. DoS protection. Clock inputs (PPS + 10 MHz) x 2, connected to both local timescales. Automatic failover to second clock if primary fails. Verilog NTP server https://github.com/Netnod/FPGA_NTP_SERVER NTP server addresses Anycast address: ntp.se Malmö: mmo1.ntp.se mmo2.ntp.se Göteborg: gbg1.ntp.se gbg2.ntp.se Stockholm: sth1.ntp.se sth2.ntp.se Sundsvall: svl1.ntp.se svl2.ntp.se PTP PTP available on request.
[Show full text]
Market-Driven Challenges to Open Internet Standards
PAPER SERIES: NO. 33 — MAY 2016 Market-driven Challenges to Open Internet Standards Patrik Fältström MARKET-DRIVEN CHALLENGES TO OPEN INTERNET STANDARDS Patrik Fältström Copyright © 2016 by Patrik Fältström Published by the Centre for International Governance Innovation and Chatham House. The opinions expressed in this publication are those of the author and do not necessarily reflect the views of the Centre for International Governance Innovation or its Board of Directors. This work was carried out with the aid of a grant from the International Development Research Centre (IDRC), Ottawa, Canada. The views expressed herein do not necessarily represent those of IDRC or its Board of Governors. This work is licensed under a Creative Commons Attribution — Non-commercial — No Derivatives License. To view this licence, visit (www.creativecommons.org/licenses/by-nc- nd/3.0/). For re-use or distribution, please include this copyright notice. Centre for International Governance Innovation, CIGI and the CIGI globe are registered trademarks. 67 Erb Street West 10 St James’s Square Waterloo, Ontario N2L 6C2 London, England SW1Y 4LE Canada United Kingdom tel +1 519 885 2444 fax +1 519 885 5450 tel +44 (0)20 7957 5700 fax +44 (0)20 7957 5710 www.cigionline.org www.chathamhouse.org TABLE OF CONTENTS vi About the Global Commission on Internet Governance vi About the Author 1 Acronyms 1 Executive Summary 1 Introduction 1 Internet Fundamentals 4 Standards Evolution 6 Market Forces 9 An Open Internet Future 9 Conclusion 10 Works Cited 12 About CIGI 12 About Chatham House 12 CIGI Masthead GLOBAL COMMISSION ON INTERNET GOVERNANCE PAPER SERIES: NO.
[Show full text]