The Interplanetary Internet a New Way of Thinking About Deep Space Communications"

”The InterPlaNetary Internet a new way of thinking about deep space communications"

Scott Burleigh Ed Greenberg Adrian J. Hooke InterPlanetary Network and Information Systems Directorate

DESCANSO Seminar, JPL, Pasadena 19 July, 2001 May 1974

In the beginning…. 1970 1980 1990 2000

NASA Telemetry Standardization “Packet” Spacecraft Telemetry and Telecommand NASA/ESA Working Group Basic Space/Ground Communications Standards for Consultative Committee for Space Data Systems (CCSDS) Space Missions }

Extension of International Standards for Space More Complex Station Space Missions } Extension of the Terrestrial Internet Evolution of space standards into Space

Evolution of the terrestrial Internet Model of Space/Ground Communications

User Applications

A1 A2 An A1 A2 An Constrained Weight, power, Applications volume: Your • CPU Father’s • Storage Space Ground Internet Terrestrial • Reliability Onboard Ground • Cost to qualify Constrained Networks NetworkingHighly NetworksInternet Resource Constrained Environment

• Delay Telemetry • Noise • Asymmetry Radio Constrained Radio Links Links Links

Telecommand Current Standardization Options

Space Constrained Task Applications Force

IPNRG Constrained Networking

Constrained Links The Consultative Committee for Member Agencies Space Data Systems (CCSDS) is an Agenzia Spaziale Italiana (ASI)/Italy. British National Space Centre (BNSC)/United Kingdom. international voluntary consensus Canadian Space Agency (CSA)/Canada. organization of space agencies and Central Research Institute of Machine Building industrial associates interested in (TsNIIMash)/Russian Federation. Centre National d'Etudes Spatiales (CNES)/France. mutually developing standard data Deutsche Forschungsanstalt für Luft- und Raumfahrt e.V. (DLR)/Germany. handling techniques to support space European Space Agency (ESA)/Europe. Instituto Nacional de Pesquisas Espaciais (INPE)/Brazil. research, including space science and National Aeronautics and Space Administration (NASA HQ)/USA. applications National Space Development Agency of Japan (NASDA)/Japan. Observer Agencies http://www.ccsds.org Australian Space Office (ASO)/Australia. * Austrian Space Agency (ASA)/Austria. Belgian Science Policy Office (SPO)/Belgium. Initial focus: Centro Tecnico Aeroespacial (CTA)/Brazil. space/ground Chinese Academy of Space Technology (CAST)/China. Communications Research Laboratory (CRL)/Japan. data link protocols Danish Space Research Institute (DSRI)/Denmark. European Organization for the Exploitation of Meteorological Satellites (EUMETSAT)/Europe. European Telecommunications Satellite Organization (EUTELSAT)/Europe. Hellenic National Space Committee (HNSC)/Greece. Indian Space Research Organization (ISRO)/India. Industry Canada/Communications Research Centre (CRC)/Canada. Institute of Space and Astronautical Science (ISAS)/Japan. Institute of Space Research (IKI)/Russian Federation. http://www.scps.org KFKI Research Institute for Particle & Nuclear Physics (KFKI)/Hungary. * MIKOMTEK: CSIR (CSIR)/Republic of South Africa. Recent focus: Ministry of Communications (MOC)/Israel. space networking National Oceanic & Atmospheric Administration (NOAA)/USA. National Space Program Office (NSPO)/Taiwan. Swedish Space Corporation (SSC)/Sweden. United States Geological Survey (USGS)/USA.

Clay Frost, MSNBC App. App. App. App. App. App.

Link Link Terminus Terminus

CCSDS Classic

Application Application “Application Over Link” CCSDS CCSDS Packet Packet

CCSDS Frames and Coding Basic CCSDS Space/Ground Communications Protocol Stack

Lossy Lossless Time Data Data Codes Compression Compression Application

Space Packet Protocol

TM Space Data AOS Space Data Proximity 1 Space TC Space Data Link Protocol Link Protocol Data Link Protocol Link Protocol Space Data Link Security Mechanisms Link Communications Link ARQ Operation Procedure 1 Synchronous Links Asynchronous Links

Convolutional Reed-Solomon Turbo TLM Frame CLTU and BCH Coding Coding Coding Coding Sync. PLOPs

Radio Frequency and Modulation Physical

CCSDS Recommendation Draft CCSDS Recommendation CCSDS Report ~200 missions, and counting “Application Emerging Over CCSDS Network”

App. App. App. App. App. App.

Onboard Link Link Ground Network Terminus Terminus Network Networked CCSDS Space/Ground Communications Protocol Stack

Store Lossy Lossless Time Interactive Data Data and Codes Compression Compression Forward Application SCPS-FP Internet Onboard CCSDS Space Packet Navigation Space FTP FTP Standards Space App. Protocol File Delivery Protocol (CFDP) SCPS-TP Internet tandards SpaceTCP/UDP TCP/UDP Transport

SCPS-SP Space Security Protocol Internet IPSec Network nterface S Standards Space Packet SCPS-NP Space Internet Protocol

Onboard Comm Onboard Protocol Network Protocol (IPv4, IPv6)

nboard I TM Space Data AOS Space Data Proximity 1 Space TC Space Data Link Protocol Link Protocol Data Link Protocol Link Protocol Space Data Link Security Mechanisms Link Communications Link ARQ Operation Procedure 1 pacecraft O Synchronous Links Asynchronous Links

Convolutional Reed-Solomon Turbo TLM Frame CLTU and BCH Coding Coding Coding Coding Sync. PLOPs SOIF: S

Onboard Bus and LAN Standards LAN and Bus Onboard Radio Frequency and Modulation Physical

CCSDS Recommendation Draft CCSDS Recommendation CCSDS Report Internet RFC

Opportunity for leverage

FTP/TCP/IP

Fiber S Satellites ho rt -h au Terrestrial l c Cable om m Internet u ni ca Standards Mobile/Wireless tio ns Nomadic

Self-organizing WDM Terabit communications Similar Problems, low delay Common Solutions Megabit communications Mars Deep-space high delay Network Optical s n o File-based ti a ic Operations n u m InterPlaNetary Space m o LEO c Internet l u Internet Constellations a -h Architecture g n Standards Ka-band o L S-band X-band IAB responsibilities include: The IESG is responsible for 1. IESG Selection, technical management of 2. Oversight of the architecture IETF activities and the Internet Society (ISOC) for the protocols and procedures Internet standards process. used by the Internet. 3. Oversight of the process used The IESG is directly Internet responsible for the actions Internet to create Internet Standards. Engineering associated with entry into Architecture 4. Editorial management and Steering publication of the Request for and movement along the Board Group Comments (RFC) document series Internet "standards track," (IAB) including final approval of (IESG) 5.External Liaison with other specifications as Internet organizations concerned with Standards. standards and other issues Internet Internet relevant to the world-wide Engineering Research Internet. Task Force Task Force 6. Technical, architectural, procedural, and (where (IETF) (IRTF) appropriate) policy advice to the The IETF is a large open Internet Society international community of network designers, operators, vendors, and researchers Internet IRTF Research Groups work on concerned with the evolution Corporation for topics related to Internet of the Internet architecture Assigned Names protocols, applications, and the smooth operation of architecture and technology. and Numbers the Internet. It is open to Participation is by individual any interested individual. (ICANN) contributors, rather than by ICANN is the non-profit representatives of corporation that was formed to organizations. The Internet Research Steering Group (IRSG) assume responsibility for the IP may from time to time hold address space allocation, topical workshops focusing on protocol parameter assignment, research areas of importance domain name system to the evolution of the management, and root server Internet. system management functions Internet Research Task Force (IRTF)

Name Reliable Space Multicast (NSRG) Routing Network Management (NMRG)

Authentication Building Authorisation Differentiated Secure Accounting Services Internet Multicast Architecture (BuDS) (SMuG) Resource (AAAARCH) Discovery (IRD)

Interplanetary End-to-End Services Internet (E2E) Management (IPNRG) Co-chairs: Eric Travis Robert Rumeau IPNSIG Open Architecture Open Specifications Public Open Implementations

IPNRG

Interplanetary Internet Architecture

Communications International Space requirements Communications Infrastructure Standardization Options Basics of the IPN Architecture

Space exploration Missions log-on becomes fully to the Internet-based “Interplanetary Remote Internet Service internets Provider” to are communicate deployed in space

An interplanetary backbone network is deployed IPN Technology Thrust Areas

i i i i I

IG i i i I IG i Inter-Internet i IG I i Dialog i i Interplanetary luna.sol

Security Gateways DeployedIn-situ InternetsInternets Interplanetary i Backbone I IG Stable i IG i Backbone

i i i i

I Wired

i Tetherless Gateways Backbone

Interplanetary Interplanetary

Security

Inter-Internet Dialog

In-situ In-situ Internets Hooke

Burleigh What is a “deployed internet” in the IPN?

• The IPN architecture differentiates between the “long-haul” backbone with round-trip times measured in minutes and deployed networks that have round-trip time characteristics closer to those for which the Internet was designed

• Any deployed network that has the following attributes is considered a deployed internet: – Has an environment that does not inherently preclude the use of (possibly enhanced) Internet protocols – It is possible to route to all nodes in the network without resorting to use of long-haul infrastructure (or protocols) Deployed Internets: A Broad Range of Possible Configurations • A single lander with an IPN gateway to a (real or virtual) internal network • Small number of cooperating robots on planetary surface (e.g. Single lander, single rover) • Orbiter-to-surface communication and coordination (e.g. sample return recovery) • Multiple beyond-line-of-sight missions connected by low-orbit communication satellites • Planet-stationary satellites for relay and gateway functions • Spacecraft on-board LANs • The Earth’s Internet Gateways Backbone

Interplanetary Interplanetary

Security

Inter-Internet Dialog

In-situ In-situ Internets Mobile Untethered Mass constrained Power-Power-Power Location-Location-Location

Deployed In-Situ Internets Even “Simple” Configurations Aren’t Simple Inter-Internet Dialog Interplanetary

Security Gateways In-situ Internets Interplanetary

Backbone What’s a Backbone? ✻ A set of high-capacity, high-availability links between network traffic hubs

– Terrestrial backbone links are between hubs like Houston and Chicago.

– Interplanetary backbone links are between hubs like Earth and Mars. Differences Between Terrestrial and Interplanetary Backbones

Terrestrial Interplanetary Delay (sec) < .1 10 to 10,000 Connectivity Wired; structural, Radiant; operational, continuous intermittent Medium Copper, glass Space; high BER Deployment $ “low” Very high Operations $ “low” High (power is costly)

Repair, upgrade $ “low” Very high What These Differences Imply

• Cost per second of transmission is very high, so… – Don’t waste transmission opportunities. • Intra-backbone connectivity might never be end-to- end, so… – Don’t rely on end-to-end connectivity for protocol operations. Use store-and-forward techniques. • End-to-end round trip time may vary from minutes to weeks, so… – Don’t rely on negotiation or other conversational protocol mechanisms; by the time a conversation converges, the reason for it may have passed. Make protocol decisions autonomously, locally. What Won’t Work

• Absence of automated protocol (the status quo). – It doesn’t scale up. Network operations cost would be too high. • Internet protocols (TCP, UDP, IP) or other protocols designed for terrestrial networks. – They rely on conversational protocol mechanisms and/or continuous end-to-end connectivity. What To Do Instead

• New application protocols that don’t rely on in- order delivery of byte streams. • New bundle-oriented protocols at the transport and network layers. – “Custodial” store-and-forward operation. – Concurrent transmission, out-of-order delivery. • New reliable link layer protocol. – Point-to-point retransmission over interplanetary distances. – Sub-layer of underlying CCSDS protocols for coding and forward error correction, to minimize the need for retransmission. Interplanetary Dialogs: communicating in a fundamentally disconnected environment i i i i I

IG i i i I IG i Inter-Internet i IG I i Dialog i i Interplanetary luna.sol

Security Gateways DeployedIn-situ Internets Internets Interplanetary

Backbone i Stable I IG Backbone i IG i

i i i i I Wired i Tetherless Interplanetary Dialogs: Design Principles

• Intermittent connectivity suggests an Email-like architecture – Common “Handling Instructions” for a data collection – Network must accommodate the persistence and transfer of state • Late-Binding – We seek functional independence of remote Internets - a single address space across the entire IPN would couple all parts of the system to evolve at the same rate. – Therefore: separate addressing domains for each internet. Administrative names converted to local addresses only at the destination IPN region • Names (not addresses) are the means of reference – Names have two parts: a routing handle (specifies the IPN region) and an administrative part (specifies the DNS name) – Routing between IPN regions based upon routing handle • Indirection – Inherent dependence on intermediate relay agents • Custodial transfer – Intermediate nodes assume possibly-long-term responsibility for data forwarding – “Bundles” as a common end-to-end transfer mechanism The Interplanetary Internet: An overlay network for interconnection of regional internets

• A region is an area where the relevant characteristics of communication are homogeneous RD • One can define regions that RC are based upon: – Communications capability – Quality of Service Peerings – Security (levels of trust) RB – Degree of resource management – Etc. RA • Traversal of two or more RE regions will affect the nature of communications IP: the “Thin Waist” of the Earth’s Internet

App App

App App App App

Transport Transport TCP TCP Network Network Network Network IP IP IP IP

Link 1 Link 1 Link 2 Link 2 Link 3 Link 3

Phys 1 Phys 1 Phys 2 Phys 2 Phys 3 Phys 3

Subnet 1 Subnet 2 Subnet 3

Internet: a Network of Connected Sub-Networks Bundles: A Store and Forward Overlay The “Thin Waist” of the Interplanetary Internet App App

App App App App

Internet a Internet b

Bundle Bundle Bundle

Transport a Transport a Transport b Transport b

Network a Network a Network a Network b Network b

Link 1 Link 1 Link 2 Link 2 Link 3 Link 3

Phys 1 Phys 1 Phys 2 Phys 2 Phys 3 Phys 3

Network of internets spanning dissimilar environments Bundling Spans Temporal Discontinuities Between Networks

B 3

B 1 2

B 4

B “Persistence of Vision” provides the illusion of end-to-end connectivity Names: New Requirements

• Names are tuples { icestation_zebra.hudsonbay.com, europa.jupiter.sol }

Administrative Name Routing Domain • Opaque outside • Specifies an IPN associated routing region where the domain administrative name • Bound to address has significance only upon entry • Used as a label for into its routing routing through domain "bundlespace"

Name tuples must be carried end-to-end within each "bundle"

Names may refer to persistent objects rather than physical entities Single Name Space, Late Name-to-Address Binding(s)

Name Space - Common Across All Internets

Name-to-Address Name-to-Address Name-to-Address Binding Space A Binding Space B Binding Space C

Interplanetary Internet Internet Backbone

IPN region: .earth.sol IPN region: .ipn.sol IPN region: .mars.sol

Name: {admin part: www.bughunter.org, Name: { admin part: www.rockshop.com, routing part: earth.sol } routing part: mars.sol} Local Address: 137.79.10.232 Local Address: 137.79.10.232 Inter-Internet Dialog and Nodes

Interplanetary Security Gateways Deployed IPN Security Internets

Stable Backbone i i i i I

Security of user data earth.sol flowing through the IPN IG i i i I IG i i IG I i i i mars.sol luna.sol

Security of the IPN backbone i I i IG IG i

i i i i IPN Security Requirements access control to the IPN will be required because space-based assets will have limited available resources. authentication will be required to perform access controls. data integrity will be required to assure that what was sent is received. data privacy will be required to assure that unauthorized users cannot obtain information. Email Key/Encryption Model for IPN

Payload Payload Symmetric Payload is encrypted Data key Data using a symmetric key

Symmetric Key Payload Symmetric encrypted in Data key destination’s public key (assumes some means of obtaining public keys)

IPN encapsulates Payload Symmetric Bundle Transport + in Bundle protocol Data key Header Net Headers “Bundlespace” Service Layering

Applications (e.g., bundle ftp) other bundle “raw” Socket Interface “Transport” API NTP bundle applications Registered 4th-class Other Mail Mail Multiplexors “Raw” API Shim “Network” API Interface

Bundle routing

TCP UDP LTP IP

CCSDS Ethernet SONET HDLC Proximity-1 TM/TC

* Security, if desired, lives in the purple stuff Networked CCSDS Space/Ground Communications Protocol Stack

SCPS-SP Space Security Protocol Internet IPSec Network nterface S Standards Space Packet SCPS-NP Space Internet Protocol

Onboard Comm Onboard Protocol Network Protocol (IPv4, IPv6)

Convolutional Reed-Solomon Turbo TLM Frame CLTU and BCH Coding Coding Coding Coding Sync. PLOPs SOIF: S

Onboard Bus and LAN Standards LAN and Bus Onboard Radio Frequency and Modulation Physical

CCSDS Recommendation Draft CCSDS Recommendation CCSDS Report Internet RFC Bundling and CFDP

CFDP File Transfer, File CORBA Streaming C email F File Store Transfer events Video, D CFDP Reg 4th Class P End-End Mail Mail

C CFDP o Extended Bundle Routing r TCP/TP UDP CFDP Reliability LTP e IP NP CCSDS Space Link

CFDP Bundles Current CCSDS Strategy: move CFDP Core +“informative” Extended procedures …………….…and defer the to a Blue Book…………………. Extended evolution to Bundles “CFDP Build 1” “CFDP Build 2” “Bundles Build 1”

CFDP File Transfer, CFDP CFDPFile File CORBA Streaming C email F File Store File Transfer TransferTransfer events Video, D CFDP CFDP Reg 4th Class P End-End End-End’ Mail Mail

C CFDP CFDP o Extended Extended’ Bundle Routing r CFDP TCP/TP UDP e CFDP Reliability LTP Reliability IP NP CCSDS Space Link

CFDP Bundles

The IPN rollout has begun! Earth Science Deep Space Science

Human Exploration Progressive, planned deployment of reusable communications infrastructure

2001 2003 2005 2007 2009 2011

In-depth Planetary Exploration

For more information…...

… http://www/ipnsig.org