Ethernet PHY Characterization ESA AO/1-8074/14/NL/LF

C. Plettner, L. Buttelmann, Airbus DS F. Guettache, G. Magistrati, ESA/ESTEC H. Kettunen, A. Virtanen, University of Jyväskylä Overview

•International context and ESA/Airbus DS vision •Project layout •Developments: electronics (PCB motherboards) and software (data acquisition) •Environmental and radiation test results •Conclusion and Outlook Confidential International Context as Motivation

tten consent of Astrium [Ltd/SAS/GmbH]. •Time Triggered (TTECH) technology gained worldwide momentum in the automotive and (aero)space industry.

ted to any ted any third towithout party the wri •NASA and Honeywell promote TTECH as baseline for the on board data bus system. Honeywell technology is rad-hard and ITAR protected.

•Large scale space projects deploying TTECH: rictly confidential. It shall not be communica be not shall It confidential. rictly -NASA/ESA Orion lunar mission to the Moon -ESA next generation launcher Ariane 6

•Strategically important to safeguard and adapt commercial ITAR free technology with the property Astriumofproperty [Ltd/SAS/GmbH] the and is st respect to one of the building blocks of TTECH which is PHY transceiver. This This itsand document contentis

10 May 2017 3 Confidential Objectives

tten consent of Astrium [Ltd/SAS/GmbH]. •Investigate the possibility to use commercial off the shelf Ethernet components for space use to circumvent the costly radiation-hardened development

ted to any ted any third towithout party the wri •Perform a trade off and choose three-best transceiver manufacturers in a defined metric

•Run a full space qualification campaign on the parts rictly confidential. It shall not be communica be not shall It confidential. rictly

•Identify the parts/manufacturers with good/acceptable performance the property Astriumofproperty [Ltd/SAS/GmbH] the and is st This This itsand document contentis

10 May 2017 4 Confidential Project Work Flow

Identification Selection WP 2100 WP2200 PCB Prod. EGSE Prod.& Soft. Prod. &Test &Test Test WP4300 tten consent of Astrium [Ltd/SAS/GmbH]. WP4100 WP4200 Contact industry WP2300 Integration Procurement WP4400 WP2300 ted to any ted any third towithout party the wri

PR TRR

Radiation Test KeyEnv. design Test WP5100 WP3100WP5200 rictly confidential. It shall not be communica be not shall It confidential. rictly Consolidate data Rad. Test Plan Env. Test Plan WP3100 WP3200 WP3300 TR

Testing Facilities WP3400 Contact Parts Distribution the property Astriumofproperty [Ltd/SAS/GmbH] the and is st Industry WP6200 PCB Design EGSE Design Software WP6100 WP3500 WP3600 Design WP3700 AR

This This itsand document contentis TPR

10 May 2017 5 Confidential Ethernet PHY Transceivers Trade-off

• Many selection criteria were taken into account and weighted according to their importance (e.g 1 for a SOW requirement and 0.2 for softer design considerations) tten consent of Astrium [Ltd/SAS/GmbH]. • Functional: IEEE802.3 compliant, Interfaces(GMII, RGMII), Interrupt generation capabilities, autonegotiation •Electrical: Copper based medium (10/100/1000MB/s), power consumption and management, auto pair

ted to any ted any third towithout party the wri correction • Mechanical (package soldering, temperature range)

Manufacturer Weighted 160 Part Points No. 140 rictly confidential. It shall not be communica be not shall It confidential. rictly Vitesse/VSC8501 148,9 1 120 Marvell/88E1111 147 2 Lantiq/PEF7071 129,6 3 100 Avago/ET1011C 98,5 4 Micrel/KSZ9031MNX 90,8 5 80 Texas/DP83867 90,6 6 60 Micrel/KSZ9031RNX 87,6 7 Weighted Points Weighted the property Astriumofproperty [Ltd/SAS/GmbH] the and is st Microchip/LAN8810 80,7 8 40 Texas/DP83865 78,2 9 20 Microchip/LAN8820 76,9 10 Broadcom/BCM5461 68 11 0 Realtek/RTL8211BG 52,8 12 02468101214 This This itsand document contentis Realtek/RTL8211DN 51,1 13 Manufacturer ID

10 May 2017 6 Confidential Ethernet PHY Interfaces

Data Interface (xMII) Interface Control • High speed parallel interface MI tten consent of Astrium [Ltd/SAS/GmbH]. • Used to send/receive data

To Magnetics TX Management Interface (MI) ted to any ted any third towithout party the wri GMII/MII/RMII Data Interface PHY • Serial slow interface RX Fr. Magnetics • Used to program/monitor the PHY • Basic MI registers are defined in the standard rictly confidential. It shall not be communica be not shall It confidential. rictly

Choosen Transceivers • Vitesse: RGMII, GMII • Marvell: RGMII, GMII, SGMII • Lantiq: (R)GMII, RMII, SGMII the property Astriumofproperty [Ltd/SAS/GmbH] the and is st This This itsand document contentis

10 May 2017 7 Confidential PHY testing concept tten consent of Astrium [Ltd/SAS/GmbH]. ted to any ted any third towithout party the wri rictly confidential. It shall not be communica be not shall It confidential. rictly the property Astriumofproperty [Ltd/SAS/GmbH] the and is st This This itsand document contentis

10 May 2017 8 Confidential PHY testing realisation

PHY DUT Control/Configuration • Control and status registers for the tten consent of Astrium [Ltd/SAS/GmbH]. EGSE implemented in the SF2 FPGA • EGSE software can execute read/write accesses to internal PHY registers • FPGA provides a register to reset PHY

ted to any ted any third towithout party the wri (after power on/after error)

PHY DUT (G)MII Loop • No need for an Ethernet MAC controller

rictly confidential. It shall not be communica be not shall It confidential. rictly • Replaced by a simple loop inside FPGA the property Astriumofproperty [Ltd/SAS/GmbH] the and is st This This itsand document contentis

10 May 2017 9 Confidential PCB Motherboards: PHY DUT

tten consent of Astrium [Ltd/SAS/GmbH]. Packaging and Integration VITESSEMARVELL LANTIQ • Transceivers have different packages, baseline is Quad Flat No-leads (QFN).

ted to any ted any third towithout party the wri 135 QFN, 96a QFN double row, 48QFN • QFN multi row is difficult to solder, but Airbus took the challenge. • A total of approx. 120 PHY DUT boards were rictly confidential. It shall not be communica be not shall It confidential. rictly manufactured, in two iterations. the property Astriumofproperty [Ltd/SAS/GmbH] the and is st This This itsand document contentis

10 May 2017 10 Confidential PCB Motherboards: PHY DUT Highlight

Substrate heating tten consent of Astrium [Ltd/SAS/GmbH]. • To make possible the life testing and the Single Event Latchup Testing which have to be conducted at high temperatures, the DUTs have a substrate heating. ted to any ted any third towithout party the wri • Thermal Ring inhibits the heat propagation. • Presented at RADECS 2016 at the Airbus booth, the image taken with a FLIR camera rictly confidential. It shall not be communica be not shall It confidential. rictly the property Astriumofproperty [Ltd/SAS/GmbH] the and is st This This itsand document contentis

10 May 2017 11 Confidential PCB Motherboards: PHY DUT Highlight tten consent of Astrium [Ltd/SAS/GmbH]. ted to any ted any third towithout party the wri rictly confidential. It shall not be communica be not shall It confidential. rictly the property Astriumofproperty [Ltd/SAS/GmbH] the and is st This This itsand document contentis

10 May 2017 12 Confidential Motherboards: PHY Base

Magnetics and redesign

tten consent of Astrium [Ltd/SAS/GmbH]. • For the first boards, the Vitesse transceivers did not send/receive packets at 1Gb/s while Lantiq did not send/receive any packets.

ted to any ted any third towithout party the wri • Very fine design details matter! LAN socket deployed an integrated 8 core module, Vitesse recommends no integrated module, but instead a discrete socket with 12 core magnetics plus other small differences to the design. rictly confidential. It shall not be communica be not shall It confidential. rictly the property Astriumofproperty [Ltd/SAS/GmbH] the and is st This This itsand document contentis

10 May 2017 13 Confidential Data acquisition

Software architecture needed more layers in order to perform the communication with PHY DUTs: tten consent of Astrium [Ltd/SAS/GmbH]. • Colasoft Network package builder sends custom network packets to PHYs. • Wireshark reads/analyzes pcap logfiles containing network packets sent/reflected by PHY. • PHY is configured via the MDIO interface and controll over all registers . MONITOR & CONTROL ted to any ted any third towithout party the wri

MDIO LAN2 FPGA Labview Buffer

rictly confidential. It shall not be communica be not shall It confidential. rictly MDIO/LAN

Laptop DATA FLOW

PHY PHY Colasoft LAN1 (G)MIRX

the property Astriumofproperty [Ltd/SAS/GmbH] the and is st FPGA Loop Wireshark TX

Laptop This This itsand document contentis

10 May 2017 14 Confidential Data acquisition

Software architecture tten consent of Astrium [Ltd/SAS/GmbH]. • Wireshark stores the captured packets locally on the laptop. • Files are processed offline by the Labview Data Evaluation Application ted to any ted any third towithout party the wri rictly confidential. It shall not be communica be not shall It confidential. rictly the property Astriumofproperty [Ltd/SAS/GmbH] the and is st This This itsand document contentis

10 May 2017 15 Confidential Environmental Tests

tten consent of Astrium [Ltd/SAS/GmbH]. • Vacuum testing

• Thermal testing ted to any ted any third towithout party the wri • Outgassing test in accordance with ECSS-Q-70-02C

• Offgassing test in accordance with ECSS-Q-70-29C rictly confidential. It shall not be communica be not shall It confidential. rictly

• ESD Testing

• Life testing the property Astriumofproperty [Ltd/SAS/GmbH] the and is st

• Radiation (Total Ionising Dose, Heavy Ions, Protons) This This itsand document contentis

10 May 2017 16 Confidential Vacuum Testing tten consent of Astrium [Ltd/SAS/GmbH]. ted to any ted any third towithout party the wri rictly confidential. It shall not be communica be not shall It confidential. rictly

Thermocouples: Type T IEC 584-3 Specified for: -40°C < T < 125°C Tolerance: +/- 0,004*T Test T = 55°C +/- 0,22 °C the property Astriumofproperty [Ltd/SAS/GmbH] the and is st P = 1E-5 mbar

Thermocouples (TC) were attached to the upper part of the

This This itsand document contentis small plates Each group has got 1 TC.

10 May 2017 17 Confidential

Vacuum Testing PHY TV-Test

TC1 TC2 TC3 TC4 Vac 70.0 1.0E+01 tten consent of Astrium [Ltd/SAS/GmbH]. 60.0 1.0E+00

50.0 1.0E-01 ted to any ted any third towithout party the wri

40.0 1.0E-02

30.0 1.0E-03 rictly confidential. It shall not be communica be not shall It confidential. rictly Pressure [hPa] Temperature [°C] Temperature 20.0 1.0E-04

10.0 1.0E-05

the property Astriumofproperty [Ltd/SAS/GmbH] the and is st 0.0 1.0E-06 0.0 5.0 10.0 15.0 20.0 25.0 Test-Time [h] There is no indication on the offgasing during the test, because there is no spike in the pressure. This This itsand document contentis All parts were inspected after the test and showed no deterioration. All parts passed the test.

10 May 2017 18 Confidential Outgassing

Test conditions ECSS-Q-ST-70-29C tten consent of Astrium [Ltd/SAS/GmbH]. • T = 125°C P = 1E-5 mbar • Duration 72 hours • Conduction: Airbus DS certified laboratory ted to any ted any third towithout party the wri Parameters measured • Total Mass Loss (TML) • Recovered Mass Loss (RML) • Water Vapour Regained • Collected Vollatile Condensed rictly confidential. It shall not be communica be not shall It confidential. rictly Material (CVC)

Samples • 13 from each supplier necessary to Results reach the critical mass • All measured parameters smaller the property Astriumofproperty [Ltd/SAS/GmbH] the and is st Vitesse/Marvell/Lantiq than the limits given in the standard • All manufacturers compliant This This itsand document contentis

10 May 2017 19 Confidential Offgassing

Test conditions ECSS-Q-ST-70-02C tten consent of Astrium [Ltd/SAS/GmbH]. • T = 50°C, N2 atmosphere • Duration 72 hours • Samples are subjected to air flow and offgased substances will be coolled

ted to any ted any third towithout party the wri down to 25°C and adsorbed on tubes • Analysis of chromatograms • Conduction: Bremen Environmental Institute CAS-Nr. Substance Test chamber SMAC Mass PSC T ind Parameters measured concentration rictly confidential. It shall not be communica be not shall It confidential. rictly •Carbon monoxide [µg/m³] [µg/m³] [µg] [µg/m³] •Volatile organic compounds 630-08-0 Carbon monoxide 49 63.000 0,0691 6,9E-04 1,1E-08 74-82-8 methane n.d. 3.500.000 ------•Mass 110-54-3 n-Hexane 44 176.000 0,0620 6,2E-04 3,5E-09 •Projected Spacecraft concentration 38640-62-9 Diisopropyl naphthaline 22 100 0,0310 3,1E-04 3,1E-06 84-69-5 Diisobutyl phthalate 7 100 0,0099 9,9E-05 9,9E-07 •Individual Toxicity Value 124-19-6 n-Nonanal 16 29.000 0,0226 2,3E-04 7,8E-09 64-19-7 Acetic acid 14 7.400 0,0197 2,0E-04 2,7E-08 the property Astriumofproperty [Ltd/SAS/GmbH] the and is st Samples 541-05-9 D3 (Hexamethylcyclotrisiloxan) 64 90.000 0,0902 9,0E-04 1,0E-08 • 8 from each supplier 556-67-2 D4 (Octamethylcyclotetrasiloxan) 51 280.000 0,0113 1,1E-04 4,0E-10 various Sum N-aromatic compound 8 100 0,0113 1,1E-04 1,1E-06 Results

This This itsand document contentis • T-value = Sum (T ind) < 0,5 • All manufacturers compliant

10 May 2017 20 Confidential Electrostatic discharge testing

Test conditions • The spark generator 2000 V pulse tten consent of Astrium [Ltd/SAS/GmbH]. • Pulse repetition rate 1, 5, 10 Hz • Test duration per test condition 5 min • Data rate: 100MB/s, 1Gb/s ted to any ted any third towithout party the wri • Conduction:ESA certified Airbus DS EMI laboratory • Standard: Columbus EMC and Power Quality Requirements, COL- ESA-RQ-014, Issue 2, Rev. E,

rictly confidential. It shall not be communica be not shall It confidential. rictly 10.12.2001 Parameters measured • PHY Functionality (packets sent/received) • Current consumption Samples • 3 from each supplier the property Astriumofproperty [Ltd/SAS/GmbH] the and is st Results • All samples fully functional at all repetition rates and both data rates This This itsand document contentis

10 May 2017 21 Confidential Life testing

Test conditions • Substrate heating T = 115°C tten consent of Astrium [Ltd/SAS/GmbH]. • Test duration: 1000 hours • Data rate: 100MB/s, 1Gb/s • Conduction: Airbus DS Space Laboratory temperature & humidity ted to any ted any third towithout party the wri controlled Parameters measured • PHY Functionality (packets sent/received) • Current consumption rictly confidential. It shall not be communica be not shall It confidential. rictly • RX Clock period for both datarates • Data to Clock delay for both datarates • Parameters analyzed once per day Samples

the property Astriumofproperty [Ltd/SAS/GmbH] the and is st • 3 from each supplier Results • All samples fully functional at all both data rates This This itsand document contentis

10 May 2017 22 Confidential Life testing results tten consent of Astrium [Ltd/SAS/GmbH]. ted to any ted any third towithout party the wri rictly confidential. It shall not be communica be not shall It confidential. rictly the property Astriumofproperty [Ltd/SAS/GmbH] the and is st This This itsand document contentis

10 May 2017 23 Confidential Life testing results tten consent of Astrium [Ltd/SAS/GmbH]. ted to any ted any third towithout party the wri rictly confidential. It shall not be communica be not shall It confidential. rictly the property Astriumofproperty [Ltd/SAS/GmbH] the and is st This This itsand document contentis

10 May 2017 24 Confidential Total Ionising Dose

Test conditions • 60Co source Activity(02.2016)= 47Tbq tten consent of Astrium [Ltd/SAS/GmbH]. • Four irradiation steps: 6.5 krad, 13 krad, 27 krad, 50 krad • Average dose rate 309.5 rad/h • Data rate: 100MB/s, 1Gb/s ted to any ted any third towithout party the wri • All samples biased • Conduction: ESA/ESTEC 60Co laboratory • ESCC 22900 Specification

Parameters measured

rictly confidential. It shall not be communica be not shall It confidential. rictly • PHY Functionality (packets sent/received) • Current consumption • RX Clock period for both datarates • Data to Clock delay for both datarates • Parameters measured after each the property Astriumofproperty [Ltd/SAS/GmbH] the and is st irradiation step and after annealing This This itsand document contentis

10 May 2017 25 Confidential Total Ionising Dose: Key Results

Pretest in ESTEC 0 krad Test after 6.5 krad Test after 50 krad

o tten consent of Astrium [Ltd/SAS/GmbH]. Test after 13 krad Pretest in Bremen 0 krad Test after 163 h annealing in 100 C Test after 27.3 krad

240 Marvell 2.5V 220 ted to any ted any third towithout party the wri 200

180

160 Vitesse 1V

140 rictly confidential. It shall not be communica be not shall It confidential. rictly

Current [mA] 120

100

80 Vitesse 2.5V

60 Marvell 1V the property Astriumofproperty [Ltd/SAS/GmbH] the and is st

Feb 18 Feb 21 Feb 24 Feb 27 Mar 1 Mar 4 Mar 7 Date This This itsand document contentis

10 May 2017 26 Confidential Total Ionising Dose: Key Results

Marvell RX Clock 100Mb/s Vitesse RX Clock 1Gb/s tten consent of Astrium [Ltd/SAS/GmbH]. ted to any ted any third towithout party the wri rictly confidential. It shall not be communica be not shall It confidential. rictly the property Astriumofproperty [Ltd/SAS/GmbH] the and is st

No parametric nor functional failures observed. The parts can withstand at least 50 krad(Si). This This itsand document contentis

10 May 2017 27 Confidential Single Event Effects Testing: Delidding

Problems encountered •Copper wires instead of gold (typical COTS) tten consent of Astrium [Ltd/SAS/GmbH]. •3:1 HNO3:H2SO4 6:1 HNO3:H2SO4 ted to any ted any third towithout party the wri rictly confidential. It shall not be communica be not shall It confidential. rictly

Problem solved • ESTEC QEC Laboratory the property Astriumofproperty [Ltd/SAS/GmbH] the and is st • Special thanks to Alessandra Costantino • Combination of milling & chemistry This This itsand document contentis

10 May 2017 28 Confidential Single Event Effects Testing

Test conditions • 9.3 MeV/u ion cocktail tten consent of Astrium [Ltd/SAS/GmbH]. • LET = 1.8, 10.2, 18.5, 32 and 60 MeVcm2/mg • SEL T = 125°C SEU T = 25°C • Fluence: 2E6-1E7 particles/cm2 ted to any ted any third towithout party the wri • Data rate: 100MB/s, 1Gb/s • Conduction: RADEF K130 cyclotron

Parameters measured

rictly confidential. It shall not be communica be not shall It confidential. rictly • PHY Functionality (packets sent/received) • Current consumption • Number of errors: Data loss, Functional interrupts, Link loss, Latchup events • Parameters during each run and the property Astriumofproperty [Ltd/SAS/GmbH] the and is st stored electronically This This itsand document contentis

10 May 2017 29 Confidential Single Event Effects Results

Marvell Vitesse tten consent of Astrium [Ltd/SAS/GmbH]. ted to any ted any third towithout party the wri rictly confidential. It shall not be communica be not shall It confidential. rictly the property Astriumofproperty [Ltd/SAS/GmbH] the and is st

•Vitesse has the lowest data loss rate, followed by Marvel. They do not display any latchup effect. •Lantiq exhibited latchup and a very high SEU rate. This This itsand document contentis

10 May 2017 30 Confidential Conclusion and Outlook

tten consent of Astrium [Ltd/SAS/GmbH]. •Twomanufacturers out of three have sucessfully qualified for space deployment.

• The transceivers market is extremely dynamic, triggered by the high demand from ted to any ted any third towithout party the wri the automotive industry: Vitesse aquired by Microsemi and Lantiq acquired by Intel.

• Problems solved -integration of the transceivers with the QFN double row package rictly confidential. It shall not be communica be not shall It confidential. rictly -redesign of the PHY base to address the magnetics problem -substrate heating for the PHYs for life and radiation test, FPGA controlled -delidding for the Single Event Effects the property Astriumofproperty [Ltd/SAS/GmbH] the and is st • Transceivers could de deployed for future developments: Airbus internal next generation Open Modular Avionics Computer

This This itsand document contentis ESA GSTP Testbed and Reference End System

10 May 2017 31 Confidential GSTP Testbed and Reference End System

Development of a reference End System for TTE Testbed providing following capabilities: tten consent of Astrium [Ltd/SAS/GmbH]. • Based on Xilinx Virtex 5 VFX130T (QV replaceable) • Re-Use of • TRP ES IP Core

ted to any ted any third towithout party the wri • PHY selection driven by TRP PHY characterisation results • FLPP Switch maturation design experience • Host Interface: Space Wire, SPI and Ethernet • 3 redundant Time Triggered Ethernet Interfaces • Data emulation with LEON4 processor board rictly confidential. It shall not be communica be not shall It confidential. rictly • 3U form factor compatible to cPCI Serial „space“ backplane • ES driver development for PikeOS the property Astriumofproperty [Ltd/SAS/GmbH] the and is st This This itsand document contentis

32 Thank you for a nice collaboration and an interesting journey! Confidential Time Triggered Ethernet- Overview

1. TTEthernet is based on the well-established IEEE 802.3 Ethernet with all of advantages (i.e. 1Gbps speed, availability of know-how) tten consent of Astrium [Ltd/SAS/GmbH]. 2. Determinism of the network traffic -> communication is time-bounded, time properties of traffic are known 3. One common network for transmitting mixed-criticality data

ted to any ted any third towithout party the wri -> i.e. control, TM&TC, scientific data 4. Three traffic classes implemented into the same network: • IEEE 802.3 Ethernet traffic (Best-Effort), • AFDX (ARINC 664 P7) Rate-Constrained traffic, introduction of VLs rictly confidential. It shall not be communica be not shall It confidential. rictly • SAE AS6802 Time-Triggered traffic. 5. Three physical ports, triplication of data paths. The (PHY) is a building block of the TTEthernet.

PHY Port #1 Data Path #1 the property Astriumofproperty [Ltd/SAS/GmbH] the and is st TTEthernet Card PHY Port #2 Data Path #2

PHY Port #3 Data Path #3 This This itsand document contentis

10 May 2017 34 Confidential Time Triggered Ethernet- Overview

6. Tight time synchronization with division of role (Synchronization Master, Compression Master, Synchronization Client). tten consent of Astrium [Ltd/SAS/GmbH]. 7. Redundant architecture by design of the network: ted to any ted any third towithout party the wri rictly confidential. It shall not be communica be not shall It confidential. rictly

the property Astriumofproperty [Ltd/SAS/GmbH] the and is st -TTEthernet can be regarded as a successor of MIL-STD-1553 in certain critical applications, e.g. Human Spaceflight. This This itsand document contentis

10 May 2017 35