1 Coding theory for scalable media delivery Michael Luby RaptorQ is a product of Qualcomm Technologies, Inc. Application layer erasure coding complements traditional error coding Forward Error Correction Technology “Error Coding” “Erasure Coding” Protects against Protects against Data Lost Data Corruption in Transmission • Vast majority of current use of FEC • Commercial application relatively new • Probably what you’re familiar with • Applied above layer 2 • Typically applied at layers 1 or 2 • Complement to Error Coding • Usually performed in hardware • Typically performed in software • PHY-FEC (physical layer FEC) • AL-FEC (application layer FEC) 3 Packet transmission Packet payload Packet header Stream of packets Received corrupted packet is discarded Can identify received packet payloads from packet headers 4 Application Layer erasure codes Source data Erasure encode Packetize Transmit Depacketize Erasure decode Source data 5 AL-FEC and PHY-FEC are complementary AL-FEC Packet loss protection over small to large block Flexible time diversity Flexible amount of protection Flexible time diversity – from sub-second to hours Time Fixed time diversity – e.g., < 1 second PHY-FEC Correct or discard corrupted packet data over small block Fixed time diversity Fixed amount of protection 6 AL-FEC and PHY-FEC working together PHY-FEC corrects noise and interference AL-FEC “interleaves” and corrects erasures − Longer block length (“interleavers”) è better performance AL-FEC CR = 0.8 Source block 4.3 Mbit/s p=0% AL-FEC Decoding PHY-FEC works Source block Repair 16QAM CR = 1/3 5.3 Mbit/s PHY-FEC p=14% fails 7 What is a fountain code? Ø Generate as much encoding as desired Ø Recover source from the minimal possible encoding Ø It doesn’t matter what is received or lost Ø It only matters that enough is received 8 Fountain codes – erasure codes without a rate Source data Erasure encode Encoded data Ø Fountain codes have no predetermined rate Ø For fountain codes, for a fixed source data size Ø Erasure code design is extendable to provide any code rate Ø All code rates use the same extendable erasure code design Ø Particular encoded symbols are generated independently of one another Ø Number of encoded symbols that can be generated on the fly is unconstrained 9 LT encoding A B C D E Source block Degree Prob 1 0.01 2 0.50 3 0.17 Degree Distribution 4 0.08 10 LT encoding A B C D E Source block Choose 2 random source symbols Choose degree = 2 XOR source B+D symbols Insert header, and send Degree Prob 1 0.01 2 0.50 3 0.17 Degree Distribution 4 0.08 11 LT encoding A B C D E Source block Choose 1 random source symbol Choose degree = 1 Copy source C symbol Insert header, and send Degree Prob 1 0.01 2 0.50 3 0.17 Degree Distribution 4 0.08 12 LT encoding A B C D E Source block Choose 4 random source symbols Choose degree = 4 XOR source B+C+D+E symbols Insert header, and send Degree Prob 1 0.01 2 0.50 3 0.17 Degree Distribution 4 0.08 13 Belief propagation decoding Source Block (unknown) Collect enough encoded symbols and set up graph between encoded symbols and source symbols to be decoded 14 Belief propagation decoding Source Block Identify encoded symbol with one unrecovered neighbor STOP if none exists 15 Belief propagation decoding B Source Block Unrecovered source symbol value is the value of all recovered neighbors XORed into the encoded symbol value 16 Belief propagation decoding B Source Block Identify encoded symbol with one unrecovered neighbor STOP if none exists 17 Belief propagation decoding B H Source Block Unrecovered source symbol value is the value of all recovered neighbors XORed into the encoded symbol value 18 Belief propagation decoding B H Source Block Identify encoded symbol with one unrecovered neighbor STOP if none exists 19 Belief propagation decoding B D H Source Block Unrecovered source symbol value is the value of all recovered neighbors XORed into the encoded symbol value 20 Belief propagation decoding A B C D E F G H Source Block (recovered) 21 Intuition for Soliton degree distribution Consider a symbol of degree d − Releases when exactly 1 of its d neighbors remains unrecovered − Degree d releases when 1/d fraction of the symbols remain to be decoded A probability distribution on degrees so release distribution is uniform − p(d) “covers” the interval 1/(d-1) to 1/d of the uniform distribution 1 − Length of interval 1/(d-1) to 1/d is − For d = 2, 3, … d ⋅(d −1) 1 p(d) = d ⋅(d −1) 1 1/2 1/3 1/4 1/5 1/6 p(2) p(3) p(4) p(5) p(6) 22 Choosing from Soliton distribution y ∈R [0,1] ' "1$ 1 ) # % if y ≥ ) # y% k d = ( ) 1 ) 1 if y < * k 23 Raptor codes in standards Ø Raptor codes (IETF RFC 5053, 3GPP, DVB, ITU, ATIS) Ø Systematic fountain codes Ø Linear time encoding and decoding Ø Standardized – 3GPP MBMS, DVB-H IPDC Ø Good recovery properties – like a random code over GF(2) Ø Good flexibility Ø Up to 8,192 source symbols Ø Up to 65,384 source + repair symbols Ø RaptorQ codes (IETF RFC 6330) Ø Systematic fountain codes Ø Linear time encoding and decoding Ø Great recovery properties – like a random code over GF(256) Ø Great flexibility Ø Up to 56,403 source symbols Ø Up to 16,777,216 source + repair symbols (essentially unlimited) 24 Major technical features (first appearance) LT code (Raptor RFC 5053) − fountain property Pre-coding (Raptor RFC 5053) − linear time Inactivation decoding (Raptor RFC 5053) − linear time Systematic construction (Raptor RFC 5053) − encoding includes original source Larger finite fields (RaptorQ RFC 6330) − reduced reception overhead Permanent inactivations (RaptorQ RFC 6330) − reduced reception overhead 25 Raptor codes computational complexity 1000 Reed-Solomon encoding/decoding 100 Raptor encoding/decoding 10 1 0.0% 2.0% 4.0% 6.0% 8.0% 10.0% 12.0% maximum packet loss Symbol operations per output symbol operations Symbol RS encoding (n=255) RS decoding (n=255) Raptor encoding Raptor decoding In comparison to other typical alternative FEC technologies, Raptor codes are an order of magnitude or more less complex 26 Raptor codes overhead 10-0 Raptor code (IETF RFC 5053) RaptorQ code (IETF RFC 6330) -1 Probability decoding fails Probability 10 • k = number of source symbols in source block • Valid for all supported values of k 10-2 • Valid for all loss probabilities: 1% to 99% 10-3 10-4 10-5 10-6 0 2 4 6 8 10 12 14 16 18 20 22 24 Number of encoded symbols received beyond k 27 IETF RMT Broadcast/Multicast Object Delivery Suite Framework and packet format Reliability using FEC codes Congestion control LCT BB FEC BB WEBRC BB RFC 5651 RFC 5052 RFC 3738 RaptorQ Raptor RFC 6330 RFC 5053 FEC INFO ALC PI Reliable object delivery RFC 3453 RFC 5775 protocol instantiation BB FRAME RFC 3048 BULK DATA FLUTE Unidirectional broadcast/multicast RFC 2887 RFC 3926 reliable file delivery 28 3GPP LTE Broadcast (eMBMS) Service Layer LTE Broadcast HTTP Adaptive Reliable object delivery using FEC codes Video streaming delivery Streaming IETF RMT Suite FLUTE, ALC PI, LCT BB, FEC BB, MPEG-DASH Suite Raptor MPEG-DASH Suite HTTP 1.1 Broadcast file delivery services Broadcast streaming services 29 Why Fountain codes? Some applications that you may (not) have thought about RaptorQ is a product of Qualcomm Technologies, Inc. 30 Mobile File Delivery Services Over Cellular Network LTE broadcast (eMBMS) Challenge: reliable file delivery to mobile devices Applications: • Streaming • Delivery of popular content • Media • Games Receivers • Millions of mobile devices Servers 31 LTE broadcast offload service for HTTP ONLY broadcast repair symbols Device Content (10 source symbols) Receive less10 symbolsthan 10 symbols Decode Decoding not possible 32 File download completion using HTTP 1.1 byte range requests Origin Server On Demand Caching HTTP edge cache server Request 5 symbol prefix of content Request 1 symbol prefix of content Request 3 symbol prefix of content Device 1 Device 2 Device 3 Received Decode5 repair symbols Received Decode9 repair symbols Received Decode7 repair symbols Need 5 additional symbols to decode Need 1 additional symbol to decode Need 3 additional symbols to decode 33 LTE broadcast offload service for HTTP 10 symbols ONLY broadcast repair symbols Content package Media Media Media content A content B content C 30 symbols total Device 1 Device 2 Device 3 Decode Decode Decode Media Media Media Media Media Media Media Media Media content A content B content C content A content B content C content A content B content C 34 Just-in-Time recovery LTE broadcast data stored directly on the SD card − Original multimedia data is never stored on the SD card − SD card stores one copy of file – not two! Multimedia content available immediately after reception − Avoids FEC decode post-processing of file after reception Just-in-Time recovery − Based on user actions – player requests data to playback multimedia content − Relevant data read from SD card, FEC decoded, provided directly to player − Trick play response time − Playback starts after one sub-block of data read from SD card and FEC decoded − Size of sub-block and decode speed determines the response time 35 Just-in-Time recovery Receiver SD card LTE broadcast Write encoded interleaved RAM data as received Read sub-block encoded data to RaptorQ decode and playback requested media in real-time Request playback of media Playback of requested media Player Just-in-Time recovery avoids costly post-processing Portions of multimedia never played back are never processed Storage usage is minimized – avoids double the writes to SD card 36 Just-in-Time recovery advantages Good user experience