Digital Communication Systems ECS 452

Asst. Prof. Dr. Prapun Suksompong (ผศ.ดร.ประพันธ ์ สขสมปองุ ) [email protected] 1. Intro to Digital Communication Systems Office Hours: BKD, 4th floor of Sirindhralai building Monday 14:00-16:00 Thursday 10:30-11:30

1 Friday 14:00-15:00 “The fundamental problem of communication is that of reproducing at one point either exactly or approximately a message selected at another point.”

Shannon, Claude. A Mathematical Theory Of Communication. (1948)

2 Shannon: Father of the Info. Age

 Documentary  Co-produced by the Jacobs School, UCSD-TV, and the California Institute for Telecommunications and Information Technology  Won a Gold award in the Biography category in the 2002 Aurora Awards.

3 [http://www.uctv.tv/shows/Claude-Shannon-Father-of-the-Information-Age-6090] [http://www.youtube.com/watch?v=z2Whj_nL-x8] C. E. Shannon (1916-2001)  1938 MIT master's thesis: A Symbolic Analysis of Relay and Switching Circuits  Insight: The binary nature of Boolean logic was analogous to the ones and zeros used by digital circuits.  The thesis became the foundation of practical digital circuit design.  The first known use of the term bit to refer to a “binary digit.”  Possibly the most important, and also the most famous, master’s thesis of the century.  It was simple, elegant, and important.

4 C. E. Shannon: Master Thesis

5 An Interesting Book  The Logician and the Engineer: How George Boole and Created the Information Age  by Paul J. Nahin  ISBN: 9780691151007  http://press.princeton.edu/titles/ 9819.html

6 C. E. Shannon (Con’t)  1948: A Mathematical Theory of Communication  Bell System Technical Journal, vol. 27, pp. 379-423, July- October, 1948.  September 1949: Book published. Include a new section by Warren Weaver that applied Shannon's theory to  Invent Information Theory: human communication. Simultaneously founded the subject, introduced all of the  Create the architecture and major concepts, and stated and concepts governing digital proved all the fundamental communication. theorems. 7 A Mathematical Theory of Communication  Link posted in the “references” section of the website.

8 [An offprint from the Bell System Technical Journal] C. E. Shannon

9 …with some remarks by . Claude E. Shannon Award

Claude E. Shannon (1972) Elwyn R. Berlekamp (1993) Sergio Verdu (2007) David S. Slepian (1974) Aaron D. Wyner (1994) Robert M. Gray (2008) Robert M. Fano (1976) G. David Forney, Jr. (1995) (2009) (1977) Imre Csiszár (1996) (2010) Mark S. Pinsker (1978) (1997) (Shitz) (2011) (1979) Neil J. A. Sloane (1998) (2012) W. Wesley Peterson (1981) Tadao Kasami (1999) (2013) Irving S. Reed (1982) (2000) János Körner (2014) Robert G. Gallager (1983) Jack KeilWolf (2001) Arthur (2015) Solomon W. Golomb (1985) Toby Berger (2002) William L. Root (1986) Lloyd R. Welch (2003) James L. Massey (1988) Robert J. McEliece (2004) Thomas M. Cover (1990) (2005) Andrew J. Viterbi (1991) (2006)

10 [http://www.ieee.org/documents/hamming_rl.pdf] IEEE Richard W. Hamming Medal

1988 - Richard W. Hamming 2002 - Peter Elias 1989 - Irving S. Reed 2003 - Claude Berrou and Alain Glavieux 1990 - Dennis M. Ritchie and Kenneth L. 2004 - Jack K. Wolf Thompson 2005 - Neil J.A. Sloane 1991 - Elwyn R. Berlekamp 2006 -Vladimir I. Levenshtein 1992 - Lotfi A. Zadeh 2007 - Abraham Lempel 1993 - Jorma J. Rissanen 2008 - Sergio Verdú 1994 - 2009 - Peter Franaszek 1995 - Jacob Ziv 2010 -Whitfield Diffie, Martin Hellman 1996 - Mark S. Pinsker and Ralph Merkle 1997 -Thomas M. Cover 2011 -Toby Berger 1998 - David D. Clark 2012 - Michael Luby, Amin Shokrollahi 1999 - David A. Huffman 2013 - Arthur Robert Calderbank 2000 - Solomon W. Golomb 2014 -Thomas Richardson and Rüdiger L. 2001 - A. G. Fraser Urbanke

“For contributions to Information Theory, including 11 source coding and its applications.” [http://www.cvaieee.org/html/toby_berger.html] Information Theory The science of information theory tackles the following questions [Berger] 1. What is information, i.e., how do we measure it quantitatively? 2. What factors limit the reliability with which information generated at one point can be reproduced at another, and what are the resulting limits? 3. How should communication systems be designed in order to achieve or at least to approach these limits?

12 Elements of communication sys.

Transmitted Received Message Message Signal Signal Information Transmitter Channel Receiver Destination Source

Noise Source

13 Elements of digital commu. sys.

Message Transmitter

Information Source Channel Digital Source Encoder Encoder Modulator Transmitted Signal

Channel Interference

&

Noise Recovered Message Receiver Received Signal Source Channel Digital Destination Decoder Decoder Demodulator

14 Digital Communication Binary data stream (sequence of data) without meaning (from channel viewpoint). Waveform  sequence  symbols  bits Take the bits from one place to another. Input Source 010100 Channel Encoder Encoder

Know the probabilistic + noise & interference structure of the input source. Channel Binary Interface

Output Source 010100 Channel Decoder Decoder

15 This is the major layering of all digital communication systems. Pokémon Communications

16 Army of Pikachus

[http://geekologie.com/2014/08/what-the-army-of-pikachus-prepare-for-ba.php] [http://www.youtube.com/watch?v=U9VkRwpFvwU] 17 [http://www.youtube.com/watch?v=CORtvPujuqg] Pikachu's language

 Some of Pikachu's speech is consistent enough that it seems that some phrases actually mean something.  Pikachu always uses "Pikapi" when referring to Ash (notice that it sounds somewhat similar to "Satoshi").  Pi-Kachu: He says this during the sponsor spots in the original Japanese, Pochama (Piplup)  Pikachu-Pi: Kasumi (Misty)  Pika-Chu: Takeshi (Brock), Kibago (Axew)  Pikaka: Hikari (Dawn)  PiPiPi: Togepy (Togepi)  PikakaPika: Fushigidane (Bulbasaur)  PikaPika: Zenigame (Squirtle), Mukuhawk (Staraptor), Goukazaru (Infernape) or Gamagaru (Palpitoad)  PiPi-kachu: Rocket-dan (Team Rocket)  Pi-Pikachu: Get da ze! (He says this after Ash wins a Badge, catches a new Pokémon or anything similar.)  Pikachu may not be the only one to use this phrase, as other Pokémon do this as well. For example, when Iris caught Emolga, Axew said Ax-Axew (Ki-Kibago in the Japanese).  Pika-Pikachu: He says this when referring to himself.  Four-symbol variable-length code?

18 Rate-Distortion Theory  The theory of lossy source coding

19