The Impact of Imperfect Feedback on the Capacity of Wireless Networks

Total Page:16

File Type:pdf, Size:1020Kb

The Impact of Imperfect Feedback on the Capacity of Wireless Networks THE IMPACT OF IMPERFECT FEEDBACK ON THE CAPACITY OF WIRELESS NETWORKS A Dissertation Presented to the Faculty of the Graduate School of Cornell University in Partial Fulfillment of the Requirements for the Degree of Doctor of Philosophy by Alireza Vahid January 2015 c 2015 Alireza Vahid ALL RIGHTS RESERVED THE IMPACT OF IMPERFECT FEEDBACK ON THE CAPACITY OF WIRELESS NETWORKS Alireza Vahid, Ph.D. Cornell University 2015 The defining metric for any wireless communication network is the maximum reliable data rate, also known as capacity. Before any data bit can be commu- nicated over a wireless channel, information about the network state such as connectivity, channel statistics, or channel gains, is required. Receiver nodes feed such information back to other wireless nodes using feedback channels and feedback mechanisms. Considering the role of feedback makes the char- acterization of the network capacity a daunting theoretical task. As a result, researchers have overwhelmingly simplified the feedback channels to come up with tractable models. Specifically, it has commonly been assumed that feed- back channel has infinite capacity and has no delay. While these assumptions could be justified for small, static, or slow-fading networks, they are not viable in the context of large-scale, mobile, or fast-fading wireless networks. In fact, feedback channel is low-rate, unreliable, scarce, and is subject to delay. The recent dramatic increase in wireless data traffic, caused by the success of on- line media streaming and the proliferation of smart phones and tablets, obliges researchers to understand the capacity of large-scale mobile networks. Thus, given the limited, scarce nature of feedback channels, future progress in wire- less data communications crucially depends on a deeper understanding of the impact of feedback on the capacity of wireless networks. In this work, we aim to adjust the assumptions on feedback channels in a way to open doors to better understanding of real world, large-scale wire- less networks. In particular, wireless networks are considered with rate-limited feedback links, with outdated channel state information, and with local views of the network state. BIOGRAPHICAL SKETCH Alireza Vahid received the B.Sc. degree in Electrical Engineering from Sharif University of Technology, Tehran, Iran, in 2009, and the M.Sc. degree in Elec- trical and Computer Engineering from Cornell University, Ithaca, NY, in 2012. As of September 2014, he is a postdoctoral scholar at Information Initiative at Duke University (iiD), Durham, NC. His research interests include information theory and wireless communications, statistics and machine learning. He has received the Director’s Ph.D. Teaching Assistant Award in 2010 from the school of electrical and computer engineering, Cornell University, and Ja- cobs Scholar Fellowship in 2009. He has also received Qualcomm Innovation Fellowship in 2013 for his research on “Collaborative Interference Manage- ment.” He was ranked second among more than 450000 participant in Iranian National Entrance Exam 2004. iii To my beloved family, Mohammad Bagher, Simin, Sara, and Sina. iv ACKNOWLEDGEMENTS I would like to express my most sincere gratitude to my advisor, Professor Salman Avestimehr for his unconditional support of my research. Not only did he teach me how to conduct research, he also helped me pick problems of sig- nificant importance. I have truly learned from his unique style of research and presentation. His dedication to his work and his students has always been a source of inspiration to me, and his immense enthusiasm even after so many achievements has always surprised me. I would like to thank my PhD committee members, Professor Lang Tong and Professor Stephen Wicker for their valuable comments and their guidance. I have gained valuable insights from them. As a student, I have also learned significant amount of knowledge in the courses they presented. I would also like to thank Dr. Mohammad Ali Maddah-Ali for sharing his knowledge and experience with me. I had an amazing experience working with him. It was through him that I learned the meaning of “thinking outside the box!” He truly does his best to provide his colleagues with the best support he can. He has exceptional knowledge of the field that has helped me a lot during the last two years of my PhD studies. I would also like to express my gratitude to Professor Ashutosh Sabharwal for his thoughtful comments and discussions throughout the joint projects. He is a great mentor and I have gathered priceless training from his style of writing and his thought process. I would like to thank Dr. Vaneet Aggarwal for his help and support during our collaboration. Not only is he a colleague to me, he is also a close friend. I am confident that our collaboration and friendship will go on. v Finally, I would like to extend my deepest gratitude, love and affection to my beloved family for always being there for, supporting me unconditionally, believing in me and wishing me the best. I owe every single one of my achieve- ments to them. vi TABLE OF CONTENTS Biographical Sketch . iii Dedication . iv Acknowledgements . .v Table of Contents . vii List of Tables . ix List of Figures . .x 1 Introduction 1 1.1 Motivation . .1 1.2 Prior Work . .4 1.3 Contributions . .6 2 Communication with Delayed Channel State Information 17 2.1 Introduction . 17 2.2 Problem Setting . 18 2.3 Statement of Main Results . 21 2.4 Overview of Key Ideas . 31 2.5 Achievability Proof of Theorem 2.2 [Delayed-CSIT] . 44 2.6 Converse Proof of Theorem 2.2 [Delayed-CSIT] . 60 2.7 Achievability Proof of Theorem 2.3 [Delayed-CSIT and OFB] . 63 2.8 Converse Proof of Theorem 2.3 [Delayed-CSIT and OFB] . 68 2.9 Achievability Proof of Theorem 2.4 [Instantaneous-CSIT and OFB] 71 2.10 Converse Proof of Theorem 2.4 [Instantaneous-CSIT and OFB] . 77 2.11 Extension to the Non-Homogeneous Setting . 79 2.12 Conclusion and Future Directions . 85 3 Capacity results for Gaussian Networks with Delayed Channel State Information 89 3.1 Introduction . 89 3.2 Problem Setting . 92 3.3 Statement of Main Result . 94 3.4 Achievability Proof of Theorem 3.1 . 98 3.5 Converse Proof of Theorem 3.1 . 105 3.6 Gap Analysis . 108 3.7 Extension to K-user MISO BC . 111 3.8 Conclusion and Future Directions . 119 4 Communication with Local Network Views 121 4.1 Introduction . 121 4.2 Problem Formulation . 124 4.3 Motivating Example . 130 4.4 An Algebraic Framework for Inter-Session Coding with Local View . 133 vii 4.5 Optimality of the Strategies . 142 4.6 Concluding Remarks . 164 5 Communication with Rate-Limited Feedback Links 166 5.1 Introduction . 166 5.2 Problem Formulation and Network Model . 168 5.3 Motivating Example . 173 5.4 Deterministic Interference Channel . 176 5.5 Linear Deterministic Interference Channel . 188 5.6 Gaussian Interference Channel . 193 5.7 Concluding Remarks . 214 A Chapter 1 of appendix 216 A.1 Achievability Proof of Theorem 2.1 [Instantaneous-CSIT] . 216 A.2 Converse Proof of Theorem 2.1 [Instantaneous-CSIT] . 229 A.3 Achievability Proof of Theorem 2.2: Sum-rate for 0 ≤ p < 0:5 ... 230 A.4 Achievability Proof of Theorem 2.2: Corner Point C ........ 236 A.5 Proof of Lemma 2.2 . 247 A.6 Achievability Proof of Theorem 2.3: Corner Point 1 − q2; 0 .... 249 B Chapter 2 of appendix 257 B.1 Lattice Quantizer . 257 B.2 Determining D such that RQ(D)=C2×1 ≤ 1 ............... 258 C Chapter 3 of appendix 260 C.1 Converse Proof for Case (2) of Theorem 4.2 . 260 C.2 Proof of Lemma 4.1 . 261 C.3 Proof of Lemma 4.2 . 263 D Chapter 4 of appendix 265 D.1 Proof of Theorem 5.2 . 265 D.2 Achievability Proof of Theorem 5.3 . 269 D.3 Proof of Theorem 5.4 . 273 D.4 Gap Analysis of Theorem 5.6 . 280 viii LIST OF TABLES 2.1 Illustration of our main results through an example in which p = 0:5..................................... 28 2.2 All possible channel realizations and transitions from the initial queue to other queues; solid arrow from tranmsitter Txi to re- ceiver Rx j indicates that Gi j[t] = 1, i; j 2 f1; 2g, t = 1; 2;:::; n. Bit “a” represents a bit in Q1!1 while bit “b” represents a bit in Q2!2. 88 A.1 Summary of Phase 1 for the Achievability Scheme of Corner Point B. Bit “a” represents a bit in Q1!1 while bit “b” represents a bit in Q2!2................................ 253 A.2 Summary of Phase 2 for the Achievability Scheme of Corner Point B. Bit “a” represents a bit in Q1;INT while bit “b” represents a bit in Q2;INT ............................... 254 A.3 Summary of Phase 1 for the Achievability Scheme of Corner Point C. Bit “a” represents a bit in Q1!1 while bit “b” represents a bit in Q2!2................................ 255 A.4 Summary of Phase 2 for the Achievability Scheme of Corner Point B. Bit “a” represents a bit in Q1;INT while bit “b” represents a bit in Q2;INT ............................... 256 ix LIST OF FIGURES 1.1 (a) The two-user binary fading interference channel, and (b) the capac- ity region for three architectures. ....................7 1.2 Two-user Multiple-Input Single-Output (MISO) Complex Gaus- sian Broadcast Channel. 10 1.3 Depiction of a typical scenario, where Nodes A and B have to rely on different partial views about the network to make their transmission decisions. ................................ 11 1.4 Illustration of two different model for network state at node N.
Recommended publications
  • Digital Communication Systems 2.2 Optimal Source Coding
    Digital Communication Systems EES 452 Asst. Prof. Dr. Prapun Suksompong [email protected] 2. Source Coding 2.2 Optimal Source Coding: Huffman Coding: Origin, Recipe, MATLAB Implementation 1 Examples of Prefix Codes Nonsingular Fixed-Length Code Shannon–Fano code Huffman Code 2 Prof. Robert Fano (1917-2016) Shannon Award (1976 ) Shannon–Fano Code Proposed in Shannon’s “A Mathematical Theory of Communication” in 1948 The method was attributed to Fano, who later published it as a technical report. Fano, R.M. (1949). “The transmission of information”. Technical Report No. 65. Cambridge (Mass.), USA: Research Laboratory of Electronics at MIT. Should not be confused with Shannon coding, the coding method used to prove Shannon's noiseless coding theorem, or with Shannon–Fano–Elias coding (also known as Elias coding), the precursor to arithmetic coding. 3 Claude E. Shannon Award Claude E. Shannon (1972) Elwyn R. Berlekamp (1993) Sergio Verdu (2007) David S. Slepian (1974) Aaron D. Wyner (1994) Robert M. Gray (2008) Robert M. Fano (1976) G. David Forney, Jr. (1995) Jorma Rissanen (2009) Peter Elias (1977) Imre Csiszár (1996) Te Sun Han (2010) Mark S. Pinsker (1978) Jacob Ziv (1997) Shlomo Shamai (Shitz) (2011) Jacob Wolfowitz (1979) Neil J. A. Sloane (1998) Abbas El Gamal (2012) W. Wesley Peterson (1981) Tadao Kasami (1999) Katalin Marton (2013) Irving S. Reed (1982) Thomas Kailath (2000) János Körner (2014) Robert G. Gallager (1983) Jack KeilWolf (2001) Arthur Robert Calderbank (2015) Solomon W. Golomb (1985) Toby Berger (2002) Alexander S. Holevo (2016) William L. Root (1986) Lloyd R. Welch (2003) David Tse (2017) James L.
    [Show full text]
  • Principles of Communications ECS 332
    Principles of Communications ECS 332 Asst. Prof. Dr. Prapun Suksompong (ผศ.ดร.ประพันธ ์ สขสมปองุ ) [email protected] 1. Intro to Communication Systems Office Hours: Check Google Calendar on the course website. Dr.Prapun’s Office: 6th floor of Sirindhralai building, 1 BKD 2 Remark 1 If the downloaded file crashed your device/browser, try another one posted on the course website: 3 Remark 2 There is also three more sections from the Appendices of the lecture notes: 4 Shannon's insight 5 “The fundamental problem of communication is that of reproducing at one point either exactly or approximately a message selected at another point.” Shannon, Claude. A Mathematical Theory Of Communication. (1948) 6 Shannon: Father of the Info. Age Documentary Co-produced by the Jacobs School, UCSD- TV, and the California Institute for Telecommunic ations and Information Technology 7 [http://www.uctv.tv/shows/Claude-Shannon-Father-of-the-Information-Age-6090] [http://www.youtube.com/watch?v=z2Whj_nL-x8] C. E. Shannon (1916-2001) Hello. I'm Claude Shannon a mathematician here at the Bell Telephone laboratories He didn't create the compact disc, the fax machine, digital wireless telephones Or mp3 files, but in 1948 Claude Shannon paved the way for all of them with the Basic theory underlying digital communications and storage he called it 8 information theory. C. E. Shannon (1916-2001) 9 https://www.youtube.com/watch?v=47ag2sXRDeU C. E. Shannon (1916-2001) One of the most influential minds of the 20th century yet when he died on February 24, 2001, Shannon was virtually unknown to the public at large 10 C.
    [Show full text]
  • IEEE Information Theory Society Newsletter
    IEEE Information Theory Society Newsletter Vol. 63, No. 3, September 2013 Editor: Tara Javidi ISSN 1059-2362 Editorial committee: Ioannis Kontoyiannis, Giuseppe Caire, Meir Feder, Tracey Ho, Joerg Kliewer, Anand Sarwate, Andy Singer, and Sergio Verdú Annual Awards Announced The main annual awards of the • 2013 IEEE Jack Keil Wolf ISIT IEEE Information Theory Society Student Paper Awards were were announced at the 2013 ISIT selected and announced at in Istanbul this summer. the banquet of the Istanbul • The 2014 Claude E. Shannon Symposium. The winners were Award goes to János Körner. the following: He will give the Shannon Lecture at the 2014 ISIT in 1) Mohammad H. Yassaee, for Hawaii. the paper “A Technique for Deriving One-Shot Achiev - • The 2013 Claude E. Shannon ability Results in Network Award was given to Katalin János Körner Daniel Costello Information Theory”, co- Marton in Istanbul. Katalin authored with Mohammad presented her Shannon R. Aref and Amin A. Gohari Lecture on the Wednesday of the Symposium. If you wish to see her slides again or were unable to attend, a copy of 2) Mansoor I. Yousefi, for the paper “Integrable the slides have been posted on our Society website. Communication Channels and the Nonlinear Fourier Transform”, co-authored with Frank. R. Kschischang • The 2013 Aaron D. Wyner Distinguished Service Award goes to Daniel J. Costello. • Several members of our community became IEEE Fellows or received IEEE Medals, please see our web- • The 2013 IT Society Paper Award was given to Shrinivas site for more information: www.itsoc.org/honors Kudekar, Tom Richardson, and Rüdiger Urbanke for their paper “Threshold Saturation via Spatial Coupling: The Claude E.
    [Show full text]
  • Sharp Threshold Rates for Random Codes∗
    Sharp threshold rates for random codes∗ Venkatesan Guruswami1, Jonathan Mosheiff1, Nicolas Resch2, Shashwat Silas3, and Mary Wootters3 1Carnegie Mellon University 2Centrum Wiskunde en Informatica 3Stanford University September 11, 2020 Abstract Suppose that P is a property that may be satisfied by a random code C ⊂ Σn. For example, for some p 2 (0; 1), P might be the property that there exist three elements of C that lie in some Hamming ball of radius pn. We say that R∗ is the threshold rate for P if a random code of rate R∗ + " is very likely to satisfy P, while a random code of rate R∗ − " is very unlikely to satisfy P. While random codes are well-studied in coding theory, even the threshold rates for relatively simple properties like the one above are not well understood. We characterize threshold rates for a rich class of properties. These properties, like the example above, are defined by the inclusion of specific sets of codewords which are also suitably \symmetric." For properties in this class, we show that the threshold rate is in fact equal to the lower bound that a simple first-moment calculation obtains. Our techniques not only pin down the threshold rate for the property P above, they give sharp bounds on the threshold rate for list-recovery in several parameter regimes, as well as an efficient algorithm for estimating the threshold rates for list-recovery in general. arXiv:2009.04553v1 [cs.IT] 9 Sep 2020 ∗SS and MW are partially funded by NSF-CAREER grant CCF-1844628, NSF-BSF grant CCF-1814629, and a Sloan Research Fellowship.
    [Show full text]
  • Reflections on ``Improved Decoding of Reed-Solomon and Algebraic-Geometric Codes
    Reflections on \Improved Decoding of Reed-Solomon and Algebraic-Geometric Codes" Venkatesan Guruswami∗ Madhu Sudany March 2002 n A t-error-correcting code over a q-ary alphabet Fq is a set C ⊆ Fq such that for any received n vector r 2 Fq there is at most one vector c 2 C that lies within a Hamming distance of t from r. The minimum distance of the code C is the minimum Hamming distance between any pair of distinct vectors c1; c2 2 C. In his seminal work introducing these concepts, Hamming pointed out that a code of minimum distance 2t + 1 is a t-error-correcting code. It also pointed out the obvious fact that such a code is not a t0-error-correcting code for any t0 > t. We conclude that a code can correct half as many errors as its distance and no more. The mathematical correctness of the above statements are indisputable, yet the interpretation is quite debatable. If a message encoded with a t-error-correcting code ends up getting corrupted in t0 > t places, the decoder may simply throw it hands up in the air and cite the above paragraph. Or, in an alternate notion of decoding, called list decoding, proposed in the late 1950s by Elias [10] and Wozencraft [43], the decoder could try to output a list of codewords within distance t0 of the received vector. If t0 is not much larger than t and the errors are caused by a probabilistic (non-malicious) channel, then most likely this list would have only one element | the transmitted codeword.
    [Show full text]
  • Digital Communication Systems ECS 452
    Digital Communication Systems ECS 452 Asst. Prof. Dr. Prapun Suksompong (ผศ.ดร.ประพันธ ์ สขสมปองุ ) [email protected] 1. Intro to Digital Communication Systems Office Hours: BKD, 6th floor of Sirindhralai building Monday 10:00-10:40 Tuesday 12:00-12:40 1 Thursday 14:20-15:30 “The fundamental problem of communication is that of reproducing at one point either exactly or approximately a message selected at another point.” Shannon, Claude. A Mathematical Theory Of Communication. (1948) 2 Shannon: Father of the Info. Age Documentary Co-produced by the Jacobs School, UCSD-TV, and the California Institute for Telecommunications and Information Technology Won a Gold award in the Biography category in the 2002 Aurora Awards. 3 [http://www.uctv.tv/shows/Claude-Shannon-Father-of-the-Information-Age-6090] [http://www.youtube.com/watch?v=z2Whj_nL-x8] C. E. Shannon (1916-2001) 1938 MIT master's thesis: A Symbolic Analysis of Relay and Switching Circuits Insight: The binary nature of Boolean logic was analogous to the ones and zeros used by digital circuits. The thesis became the foundation of practical digital circuit design. The first known use of the term bit to refer to a “binary digit.” Possibly the most important, and also the most famous, master’s thesis of the century. It was simple, elegant, and important. 4 C. E. Shannon: Master Thesis 5 Boole/Shannon Celebration Events in 2015 and 2016 centered around the work of George Boole, who was born 200 years ago, and Claude E. Shannon, born 100 years ago. Events were scheduled both at the University College Cork (UCC), Ireland and the Massachusetts Institute of Technology (MIT) 6 http://www.rle.mit.edu/booleshannon/ An Interesting Book The Logician and the Engineer: How George Boole and Claude Shannon Created the Information Age by Paul J.
    [Show full text]
  • IEEE Information Theory Society Newsletter
    IEEE Information Theory Society Newsletter Vol. 66, No. 4, December 2016 Editor: Michael Langberg ISSN 1059-2362 Editorial committee: Frank Kschischang, Giuseppe Caire, Meir Feder, Tracey Ho, Joerg Kliewer, Parham Noorzad, Anand Sarwate, Andy Singer, and Sergio Verdú President’s Column Alon Orlitsky One should never start with a cliche. So let me that would bring and curate information the- end with one: where did 2016 go? It seems like oretic lectures for large audiences. yesterday that I wrote my first column, and it’s already time to reflect on a year gone by? • Jeff Andrews and Elza Erkip are heading a BoG ad-hoc committee exploring the cre- And a remarkable year it was! Each of earth’s ation of a new publication connecting corners and all of life’s walks were abuzz with information theory to other topics and activity and change, and information theory communities, with two main formats con- followed suit. Adding to our society’s regu- sidered: a special topics journal, and a larly hectic conference meeting/publication popular magazine. calendar, we also celebrated Shannon’s 100th anniversary with fifty worldwide centennials, • Christina Fragouli and Anna Scaglione are numerous write-ups in major journals and co-authoring a children’s book on informa- magazines, and a coveted Google Doodle on tion theory, the first chapter is completed Shannon’s birthday. For the last time let me and the rest are expected next year. thank Christina Fragouli and Rudi Urbanke for co-chairing the hyperactive Centennials Committee. As the holidays ushered in, twelve-shy-one society members received jolly good tidings.
    [Show full text]
  • IEEE Information Theory Society Newsletter
    IEEE Information Theory Society Newsletter Vol. 53, No. 1, March 2003 Editor: Lance C. Pérez ISSN 1059-2362 LIVING INFORMATION THEORY The 2002 Shannon Lecture by Toby Berger School of Electrical and Computer Engineering Cornell University, Ithaca, NY 14853 1 Meanings of the Title Information theory has ... perhaps The title, ”Living Information Theory,” is a triple enten- ballooned to an importance beyond dre. First and foremost, it pertains to the information its actual accomplishments. Our fel- theory of living systems. Second, it symbolizes the fact low scientists in many different that our research community has been living informa- fields, attracted by the fanfare and by tion theory for more than five decades, enthralled with the new avenues opened to scientific the beauty of the subject and intrigued by its many areas analysis, are using these ideas in ... of application and potential application. Lastly, it is in- biology, psychology, linguistics, fun- tended to connote that information theory is decidedly damental physics, economics, the theory of the orga- alive, despite sporadic protestations to the contrary. nization, ... Although this wave of popularity is Moreover, there is a thread that ties together all three of certainly pleasant and exciting for those of us work- these meanings for me. That thread is my strong belief ing in the field, it carries at the same time an element that one way in which information theorists, both new of danger. While we feel that information theory is in- and seasoned, can assure that their subject will remain deed a valuable tool in providing fundamental in- vitally alive deep into the future is to embrace enthusias- sights into the nature of communication problems tically its applications to the life sciences.
    [Show full text]
  • Robust Coding Strategies and Physical Layer Service Integration for Bidirectional Relaying
    TECHNISCHE UNIVERSITÄT MÜNCHEN Lehrstuhl für Theoretische Informationstechnik Robust Coding Strategies and Physical Layer Service Integration for Bidirectional Relaying Rafael Felix Wyrembelski Vollständiger Abdruck der von der Fakultät für Elektrotechnik und Informationstechnik der Technischen Universität München zur Erlangung des akademischen Grades eines Doktor-Ingenieurs (Dr.-Ing.) genehmigten Dissertation. Vorsitzender: Univ.-Prof. Dr. sc. techn. Gerhard Kramer Prüfer der Dissertation: 1. Univ.-Prof. Dr.-Ing. Dr. rer. nat. Holger Boche 2. Prof. Dr. Vincent Poor (Princeton University, USA) Die Dissertation wurde am 06.10.2011 bei der Technischen Universität München eingereicht und durch die Fakultät für Elektrotechnik und Informationstechnik am 22.03.2012 angenom- men. Zusammenfassung Aktuelle Forschungsergebnisse zeigen, dass Relaiskonzepte die Leistungsfähigkeit und Ab- deckung drahtloser Kommunikationssysteme deutlich erhöhen können. In dieser Disserta- tion betrachten wir bidirektionale Relais-Kommunikation in einem Netzwerk mit drei Statio- nen, in dem zwei Stationen mit Hilfe einer Relaisstation kommunizieren. Im ersten Teil der Dissertation analysieren wir die Auswirkungen ungenauer Kanalkennt- nis an Sender und Empfängern und betrachten den dazugehörigen diskreten gedächtnis- losen bidirektionalen Compound Broadcastkanal. Wir leiten die Kapazitätsregion her und analysieren die Szenarien, in denen zusätzlich entweder der Sender oder die Empfänger per- fekte Kanalkenntnis besitzen. Hierbei zeigt sich, dass Kanalkenntnis an den
    [Show full text]
  • Principles of Communications ECS 332
    Principles of Communications ECS 332 Asst. Prof. Dr. Prapun Suksompong (ผศ.ดร.ประพันธ ์ สขสมปองุ ) [email protected] 1. Intro to Communication Systems Office Hours: BKD, 6th floor of Sirindhralai building Wednesday 13:45-15:15 Friday 13:45-15:15 1 “The fundamental problem of communication is that of reproducing at one point either exactly or approximately a message selected at another point.” Shannon, Claude. A Mathematical Theory Of Communication. (1948) 2 Shannon: Father of the Info. Age Documentary Co-produced by the Jacobs School, UCSD-TV, and the California Institute for Telecommunications and Information Technology Won a Gold award in the Biography category in the 2002 Aurora Awards. 3 [http://www.uctv.tv/shows/Claude-Shannon-Father-of-the-Information-Age-6090] [http://www.youtube.com/watch?v=z2Whj_nL-x8] C. E. Shannon (1916-2001) 1938 MIT master's thesis: A Symbolic Analysis of Relay and Switching Circuits Insight: The binary nature of Boolean logic was analogous to the ones and zeros used by digital circuits. The thesis became the foundation of practical digital circuit design. The first known use of the term bit to refer to a “binary digit.” Possibly the most important, and also the most famous, master’s thesis of the century. It was simple, elegant, and important. 4 C. E. Shannon: Master Thesis 5 Boole/Shannon Celebration Events in 2015 and 2016 centered around the work of George Boole, who was born 200 years ago, and Claude E. Shannon, born 100 years ago. Events were scheduled both at the University College Cork (UCC), Ireland and the Massachusetts Institute of Technology (MIT) 6 http://www.rle.mit.edu/booleshannon/ An Interesting Book The Logician and the Engineer: How George Boole and Claude Shannon Created the Information Age by Paul J.
    [Show full text]
  • Channel Coding in Optical Communication Systems
    Transport and Communications, 2016; Vol. II. DOI: 10.26552/tac.C.2016.2.1 ISSN: 1339-5130 1 Channel Coding in Optical Communication Systems Viktor Durcek1, Michal Kuba2, Milan Dado3 1,2,3Dept. of Telecommunications and Multimedia, Faculty of Electrical Engineering, University of Žilina, Univerzitná 8215/1, 010 26 Žilina, Slovakia Abstract In this paper, an overview of various types of error-correcting codes is present. Three generations of forward error correction methods used in optical communication systems are listed and described. Forward error correction schemes proposed for use in future high-speed optical networks can be found in the third generation of codes. Keywords FEC, channel coding, LDPC, Turbo codes JEL C690 Hamming codes are still used in some types of ECC 1. Introduction memories [2], [4-5]. In 1954 David E. Muller described a class of Forward Error Correction (FEC) is an important part of multiple-error-correcting codes [6] and Irving S. Reed modern communication systems. Throughout history new proposed the first algorithm for decoding these codes types of channel codes and FEC schemes with higher (known as majority decoding) [7]. Today this class of binary error-correcting performance were introduced. In section 2 linear block codes is called Reed-Muller codes. Their of this paper, an overview of different types of channel advantage is simple description and simple decoding codes is shown. Methods of error correction used in optical algorithm [2]. networks are described and divided into generations in Convolutional codes are a class of linear time-invariant section 3. FEC schemes proposed to be used in future tree codes and can be generated by a linear shift-register optical networks are also mentioned in section 3.
    [Show full text]
  • Digital Communication Systems ECS 452
    Digital Communication Systems ECS 452 Asst. Prof. Dr. Prapun Suksompong (ผศ.ดร.ประพันธ ์ สขสมปองุ ) [email protected] 1. Intro to Digital Communication Systems Office Hours: BKD, 6th floor of Sirindhralai building Monday 10:00-10:40 Tuesday 12:00-12:40 1 Thursday 14:20-15:30 “The fundamental problem of communication is that of reproducing at one point either exactly or approximately a message selected at another point.” Shannon, Claude. A Mathematical Theory Of Communication. (1948) 2 Shannon: Father of the Info. Age Documentary Co-produced by the Jacobs School, UCSD-TV, and the California Institute for Telecommunications and Information Technology Won a Gold award in the Biography category in the 2002 Aurora Awards. 3 [http://www.uctv.tv/shows/Claude-Shannon-Father-of-the-Information-Age-6090] [http://www.youtube.com/watch?v=z2Whj_nL-x8] C. E. Shannon (1916-2001) 1938 MIT master's thesis: A Symbolic Analysis of Relay and Switching Circuits Insight: The binary nature of Boolean logic was analogous to the ones and zeros used by digital circuits. The thesis became the foundation of practical digital circuit design. The first known use of the term bit to refer to a “binary digit.” Possibly the most important, and also the most famous, master’s thesis of the century. It was simple, elegant, and important. 4 C. E. Shannon: Master Thesis 5 Boole/Shannon Celebration Events in 2015 and 2016 centered around the work of George Boole, who was born 200 years ago, and Claude E. Shannon, born 100 years ago. Events were scheduled both at the University College Cork (UCC), Ireland and the Massachusetts Institute of Technology (MIT) 6 http://www.rle.mit.edu/booleshannon/ An Interesting Book The Logician and the Engineer: How George Boole and Claude Shannon Created the Information Age by Paul J.
    [Show full text]