Multivariate Decoding of Reed-Solomon Codes

Total Page:16

File Type:pdf, Size:1020Kb

Multivariate Decoding of Reed-Solomon Codes UC San Diego UC San Diego Electronic Theses and Dissertations Title Algebraic list-decoding of error-correcting codes Permalink https://escholarship.org/uc/item/68q346tn Author Parvaresh, Farzad Publication Date 2007 Peer reviewed|Thesis/dissertation eScholarship.org Powered by the California Digital Library University of California UNIVERSITY OF CALIFORNIA, SAN DIEGO Algebraic List-Decoding of Error-Correcting Codes A dissertation submitted in partial satisfaction of the requirements for the degree Doctor of Philosophy in Electrical Engineering (Communications Theory and Systems) by Farzad Parvaresh Committee in charge: Professor Alexander Vardy, Chair Professor Ilya Dumer Professor Alon Orlitsky Professor Paul H. Siegel Professor Jack K. Wolf 2007 Copyright Farzad Parvaresh, 2007 All rights reserved. The dissertation of Farzad Parvaresh is approved, and it is acceptable in quality and form for publication on microfilm: Chair University of California, San Diego 2007 iii To my parents iv TABLE OF CONTENTS Signature Page . iii Dedication . iv Table of Contents . v List of Figures . vii Acknowledgements . viii Vita and Publications . xi Abstract of the Dissertation . xii Chapter 1 Introduction . 1 1.1 Contributions . 5 1.2 Waiting for a bus in front of a pub . 8 1.2.1 Reed-Solomon codes . 9 1.2.2 Guruswami-Sudan algorithm . 10 1.2.3 Multivariate interpolation decoding algorithm . 12 1.3 Waiting for a bus on an April Fool’s day . 15 1.4 A new kind of Tic-Tac-Toe with multiplicity . 18 Chapter 2 Multivariate decoding of Reed-Solomon codes . 21 2.1 Introduction . 22 2.2 Preliminaries . 27 2.3 Error-correction radius of the MID algorithm . 30 2.4 Iterative multivariate interpolation . 35 2.5 Multivariate polynomial recovery . 39 2.6 The MID algorithm works . 44 2.7 A bound on the performance of the MID algorithm . 46 2.7.1 Background and notation . 47 2.7.2 Bound on the failure probability . 48 v Chapter 3 Correcting errors beyond the Guruswami-Sudan radius . 58 3.1 Introduction . 59 3.1.1 Prior work on the list decoding problem . 61 3.1.2 Our main results . 63 3.1.3 The underlying ideas . 65 3.1.4 Overview of the chapter . 66 3.2 Multivariate interpolation . 67 3.3 Simple trivariate codes and their decoding . 70 3.3.1 Code parameters and encoder mapping . 71 3.3.2 Simple trivariate interpolation decoding . 73 3.4 General trivariate codes and their decoding . 77 3.4.1 Code parameters and encoder mapping . 77 3.4.2 General trivariate interpolation decoding . 79 3.5 Extension to multivariate interpolation . 81 3.6 Explicit capacity achieving codes . 84 3.6.1 Folded Reed-Solomon codes . 85 3.6.2 Using trivariate interpolation for folded RS codes . 86 Chapter 4 Multiplicity assignment . 90 4.1 Introduction . 91 4.2 Background and notation . 93 4.3 Geometrical framework . 96 4.4 Second-order approximation . 102 4.4.1 Iterative solution . 104 4.4.2 Analytical solution . 106 4.5 Fixed-cost multiplicity assignment . 111 Chapter 5 Efficient interpolation via matrix-chain product . 116 5.1 Introduction . 117 5.2 Interpolation as a matrix-chain product . 119 5.3 Optimal multiplication order . 121 5.4 Suboptimal dynamic-programming algorithm . 124 5.5 Optimization over the interpolation polynomial . 125 Chapter 6 Conclusion and open problems . 129 References . 134 vi LIST OF FIGURES Figure 1.1 Schematic of a generic communication system . 2 Figure 1.2 q-ary symmetric channel . 8 Figure 1.3 Monomials of weighted degree smaller than ¢ . 12 Figure 1.4 Error-correction radius of trivariate interpolation decoding 13 Figure 1.5 Error-correction radius of different codes in the worst-case 16 Figure 1.6 Tic-Tac-Toe with multiplicity . 19 Figure 2.1 Error-correction radius of trivariate interpolation decoding 24 Figure 2.2 Comparison of algorithms that correct synchronized errors 25 Figure 2.3 The union of cubes S and the pyramid P . 32 Figure 2.4 Deltaset of the ideal IP .................... 41 Figure 2.5 Deriving the bound for ¢2 ................... 42 Figure 2.6 Bound on decoding with two Grobner¨ basis . 43 Figure 2.7 Performance of MID of C256(15, 11) . 45 Figure 2.8 Performance of MID of C256(15, 7) . 46 Figure 2.9 Counting the number of curves . 50 Figure 2.10 Comparing upper and lower bounds on the weighted degree 54 ¤ Figure 2.11 Deriving the bound on Wdeg G (X, Y, Z) . 57 Figure 3.1 Unfolding a folded Reed-Solomon code . 86 Figure 4.1 Score distributions for a fixed n . 92 Figure 4.2 Geometrical framework . 100 Figure 4.3 Performance of C16(15, 11) . 101 Figure 4.4 Performance of decoding C(468, 420) over AWGN channel 106 Figure 4.5 Performance of decoding C(255, 239) over AWGN channel 107 Figure 4.6 Geometrical framework; The cone and tangent rays . 113 Figure 5.1 Cost of multiplying a 4 £ 4 polynomial matrix-chain . 128 Figure 5.2 Cost of multiplying an 8 £ 8 polynomial matrix-chain . 128 vii ACKNOWLEDGEMENTS First and foremost, I like to thank my advisor, Alexander Vardy. Now that I look back to the time I got admission from UCSD, and started working with Alex, it all looks like a miracle to me. I truly believe, during the past five years, I have been evolved as a scientist and a person, and more than any other person, Alex was influential in this change. This work would not be possible with the very friendly and supportive research environment that he provided for me and his constant attention and believe on what I was doing for my research. I feel very lucky to have had Alex Vardy as my advisor and look forward to learn and work with him in future. I like to thank my dissertation committee members. I am very grateful to Paul Siegel. I learned a lot about coding theory from his classes and enjoyed attending STAR group meetings. I am grateful to Alon Orlitsky. Alon’s class on information theory had a huge impact on attracting me toward coding and information theory. Also, I could not imagine doing my Ph.D. at UCSD without his help with my visa. Jack Wolf has been a role model for me. I am hoping that some day I would be able to explain complex subjects in simple terms like him. I am grateful to Ilya Dumer. Ilya’s insight that the bounds of Chapter 2 are optimal in a certain sense makes the results of Chapter 2 much stronger. And, although he had to drive from Riverside to San Diego each time for my qualifi- cation exam and defense, he kindly agreed to be in my defense committee. I had a chance to do an internship at Bell laboratories under the supervision of Alexei Ashikhmin. I learned a lot about quantum codes from Alexei during the short period that I spent at Bell Labs. I am very grateful to him for his magic introduction to tough concept of quantum codes in a language which is plausible for a coding guy. I also like to thank Gerhard Kramer, Tom Marzetta, Emina Soljanin, Adriaan van Wijngaarden and others at Bell Labs mathematical research center for making my stay at Bell Labs an enjoyable one. I am grateful to Bob McEliece for giving me a chance to visit his group at Caltech and Shuki Bruck for letting me to attend his group meetings during my stay at Caltech. I truly enjoyed the discussions in the meetings which helped viii me a lot to diversify my research. I also like to thank Ralf Koetter. Ralf’s suggestions on my research always helped me to understand the problem in a much deeper level . I hope someday I will be as comfortable as he is with algebra. I like to acknowledge Madhu Sudan and Venkat Guruswami for their invaluable comments on my research. I would also like to thank my officemates, Nandu Santi for all the enjoy- able discussions we had, Jun Ma, Navin Kashyap and Moshe schwartz. I like to thank my friends, Houman Ghajari for being a great roommate and great friend, Amin Shameli, Alireza Vakil Amirkhizi, Mohsen Bayati, Navid Ehsan, Moham- mad Farazian , Zeinab Taghavi, Hossein Taghavi, Kambiz Samadi, Amir Fara- jidana, Shafigh Shirinfard, Aydin Babakhani, Olgica Milenkovic, Narayana P. Santhanam, Mostafa Al-Khamy, Mihailo Stojnic, Ashay Dhamdhere, Mishal Al- gharabally, Sharon Aviran, Liwen Yu, Seyhan Karkulak, Mike Cheng, Joseph So- riaga, Henry Pfister, Junsheng Han, Patrick Amihood, Chaitanya Rao, Sormeh Shadbakht, Ali Vakili, Weiyu Xu, Fred´ erique´ Oggier, Haris Vikalo, Vincent Bo- hossian, Yuval Cassuto, Michael Langberg, Sarah Fargol, Edwin Soedarmadji, and many others that made my graduate life a fruitful one. I am specially grateful to my family, to my father, Ahmad, for always being there for me, paying attention to all the details of my work and giving his help and support in all aspect of my life, to my mom, Parvin, for always encouraging and complementing my work and giving me confidence on what I am doing and my sister, Maryam, which her sense of humor made my telephone calls more fun. Although, I did not have a chance to visit them during my study at UCSD, I had their love and support even from such a long distance. And, I am very grateful to my uncles, Hushang, Farideh, Parynaz, Shahram, Peyman, Ebi, Ann and my second cousins for their support and for making me feel that I am back home here in US. The results of the Chapter 2 have been presented, in part, at the 43ed Annual Allerton Conference on Communication, Control, and Computing, Parvaresh, Farzad; Vardy, Alexander, and at the 2006 International Symposium on Information Theory (ISIT), Parvaresh, Farzad; Taghavi, Mohammad; Vardy, Alexander.
Recommended publications
  • Group Testing
    Group Testing Amit Kumar Sinhababu∗ and Vikraman Choudhuryy Department of Computer Science and Engineering, Indian Institute of Technology Kanpur April 21, 2013 1 Motivation Out original motivation in this project was to study \coding theory in data streaming", which has two aspects. • Applications of theory correcting codes to efficiently solve problems in the model of data streaming. • Solving coding theory problems in the model of data streaming. For ex- ample, \Can one recognize a Reed-Solomon codeword in one-pass using only poly-log space?" [1] As we started, we were directed to a related combinatorial problem, \Group testing", which is important on its own, having connections with \Compressed Sensing", \Data Streaming", \Coding Theory", \Expanders", \Derandomiza- tion". This project report surveys some of these interesting connections. 2 Group Testing The group testing problem is to identify the set of \positives" (\defectives", or \infected", or 1) from a large set of population/items, using as few tests as possible. ∗[email protected] [email protected] 1 2.1 Definition There is an unknown stream x 2 f0; 1gn with at most d ones in it. We are allowed to test any subset S of the indices. The answer to the test tells whether xi = 0 for all i 2 S, or not (at least one xi = 1). The objective is to design as few tests as possible (t tests) such that x can be identified as fast as possible. Group testing strategies can be either adaptive or non-adaptive. A group testing algorithm is non-adaptive if all tests must be specified without knowing the outcome of other tests.
    [Show full text]
  • DRASIC Distributed Recurrent Autoencoder for Scalable
    DRASIC: Distributed Recurrent Autoencoder for Scalable Image Compression Enmao Diao∗, Jie Dingy, and Vahid Tarokh∗ ∗Duke University yUniversity of Minnesota-Twin Cities Durham, NC, 27701, USA Minneapolis, MN 55455, USA [email protected] [email protected] [email protected] Abstract We propose a new architecture for distributed image compression from a group of distributed data sources. The work is motivated by practical needs of data-driven codec design, low power con- sumption, robustness, and data privacy. The proposed architecture, which we refer to as Distributed Recurrent Autoencoder for Scalable Image Compression (DRASIC), is able to train distributed encoders and one joint decoder on correlated data sources. Its compression capability is much bet- ter than the method of training codecs separately. Meanwhile, the performance of our distributed system with 10 distributed sources is only within 2 dB peak signal-to-noise ratio (PSNR) of the performance of a single codec trained with all data sources. We experiment distributed sources with different correlations and show how our data-driven methodology well matches the Slepian- Wolf Theorem in Distributed Source Coding (DSC). To the best of our knowledge, this is the first data-driven DSC framework for general distributed code design with deep learning. 1 Introduction It has been shown by a variety of previous works that deep neural networks (DNN) can achieve comparable results as classical image compression techniques [1–9]. Most of these methods are based on autoencoder networks and quantization of bottleneck representa- tions. These models usually rely on entropy codec to further compress codes. Moreover, to achieve different compression rates it is unavoidable to train multiple models with different regularization parameters separately, which is often computationally intensive.
    [Show full text]
  • Nested Tailbiting Convolutional Codes for Secrecy, Privacy, and Storage
    Nested Tailbiting Convolutional Codes for Secrecy, Privacy, and Storage Thomas Jerkovits Onur Günlü Vladimir Sidorenko [email protected] [email protected] Gerhard Kramer German Aerospace Center TU Berlin [email protected] Weçling, Germany Berlin, Germany [email protected] TU Munich Munich, Germany ABSTRACT them as physical “one-way functions” that are easy to compute and A key agreement problem is considered that has a biometric or difficult to invert [33]. physical identifier, a terminal for key enrollment, and a terminal There are several security, privacy, storage, and complexity con- for reconstruction. A nested convolutional code design is proposed straints that a PUF-based key agreement method should fulfill. First, that performs vector quantization during enrollment and error the method should not leak information about the secret key (neg- control during reconstruction. Physical identifiers with small bit ligible secrecy leakage). Second, the method should leak as little error probability illustrate the gains of the design. One variant of information about the identifier (minimum privacy leakage). The the nested convolutional codes improves on the best known key privacy leakage constraint can be considered as an upper bound vs. storage rate ratio but it has high complexity. A second variant on the secrecy leakage via the public information of the first en- with lower complexity performs similar to nested polar codes. The rollment of a PUF about the secret key generated by the second results suggest that the choice of code for key agreement with enrollment of the same PUF [12]. Third, one should limit the stor- identifiers depends primarily on the complexity constraint.
    [Show full text]
  • MASTER of ADVANCED STUDY New Professional Degrees for Engineers University of California, San Diego of California, University
    pulse cover12_Layout 1 6/22/11 3:46 PM Page 1 Entrepreneurism Center • Research Expo 2011 In Memory of Jack Wolf Jacobs School of Engineering News PulseSummer 2011 MASTER OF ADVANCED STUDY New Professional Degrees for Engineers University of California, San Diego of California, University > dean’s column < New Interdisciplinary Degree Programs for Engineering Professionals Jacobs School of Engineering The most exciting and innovative engineering often occurs on the interface between traditional disciplines. We are extending our interdisciplinary Leadership Dean: Frieder Seible collaborations — which have always been at the core of the Jacobs School culture Associate Dean: Jeanne Ferrante — to new graduate education programs for engineering professionals. Associate Dean: Charles Tu Associate Dean for Administration and Finance: Beginning this fall, the Jacobs School will offer four new interdisciplinary Steve Ross Master of Advanced Study (MAS) programs for working engineers: Wireless Executive Director of External Relations: Embedded Systems, Medical Device Engineering, Structural Health Monitoring, Denine Hagen and Simulation-Based Engineering. Academic Departments Bioengineering: Shankar Subramanian, Chair TThese master degree programs are engineering equivalents of MBA programs Computer Science and Engineering: at business management schools. Geared to early- to mid-career engineers Rajesh Gupta, Chair Electrical and Computer Engineering: with practical work experience, our new MAS programs align faculty research Yeshaiahu Fainman, Chair strengths with industry workforce needs. The curricula are always jointly offered Mechanical and Aerospace Engineering: by two academic departments, so that the training focuses in a practical way on Sutanu Sarkar, Chair NanoEngineering: industry-specific application areas that are not available through traditional master Kenneth Vecchio, Chair degree programs.
    [Show full text]
  • Information Theory and Statistics: a Tutorial
    Foundations and Trends™ in Communications and Information Theory Volume 1 Issue 4, 2004 Editorial Board Editor-in-Chief: Sergio Verdú Department of Electrical Engineering Princeton University Princeton, New Jersey 08544, USA [email protected] Editors Venkat Anantharam (Berkeley) Amos Lapidoth (ETH Zurich) Ezio Biglieri (Torino) Bob McEliece (Caltech) Giuseppe Caire (Eurecom) Neri Merhav (Technion) Roger Cheng (Hong Kong) David Neuhoff (Michigan) K.C. Chen (Taipei) Alon Orlitsky (San Diego) Daniel Costello (NotreDame) Vincent Poor (Princeton) Thomas Cover (Stanford) Kannan Ramchandran (Berkeley) Anthony Ephremides (Maryland) Bixio Rimoldi (EPFL) Andrea Goldsmith (Stanford) Shlomo Shamai (Technion) Dave Forney (MIT) Amin Shokrollahi (EPFL) Georgios Giannakis (Minnesota) Gadiel Seroussi (HP-Palo Alto) Joachim Hagenauer (Munich) Wojciech Szpankowski (Purdue) Te Sun Han (Tokyo) Vahid Tarokh (Harvard) Babak Hassibi (Caltech) David Tse (Berkeley) Michael Honig (Northwestern) Ruediger Urbanke (EPFL) Johannes Huber (Erlangen) Steve Wicker (GeorgiaTech) Hideki Imai (Tokyo) Raymond Yeung (Hong Kong) Rodney Kennedy (Canberra) Bin Yu (Berkeley) Sanjeev Kulkarni (Princeton) Editorial Scope Foundations and Trends™ in Communications and Information Theory will publish survey and tutorial articles in the following topics: • Coded modulation • Multiuser detection • Coding theory and practice • Multiuser information theory • Communication complexity • Optical communication channels • Communication system design • Pattern recognition and learning • Cryptology
    [Show full text]
  • IEEE Information Theory Society Newsletter
    IEEE Information Theory Society Newsletter Vol. 63, No. 3, September 2013 Editor: Tara Javidi ISSN 1059-2362 Editorial committee: Ioannis Kontoyiannis, Giuseppe Caire, Meir Feder, Tracey Ho, Joerg Kliewer, Anand Sarwate, Andy Singer, and Sergio Verdú Annual Awards Announced The main annual awards of the • 2013 IEEE Jack Keil Wolf ISIT IEEE Information Theory Society Student Paper Awards were were announced at the 2013 ISIT selected and announced at in Istanbul this summer. the banquet of the Istanbul • The 2014 Claude E. Shannon Symposium. The winners were Award goes to János Körner. the following: He will give the Shannon Lecture at the 2014 ISIT in 1) Mohammad H. Yassaee, for Hawaii. the paper “A Technique for Deriving One-Shot Achiev - • The 2013 Claude E. Shannon ability Results in Network Award was given to Katalin János Körner Daniel Costello Information Theory”, co- Marton in Istanbul. Katalin authored with Mohammad presented her Shannon R. Aref and Amin A. Gohari Lecture on the Wednesday of the Symposium. If you wish to see her slides again or were unable to attend, a copy of 2) Mansoor I. Yousefi, for the paper “Integrable the slides have been posted on our Society website. Communication Channels and the Nonlinear Fourier Transform”, co-authored with Frank. R. Kschischang • The 2013 Aaron D. Wyner Distinguished Service Award goes to Daniel J. Costello. • Several members of our community became IEEE Fellows or received IEEE Medals, please see our web- • The 2013 IT Society Paper Award was given to Shrinivas site for more information: www.itsoc.org/honors Kudekar, Tom Richardson, and Rüdiger Urbanke for their paper “Threshold Saturation via Spatial Coupling: The Claude E.
    [Show full text]
  • Network Information Theory
    Network Information Theory This comprehensive treatment of network information theory and its applications pro- vides the first unified coverage of both classical and recent results. With an approach that balances the introduction of new models and new coding techniques, readers are guided through Shannon’s point-to-point information theory, single-hop networks, multihop networks, and extensions to distributed computing, secrecy, wireless communication, and networking. Elementary mathematical tools and techniques are used throughout, requiring only basic knowledge of probability, whilst unified proofs of coding theorems are based on a few simple lemmas, making the text accessible to newcomers. Key topics covered include successive cancellation and superposition coding, MIMO wireless com- munication, network coding, and cooperative relaying. Also covered are feedback and interactive communication, capacity approximations and scaling laws, and asynchronous and random access channels. This book is ideal for use in the classroom, for self-study, and as a reference for researchers and engineers in industry and academia. Abbas El Gamal is the Hitachi America Chaired Professor in the School of Engineering and the Director of the Information Systems Laboratory in the Department of Electri- cal Engineering at Stanford University. In the field of network information theory, he is best known for his seminal contributions to the relay, broadcast, and interference chan- nels; multiple description coding; coding for noisy networks; and energy-efficient packet scheduling and throughput–delay tradeoffs in wireless networks. He is a Fellow of IEEE and the winner of the 2012 Claude E. Shannon Award, the highest honor in the field of information theory. Young-Han Kim is an Assistant Professor in the Department of Electrical and Com- puter Engineering at the University of California, San Diego.
    [Show full text]
  • 2010 Roster (V: Indicates Voting Member of Bog)
    IEEE Information Theory Society 2010 Roster (v: indicates voting member of BoG) Officers Frank Kschischang President v Giuseppe Caire First Vice President v Muriel M´edard Second Vice President v Aria Nosratinia Secretary v Nihar Jindal Treasurer v Andrea Goldsmith Junior Past President v Dave Forney Senior Past President v Governors Until End of Alexander Barg 2010 v Dan Costello 2010 v Michelle Effros 2010 v Amin Shokrollahi 2010 v Ken Zeger 2010 v Helmut B¨olcskei 2011 v Abbas El Gamal 2011 v Alex Grant 2011 v Gerhard Kramer 2011 v Paul Siegel 2011 v Emina Soljanin 2011 v Sergio Verd´u 2011 v Martin Bossert 2012 v Max Costa 2012 v Rolf Johannesson 2012 v Ping Li 2012 v Hans-Andrea Loeliger 2012 v Prakash Narayan 2012 v Other Voting Members of BoG Ezio Biglieri IT Transactions Editor-in-Chief v Bruce Hajek Chair, Conference Committee v total number of voting members: 27 quorum: 14 1 Standing Committees Awards Giuseppe Caire Chair, ex officio 1st VP Muriel M´edard ex officio 2nd VP Alexander Barg new Max Costa new Elza Erkip new Ping Li new Andi Loeliger new Ueli Maurer continuing En-hui Yang continuing Hirosuke Yamamoto new Ram Zamir continuing Aaron D. Wyner Award Selection Frank Kschischang Chair, ex officio President Giuseppe Caire ex officio 1st VP Andrea Goldsmith ex officio Junior PP Dick Blahut new Jack Wolf new Claude E. Shannon Award Selection Frank Kschischang Chair, ex officio President Giuseppe Caire ex officio 1st VP Muriel M´edard ex officio 2nd VP Imre Csisz`ar continuing Bob Gray continuing Abbas El Gamal new Bob Gallager new Conference
    [Show full text]
  • Symposium in Remembrance of Rudolf Ahlswede
    in cooperation with Fakultät für Mathematik Department of Mathematics Symposium in Remembrance of Rudolf Ahlswede July 25 -26, 2011 Program and Booklet of Abstracts Symposium in Remembrance of Rudolf Ahlswede Bielefeld, Germany, July 25 -26, 2011 Program and Booklet of Abstracts Organizers: Harout Aydinian Ingo Alth¨ofer Ning Cai Ferdinando Cicalese Christian Deppe Gunter Dueck Ulrich Tamm Andreas Winter Contents 1 Program 1 2 Rudolf Ahlswede 1938-2010 5 Christian Deppe 3 Obituary of the ZIF 11 Manuela Lenzen 4 AZ-identity for regular posets 13 Harout Aydinian 5 Quantum information, the ambiguity of the past, and the complexity of the present 15 Charles Bennett 6 Local-global principles in discrete extremal problems 17 Sergei L. Bezrukov 7 Secure network coding 19 Ning Cai 8 Common randomness in information theory 21 Imre Csisz´ar 9 The deep impact of Rudolf Ahlswede on combinatorics 23 Gyula O. H. Katona 10 Common randomness and multiterminal secure computation 25 Prakash Narayan 11 String reconstruction from substring compositions 27 Alon Orlitsky 12 Stochastic search for locally clustered targets 29 K. R¨udigerReischuk 13 Information flows and bottle necks in dynamic communication networks 31 Soren Riis 14 On the complexity of families of binary sequences and lattices 33 Andras Sarkozy 15 Higher order extremal problems 35 L´aszl´oSz´ekely 16 A generalisation of the Gilbert-Varshamov bound and its asymptotic evaluation 37 Ludo Tolhuizen 17 Quantum channels and identification theory 39 Andreas Winter 18 List of Participants 41 iii Monday July 25, 2011 PROGRAM 10:15 Warm up: C. Bennett - Quantum information, the ambiguity of the past, and the complexity of the present 12:00 Welcome and registration at the ZiF - Chair C.
    [Show full text]
  • Reflections on Compressed Sensing, by E
    itNL1208.qxd 11/26/08 9:09 AM Page 1 IEEE Information Theory Society Newsletter Vol. 58, No. 4, December 2008 Editor: Daniela Tuninetti ISSN 1059-2362 Source Coding and Simulation XXIX Shannon Lecture, presented at the 2008 IEEE International Symposium on Information Theory, Toronto Canada Robert M. Gray Prologue Source coding/compression/quantization A unique aspect of the Shannon Lecture is the daunting fact that the lecturer has a year to prepare for (obsess over?) a single lec- source reproduction ture. The experience begins with the comfort of a seemingly infi- { } - bits- - Xn encoder decoder {Xˆn} nite time horizon and ends with a relativity-like speedup of time as the date approaches. I early on adopted a few guidelines: I had (1) a great excuse to review my more than four decades of Simulation/synthesis/fake process information theoretic activity and historical threads extending simulation even further back, (2) a strong desire to avoid repeating the top- - - ics and content I had worn thin during 2006–07 as an interconti- random bits coder {X˜n} nental itinerant lecturer for the Signal Processing Society, (3) an equally strong desire to revive some of my favorite topics from the mid 1970s—my most active and focused period doing Figure 1: Source coding and simulation. unadulterated information theory, and (4) a strong wish to add something new taking advantage of hindsight and experience, The goal of source coding [1] is to communicate or transmit preferably a new twist on some old ideas that had not been pre- the source through a constrained, discrete, noiseless com- viously fully exploited.
    [Show full text]
  • Andrew J. and Erna Viterbi Family Archives, 1905-20070335
    http://oac.cdlib.org/findaid/ark:/13030/kt7199r7h1 Online items available Finding Aid for the Andrew J. and Erna Viterbi Family Archives, 1905-20070335 A Guide to the Collection Finding aid prepared by Michael Hooks, Viterbi Family Archivist The Andrew and Erna Viterbi School of Engineering, University of Southern California (USC) First Edition USC Libraries Special Collections Doheny Memorial Library 206 3550 Trousdale Parkway Los Angeles, California, 90089-0189 213-740-5900 [email protected] 2008 University Archives of the University of Southern California Finding Aid for the Andrew J. and Erna 0335 1 Viterbi Family Archives, 1905-20070335 Title: Andrew J. and Erna Viterbi Family Archives Date (inclusive): 1905-2007 Collection number: 0335 creator: Viterbi, Erna Finci creator: Viterbi, Andrew J. Physical Description: 20.0 Linear feet47 document cases, 1 small box, 1 oversize box35000 digital objects Location: University Archives row A Contributing Institution: USC Libraries Special Collections Doheny Memorial Library 206 3550 Trousdale Parkway Los Angeles, California, 90089-0189 Language of Material: English Language of Material: The bulk of the materials are written in English, however other languages are represented as well. These additional languages include Chinese, French, German, Hebrew, Italian, and Japanese. Conditions Governing Access note There are materials within the archives that are marked confidential or proprietary, or that contain information that is obviously confidential. Examples of the latter include letters of references and recommendations for employment, promotions, and awards; nominations for awards and honors; resumes of colleagues of Dr. Viterbi; and grade reports of students in Dr. Viterbi's classes at the University of California, Los Angeles, and the University of California, San Diego.
    [Show full text]
  • IEEE Information Theory Society Newsletter
    IEEE Information Theory Society Newsletter Vol. 51, No. 3, September 2001 Editor: Lance C. Pérez ISSN 1059-2362 2001 Shannon Lecture Constrained Sequences, Crossword Puzzles and Shannon Jack Keil Wolf University of California, San Diego and QUALCOMM Incorporated One-dimensional con- tween every pair of uncon- strained sequences play an strained binary digits unless important role in both com- that pair of digits is both 0’s munication and storage sys- in which case insert a 1. tems. Many interesting Using this rule the uncon- constraints exist, e.g., bal- strained sequence …11010 anced codes, (d,k) codes, etc. 0 0 …becomes the con- strained sequence … 1 0 100 Initially we will concentrate 0 1001010 … where the in- on one-dimensional binary serted binary digits are un- (d,k) sequences [1]. These se- derlined. Decoding consists quences are described by two of removing the underlined integers, d and k, 0 ≤ d<k, binary digits. This is an ex- such that there are at least d ample of a fixed rate code in and at most k 0’s before and that the number of con- after every 1. As an example, Jack Wolf presenting the 2001 Shannon Lecture in strained binary digits is al- … 01010001001010 … is a seg- Washington D. C. ways a constant times the ment of an allowable (1,3) se- number of unconstrained binary digits. It is also an ex- quence while … 0110001000010 …is not, due to the ample of a systematic code in that the unconstrained bi- violations that are underlined. nary digits are present in the stream of constrained There is an abundance of literature on the applications binary digits.
    [Show full text]