DOCSLIB.ORG

Nonparametric Statistics a Brief Introduction

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Nonparametric Statistics a Brief Introduction Nonparametric Statistics A Brief Introduction Curtis Greene December 4, 2003 Statistics Across the Curriculum – p.1 Nonparametric tests: examples • Sign Test • Mann-Whitney(=Wilcoxon Rank Sum) Test • Wilcoxon Signed Rank Test • Tukey’s Quick Test • Wald-Wolfowitz Runs Test • Kruskal-Wallis Test • Friedman Test • Spearman’s Rho /Kendall’s Tau • Chi-Squared Test • Kolmogorov-Smirnov Test • Log Rank Test Statistics Across the Curriculum – p.2 Nonparametric tests: examples • Sign Test (t-test/location) • Mann-Whitney(=Wilcoxon Rank Sum) Test • Wilcoxon Signed Rank Test (t-test/location) • Tukey’s Quick Test (t-test/location) • Wald-Wolfowitz Runs Test (t-test/location) • Kruskal-Wallis Test (ANOVA) • Friedman Test (ANOVA) • Spearman’s Rho /Kendall’s Tau (Correlation) • Chi-Squared Test (Goodness of fit) • Kolmogorov-Smirnov Test (Goodness of fit) • Log Rank Test (Survival data) Statistics Across the Curriculum – p.2 And possibly even more . Some statisticians would add to this list: • Binomial Test (comparing sample proportions) This despite the obvious presence of “parameters” being compared. Statistics Across the Curriculum – p.3 Definition of "nonparametric" • There is not complete agreement about the precise meaning of "nonparametric test". Some statisticians are more generous than others in what they would include. • Fortunately, it’s not a distinction worth arguing about. Nobody seems to care much about the semantics here. • The next slide contains a definition that seems to work pretty well. It is paraphrased from Practical Nonparametric Statistics, by W. J. Conover, which is an excellent book on this subject. Statistics Across the Curriculum – p.4 Definition of "nonparametric" A test is nonparametric if it satisfies at least one of the following conditions: • It may be applied to categorical(nominal) data. • It may be applied to ordinal data (measurements may be put in rank order). • It may be applied to continuous data where the distribution function of the random variable producing the data is either unspecified, or specified except for an infinite number of unknown parameters. – W. J. Conover, Practical Nonparametric Statistics Statistics Across the Curriculum – p.5 Some possible confusions • Nonparametric tests can also be applied to “parametric” data. • Nonparametric tests often compute “statistics” that are approximated by parametric distributions in the limit, e.g. approximately normal for large sample sizes. • For example, the chi-square test may be applied to any kind of data (even continuous normal). The accuracy of the chi-square statistic rests on “parametric” ideas, but requires the the sample sizes to be fairly large. For very small samples, there is an “even more nonparametric” version called Fishers’s exact test, that should be used instead. Statistics Across the Curriculum – p.6 Data for this talk Interval from primary AIDS diagnosis to death for a sample of 21 hemophiliac patients, stratified by age at diagnosis (1990 study). Age ≤ 40 Age > 40 P atientNumber Survival(months) P atientNumber Survival(months) 1 2 1 1 2 3 2 1 3 6 3 1 4 6 4 1 5 7 5 2 6 10 6 3 7 15 7 3 8 15 8 9 9 16 9 22 10 27 11 30 12 32 From Ch. 21, Principles of Biostatistics, by M. Pagano and K. Gauvreau Statistics Across the Curriculum – p.7 Approaches to Analyzing this Data • Compute means for the two groups and use a t-test to compare them. Statistics Across the Curriculum – p.8 Approaches to Analyzing this Data • Compute means for the two groups and use a t-test to compare them. • NO WAY!! This is a really bad idea. Statistics Across the Curriculum – p.8 Approaches to Analyzing this Data • Compute means for the two groups and use a t-test to compare them. • NO WAY!! This is a really bad idea. • Mann-Whitney (= Wilcoxon rank sum) test. Statistics Across the Curriculum – p.8 Approaches to Analyzing this Data • Compute means for the two groups and use a t-test to compare them. • NO WAY!! This is a really bad idea. • Mann-Whitney (= Wilcoxon rank sum) test. • Wald-Wolfowitz runs test. Statistics Across the Curriculum – p.8 Approaches to Analyzing this Data • Compute means for the two groups and use a t-test to compare them. • NO WAY!! This is a really bad idea. • Mann-Whitney (= Wilcoxon rank sum) test. • Wald-Wolfowitz runs test. • Tukey’s quick test. Statistics Across the Curriculum – p.8 Approaches to Analyzing this Data • Compute means for the two groups and use a t-test to compare them. • NO WAY!! This is a really bad idea. • Mann-Whitney (= Wilcoxon rank sum) test. • Wald-Wolfowitz runs test. • Tukey’s quick test. • Kaplan-Meier survival analysis, with a log-rank test*. *The data came from a chapter in Pagano-Gauvreau illustrating this method. Statistics Across the Curriculum – p.8 Wald-Wolfowitz Runs Test Objective: to test • H0: samples come from the populations with the same distribution, vs. • Ha: samples come from populations with different distributions Statistics Across the Curriculum – p.9 Wald-Wolfowitz Runs Test Objective: to test • H0: samples come from the populations with the same distribution, vs. • Ha: samples come from populations with different distributions Method: • Arrange all of the data in increasing order, labelling entries with “A” or “B” according to which sample they came from. • Compute the number T of “runs” of A’s or B’s. • Reject H0 if T is too large or too small. Statistics Across the Curriculum – p.9 Wald-Wolfowitz Runs Test 111122333667 B B B B A B A B B A A A 9 10 15 15 16 22 27 30 32 B A A A A B A A A T = # Runs = 10 Or maybe (because of ties) 111122333667 B B B B A B B B A A A A 9 10 15 15 16 22 27 30 32 B A A A A B A A A T = # Runs =8 This is neither too many nor too few to reject H0 at the 5% level (but it’s close). Statistics Across the Curriculum – p.10 Wald-Wolfowitz Runs Test • When a and b (the size of the two groups) are small, the cutoff values at various significance levels can be looked up in tables. Statistics Across the Curriculum – p.11 Wald-Wolfowitz Runs Test • When a and b (the size of the two groups) are small, the cutoff values at various significance levels can be looked up in tables. • For this example (with a = 12 and b =9) the acceptance region for a 2-tailed test (p = .05) is 7 ≤ T ≤ 15, and for a 1-tailed test it is T ≥ 8. Statistics Across the Curriculum – p.11 Wald-Wolfowitz Runs Test • When a and b (the size of the two groups) are small, the cutoff values at various significance levels can be looked up in tables. • For this example (with a = 12 and b =9) the acceptance region for a 2-tailed test (p = .05) is 7 ≤ T ≤ 15, and for a 1-tailed test it is T ≥ 8. • When a and b are large, T is approximately normal, with 2ab 2ab(2ab − a − b) µ = +1 , σ = 2 a + b s(a + b) (a + b − 1) Statistics Across the Curriculum – p.11 Jacob Wolfowitz Jacob Wolfowitz (1910-1981) is described in one obituary as “a giant among the founders of American Statistics”. He is best known for his work on sequential analysis and decision theory. According to one account, he is the first one to use the phrase “nonparametric statistics”, in a 1942 paper. His son Paul Wolfowitz (1943-) is currently serving as Deputy Secretary of Defense. Statistics Across the Curriculum – p.12 Main Page | Recent changes | Edit this page | Page Not logged in history Log in | Help Printable version Go Search Other languages: Deutsch | (Nihongo) Paul Wolfowitz From Wikipedia, the free encyclopedia. Paul Wolfowitz (born December 22, 1943) is an American political advisor and United States Deputy Secretary of Defense. Main Page Recent changes Random page He is a neoconservative and Straussian Current events known for his "hawkish" views, passionate pro-Israel advocacy and staunch support for Edit this page war on Iraq. Discuss this page Page history Wolfowitz is currently United States Deputy What links here Secretary of Defense — second in charge of Related changes the defense department, under the US Secretary of Defense, Donald Rumsfeld. Special pages Bug reports Donations A military analyst under Ronald Reagan, Wolfowitz was later a leading participant in the Project for the New American Century. That think tank formed in 1997 during the Clinton presidency, and expressed a new foreign policy with regard to Iraq and other "potential aggressor states", dismissing "containment" in favor of "preemption"; strike first to eliminate threats. Clinton, along with George H. W. Bush, Colin Powell, and other former Bush administration officials, dismissed calls for "preemption" in favor of continued "containment." This was the policy of George W. Bush as well for his first several months in office. Many saw Wolfowitz's plan as a "blueprint for US hegemony" and his "preemption" policy remained contained until the terrorist attacks of September 11 revived hawkish advocacy for defending by attacking. Folllowing the terrorist attacks of 9-11 debate began within the White House as to the degrees of action to take against Al Qaeda. The neoconservative members of President Bush's cabinet led by Wolfowitz advocated premptive strikes on terror cells in Afghanistan. This signaled the start of a new direction in the foreign policy plan of the Bush Administration, and led to the creation of what would later be dubbed the Bush Doctrine. Secretary of State Colin Powell supports the philosophy behind containment, as a moderated degree of action.
Load more

Recommended publications
  • Principles of Communications ECS 332
    Principles of Communications ECS 332 Asst. Prof. Dr. Prapun Suksompong (ผศ.ดร.ประพันธ ์ สขสมปองุ ) [email protected] 1. Intro to Communication Systems Office Hours: Check Google Calendar on the course website. Dr.Prapun’s Office: 6th floor of Sirindhralai building, 1 BKD 2 Remark 1 If the downloaded file crashed your device/browser, try another one posted on the course website: 3 Remark 2 There is also three more sections from the Appendices of the lecture notes: 4 Shannon's insight 5 “The fundamental problem of communication is that of reproducing at one point either exactly or approximately a message selected at another point.” Shannon, Claude. A Mathematical Theory Of Communication. (1948) 6 Shannon: Father of the Info. Age Documentary Co-produced by the Jacobs School, UCSD- TV, and the California Institute for Telecommunic ations and Information Technology 7 [http://www.uctv.tv/shows/Claude-Shannon-Father-of-the-Information-Age-6090] [http://www.youtube.com/watch?v=z2Whj_nL-x8] C. E. Shannon (1916-2001) Hello. I'm Claude Shannon a mathematician here at the Bell Telephone laboratories He didn't create the compact disc, the fax machine, digital wireless telephones Or mp3 files, but in 1948 Claude Shannon paved the way for all of them with the Basic theory underlying digital communications and storage he called it 8 information theory. C. E. Shannon (1916-2001) 9 https://www.youtube.com/watch?v=47ag2sXRDeU C. E. Shannon (1916-2001) One of the most influential minds of the 20th century yet when he died on February 24, 2001, Shannon was virtually unknown to the public at large 10 C.
    [Show full text]
  • Arxiv:1306.1586V4 [Quant-Ph]
    Strong converse for the classical capacity of entanglement-breaking and Hadamard channels via a sandwiched R´enyi relative entropy Mark M. Wilde∗ Andreas Winter†‡ Dong Yang†§ May 23, 2014 Abstract A strong converse theorem for the classical capacity of a quantum channel states that the probability of correctly decoding a classical message converges exponentially fast to zero in the limit of many channel uses if the rate of communication exceeds the classical capacity of the channel. Along with a corresponding achievability statement for rates below the capacity, such a strong converse theorem enhances our understanding of the capacity as a very sharp dividing line between achievable and unachievable rates of communication. Here, we show that such a strong converse theorem holds for the classical capacity of all entanglement-breaking channels and all Hadamard channels (the complementary channels of the former). These results follow by bounding the success probability in terms of a “sandwiched” R´enyi relative entropy, by showing that this quantity is subadditive for all entanglement-breaking and Hadamard channels, and by relating this quantity to the Holevo capacity. Prior results regarding strong converse theorems for particular covariant channels emerge as a special case of our results. 1 Introduction One of the most fundamental tasks in quantum information theory is the transmission of classical data over many independent uses of a quantum channel, such that, for a fixed rate of communica- tion, the error probability of the transmission decreases to zero in the limit of many channel uses. The maximum rate at which this is possible for a given channel is known as the classical capacity of the channel.
    [Show full text]
  • Jacob Wolfowitz 1910–1981
    NATIONAL ACADEMY OF SCIENCES JACOB WOLFOWITZ 1910–1981 A Biographical Memoir by SHELEMYAHU ZACKS Any opinions expressed in this memoir are those of the author and do not necessarily reflect the views of the National Academy of Sciences. Biographical Memoirs, VOLUME 82 PUBLISHED 2002 BY THE NATIONAL ACADEMY PRESS WASHINGTON, D.C. JACOB WOLFOWITZ March 19, 1910–July 16, 1981 BY SHELEMYAHU ZACKS ACOB WOLFOWITZ, A GIANT among the founders of modern Jstatistics, will always be remembered for his originality, deep thinking, clear mind, excellence in teaching, and vast contributions to statistical and information sciences. I met Wolfowitz for the first time in 1957, when he spent a sab- batical year at the Technion, Israel Institute of Technology. I was at the time a graduate student and a statistician at the building research station of the Technion. I had read papers of Wald and Wolfowitz before, and for me the meeting with Wolfowitz was a great opportunity to associate with a great scholar who was very kind to me and most helpful. I took his class at the Technion on statistical decision theory. Outside the classroom we used to spend time together over a cup of coffee or in his office discussing statistical problems. He gave me a lot of his time, as though I was his student. His advice on the correct approach to the theory of statistics accompanied my development as statistician for many years to come. Later we kept in touch, mostly by correspondence and in meetings of the Institute of Mathematical Statistics. I saw him the last time in his office at the University of Southern Florida in Tampa, where he spent the last years 3 4 BIOGRAPHICAL MEMOIRS of his life.
    [Show full text]
  • Rakesh V. Vohra
    Rakesh V. Vohra Department of Economics and the Department of Electrical and Systems Engineering University of Pennsylvania Philadelphia, PA 19104 Electronic mail: [email protected], [email protected] August 15th, 2020 Experience • (2013 to date) George A. Weiss and Lydia Bravo Weiss University Professor, Depart- ment of Economics and the Department of Electrical and Systems Engineering, University of Pennsylvania • (2013 to date) Secondary appointment, Department of Computer and Information Sciences, University of Pennsylvania. • (1999 to 2013) John L. and Helen Kellogg Professor of Managerial Economics and Decision Sciences, Kellogg School of Management, Northwestern University. • (2010 to 2013) Professor (Courtesy), Department of Economics, Weinberg College of Arts and Sciences, Northwestern University. • (2006 to 2013) Professor (Courtesy), Electrical Engineering and Computer Science, Mc- Cormick School, Northwestern University. • (1998 to 1999) Professor of Managerial Economics and Decision Sciences, Kellogg School of Management, Northwestern University. • (1991 to 1998) Associate Professor of Management Science and Industrial Engineering, Fisher College of Business, The Ohio State University. • (1985 to 1991) Assistant Professor of Management Science, Fisher College of Business, The Ohio State University. • (Summer 2011, 2012, 2014) Visiting Researcher, Microsoft Research, New England. • (Summer 2006) Visiting Researcher, Microsoft Research, Redmond. • (Winter 2005) Visiting Scholar, California Institute of Technology. • (Spring 2004, 2006, 2011, 2016) Visiting Professor, Indian School of Business. 1 • (Summer 2003) METEOR Fellow, Department of Quantitative Economics, University of Maas- tricht. • (September 2000) Cycle and Carriage Visiting Professor, Department of Decision Sciences, College of Business, National University of Singapore. • (1997-1998) Visiting Associate Professor, The Kellogg School of Management, Northwestern University. • (1992 -1993, Summer '96) Visiting Associate Professor, The Sloan School, MIT.
    [Show full text]
  • Symposium in Remembrance of Rudolf Ahlswede
    in cooperation with Fakultät für Mathematik Department of Mathematics Symposium in Remembrance of Rudolf Ahlswede July 25 -26, 2011 Program and Booklet of Abstracts Symposium in Remembrance of Rudolf Ahlswede Bielefeld, Germany, July 25 -26, 2011 Program and Booklet of Abstracts Organizers: Harout Aydinian Ingo Alth¨ofer Ning Cai Ferdinando Cicalese Christian Deppe Gunter Dueck Ulrich Tamm Andreas Winter Contents 1 Program 1 2 Rudolf Ahlswede 1938-2010 5 Christian Deppe 3 Obituary of the ZIF 11 Manuela Lenzen 4 AZ-identity for regular posets 13 Harout Aydinian 5 Quantum information, the ambiguity of the past, and the complexity of the present 15 Charles Bennett 6 Local-global principles in discrete extremal problems 17 Sergei L. Bezrukov 7 Secure network coding 19 Ning Cai 8 Common randomness in information theory 21 Imre Csisz´ar 9 The deep impact of Rudolf Ahlswede on combinatorics 23 Gyula O. H. Katona 10 Common randomness and multiterminal secure computation 25 Prakash Narayan 11 String reconstruction from substring compositions 27 Alon Orlitsky 12 Stochastic search for locally clustered targets 29 K. R¨udigerReischuk 13 Information flows and bottle necks in dynamic communication networks 31 Soren Riis 14 On the complexity of families of binary sequences and lattices 33 Andras Sarkozy 15 Higher order extremal problems 35 L´aszl´oSz´ekely 16 A generalisation of the Gilbert-Varshamov bound and its asymptotic evaluation 37 Ludo Tolhuizen 17 Quantum channels and identification theory 39 Andreas Winter 18 List of Participants 41 iii Monday July 25, 2011 PROGRAM 10:15 Warm up: C. Bennett - Quantum information, the ambiguity of the past, and the complexity of the present 12:00 Welcome and registration at the ZiF - Chair C.
    [Show full text]
  • Engineering Theory and Mathematics in the Early Development of Information Theory
    1 Engineering Theory and Mathematics in the Early Development of Information Theory Lav R. Varshney School of Electrical and Computer Engineering Cornell University information theory in the American engineering community Abstract— A historical study of the development of information and also touch on the course that information theory took in theory advancements in the first few years after Claude E. Shannon’s seminal work of 1948 is presented. The relationship the American mathematics community. As the early between strictly mathematical advances, information theoretic development of information theory was being made, social evaluations of existing communications systems, and the meanings of the nascent field were just being constructed and development of engineering theory for applications is explored. It incorporated by the two different social groups, mathematical is shown that the contributions of American communications scientists and communications engineering theorists. The engineering theorists are directly tied to the socially constructed meanings constructed had significant influence on the direction meanings of information theory held by members of the group. The role played by these engineering theorists is compared with that future developments took, both in goals and in the role of American mathematical scientists and it is also shown methodology. Mutual interaction between the two social that the early advancement of information is linked to the mutual groups was also highly influenced by these social meanings. interactions between these two social groups. In the half century since its birth, Shannon information theory has paved the way for electronic systems such as compact discs, cellular phones, and modems, all built upon the I. INTRODUCTION developments and social meanings of its first few years.
    [Show full text]
  • History of the Department of Statistics at Columbia University
    Columbia University Statistics Tian Zheng and Zhiliang Ying Statistical Activities at Columbia Before 1946 Statistical activities at Columbia predate the formation of the department. Faculty members from other disciplines had carried out research and instruction of sta- tistics, especially in the Faculty of Political Sciences (Anderson 1955). Harold Hotelling’s arrival in 1931, a major turning point, propelled Columbia to a position of world leadership in Statistics. Hotelling’s primary research activities were in Mathematical, Economics, and Statistics but his interests had increasingly shifted toward Statistics. According to Paul Samuelson (Samuelson 1960), ‘‘It was at Columbia, in the decade before World War II, that Hotelling became the Mecca towards whom the best young students of economics and mathematical statistics turned. Hotelling’s increasing preoccupation with mathematical statistics was that discipline’s gain but a loss to the literature of economics.’’ His many contributions include canonical correlation, principal components and Hotelling’s T2. In 1938, after attending a conference of the Cowles Commission for Research in Economics, Abraham Wald, concerned by the situation in Europe, decided to stay in the United States. With Hotelling’s assistance, Wald came to Columbia on A substantial part of this chapter was developed based on Professor T. W. Anderson’s speech during our department’s sixtieth year anniversary reunion. We thank Professor Anderson for his help (as a founding member of our department) during the preparation of this chapter, our current department faculty members, Professors Ingram Olkin, and and Tze Leung Lai for their comments and suggestions on earlier versions of this chapter. Columbia University, Room 1005 SSW, MC 4690 1255 Amsterdam Avenue, New York, NY 10027, USA T.
    [Show full text]
  • AMERICAN MATHEMATICAL SOCIETY Notices
    AMERICAN MATHEMATICAL SOCIETY Notices Edited by J. H. CURTISS Issue Number 14 December 1955 111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111 Contents MEETINGS Calendar of Meetings ........................................................................ 2 Program of the Annual Meeting in Houston .................................... 3 NEWS ITEMS AND ANNOUNCEMENTS ........................ ...... ................... 17 CATALOGUE OF LECTURE NOTES .................................................... 23 PERSONAL ITEMS ................................................................................... 32 NEW PUBLICATIONS .. ................................ ............................................ 38 MEMORANDUM TO MEMBERS Reservation form .. .............................................................................. 41 Published by the Society MENASHA, WISCONSIN, AND PROVIDENCE, RHODE ISLAND Printed in the United States of America CALENDAR OF MEETINGS Note: This Calendar lists all of the meetings which have been ap­ proved by the Council up to the date at which this issue of the Notices was sent to press. The meeting dates which fall rather far in the future are subject to change. This is particularly true of the meetings to which no numbers have yet been assigned. Meet­ Deadline ing Date Place for No. Abstracts 522 February 25, 1956 New York, New York Jan. 12 April 20-21, 1956 New York, New York April 28, 1956 Monterey, California
    [Show full text]
  • Abelian Varieties in Coding and Cryptography
    IEEE Information Theory Society Newsletter Vol. 61, No. 1, March 2011 Editor: Tracey Ho ISSN 1045-2362 Editorial committee: Helmut Bölcskei, Giuseppe Caire, Meir Feder, Joerg Kliewer, Anand Sarwate, and Andy Singer President’s Column Giuseppe Caire I am deeply honored to serve as your Society too often forgotten by many politicians and peo- president for 2011. I’d like to begin with ac- ple with responsibilities around the world. On knowledging my recent predecessors, Frank the other hand, we have a lot of work to do and Kschischang (Junior Past President) and Andrea we must be proactive in facing the challenges Goldsmith (Senior Past President), as well as that the future is putting in front of us. Dave Forney, who has offi cially ended his ser- vice as an offi cer of the IT Society on December While our Information Theory Transactions 31st, 2010, after a long and perhaps unmatched continues to rank at the top of the ISI Journal history of leadership and guidance, that stands Citation Report among all journals in Electri- as a reference for all of us. Under their lead, the cal and Electronic Engineering and Computer IT Society has sailed through some signifi cant Science in total citations, and fi rst among all storms, such as an unprecedented economic re- journals in Electrical Engineering, Computer cession, causing turmoil for IEEE fi nances, and a Science and Applied Mathematics according number of sad events, including the premature to the Eigenfactor tm score, the “sub-to-pub” passing of Shannon Lecturer Rudolf Ahlswede time (i.e., the length of the time between fi rst and other notables.
    [Show full text]
  • Principles of Communications ECS 332
    Principles of Communications ECS 332 Asst. Prof. Dr. Prapun Suksompong (ผศ.ดร.ประพันธ ์ สขสมปองุ ) [email protected] 1. Intro to Communication Systems Office Hours: BKD, 6th floor of Sirindhralai building Wednesday 13:45-15:15 Friday 13:45-15:15 1 “The fundamental problem of communication is that of reproducing at one point either exactly or approximately a message selected at another point.” Shannon, Claude. A Mathematical Theory Of Communication. (1948) 2 Shannon: Father of the Info. Age Documentary Co-produced by the Jacobs School, UCSD-TV, and the California Institute for Telecommunications and Information Technology Won a Gold award in the Biography category in the 2002 Aurora Awards. 3 [http://www.uctv.tv/shows/Claude-Shannon-Father-of-the-Information-Age-6090] [http://www.youtube.com/watch?v=z2Whj_nL-x8] C. E. Shannon (1916-2001) 1938 MIT master's thesis: A Symbolic Analysis of Relay and Switching Circuits Insight: The binary nature of Boolean logic was analogous to the ones and zeros used by digital circuits. The thesis became the foundation of practical digital circuit design. The first known use of the term bit to refer to a “binary digit.” Possibly the most important, and also the most famous, master’s thesis of the century. It was simple, elegant, and important. 4 C. E. Shannon: Master Thesis 5 Boole/Shannon Celebration Events in 2015 and 2016 centered around the work of George Boole, who was born 200 years ago, and Claude E. Shannon, born 100 years ago. Events were scheduled both at the University College Cork (UCC), Ireland and the Massachusetts Institute of Technology (MIT) 6 http://www.rle.mit.edu/booleshannon/ An Interesting Book The Logician and the Engineer: How George Boole and Claude Shannon Created the Information Age by Paul J.
    [Show full text]
  • Spectrally Efficient Bidirectional Decode-And
    Spectrally Efficient Bidirectional Decode-and-Forward Relaying for Wireless Networks von Diplom-Ingenieur Tobias Josef Oechtering aus Rheine von der Fakultät IV - Elektrotechnik und Informatik der Technischen Universität Berlin zur Erlangung des akademischen Grades Doktor der Ingenieurwissenschaften – Dr.-Ing. – genehmigte Dissertation Promotionsausschuss Vorsitzender: Prof. Dr.-Ing. habil. Gerhard Mönich 1. Berichter: Prof. Dr.-Ing. Dr. rer. nat. Holger Boche, 2. Berichter: Prof. Dr.-Ing. Dr.-Ing. E. h. Joachim Hagenauer Tag der wissenschaftlichen Aussprache: 09.10.2007 Berlin, 2007 D83 ii Zusammenfassung Relaiskonzepte werden in Zunkuft in drahtlosen Netzwerken eine zentrale Rolle spielen. In dieser Dissertation wird ein Netzwerk mit drei Stationen betrachtet, in welchem zwei Stationen mittels einer Relaisstation miteinander kommunizieren. Wir untersuchen ein Zweiphasenprotokoll ohne Rückkopplung, in dem die Relaisstation die Nachrichten für beide Richtungen gleichzeitig dekodiert und weiterleitet. Damit kann der spektrale Ver- lust, verursacht durch halbduplexe Stationen in unidirektionalen Protokollen, kompensiert werden. Im ersten Abschnitt geht es um schichtübergreifende Konzepte für die bidirektionale Re- laiskommunikation basierend auf dem Prinzip der Superpositionskodierung. Die Betrach- tungen werden für die festgelegte und optimale Zeitaufteilung der Phasen durchgeführt. Eine ausführliche Untersuchung der Kombinatorik der erreichbaren Ratenregion für Stationen mit einer Antenne erlaubt es uns die Ratenpaare, bei denen die Summe
    [Show full text]
  • ©Copyright 2020 Xin Yang Towards Better Understanding of Algorithms and Complexity of Some Learning Problems
    ©Copyright 2020 Xin Yang Towards Better Understanding of Algorithms and Complexity of Some Learning Problems Xin Yang A dissertation submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy University of Washington 2020 Reading Committee: Paul Beame, Chair Kevin Jamieson Sewoong Oh Program Authorized to Offer Degree: Computer Science and Engineering University of Washington Abstract Towards Better Understanding of Algorithms and Complexity of Some Learning Problems Xin Yang Chair of the Supervisory Committee: Professor Paul Beame Computer Science and Engineering We present several novel results on computational problems related to supervised learn- ing. We focus on the computational resources required by algorithms to solve learning problems. The computational resources we consider are running time, memory usage and query complexity, which is the number of positions in the input that the algorithm needs to check. Some contributions include: • Time-space tradeoff lower bounds for problems of learning from uniformly random labelled examples. With our methods we can obtain bounds for learning concept classes of finite functions from random evaluations even when the sample space of random inputs can be significantly smaller than the concept class of functions and the function values can be from an arbitrary finite set. • A simple and efficient algorithm for approximating the John Ellipsoid of a symmet- ric polytope. Our algorithm is near optimal in the sense that our time complexity matches the current best verification algorithm. Experimental results suggest that our algorithm significantly outperforms existing algorithms. • The first algorithm for the total least squares problem, a variant of the ordinary least squares problem, that runs in time proportional to the sparsity of the input.
    [Show full text]