Recent Developments in Nonparametric Inference and Probability Festschrift for Michael Woodroofe

Total Page:16

File Type:pdf, Size:1020Kb

Recent Developments in Nonparametric Inference and Probability Festschrift for Michael Woodroofe Institute of Mathematical Statistics LECTURE NOTES–MONOGRAPH SERIES Recent Developments in Nonparametric Inference and Probability Festschrift for Michael Woodroofe Jiayang Sun, Anirban DasGupta, Vince Melfi, Connie Page, Editors Volume 50 ISBN 0-940600-66-9 Institute of Mathematical Statistics LECTURE NOTES–MONOGRAPH SERIES Volume 50 Recent Developments in Nonparametric Inference and Probability Festschrift for Michael Woodroofe Jiayang Sun, Anirban DasGupta, Vince Melfi, Connie Page, Editors Institute of Mathematical Statistics Beachwood, Ohio, USA Institute of Mathematical Statistics Lecture Notes–Monograph Series Series Editor: R. A. Vitale The production of the Institute of Mathematical Statistics Lecture Notes–Monograph Series is managed by the IMS Office: Jiayang Sun, Treasurer and Elyse Gustafson, Executive Director. Library of Congress Control Number: 2006934183 International Standard Book Number 0-940600-66-9 International Standard Serial Number 0749-2170 Copyright c 2006 Institute of Mathematical Statistics All rights reserved Printed in the United States of America Contents Preface Jiayang Sun, Anirban DasGupta, Vince Melfi and Connie Page ............. v Contributors to this volume ................................................. vii PROBABILITY, BAYESIAN INFERENCE AND STOCHASTIC PROCESS Group invariant inferred distributions via noncommutative probability B. Heller and M. Wang ................................... 1 Invariance principles for fractionally integrated nonlinear processes Wei Biao Wu and Xiaofeng Shao .............................. 20 Random walk on a polygon Jyotirmoy Sarkar ....................................... 31 CONTEMPORARY SEQUENTIAL ANALYSIS Bias correction and confidence intervals following sequential tests Tze Leung Lai, Zheng Su and Chin Shan Chuang ..................... 44 Multivariate sequential analysis with linear boundaries Robert Keener ......................................... 58 Corrected confidence intervals for secondary parameters following sequential tests R. C. Weng and D. S. Coad ................................. 80 Efficient three-stage t-tests Jay Bartroff ..........................................105 BIASED SAMPLING, MEASUREMENT ERROR MODELS AND RESTRICTED INFERENCE On the behavior of Bayesian credible intervals for some restricted parameter space problems Eric´ Marchand and William E. Strawderman ....................... 112 Sieve estimates for biased survival data Jiayang Sun and Bin Wang .................................127 Existence of the signal in the signal plus background model Tonglin Zhang .........................................144 A test for equality of multinomial distributions vs increasing convex order Arthur Cohen, John Kolassa and Harold Sackrowitz ................... 156 NONLINEAR RENEWAL THEORY Nonlinear renewal theorems for random walks with perturbations of intermediate order Keiji Nagai and Cun-Hui Zhang ..............................164 A non-linear Renewal Theorem with stationary and slowly changing perturbations Dong-Yun Kim and Michael Woodroofe ..........................176 MULTIPLE TESTING, FDR, STATISTICS IN IMAGING AND DATA MINING On the false discovery rates of a frequentist: Asymptotic expansions Anirban DasGupta and Tonglin Zhang ...........................190 Spatial-temporal data mining procedure: LASR Xiaofeng Wang, Jiayang Sun and Kath Bogie ....................... 213 iii Preface There have been extensive developments recently in modern nonparametric infer- ence and modeling. Nonparametric and semi-parametric methods are especially useful with large amounts of data that are now routinely collected in many areas of science. Probability and stochastic modeling are also playing major new roles in scientific applications. This refereed special volume highlights challenges and developments at this in- terface of statistics, probability and the sciences, and honors Michael B. Woodroofe for his pioneering contributions to nonparametric inference and probability. Topics covered include biased sampling and missing data, shape-restricted infer- ence, contemporary sequential analysis, modern nonparametric inference, probabil- ity, and statistics applications. Some of the papers in this volume were presented at “A Conference on Nonparametric Inference and Probability with Applications to Science”, September 24–25, 2005, at Ann Arbor, Michigan: http:// www.stat.lsa.umich.edu/conference/mw2005/ for which there were 97 pre-registered participants. The conference was organized by Robert Keener and Jiayang Sun. Invited Speakers and participants included: Persi Diaconis, Robert Keener, Steve Lalley, T.L. Lai, Mario Mateo, Mary Meyer, Vijay Nair, Gordie Simons, Jiayang Sun, Michael Woodroofe, Wei Biao Wu, Cun-Hui Zhang, Charles Hagwood, Steve Coad, Hira Koul, Anand Vidyashenkar, Zhiliang Ying, Arniban DasGupta, Moulinath Banerjee, Anna Amirdjanova, Bill Strawder- man, Connie Page, Tom Sellke, Byron Roe, Vince Melfi, and Herman Chernoff. Michael Woodroofe has had a distinguished career and is widely recognized as a pre-eminent scientist in statistics and probability. He has broad interests and has made deep and significant contributions in many areas, many represented by sessions at this conference. His work in probability, sequential analysis and inference is regarded as seminal and pioneering and has influenced an entire generation of researchers. He has published more than 100 research articles, written a SIAM monograph, and authored a book. He is a former Editor of the Annals of Statistics, a member of Phi Beta Kappa, and a fellow of the Institute of Mathematical Statistics and an elected member of the International Statistical Institute. We thank the National Science Foundation, the National Security Agency, and the University of Michigan, (the Department of Statistics; the College of Litera- ture, Science, and the Arts; the Office of the Vice President for Research; and the Rackham Graduate School) for their financial support to the conference, and the Institute of Mathematical Statistics, and the American Statistical Association for the co-sponsorship. We also thank Amy Rundquist for conference administration. Jiayang Sun, Anirban DasGupta, Case Western Reserve University Purdue University Vince Melfi, Connie Page, Michigan State University Michigan State University v Special Thanks to Editorial Assistants Steve Ganocy Xiaofeng Wang vi Contributors to this volume Bartroff, J., Stanford University Bogie, K., Cleveland FES center Chuang, C. S., Millennium Partners Coad, D. S., University of London Cohen, A., Rutgers University DasGupta, A., Purdue University Heller, B., Illinois Institute of Technology Keener, R., University of Michigan Kim, D.-Y., Michigan State University Kolassa, J., Rutgers University Lai, T. L., Stanford University Marchand, E., Universit´ede Sherbrooke Nagai, K., Yokohama National University Sackrowitz, H., Rutgers University Sarkar, J., Indiana University Purdue University Indianapolis Shao, X., University of Chicago Strawderman, W. E., Rutgers University Su, Z., Stanford University Sun, J., Case Western Reserve University Wang, B., University of South Alabama Wang, M., University of Chicago Wang, X., The Cleveland Clinic Foundation Weng, R. C., National Chengchi University Woodroofe, M., the University of Michigan Wu, W. B., University of Illinois, at Urbana-Champaign Zhang, C.-H., Rutgers University Zhang, T., Purdue University vii IMS Lecture Notes–Monograph Series Recent Developments in Nonparametric Inference and Probability Vol. 50 (2006) 1–19 c Institute of Mathematical Statistics, 2006 DOI: 10.1214/074921706000000563 Group invariant inferred distributions via noncommutative probability 1 2, B. Heller and M. Wang ∗ Illinois Institute of Technology and University of Chicago Abstract: One may consider three types of statistical inference: Bayesian, fre- quentist, and group invariance-based. The focus here is on the last method. We consider the Poisson and binomial distributions in detail to illustrate a group invariance method for constructing inferred distributions on parameter spaces given observed results. These inferred distributions are obtained without using Bayes’ method and in particular without using a joint distribution of random variable and parameter. In the Poisson and binomial cases, the final formulas for inferred distributions coincide with the formulas for Bayes posteriors with uniform priors. 1. Introduction The purpose of this paper is to construct a probability distribution on the parame- ter space given an observed result (inferred distribution) in the case of a discrete random variable with a continuous parameter space using group theoretic meth- ods. We present two examples, the Poisson and binomial distributions. From the point of view of posterior Bayes distributions, these group theoretic methods lead to uniform non-informative prior distributions on canonical parameters for both the Poisson and binomial cases. Alternatively, posterior distributions are obtained here from group theory alone without explicitly using Bayes method. The construction of inferred probability distributions by non-Bayesian methods has a long history beginning with Fisher’s fiducial method of inference. The use of group theoretic methods to construct pivotal functions also has a long history as introduced in Fraser (1961) and amplified by many others since then. Briefly, the group theoretic or “invariance” method of inference has operated from a context in which a group G acts upon both the parameter space and the sample space. Consider
Recommended publications
  • Program Book Final
    GENERAL PROGRAM SCHEDULE 8:00 am–12:00 pm FRY-New Brunswick SUNDAY AUGUST 8 Advisory Committee on Teacher Enhancement (closed) Committee/Business Meetings & Other Activities Chair(s): Thomas H. Short, Indiana University of Pennsylvania 7:00 am–4:00 pm FRY-Meeting Services Desk 8:00 am–12:30 pm ICH-Halton JSM CE Pre-registered Pick Up Desk Committee on Publications (closed) Chair(s): William Q. Meeker, Iowa State University 7:00 am–6:00 pm FRY- Prince Edward Island Sunday Speaker Work Room 8:00 am–1:00 pm FRY-York Pathways to the Future Workshop 7:00 am–6:00 pm TCC-702 Organizer(s): Lynne Billard, University of Georgia Speaker Work Room 8:00 am–6:00 pm TCC-Exhibit Hall E 7:00 am–8:30 pm TCC-600 Level Exhibitor Lounge ASA Membership Booth (Reg Area) 9:00 am–10:30 am ICH-Grenadier 7:00 am–8:30 pm TCC-600 Level Caucus for Women in Statistics Committee Meeting JSM Main Registration Organizer(s): Mariza de Andrade, Mayo Clinic 7:00 am–8:30 pm TCC-600 Level 9:00 am–11:00 am TCC-Exhibit Hall F Special Assistance Desk Career Placement Service (Job Posting and Resume Submission Only) 7:00 am–8:30 pm TCC-Entrance of South Building Guest Services Desk 9:00 am–12:00 pm FRY-Nova Scotia Council of Sections Governing Board Meeting 7:00 am–8:30 pm TCC-600 Level (closed) Press Desk Chair(s): Thomas J. Santner, The Ohio State University 7:00 am–11:00 pm TCC-600 Level 9:00 am–5:00 pm TCC-600 Level Cyber Café and Message Center ASA Marketplace 7:30 am–8:15 am ICH-Oakville 10:00 am–2:00 pm ICH-Haliburton Association of GCRC Statisticians Breakfast (closed) Committee on Meetings (closed) Organizer(s): Curtis A Parvin, Washington University School of Medicine Chair(s): Kim McGuigan, Medco Health Solutions 7:30 am–9:00 am ICH-Grenadier 11:00 am–2:00 pm ICH-Humber Committee on Women in Statistics (closed) NISS/SAMSI Affiliates Meeting (closed) Chair(s): Amita K.
    [Show full text]
  • Notices of the American Mathematical Society
    NUMERICAL ANALYSIS edited by Gene H. Golub and Joseph Oliger Lecture Notes from the Short Course sponsored by the AMS, Atlanta, january 3-4, 1978 This is the collection of texts prepared by the lec­ corporate the classical notions and realistic costs turers of the Numerical Analysis Short Course of producing the desired result. The discussion of given at the A. M.S. meeting in Atlanta, Georgia in good vs. best approximation is an example. More January 1978. Computational linear algebra, opti· attention is being given to providing not only an mization and the solution of nonlinear equations, answer, but a computed guarantee that it is a good the approximation of functions and functionals, answer-or a poor one. Easily computed and sharp and approximations for initial and boundary value a posteriori estimates are needed. The discussion problems for ordinary and partial differential equa­ of estimates of condition numbers is an example. tions are discussed. Methods such as the QR fac­ There is progress being made in algorithm design torization, singular value decomposition, quasi­ based on operator splittings which allow one to Newton and secant methods, finite difference, fi· take advantage of being able to solve simpler sub­ nite element and collocation methods are included problems very efficiently. Updating strategies for in these discussions. · optimization and splitting methods for differential equations are examples. The subject matter was chosen to emphasize prom­ inent research areas and attitudes in numerical These texts should be useful to the practicing users analysis. These are introductory lectures on the of numerical methods, programmers, scientists, subject matter for presentation to an audience of and engineers who would like to know what prog· scientists from other areas or disciplines.
    [Show full text]
  • IMS Bulletin
    Volume 36 • Issue 3 IMS Bulletin April 2007 IMS launches two new journals Statistics Surveys CONTENTS Statistics Surveys is a new open access, electronic journal, sponsored by IMS and the 1 New IMS journals Bernoulli Society. Statistics Surveys publishes survey articles in theoretical, applied, and computational statistics. The style of articles may range from reviews of recent 2–3 IMS Members’ News: Michael Woodroofe, Arak research to graduate textbook exposition. Articles may be broad or narrow in scope. Mathai, Howell Tong The essential requirements are a well-specified topic and target audience, together with clear exposition. 4 Board on Mathematical Jon Wellner Sciences & Applications We are pleased to announce the appointment of , University of Washington, as IMS Executive Editor, and Wendy L. Martinez, US Office of Naval 5 C R Rao Advanced Institute Research, as Coordinating Editor. 7 Profile: Bruno de Finetti Sponsorship from other societies is welcomed. Each sponsoring society appoints its own Executive Editor, who in turn has authority to appoint any number of Associate 8 NSF Statistics Program; Funding for Probability Editors on behalf of their sponsoring society (Associate Editors are sponsored by only one society). An initial set of twenty IMS-sponsored Associate Editors have been IMS Childcare Initiative; 10 appointed; for a listing see http://www.i-journals.org/ss/editors.php. To discuss the NSF-CBMS Conferences potential involvement of a new sponsoring society, please contact Wendy 11 Terence’s Stuff: Model Martinez at [email protected]. Skeptics The journal can be accessed at http://www.i-journals.org/ss/. 12 IMS Meetings You can sign up to receive an email notification of each new issue’s Table of Contents — this also indicates your support, to 17 Other Meetings and Announcements editors and sponsors, for the journal’s work.
    [Show full text]
  • STATISTICAL SCIENCE Volume 31, Number 3 August 2016
    STATISTICAL SCIENCE Volume 31, Number 3 August 2016 A Review of Nonparametric Hypothesis Tests of Isotropy Properties in Spatial Data ...................................................Zachary D. Weller and Jennifer A. Hoeting 305 Rank Tests from Partially Ordered Data Using Importance and MCMC Sampling Methods .........................................................Debashis Mondal and Nina Hinrichs 325 On Negative Outcome Control of Unobserved Confounding as a Generalization of Difference-in-Differences................Tamar Sofer, David B. Richardson, Elena Colicino, Joel Schwartz and Eric J. Tchetgen Tchetgen 348 Quantum Annealing with Markov Chain Monte Carlo Simulations and D-Wave Quantum Computers...........................................Yazhen Wang, Shang Wu and Jian Zou 362 MarkovChainsasModelsinStatisticalMechanics.............................Eugene Seneta 399 Fractional Imputation in Survey Sampling: A Comparative Review ...............................................................Shu Yang and Jae Kwang Kim 415 AConversationwithMichaelWoodroofe............Moulinath Banerjee and Bodhisattva Sen 433 AConversationwithArthurCohen...............................................Joseph Naus 442 AConversationwithEstateV.Khmaladze................... Hira L. Koul and Roger Koenker 453 Statistical Science [ISSN 0883-4237 (print); ISSN 2168-8745 (online)], Volume 31, Number 3, August 2016. Published quarterly by the Institute of Mathematical Statistics, 3163 Somerset Drive, Cleveland, OH 44122, USA. Periodicals postage paid at Cleveland,
    [Show full text]