R(Y NONRESPONSE in SURVEY RESEARCH Proceedings of the Eighth International Workshop on Household Survey Nonresponse 24-26 September 1997
Total Page:16
File Type:pdf, Size:1020Kb
ZUMA Zentrum für Umfragen, Melhoden und Analysen No. 4 r(y NONRESPONSE IN SURVEY RESEARCH Proceedings of the Eighth International Workshop on Household Survey Nonresponse 24-26 September 1997 Edited by Achim Koch and Rolf Porst Copyright O 1998 by ZUMA, Mannheini, Gerinany All rights reserved. No part of tliis book rnay be reproduced or utilized in any form or by aiiy means, electronic or mechanical, including photocopying, recording, or by any inforniation Storage and retrieval System, without permission in writing froni the publisher. Editors: Achim Koch and Rolf Porst Publisher: Zentrum für Umfragen, Methoden und Analysen (ZUMA) ZUMA is a member of the Gesellschaft Sozialwissenschaftlicher Infrastruktureinrichtungen e.V. (GESIS) ZUMA Board Chair: Prof. Dr. Max Kaase Dii-ector: Prof. Dr. Peter Ph. Mohlcr P.O. Box 12 21 55 D - 68072.-Mannheim Germany Phone: +49-62 1- 1246-0 Fax: +49-62 1- 1246- 100 Internet: http://www.social-science-gesis.de/ Printed by Druck & Kopie hanel, Mannheim ISBN 3-924220-15-8 Contents Preface and Acknowledgements Current Issues in Household Survey Nonresponse at Statistics Canada Larry Swin und David Dolson Assessment of Efforts to Reduce Nonresponse Bias: 1996 Survey of Income and Program Participation (SIPP) Preston. Jay Waite, Vicki J. Huggi~isund Stephen 1'. Mnck Tlie Impact of Nonresponse on the Unemployment Rate in the Current Population Survey (CPS) Ciyde Tucker arzd Brian A. Harris-Kojetin An Evaluation of Unit Nonresponse Bias in the Italian Households Budget Survey Claudio Ceccarelli, Giuliana Coccia and Fahio Crescetzzi Nonresponse in the 1996 Income Survey (Supplement to the Microcensus) Eva Huvasi anci Acfhnz Marron The Stability ol' Nonresponse Rates According to Socio-Dernographic Categories Metku Znletel anci Vasju Vehovar Understanding Household Survey Nonresponse Through Geo-demographic Coding Schemes Jolin King Response Distributions when TDE is lntroduced Hikan L. Lindström A Survey on Telephone Coverage in Finland Vesa Kuusela 1s it True that Nonresponse Rates in a Panel Survey Increase when Supplement Surveys are Annexed? Malka Kantorowitz How Many Mailings are Enough? Vasja Velzovar ccnd Katja Llzar Improving Advance Letters for Major Government Surveys Antanda White, Jean Mczrtin, Nikki Bennert und Srephunie Freeth FightingNonresponse in Telephone Interviews; Successful Interviewer Tactics Joop Hox, Edith de Leeirw utid Ger Snijkers The EfCcct of Interviewer Pcrsuasiori Strategies on Refusal Rates in Household Surveys Plztrick Sturgis und Puntekz Cuml~unelli lncentives in Two Germün Mai1 Surveys 1'396197 & 1997 Junet Hurkness. Peter Moltler, Michuel Scltneid arid Bertzluird Christol~lz Promised Inccntivcs on a Ründom Digit Dial Survey Ilailid Caritor; Britce Allen. Prltt-icia Curtnirlgharti, J. Micliael Brick. Rertee Slobusky, Pornelu Ciarrzbo clnd Jcfnny Kenny Does the Payment of lncentives Create Expectation Effects? Electnor Sittger, Jolin van Hoewyk nrld Mary P. Maher Interviewer Opinions, Attitudes and Strategies Regarding Survey Participation and Their Effect on Response Editlz de Leeuw~,Joop Ho-r, Ger Snijkers attd Wim de Heer The Effect of Interviewer and Respondent ~haracteristicson Refusals in a Panel Survey Gecrt Loosveldt, Ann Carton nnd Jnrt Picket? Longitudinal Nonresponse in tlie Currcnt Population Survey (CPS) 1Jrian A. Harris-Kojetin czrid Clyde Tucker A Bootstrap Strategy for the Detection of a Panel Attrition Bias in a Household Panel with an Application to the German Socio-Economic Panel (GSOEP) 2 73 Ulrich Rendtel attd Felix Büchel Regression-Based Nearest Neighboiir Hot Decking Seppo Lmksorzen Handling of Household and ltem Nonresponse in Surueys Rajendrtl P. Singh und Rita J. Petroni Aspects Concerning Data Fusion Techniques Sltsanne Rnessler.nnd .Kar-lheinz Fleischer A Conditional Minimax Estimator for Treating Nonresponse Siclpfried Gabler aizd Snbine Häder Contributors in Alphabetical Order 350 Preface and Acknowledgements This volume, the fourth in the ZUMA-Nachrichten Spezial series on methodological issues in empirical social science research, takes up issues of nonresponse. Nonresponse, that is, the failure to obtain measurements from all targeted members 0f.a survey sample, is a problem which confronts many survey organizations in different parts of the world. The papers in this volume discuss nonresponse from different perspectives: they describe efforts undertaken for individual surveys and procedures employed in different countries to deal with nonresponse, analyses of the role of interviewers, the use of advance letters, incentives, etc. to reduce nonresponse rates, analyses of the correlates and consequences of nonresponse, and descriptions of post-survey statistical adjustments to compensate for nonresponse. All the contributions are based on presentations made at the '8th International Workshop on Household Survey Nonresponse'. The workshop took place from September 24 - 26, 1997 in Mannheim, Gerrnany, the home base of the workshop host institute, ZUMA. The international workshop series on nonresponse was initiated in 1990 by Robert Groves, University of Michigan, Bob Barnes, Office of National Statistics, UK and Lars Lyberg, Statistics Sweden. Since then, the workshop has been held ea~h"~earin a different country. The purpose of the workshop is to gather researchers and methodologists from statistical agencies, research institutes and universities interested and active in the nonresponse field, so that exchange of ideas and collaborations across nations and different type of organizations can take place in an informal setting. Former hosts have been Statistics Sweden, US Bureau of the Census, Statistics Netherlands, Office of National Statistics (UK), Statistics Canada, Statistics Finland and Istituto Nazionale di Statistica (Italy). The Mannheim workshop drew 51 delegates from nine European countries, as well as Canada, Israel and the United States. Twenty-nine papers were presented and discussed, of which twenty-five are included here. We would like to take this opportunity to thank all the participants of the workshop, in particular the presenters and the session chairpersons. We are especially grateful to Lilli Japec, Statistics Sweden, for her assistance in organizing the workshop. We also wish to thank Christa von Briel and Maria Kreppe-Aygün, ZUMA, for their support in planning the workshop as well as their patience in helping produce this volume. Mannheim, August 1998 Achim Koch, Rolf Porst Editors Current Issues in Household Suwey Nonresponse at Statistics Canada LARRYSWAIN AND DA VID DOLSON Abstract: A variety of current and recent initiatives and studies related to unit nonresponse for both cross-sectional und longitudinal household surveys at Statistics Canada is presented. Surveys discussed include the Labour Force Survey (LFS), supplementary und longitudinal surveys based on the LFS frame, the General Social Survey, und several household surveys carried out as special surveys. Factors injluencing response und initiatives tabn to maintain and maximize response are then reviewed. The next sections present adjustment techniques und a Summary of the major themes discussed in the paper. Keywords: response rates, maintaining und maximizing response, nonresponse adjustment 1 Introduction Despite the best efforts of survey managers and operations staff to maximize response, some degree of nonresponse is virtually certain to occur in household surveys. Nonresponse has two effects on survey data: one contributing to an increase in the sampling variance of estimates as the effective sample size is reduced from that originally sought; the other contributing to bias of estimates if nonrespondents differ from respondents in the characteristics measured. Survey budgets and potential nonresponse bias influence the decisions made about the degree of nonresponse that is tolerable and the depth of research into adjustments to survey data that compensate for nonresponse. Nonresponse is monitored for feedback to survey staff for immediate and future action and is reported to Users of the survey data as Part of the overall considerations of data quality. This paper is intended to take stock of recent and current events in household survey nonresponse at Statistics Canada in order to determine underlying themes.. It. is not- intended to.be -a complete overview of'all activities but is to be topical. The emphasis is on unit nonresponse, and not item nonresponse. This paper is an abbreviated version of that presented at the workshop and of the slightly modified version of the workshop paper noted below in the references. In the longer version, a more extensive overview of the various household surveys at Statistics Canada and their response rates is presented, along 2 ZUMA Nachrichten Spezial, August 1998 with an examination of monitoring and reporting of nonresponse, remarks on Statistics Canada's nonresponse databases and nonresponse standards, and an extensive list of references. 2 Maintaining and maximizing response 2.1 Factors influencing response Like many national statistical agencies, Statistics Canada conducts a wide variety of household surveys. Some are Part of the regular ongoing program while others conducted on an occasional or one-time basis are known as special surveys. The major example in the former group is the Canadian Labour Force Survey (LFS) which achieves response rates of about 95%. Supplemental surveys can be annexed to the LFS. Such surveys include the Family Expenditure Survey with response at about 70% to 80%