DOCSLIB.ORG

5.1 Survey Frame Methodology

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
5.1 Survey Frame Methodology Regional Course on Statistical Business Registers: Data sources, maintenance and quality assurance Perak, Malaysia 21-25 May, 2018 4 .1 Survey fram e methodology REVIEW For sampling purposes, a snapshot of the live register at a particular point in t im e is needed. The collect ion of active statistical units in the snapshot is referred to as a frozen frame. REVIEW A sampling frame for a survey is a subset of t he frozen fram e t hat includes units and characteristics needed for t he survey. A single frozen fram e should be used for all surveys in a given reference period Creat ing sam pling fram es SPECIFICATIONS Three m ain t hings need t o be specified t o draw appropriate sampling frames: ▸ Target population (which units?) ▸ Variables of interest ▸ Reference period CHOICE OF STATISTICAL UNIT Financial data Production data Regional data Ent erpri ses are Establishments or Establishments or typically the most kind-of-activity local units should be appropriate units to units are typically used if regional use for financial data. the most appropriate disaggregation is for production data. necessary. Typically a single t ype of unit is used for each survey, but t here are except ions where t arget populat ions include m ult iple unit t ypes. CHOICE OF STATISTICAL UNIT Enterprise groups are useful for financial analyses and for studying company strategies, but they are not normally the target populations for surveys because t hey are t oo diverse and unstable. SURVEYS OF EMPLOYMENT The sam pling fram es for t hese include all active units that are em ployers. SECTOR-SPECIFIC SURVEYS E.g., manufacturing surveys. The sam pling fram es for t hese include all active units with an ISIC code in the specified group. CAPITAL EXPENDITURE SURVEYS The sam pling fram es for t hese m ay include all active units above a cert ain size. BASIC STEPS St ep 1 St ep 2 At specified t im es A frozen frame is (m ont hly, quart erly, creat ed, t ypically yearly), snapshots are containing all ext ract ed from t he live statistical units that register containing all have been act ive in t he units and their past 12 months. characteristics. BASIC STEPS St ep 3 St ep 4 Frame populations are A sampling frame is t he com plet e set s of t ypically select ed from each statistical unit a single fram e t ype from t he frozen population. fram e. FRAME GENERATION FREQUENCY Annual Quarterly or monthly Som e count ries generat e If SBR frozen fram es are frozen frames annually, generat ed quart erly or and the annual frozen monthly, a relationship will fram e is used for all need t o be est ablished bet ween monthly, quarterly and survey fram es for different annual survey frames. periods (keeping in mind characteristics will likely not be addit ive over t im e). FRAME ERRORS: UNDERCOVERAGE Undercoverage, when t he fram e populat ion does not include all units in the target population for the survey, can occur for many reasons, including: ▸ A size threshold for inclusion in administrative s ources ▸ Active units that are erroneously marked inactive ▸ Lag time before an active unit is included in the SBR FRAME ERRORS: OVERCOVERAGE The opposit e, overcoverage, is when t he fram e population includes units not in the target populat ion for t he survey. Reasons include: ▸ Mistakenly keeping inactive units in the SBR ▸ Double counting when combining multiple data s ources FRAME DIAGRAM REDUCING FRAME ERRORS While fram e errors cannot be ent irely avoided, t here are ways t o reduce t hem . One m et hod is t o ext ract t ables from t he live regist er and compare them with the current frozen frame in order t o check for errors before t he next frozen fram e is generat ed. CASE STUD Y: THE D UTCH SBR In t he Net herlands, a frozen fram e is creat ed from t he live regist er each m ont h, consist ing of enterprise groups, enterprises and local units and their main characteristics. In addition the statistical units are linked to the legal and the administrative units valid for that month. CASE STUD Y: THE D UTCH SBR A list is kept with frame errors referring to activity codes or size classes of statistical units in order t o be able t o generat e several inst ances of each frozen fram e wit h im proved qualit y each t im e. REFERENCES This presentation was primarily based on UNECE’s Guidelines on Statistical Business Registers, in particular Chapter 8. Other m at erial used: ▸ The African Development Bank’s Guidelines for Building Statistical Business Registers in Africa ▸ Eurostat’s Business registers: Recommendations manual Country maps based on Natural Earth data. Presentation template by SlidesCarnival.
Load more

Recommended publications
  • Esomar/Grbn Guideline for Online Sample Quality
    ESOMAR/GRBN GUIDELINE FOR ONLINE SAMPLE QUALITY ESOMAR GRBN ONLINE SAMPLE QUALITY GUIDELINE ESOMAR, the World Association for Social, Opinion and Market Research, is the essential organisation for encouraging, advancing and elevating market research: www.esomar.org. GRBN, the Global Research Business Network, connects 38 research associations and over 3500 research businesses on five continents: www.grbn.org. © 2015 ESOMAR and GRBN. Issued February 2015. This Guideline is drafted in English and the English text is the definitive version. The text may be copied, distributed and transmitted under the condition that appropriate attribution is made and the following notice is included “© 2015 ESOMAR and GRBN”. 2 ESOMAR GRBN ONLINE SAMPLE QUALITY GUIDELINE CONTENTS 1 INTRODUCTION AND SCOPE ................................................................................................... 4 2 DEFINITIONS .............................................................................................................................. 4 3 KEY REQUIREMENTS ................................................................................................................ 6 3.1 The claimed identity of each research participant should be validated. .................................................. 6 3.2 Providers must ensure that no research participant completes the same survey more than once ......... 8 3.3 Research participant engagement should be measured and reported on ............................................... 9 3.4 The identity and personal
    [Show full text]
  • SAMPLING DESIGN & WEIGHTING in the Original
    Appendix A 2096 APPENDIX A: SAMPLING DESIGN & WEIGHTING In the original National Science Foundation grant, support was given for a modified probability sample. Samples for the 1972 through 1974 surveys followed this design. This modified probability design, described below, introduces the quota element at the block level. The NSF renewal grant, awarded for the 1975-1977 surveys, provided funds for a full probability sample design, a design which is acknowledged to be superior. Thus, having the wherewithal to shift to a full probability sample with predesignated respondents, the 1975 and 1976 studies were conducted with a transitional sample design, viz., one-half full probability and one-half block quota. The sample was divided into two parts for several reasons: 1) to provide data for possibly interesting methodological comparisons; and 2) on the chance that there are some differences over time, that it would be possible to assign these differences to either shifts in sample designs, or changes in response patterns. For example, if the percentage of respondents who indicated that they were "very happy" increased by 10 percent between 1974 and 1976, it would be possible to determine whether it was due to changes in sample design, or an actual increase in happiness. There is considerable controversy and ambiguity about the merits of these two samples. Text book tests of significance assume full rather than modified probability samples, and simple random rather than clustered random samples. In general, the question of what to do with a mixture of samples is no easier solved than the question of what to do with the "pure" types.
    [Show full text]
  • Use of Sampling in the Census
    Regional Workshop on the Operational Guidelines of the WCA 2020 Amman, Jordan 1-4 April 2019 Use of sampling in the census Technical Session 5.2 Oleg Cara Statistician, Agricultural Censuses Team FAO Statistics Division (ESS) 1 CONTENTS Complete enumeration censuses versus sample-based censuses Uses of sampling at other census stages Sample designs based on list frames Sample designs based on area frames Sample designs based on multiple frames Choice of sample design Country examples 2 Background As mentioned in the WCA 2020, Vol. 1 (Chapter 4, paragraph 4.34), when deciding whether to conduct a census by complete or sample enumeration, in addition to efficiency considerations (precision versus costs), one should take into account: desired level of aggregation for census data; use of the census as a frame for ongoing sampling surveys; data content of the census; and capacity to deal with sampling methods and subsequent statistical analysis based on samples. 3 Complete enumeration versus sample enumeration census Complete enumeration Sample enumeration Advantages 1. Reliable census results for the 1. Is generally less costly that a smallest administrative and complete enumeration geographic units and on rare events 2. Contributes to decrease the overall (such as crops/livestock types) response burden 2. Provides a reliable frame for the organization of subsequent regular 3. Requires a smaller number of infra-annual and annual sample enumerators and supervisors than a surveys. In terms of frames, it is census conducted by complete much less demanding in respect of enumeration. Consequently, the the holdings’ characteristics non-sampling errors can be 3. Requires fewer highly qualified expected to be lower because of statistical personnel with expert the employment of better trained knowledge of sampling methods enumerators and supervisors and than a census conducted on a sample basis.
    [Show full text]
  • Eurobarometer 422
    Flash Eurobarometer 422 CROSS-BORDER COOPERATION IN THE EU SUMMARY Fieldwork: June 2015 Publication: September 2015 This survey has been requested by the European Commission, Directorate-General for Regional and Urban Policy and co-ordinated by Directorate-General for Communication. This document does not represent the point of view of the European Commission. The interpretations and opinions contained in it are solely those of the authors. Flash Eurobarometer 422 - TNS Political & Social Flash Eurobarometer 422 Project title “Cross-border cooperation in the EU” Linguistic Version EN Catalogue Number KN-04-15-608-EN-N ISBN 978-92-79-50789-2 DOI 10.2776/964957 © European Union, 2015 Flash Eurobarometer 422 Cross-border cooperation in the EU Conducted by TNS Political & Social at the request of the European Commission, Directorate-General Regional and Urban Policy Survey co-ordinated by the European Commission, Directorate-General for Communication (DG COMM “Strategy, Corporate Communication Actions and Eurobarometer” Unit) FLASH EUROBAROMETER 422 “Cross-border cooperation in the EU” TABLE OF CONTENTS INTRODUCTION .................................................................................................. 2 I. Awareness of EU regional policy-funded cross-border cooperation activities6 II. Going abroad to other countries ................................................................. 10 III. social trust of the EU population living in border regions covered by the Interreg cross-border cooperation programmes .............................................
    [Show full text]
  • STANDARDS and GUIDELINES for STATISTICAL SURVEYS September 2006
    OFFICE OF MANAGEMENT AND BUDGET STANDARDS AND GUIDELINES FOR STATISTICAL SURVEYS September 2006 Table of Contents LIST OF STANDARDS FOR STATISTICAL SURVEYS ....................................................... i INTRODUCTION......................................................................................................................... 1 SECTION 1 DEVELOPMENT OF CONCEPTS, METHODS, AND DESIGN .................. 5 Section 1.1 Survey Planning..................................................................................................... 5 Section 1.2 Survey Design........................................................................................................ 7 Section 1.3 Survey Response Rates.......................................................................................... 8 Section 1.4 Pretesting Survey Systems..................................................................................... 9 SECTION 2 COLLECTION OF DATA................................................................................... 9 Section 2.1 Developing Sampling Frames................................................................................ 9 Section 2.2 Required Notifications to Potential Survey Respondents.................................... 10 Section 2.3 Data Collection Methodology.............................................................................. 11 SECTION 3 PROCESSING AND EDITING OF DATA...................................................... 13 Section 3.1 Data Editing ........................................................................................................
    [Show full text]
  • Statistical Sampling: an Overview for Criminal Justice Researchers April 28, 2016 Stan Orchowsky
    Statistical Sampling: An Overview for Criminal Justice Researchers April 28, 2016 Stan Orchowsky: Good afternoon everyone. My name is Stan Orchowsky, I'm the research director for the Justice Research and Statistics Association. It's my pleasure to welcome you this afternoon to the next in our Training and Technical Assistance Webinar Series on Statistical Analysis for Criminal Justice Research. We want to thank the Bureau of Justice Statistics, which is helping to support this webinar series. Stan Orchowsky: Today's topic will be on statistical sampling, we will be providing an overview for criminal justice research. And I'm going to turn this over now to Dr. Farley, who's going to give you the objectives for the webinar. Erin Farley: Greetings everyone. Erin Farley: Okay, so the webinar objectives. Sampling is a very important and useful tool in social science criminal justice research, and that is because in many, if not most, situations accessing an entire population to conduct research is not feasible. Oftentimes it would be too time-consuming and expensive. As a result, the use of sampling methodology, if utilized properly, can save time, money, and produce sample estimates that can be utilized to make inferences about the larger population. Erin Farley: The objectives of this webinar include: describing the different types of probability and non-probability sampling designs; discussing the strengths and weaknesses of these techniques, as well as discussing the importance of sampling to the external validity of experimental designs and statistical analysis. Erin Farley: This slide presents a simple diagram illustrating the process and goal of sampling.
    [Show full text]
  • Task Force on Quality of BCS Data Analysis of Sampling Frames
    Task force on quality of BCS data Analysis of sampling frames Appropriateness and comprehensiveness of sampling frames, theoretical considerations, empirical evidence on links with data volatility and bias; August 2013 Krzysztof Puszczak Agnieszka Fronczyk Marek Urbański Sofia Pashova 1 Table of Contents 1. Introduction a. Definitions b. Common problems with sampling frames c. Telephone-based sampling frames – drawbacks and benefits d. Sampling frames used in the DG ECFIN Consumer Survey 2. Quality measures vs. descriptive features of sampling frames a. Type of units in sampling frames - analysis of impact b. Update frequency of sampling frames - analysis of impact c. Sampling frames coverage - analysis of impact d. Additional analysis 3. Analyses summary and conclusions 4. References. 2 1. Introduction 1.a Definitions Generally sampling frame is a list of all members of a population used as a basis for survey design [1]. There are two types of frames: list frames and area frames. A list frame is a list of all the units in the survey target population (e.g. administrative lists, the electoral roll). An area frame is a complete and exhaustive list of non- overlapping geographic areas. Area frames are less expensive and complex than a list frame. They are also used when no list frame exists and it would be too expensive or complex to create. A reliable sampling frame should meet the following requirements: Well- organized in a logical, systematic fashion all units should be accessible – it should contain sufficient information to uniquely identify and contact each unit and other relevant information 'up-to-date' every element of the population of interest is present in the frame every element of the population is present only once in the frame no elements from outside the population of interest are present in the frame The most popular examples of sampling frame in social research are a population register (census) and a telephone directory or random digit dialing.
    [Show full text]
  • Source of the Data and Accuracy of the Estimates for the 2020
    Source of the Data and Accuracy of the Estimates for the 2020 Household Pulse Survey Interagency Federal Statistical Rapid Response Survey to Measure Household Experiences during the Coronavirus (COVID-19) Pandemic SOURCE OF THE DATA The 2020 Household Pulse Survey (HPS), an experimental data product, is an Interagency Federal Statistical Rapid Response Survey to Measure Household Experiences during the Coronavirus (COVID-19) Pandemic, conducted by the United States Census Bureau in partnership with five other agencies from the Federal Statistical System: • Bureau of Labor Statistics (BLS) • National Center for Health Statistics (NCHS) • Department of Agriculture Economic Research Service (ERS) • National Center for Education Statistics (NCES) • Department of Housing and Urban Development (HUD) These agencies collaborated on the design and content for the HPS, which was also reviewed and approved by the Office of Management and Budget (OMB). (OMB # 0607- 1013; expires 07/31/2020.) The HPS asks individuals about their experiences regarding employment status, spending patterns, food security, housing, physical and mental health, access to health care, and educational disruption. The ability to understand how individuals are experiencing this period is critical to governmental and non-governmental response in light of business curtailment and closures, stay-at-home and safer-at-home orders, school closures, changes in consumer patterns and the availability of consumer goods, and other abrupt and significant changes to American life. The HPS is designed to produce estimates at three different geographical levels. The first level, the lowest geographical area, is for the 15 largest Metropolitan Statistical Areas (MSAs). The second level of geography is state-level estimates for each of the 50 states plus the District of Columbia, and the final level of geography is national-level estimates.
    [Show full text]
  • Topic 3 Populations and Samples
    BioEpi540W Populations and Samples Page 1 of 33 Topic 3 Populations and Samples Topics 1. A Feeling for Populations v Samples …………………… 2 2. Target Populations, Sampled Populations, Sampling Frames 5 3. On Making Inferences from a Sample ……………………. 8 4. Simple Random Sampling ………………….……………. 10 5. Some Non-Probability Sampling Plans ………………….. 13 6. Introduction to Probability Sampling ……..…………….. 16 a. Sampling WITH v WITHOUT replacement …… 17 b. How to select a simple random sample ……….. 25 7. Some Other Probability Sampling Plans ………………… 28 a. Systematic ……………………………………….. 28 b. Stratified …………………………………………. 30 C. Multi-stage ………………………………………. 32 8. The Nationwide Inpatient Survey (NIS) ……………….. 33 BioEpi540W Populations and Samples Page 2 of 33 1. A Feeling for Populations versus Samples Initially, we gave ourselves permission to consider not at all the source of the available data. • The course introduction included some examples making the point that statistics is a tool for evaluating uncertainty and that we must be wary of biases that might enter our thinking; • In topic 1, Summarizing Data, the techniques and advantages of graphical and tabular summaries of data were emphasized; and • In topic 1, Summarizing Data, too, we familiarized ourselves with the basics of summarizing data using numerical approaches (means, variances, etc) The backdrop has been an overall communication of what, ultimately, statistics is about • To learn about and describe the population which gave rise to the sample; or • To investigate some research question; or • To assigning probabilities of events (mathematical tool); or • To calculate the likelihood of the observed events under some specified postulates (statistical significance); and • What statistics is not about - Statistical significance is not the same as biological significance.
    [Show full text]
  • The Sampling Frame and Survey Participation Appendix C
    APPENDICES - TABLE OF CONTENTS Appendix A: Methodology A.1: Defining the Population of Interest A.2: Creating the Sample Frame A.3: Designing the Survey Questionnaire A.4: Survey Implementation A.5: Weighting System for Data Aggregation Appendix B: The Sampling Frame and Survey Participation B.1: The Representativeness of the Survey Participant Sample B.1.1: Survey Recipient & Participant Distribution by Sex B.1.2: Survey Recipient & Participant Distribution by Stakeholder B.1.3: Survey Recipient & Participant Distribution by Country B.2: Other Survey Participant Characteristics B.2.1: The Professional Backgrounds of Survey Participants B.2.2: The Educational Backgrounds of Survey Participants B.2.3: The Employment Status of Survey Participants in 2014 B.2.3: Survey Questionnaire Language Appendix C: Sampling Frame Inclusion Criteria Appendix D: 2014 Reform Efforts Survey Questionnaire Appendix E: Supplemental Information Appendix F: References Appendix A Methodology Prior to fielding the 2014 Reform Efforts Survey, our research team spent nearly five years preparing a sampling frame of approximately 55,000 host government and development partner officials, civil society leaders, private sector representatives, and independent experts from 126 low- and lower-middle income countries and semi- autonomous territories. In this appendix, we provide an overview of our methodology and describe key attributes of our sampling frame construction, questionnaire design, survey implementation, and data aggregation processes. Appendix A Appendix A: Methodology
    [Show full text]
  • NASS Sampling Frames
    Accuracy Unbiased Timeliness Service Security National Agricultural Statistics Service Impartial Trust Confidentiality Team Work United States Department of Agriculture Information System for U.S. Agriculture Agricultural Marketing Service quick market information on prices, supply & demand National Agricultural Statistics Service basic statistics on crops, livestock, labor, chemical use, farm demographics, income & expenses Economic Research Service economic analysis for the U.S. agricultural sector What is NASS? National Agricultural Statistics Service the statistical survey agency of the U.S. Department of Agriculture non-political non-policy making independent-objective-unbiased appraisers of U.S. agriculture a cooperative statistical survey agency State departments of agriculture agricultural colleges & universities National Agricultural Statistics Service Mission: to provide timely, accurate and useful statistics in service to U.S. agriculture What does NASS do? administer USDA’s domestic agricultural statistics program over 450 reports each year 120 crop items 45 livestock items Agricultural census every 5 years Farm & ranch irrigation survey every 5 years Horticultural census every 10 years Aquaculture census Agricultural economics & land ownership survey What does NASS do? coordinate federal & state agricultural statistics needs statistical & survey consulting other USDA agencies other government agencies private organizations other countries statistical research Who is NASS? Headquarters in Washington D.C. 12 regional offices
    [Show full text]
  • A Guide to Area Sampling Frame Construction Utilizing Satellite Imagery
    A GUIDE TO AREA SAMPLING FRAME CONSTRUCTION UTILIZING SATELLITE IMAGERY .,I Wj'f1am H. Wigton 1/ and Peter Bormann 1/ ! A GUIDE TO AREA SAMPLING FRAME CONSTRUCTION UTILIZING SATELLITE IMAGERY A paper submitted to the United Nations at the request of the United Nations Outer Space Affairs Division based on material used and experience gained at the Second International Training Course in Remote Sensing Applications for Agriculture: Crop Statistics and Agricultural Census. (Rome: 25 April-13 May 1977) ACKNOWLEDGEMENTS Preparation of this report would not have been possible without the assistance of Dr. H.G.S. Murthy, Expert on Space Applications, United Nations, New York, and Dr. John A. Howard, Head, Remote Sensing Unit, Food and Agriculture Organization, Rome, Italy. Special thanks go to Ms. Berna Spiers, Technical Officer, Remote Sensing Unit, Food and Agriculture Organization, for helping teach the course for which this was prepared. l/William H. Wigton, Mathematical Statistician, Consultant to the United Nations, U.S. Department of Agriculture; Economics, Statistics and Cooperatives Service, Washington, D.C. 20250 2/ - Peter Bormann, Geophysicist, United Nations, Outer Space Affairs Division, New York, NY 10017 CONTENTS Page SUMMARY •••. 1 I. INTRODUCTION 3 II. CONSTRUCTION OF THE AREA SAMPLING FRAME 4 A. Explanation of terms used .•••••••.•••• 4 B. Survey priorities, resources and difficulties • 5 C• Material and facilities needed •••.•.. 7 D. Sequence of constructing the area sampling frame 8 1. Stratification and boundary selection ••••••••. 8 2. Primary sampling unit construction ••.......• 10 3. Sampling unit construction and primary sampling unit and segment selection •..•••••.•.• 11 4. The use of random number tables in the selection of primary sampling units and segments 13 E.
    [Show full text]