Introduction to Survey Design & Delivery

Total Page:16

File Type:pdf, Size:1020Kb

Introduction to Survey Design & Delivery Introduction to Survey Design and Delivery SOCIAL PROGRAMS SCIENCE TOOLS FOR COASTAL Social Science Tools for Coastal Programs Introduction to Survey Design and Delivery About This Publication Some of the most challenging decisions in coastal management stem from the relationship between people and the environment. NOAA provides technical assistance to coastal management professionals addressing complex human-based problems. This publication, “Introduction to Survey Design and Delivery,” is the first in a series of guides developed to bring information to this audience about the use of social science tools in their field of work. For more information, or to obtain additional copies, contact our office at [email protected]. NOAA’s Office for Coastal Management “Coastal management” is the term used by communities and organizations striving to keep the nation’s coasts safe from storms, rich in natural resources, and economically strong. The national lead for these efforts is NOAA’s Office for Coastal Management, an organization devoted to partnerships, science, and good policy. This agency, housed within the National Ocean Service, oversees major initiatives that include the National Coastal Zone Management Program, Coral Reef Conservation Program, Digital Coast, and National Estuarine Research Reserve System. Table of Contents Introduction ................................................................................................................ 1 Population and Sample Size ........................................................................................ 1 Survey Delivery Mechanisms ...................................................................................... 3 Sampling Techniques .................................................................................................. 5 Constructing Survey Questionnaires........................................................................... 7 The Report ................................................................................................................... 12 Appendix A: Guide to Survey Sampling and Analysis Terms ...................................... 13 Appendix B: Guide to Survey Types ............................................................................ 15 1 Introduction Often, the public’s attitudes, perceptions, and beliefs strongly influence management decision making. Social science tools, such as a survey instrument, can help identify the relationship between the community and natural resources. Surveys are a method of collecting data via telephone, mail, or the Internet, as well as in person, using an ordered list of questions to gather important information in a systematic fashion. This technique allows for the collection of information and opinions from a representative sample of individuals related to specific natural resource management issues. This document provides insight into the various types and methods of survey research. The most important component of any successful survey project is to have a strong Conducting a survey study conceptualization. Conducting a survey is much more complex than just asking is much more complex a group of people a series of questions to try to solve a problem or better understand an than just asking a issue. Rather, a survey is a systematic examination of a population by means of a series of groupof people a series specific, targeted questions. These questions should possess direct application in solving of questions to try to an identified problem or issue. The development of a survey simply for the purpose of solve a problem. determining what people think (e.g., pleased, displeased, concerned, happy, etc.) often generates data that are of limited utility. As with any professional undertaking, the most successful projects are generally a result of professional knowledge and expertise. Survey research is no different. Research within any academic discipline must follow specific, methodic protocols. Once information has been collected, specific statistical data testing methods must be employed to produce usable information. The intent of this document is to provide insight into the various methodological components of survey research. The document serves as an overview of survey-related techniques and as a means for coastal managers to understand basic survey information and terminology (Appendix A) to strengthen awareness and understanding of such projects. Population and Sample Size Determining an adequate sample size is critical in generating usable survey results; however, it is difficult to identify a specific population to study large-scale issues such as beach access. Beach visitors include local residents and people across a particular state, as well as people from other states and nations. In this instance, the number of potential visitors is indefinite and virtually impossible to quantify accurately. The size of a sample, however, is not nearly as important as the sample design. If you are conducting a survey, it is more important to obtain a representative sample than a large sample. A sample size that is larger than necessary will in no way compromise the results 2 of your study, but it will misuse time, effort, and financial resources. It is more useful to identify the population of interest and make efforts to achieve a high response rate rather than administer vast numbers of surveys. For the most rigorous approach to a sampling, it is important to consider such items such as the margin of error, degree of accuracy, and the most practical sampling strategy to use. These and other terms are described in Appendix A. With pilot data in hand, an experienced individual can help you work out the total sample size you need for the degree of accuracy you choose. Information on pilot testing is highlighted in Appendix B. Fortunately, you do not need to be concerned about knowing the size of an exceptionally large population (e.g., a community, township, or user group such as recreational fishermen of the Chesapeake Bay). Laws of mathematical probability tell us in such instances that population size is of much less concern than the sample size, though there are links between the size of your sample and the level of analysis that can be performed following the survey. Statistical analysis can be categorized into two types: descriptive and inferential. Descriptive statistics (e.g., mean, median, standard deviation) are used to summarize or describe the survey results, such as the average number of males and females, the number of people over the age of 45, etc. Inferential statistics are a bit more complex. Inferential statistics allow the researcher to arrive at a certain conclusion that is based on probability. For example, a survey of sea kayakers may suggest that females over the age of 45 exhibit greater pro-environmental behaviors than males under the same conditions. Inferential statistics reveal the degree to which different variables are related. In the previous example, pro-environmental behavior is related to both gender and age. The following is a general example to show how sampling works with a large population. If you survey 500 people, stastically your results are equally significant whether the total population is 10,000 or 100,000. For this example, where a large population whose exact number is unknown, an appropriate minimum sample size is 384. By sampling this number of people (with a 100 percent response rate) you are ensuring a 95 percent confidence level with a confidence interval or margin of error of 5. This confidence level and margin of error is the standard desired level of significance for most survey research. The confidence level reflects how certain you can be that the survey results are accurate. In this instance, the results would prove to be 95 percent accurate, and the 5 percent margin of error is commonly sought. You could therefore state that results of your survey are 95 percent accurate, plus or minus 5 percent of people surveyed. Please remember that this sampling scenario is a general example and is not applicable to all situations. 3 Main Points: • There is much greater benefit in obtaining a representative sample than in obtaining an exceedingly large sample. • If you have the time, contacts, and resources to be more rigorous about a sampling scheme, try to ensure that your responses possess a 95 percent confidence level. • Determining an adequate sample size is best determined by someone professionally trained in survey techniques. Survey Delivery Mechanisms Surveys can be administered in many different ways, which are commonly divided into two categories: interview-based and self-completed. Common interview-based mechanisms include face-to-face interviews and telephone surveys. Self-completed survey instruments commonly include mailback surveys, hand-delivered questionnaires, and Web surveys. The following table is a brief synopsis of each survey type and various positive and negative aspects of each. Description Positives Negatives Face-to-Face Interview A directed, one-on-one + Obtain great level of detail - Analysis of results can conversation ranging from + Ability to observe non- be cumbersome and time casual to highly structured verbal communication along consuming with verbal responses - Limited generalization to a greater population Telephone Survey A directed one-on-one + Highly effective in - Skilled interviewer is telephone interview ranging generating timely responses needed to help guide from casual to highly + Large
Recommended publications
  • Sampling and Fieldwork Practices in Europe
    www.ssoar.info Sampling and Fieldwork Practices in Europe: Analysis of Methodological Documentation From 1,537 Surveys in Five Cross-National Projects, 1981-2017 Jabkowski, Piotr; Kołczyńska, Marta Veröffentlichungsversion / Published Version Zeitschriftenartikel / journal article Empfohlene Zitierung / Suggested Citation: Jabkowski, P., & Kołczyńska, M. (2020). Sampling and Fieldwork Practices in Europe: Analysis of Methodological Documentation From 1,537 Surveys in Five Cross-National Projects, 1981-2017. Methodology: European Journal of Research Methods for the Behavioral and Social Sciences, 16(3), 186-207. https://doi.org/10.5964/meth.2795 Nutzungsbedingungen: Terms of use: Dieser Text wird unter einer CC BY Lizenz (Namensnennung) zur This document is made available under a CC BY Licence Verfügung gestellt. Nähere Auskünfte zu den CC-Lizenzen finden (Attribution). For more Information see: Sie hier: https://creativecommons.org/licenses/by/4.0 https://creativecommons.org/licenses/by/4.0/deed.de Diese Version ist zitierbar unter / This version is citable under: https://nbn-resolving.org/urn:nbn:de:0168-ssoar-74317-3 METHODOLOGY Original Article Sampling and Fieldwork Practices in Europe: Analysis of Methodological Documentation From 1,537 Surveys in Five Cross-National Projects, 1981-2017 Piotr Jabkowski a , Marta Kołczyńska b [a] Faculty of Sociology, Adam Mickiewicz University, Poznan, Poland. [b] Department of Socio-Political Systems, Institute of Political Studies of the Polish Academy of Science, Warsaw, Poland. Methodology, 2020, Vol. 16(3), 186–207, https://doi.org/10.5964/meth.2795 Received: 2019-03-23 • Accepted: 2019-11-08 • Published (VoR): 2020-09-30 Corresponding Author: Piotr Jabkowski, Szamarzewskiego 89C, 60-568 Poznań, Poland. +48 504063762, E-mail: [email protected] Abstract This article addresses the comparability of sampling and fieldwork with an analysis of methodological data describing 1,537 national surveys from five major comparative cross-national survey projects in Europe carried out in the period from 1981 to 2017.
    [Show full text]
  • ESOMAR 28 Questions
    Responses to ESOMAR 28 Questions INTRODUCTION Intro to TapResearch TapResearch connects mobile, tablet and pc users interested in completing surveys with market researchers who need their opinions. Through our partnerships with dozens of leading mobile apps, ad networks and websites, we’re able to reach an audience exceeding 100 million people in the United States. We are focused on being a top-quality partner for ad hoc survey sampling, panel recruitment, and router integrations. Our technology platform enables reliable feasibility estimates, highly competitive costs, sophisticated quality enforcement, and quick-turnaround project management. Intro to ESOMAR ESOMAR (European Society for Opinion and Market Research) is the essential organization for encouraging, advancing and elevating market research worldwide. Since 1948, ESOMAR’s aim has been to promote the value of market and opinion research in effective decision-making. The ICC/ESOMAR Code on Market and Social Research, which was developed jointly with the International Chamber of Commerce, sets out global guidelines for self-regulation for researchers and has been undersigned by all ESOMAR members and adopted or endorsed by more than 60 national market research associations worldwide. Responses to ESOMAR 28 Questions COMPANY PROFILE 1) What experience does your company have in providing online samples for market research? TapResearch connects mobile, tablet and pc users interested in completing surveys with market researchers who need their opinions. Through our partnerships with dozens of leading mobile apps, ad networks and websites, we’re able to reach an audience exceeding 100 million people in the United States - we’re currently adding about 30,000 panelists/day and this rate is increasing.
    [Show full text]
  • Esomar/Grbn Guideline for Online Sample Quality
    ESOMAR/GRBN GUIDELINE FOR ONLINE SAMPLE QUALITY ESOMAR GRBN ONLINE SAMPLE QUALITY GUIDELINE ESOMAR, the World Association for Social, Opinion and Market Research, is the essential organisation for encouraging, advancing and elevating market research: www.esomar.org. GRBN, the Global Research Business Network, connects 38 research associations and over 3500 research businesses on five continents: www.grbn.org. © 2015 ESOMAR and GRBN. Issued February 2015. This Guideline is drafted in English and the English text is the definitive version. The text may be copied, distributed and transmitted under the condition that appropriate attribution is made and the following notice is included “© 2015 ESOMAR and GRBN”. 2 ESOMAR GRBN ONLINE SAMPLE QUALITY GUIDELINE CONTENTS 1 INTRODUCTION AND SCOPE ................................................................................................... 4 2 DEFINITIONS .............................................................................................................................. 4 3 KEY REQUIREMENTS ................................................................................................................ 6 3.1 The claimed identity of each research participant should be validated. .................................................. 6 3.2 Providers must ensure that no research participant completes the same survey more than once ......... 8 3.3 Research participant engagement should be measured and reported on ............................................... 9 3.4 The identity and personal
    [Show full text]
  • Intro Surveys for Honors Theses, 2009
    PROGRAM ON SURVEY RESEARCH HARVARD UNIVERSITY ` Introduction to Survey Research ` The Survey Process ` Survey Resources at Harvard ` Sampling, Coverage, and Nonresponse ` Thinking About Modes April 14, 2009 ` Question Wording `Representation ◦The research design make inference to a larger population ◦Various population characteristics are represented in research data the same way there are present in population ◦Example: General population survey to estimate population characteristics Reporting `Realism Research Survey ◦A full picture of subjects emerges And ◦Relationships between multiple variables and multiple ways of looking at Methods the same variables can be studied Theories Analysis ◦Example: A qualitative case study to evaluate the nature of democracy in a small town with community meetings `Randomization ◦Variables which are not important in model are completely randomized ◦Effects of non-randomized variables can be tested ◦Example: Randomized clinical trial to test effectiveness of new cancer drug Integrated Example: Surveys and the Research Process Theories About Things `Good Measures: ◦Questions or measures impact your ability to study concepts ◦Think carefully about the underlying concepts a survey is trying to measure. Do the survey questions do a good job of capturing this? ◦The PSR Tip Sheet on Questionnaire Design contains good ideas on Concepts Population Validity External how to write survey questions. Specification Error ` Measures Sample Good Samples: ◦Samples give you the ability to generalize your findings Survey Errors ◦Think carefully about the population you are trying to generalize Internal Validity Internal your findings to. Does your sample design do a good job of Data Respondents representing these people? ◦The PSR Tip Sheet on Survey Sampling, Coverage, and Nonresponse contains thinks to think about in designing or evaluating a sample.
    [Show full text]
  • Sampling and Household Listing Manual [DHSM4]
    SAMPLING AND HOUSEHOLD LISTING MANuaL Demographic and Health Surveys Methodology This document is part of the Demographic and Health Survey’s DHS Toolkit of methodology for the MEASURE DHS Phase III project, implemented from 2008-2013. This publication was produced for review by the United States Agency for International Development (USAID). It was prepared by MEASURE DHS/ICF International. [THIS PAGE IS INTENTIONALLY BLANK] Demographic and Health Survey Sampling and Household Listing Manual ICF International Calverton, Maryland USA September 2012 MEASURE DHS is a five-year project to assist institutions in collecting and analyzing data needed to plan, monitor, and evaluate population, health, and nutrition programs. MEASURE DHS is funded by the U.S. Agency for International Development (USAID). The project is implemented by ICF International in Calverton, Maryland, in partnership with the Johns Hopkins Bloomberg School of Public Health/Center for Communication Programs, the Program for Appropriate Technology in Health (PATH), Futures Institute, Camris International, and Blue Raster. The main objectives of the MEASURE DHS program are to: 1) provide improved information through appropriate data collection, analysis, and evaluation; 2) improve coordination and partnerships in data collection at the international and country levels; 3) increase host-country institutionalization of data collection capacity; 4) improve data collection and analysis tools and methodologies; and 5) improve the dissemination and utilization of data. For information about the Demographic and Health Surveys (DHS) program, write to DHS, ICF International, 11785 Beltsville Drive, Suite 300, Calverton, MD 20705, U.S.A. (Telephone: 301-572- 0200; fax: 301-572-0999; e-mail: [email protected]; Internet: http://www.measuredhs.com).
    [Show full text]
  • STANDARDS and GUIDELINES for STATISTICAL SURVEYS September 2006
    OFFICE OF MANAGEMENT AND BUDGET STANDARDS AND GUIDELINES FOR STATISTICAL SURVEYS September 2006 Table of Contents LIST OF STANDARDS FOR STATISTICAL SURVEYS ....................................................... i INTRODUCTION......................................................................................................................... 1 SECTION 1 DEVELOPMENT OF CONCEPTS, METHODS, AND DESIGN .................. 5 Section 1.1 Survey Planning..................................................................................................... 5 Section 1.2 Survey Design........................................................................................................ 7 Section 1.3 Survey Response Rates.......................................................................................... 8 Section 1.4 Pretesting Survey Systems..................................................................................... 9 SECTION 2 COLLECTION OF DATA................................................................................... 9 Section 2.1 Developing Sampling Frames................................................................................ 9 Section 2.2 Required Notifications to Potential Survey Respondents.................................... 10 Section 2.3 Data Collection Methodology.............................................................................. 11 SECTION 3 PROCESSING AND EDITING OF DATA...................................................... 13 Section 3.1 Data Editing ........................................................................................................
    [Show full text]
  • The Rise of Survey Sampling
    The rise of survey008uurveyey samplingsampli Jelke Bethlehem The views expressed in this paper are those of the author(s) and do not necessarily refl ect the policies of Statistics Netherlands Discussion paper (09015) Statistics Netherlands The Hague/Heerlen, 2009 Explanation of symbols . = data not available * = provisional fi gure x = publication prohibited (confi dential fi gure) – = nil or less than half of unit concerned – = (between two fi gures) inclusive 0 (0,0) = less than half of unit concerned blank = not applicable 2005-2006 = 2005 to 2006 inclusive 2005/2006 = average of 2005 up to and including 2006 2005/’06 = crop year, fi nancial year, school year etc. beginning in 2005 and ending in 2006 2003/’04–2005/’06 = crop year, fi nancial year, etc. 2003/’04 to 2005/’06 inclusive Due to rounding, some totals may not correspond with the sum of the separate fi gures. Publisher Statistics Netherlands Henri Faasdreef 312 2492 JP The Hague Prepress Statistics Netherlands - Facility Services Cover TelDesign, Rotterdam Information Telephone .. +31 88 570 70 70 Telefax .. +31 70 337 59 94 Via contact form: www.cbs.nl/information Where to order E-mail: [email protected] Telefax .. +31 45 570 62 68 Internet www.cbs.nl ISSN: 1572-0314 © Statistics Netherlands, The Hague/Heerlen, 2009. Reproduction is permitted. ‘Statistics Netherlands’ must be quoted as source. 6008309015 X-10 The rise of survey sampling Jelke Bethlehem Summary: This paper is about the history of survey sampling. It describes how sampling became an accepted scientific method. From the first ideas in 1895 it took some 50 years before the principles of probabilit y sampling were widely accepted.
    [Show full text]
  • 1 AAPOR/WAPOR Task Force Report on Quality in Comparative Surveys April, 2021 Chairing Committee: Lars Lyberg, Demoskop, AAPOR T
    AAPOR/WAPOR Task Force Report on Quality in Comparative Surveys April, 2021 Chairing Committee: Lars Lyberg, Demoskop, AAPOR Task Force Chair Beth-Ellen Pennell, University of Michigan, WAPOR Task Force Chair Kristen Cibelli Hibben, University of Michigan, Co-Chair Julie de Jong, University of Michigan, Co-Chair Contributors: Dorothée Behr, GESIS – Leibniz Institute for the Social Sciences Jamie Burnett, Kantar Public Rory Fitzgerald, City, University of London Peter Granda, University of Michigan Linda Luz Guerrero, Social Weather Stations Hayk Gyuzalyan, Conflict Management Consulting Tim Johnson, University of Illinois, Chicago Jibum Kim, Sungkyunkwan University, South Korea Zeina Mneimneh, University of Michigan Patrick Moynihan, Pew Research Center Michael Robbins, Princeton University Alisú Schoua-Glusberg, Research Support Services Mandy Sha, www.mandysha.com Tom W. Smith, NORC University of Chicago Ineke Stoop, The Netherlands Irina Tomescu-Dubrow, Institute of Philosophy and Sociology, Polish Academy of Sciences (PAN) and CONSIRT at Ohio State University and PAN Diana Zavala-Rojas, Universitat Pompeu Fabra, Barcelona Elizabeth J. Zechmeister, Vanderbilt University, LAPOP This report was commissioned by the AAPOR and WAPOR Executive Councils as a service to the profession. The report was reviewed and accepted by AAPOR and WAPOR Executive Councils. The opinions expressed in this report are those of the authors and do not necessarily reflect the views of either council. The authors, who retain the copyright to this report, grant AAPOR a non-exclusive perpetual license to the version on the AAPOR website and the right to link to any published versions. 1 This report is dedicated to the memory of Lars Lyberg, who has had a profound and lasting influence on our field.
    [Show full text]
  • Online Panel Research History, Concepts, Applications and a Look at the Future
    Callegaro c01.tex V1 - 01/16/2014 6:15 P.M. Page 1 1 Online panel research History, concepts, applications and a look at the future Mario Callegaro1,RegBaker2, Jelke Bethlehem3, Anja S. Göritz4, Jon A. Krosnick5 and Paul J. Lavrakas6 1Google, UK 2Market Strategies International, USA 3Statistics Netherlands, the Netherlands 4University of Freiburg, Germany 5Stanford University, USA 6Independent consultant, USA 1.1 Introduction Online panels have become a prominent way to collect survey data. They are used in many fields including market research (Comley, 2007; Göritz, 2010; Postoaca, 2006), social research (Tortora, 2008), psychological research (Göritz, 2007), election studies (Clarke, Sanders, Stewart, & Whiteley, 2008), and medical research (Couper, 2007). Panel-based online survey research has grown steadily over the last decade. ESOMAR has estimated that global expenditures on online research as a percentage of total expenditures on quantitative research grew from 19% in 2006 to 29% in 2011.1 Inside Research (2012), using 1 Authors’ computation of ESOMAR Global market research reports, 2006–2012. Online Panel Research, First Edition. Edited by Mario Callegaro, Reg Baker, Jelke Bethlehem, Anja S. Göritz, Jon A. Krosnick and Paul J. Lavrakas. © 2014 John Wiley & Sons, Ltd. Published 2014 by John Wiley & Sons, Ltd. Callegaro c01.tex V1 - 01/16/2014 6:15 P.M. Page 2 2 ONLINE PANEL RESEARCH data from 37 market research companies and their subsidiaries, estimated that clients spent about $1.5 billion on online research in the United States during 2006 versus more than $2 billion during 2012. In Europe, expenditures were $490 million in 2006 and a little more than $1 billion in 2012.
    [Show full text]
  • Basic Marketing Research: Volume 1 Handbook for Research Professionals
    Basic Marketing Research: Volume 1 Handbook for Research Professionals Official Training Guide from Qualtrics Scott M. Smith | Gerald S. Albaum © Copyright 2012, Qualtrics Labs, Inc. ISBN: 978-0-9849328-1-8 © 2012 Qualtrics Labs Inc. All rights reserved. This publication may not be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopy, recording, or any information storage and retrieval system, without permission in writing from Qualtrics. Errors or omissions will be corrected in subsequent editions. Author Information Scott M. Smith is Founder of Qualtrics, Professor Emeritus of Marketing, Brigham Young University. Professor Smith is a Fulbright Scholar and has written numerous articles published in journals such as Journal of Consumer Research, Journal of the Academy of Marketing Science, Journal of Business Ethics , International Journal of Marketing Research, Journal of Marketing Research, and Journal of Business Research. He is the author, co-author, or editor of books, chapters, and proceedings including An Introduction to Marketing Research. Qualtrics, 2010 (with G. Albaum); Fundamentals of Marketing Research. Thousand Oaks, CA : Sage Publishers 2005 (with G. Albaum); Multidimensional Scaling. New York: Allyn and Bacon 1989 (with F. J. Carmone and P. E. Green), and Computer Assisted Decisions in Marketing. Richard D. Irwin 1988 (with W. Swinyard). Gerald S. Albaum is Research Professor in the Marketing Department at the Robert O. Anderson Schools of Management, the University of New Mexico, Professor Emeritus of Marketing, University of Oregon. Professor Albaum has written numerous articles published in journals such as Journal of Marketing Research, Journal of the Academy of Marketing Science, Journal of the Market Research Society, Psychological Reports, Journal of Retailing, Journal of Business and Journal of Business Research.
    [Show full text]
  • WHO Multi-Country Survey Study on Health and Responsiveness 2000-2001
    WHO Multi-country Survey Study on Health and Responsiveness 2000-2001 T. Bedirhan Üstün, Somnath Chatterji, Maria Villanueva, Lydia Bendib Can Çelik, Ritu Sadana, Nicole Valentine, Juan Ortiz, Ajay Tandon, Joshua Salomon, Yang Cao, Xie Wan Jun, Emre Özaltin, Colin Mathers and Christopher J.L. Murray GPE Discussion Paper 37 30 November 2001 TABLE OF CONTENTS SUMMARY................................................................................................................................................ 1 1. INTRODUCTION ................................................................................................................................ 3 2. OVERALL GOALS OF THE SURVEY STUDY .............................................................................. 6 2.1 SPECIFIC AIMS OF THE WHO MULTI-COUNTRY SURVEY STUDY........................................................... 7 2.2 THE SPECIFIC AIM OF CROSS-POPULATION COMPARABILITY ................................................................ 7 3. DEVELOPMENT AND CONTENT OF SURVEY INSTRUMENT ............................................. 11 3.1 SELECTION OF HEALTH DOMAINS..................................................................................................... 11 3.2 FORMULATION OF QUESTIONS.......................................................................................................... 12 3.3 OPERATIONALIZATION OF CROSS-POPULATION CRITERIA .................................................................. 13 3.4 HEALTH STATE DESCRIPTIONS.........................................................................................................
    [Show full text]
  • ESOMAR GRBN Draft Online Sample Quality Guideline April 2014
    ESOMAR/GRBN GUIDELINE FOR ONLINE SAMPLE QUALITY CONSULTATION DRAFT April 2014 DRAFT ONLINE SAMPLE QUALITY GUIDELINE ESOMAR, the World Association for Social, Opinion and Market Research, is the essential organisation for encouraging, advancing and elevating market research. GRBN, the Global Research Business Network, connects 38 research associations and over 3500 research businesses on five continents. © 2014 ESOMAR and GRBN. Issued April 2014. This guideline is drafted in English and the English text is the definitive version. The text may be copied, distributed and transmitted under the condition that appropriate attribution is made and the following notice is included “© 2014 ESOMAR and GRBN”. 2 DRAFT ONLINE SAMPLE QUALITY GUIDELINE ESOMAR/GRBN GUIDELINE FOR ONLINE SAMPLE QUALITY DRAFT CONTENTS 1 INTRODUCTION AND SCOPE 4 2 DEFINITIONS 5 3 KEY REQUIREMENTS 7 3.1 The claimed identity of each respondent should be validated 7 3.2 Providers must make every effort to ensure that no respondent completes the same survey more than once 8 3.2.1 Device ID 3.2.2 Cookies and other similar object 3.2.3 Other Methods 3.3 Respondent engagement should be measured and reported on. 9 3.4 The identity and personal data of respondents must be protected. 10 3.5 Take special care with children and young people. 10 3.6 Employ good online questionnaire design practices. 10 3.7 Online sample providers must be transparent with researchers and clients about sample sources, the sampling process, and its outcomes 11 3.8 Researchers using online samples must be transparent with clients. 11 3.9 Passive Data collection 12 3.10 Conform to all relevant laws, regulations, and industry codes of conduct.
    [Show full text]