Esomar Guideline for Conducting Survey Research
Total Page:16
File Type:pdf, Size:1020Kb
Load more
Recommended publications
-
A Critical Review of Studies Investigating the Quality of Data Obtained with Online Panels Based on Probability and Nonprobability Samples1
Callegaro c02.tex V1 - 01/16/2014 6:25 P.M. Page 23 2 A critical review of studies investigating the quality of data obtained with online panels based on probability and nonprobability samples1 Mario Callegaro1, Ana Villar2, David Yeager3,and Jon A. Krosnick4 1Google, UK 2City University, London, UK 3University of Texas at Austin, USA 4Stanford University, USA 2.1 Introduction Online panels have been used in survey research as data collection tools since the late 1990s (Postoaca, 2006). The potential great cost and time reduction of using these tools have made research companies enthusiastically pursue this new mode of data collection. However, 1 We would like to thank Reg Baker and Anja Göritz, Part editors, for their useful comments on preliminary versions of this chapter. Online Panel Research, First Edition. Edited by Mario Callegaro, Reg Baker, Jelke Bethlehem, Anja S. Göritz, Jon A. Krosnick and Paul J. Lavrakas. © 2014 John Wiley & Sons, Ltd. Published 2014 by John Wiley & Sons, Ltd. Callegaro c02.tex V1 - 01/16/2014 6:25 P.M. Page 24 24 ONLINE PANEL RESEARCH the vast majority of these online panels were built by sampling and recruiting respondents through nonprobability methods such as snowball sampling, banner ads, direct enrollment, and other strategies to obtain large enough samples at a lower cost (see Chapter 1). Only a few companies and research teams chose to build online panels based on probability samples of the general population. During the 1990s, two probability-based online panels were documented: the CentER data Panel in the Netherlands and the Knowledge Networks Panel in the United States. -
Esomar/Grbn Guideline for Online Sample Quality
ESOMAR/GRBN GUIDELINE FOR ONLINE SAMPLE QUALITY ESOMAR GRBN ONLINE SAMPLE QUALITY GUIDELINE ESOMAR, the World Association for Social, Opinion and Market Research, is the essential organisation for encouraging, advancing and elevating market research: www.esomar.org. GRBN, the Global Research Business Network, connects 38 research associations and over 3500 research businesses on five continents: www.grbn.org. © 2015 ESOMAR and GRBN. Issued February 2015. This Guideline is drafted in English and the English text is the definitive version. The text may be copied, distributed and transmitted under the condition that appropriate attribution is made and the following notice is included “© 2015 ESOMAR and GRBN”. 2 ESOMAR GRBN ONLINE SAMPLE QUALITY GUIDELINE CONTENTS 1 INTRODUCTION AND SCOPE ................................................................................................... 4 2 DEFINITIONS .............................................................................................................................. 4 3 KEY REQUIREMENTS ................................................................................................................ 6 3.1 The claimed identity of each research participant should be validated. .................................................. 6 3.2 Providers must ensure that no research participant completes the same survey more than once ......... 8 3.3 Research participant engagement should be measured and reported on ............................................... 9 3.4 The identity and personal -
SAMPLING DESIGN & WEIGHTING in the Original
Appendix A 2096 APPENDIX A: SAMPLING DESIGN & WEIGHTING In the original National Science Foundation grant, support was given for a modified probability sample. Samples for the 1972 through 1974 surveys followed this design. This modified probability design, described below, introduces the quota element at the block level. The NSF renewal grant, awarded for the 1975-1977 surveys, provided funds for a full probability sample design, a design which is acknowledged to be superior. Thus, having the wherewithal to shift to a full probability sample with predesignated respondents, the 1975 and 1976 studies were conducted with a transitional sample design, viz., one-half full probability and one-half block quota. The sample was divided into two parts for several reasons: 1) to provide data for possibly interesting methodological comparisons; and 2) on the chance that there are some differences over time, that it would be possible to assign these differences to either shifts in sample designs, or changes in response patterns. For example, if the percentage of respondents who indicated that they were "very happy" increased by 10 percent between 1974 and 1976, it would be possible to determine whether it was due to changes in sample design, or an actual increase in happiness. There is considerable controversy and ambiguity about the merits of these two samples. Text book tests of significance assume full rather than modified probability samples, and simple random rather than clustered random samples. In general, the question of what to do with a mixture of samples is no easier solved than the question of what to do with the "pure" types. -
EFAMRO / ESOMAR Position Statement on the Proposal for an Eprivacy Regulation —
EFAMRO / ESOMAR Position Statement on the Proposal for an ePrivacy Regulation — April 2017 EFAMRO/ESOMAR Position Statement on the Proposal for an ePrivacy Regulation April 2017 00. Table of contents P3 1. About EFAMRO and ESOMAR 2. Key recommendations P3 P4 3. Overview P5 4. Audience measurement research P7 5. Telephone and online research P10 6. GDPR framework for research purposes 7. List of proposed amendments P11 a. Recitals P11 b. Articles P13 2 EFAMRO/ESOMAR Position Statement on the Proposal for an ePrivacy Regulation April 2017 01. About EFAMRO and ESOMAR This position statement is submitted In particular our sector produces research on behalf of EFAMRO, the European outcomes that guide decisions of public authorities (e.g. the Eurobarometer), the non- Research Federation, and ESOMAR, profit sector including charities (e.g. political the World Association for Data, opinion polling), and business (e.g. satisfaction Research and Insights. In Europe, we surveys, product improvement research). represent the market, opinion and In a society increasingly driven by data, our profession ensures the application of appropriate social research and data analytics methodologies, rigour and provenance controls sectors, accounting for an annual thus safeguarding access to quality, relevant, turnover of €15.51 billion1. reliable, and aggregated data sets. These data sets lead to better decision making, inform targeted and cost-effective public policy, and 1 support economic development - leading to ESOMAR Global Market Research 2016 growth and jobs. 02. Key Recommendations We support the proposal for an ePrivacy Amendment of Article 8 and Recital 21 to enable Regulation to replace the ePrivacy Directive as research organisations that comply with Article this will help to create a level playing field in a true 89 of the General Data Protection Regulation European Digital Single Market whilst increasing (GDPR) to continue conducting independent the legal certainty for organisations operating in audience measurement research activities for different EU member states. -
Summary of Human Subjects Protection Issues Related to Large Sample Surveys
Summary of Human Subjects Protection Issues Related to Large Sample Surveys U.S. Department of Justice Bureau of Justice Statistics Joan E. Sieber June 2001, NCJ 187692 U.S. Department of Justice Office of Justice Programs John Ashcroft Attorney General Bureau of Justice Statistics Lawrence A. Greenfeld Acting Director Report of work performed under a BJS purchase order to Joan E. Sieber, Department of Psychology, California State University at Hayward, Hayward, California 94542, (510) 538-5424, e-mail [email protected]. The author acknowledges the assistance of Caroline Wolf Harlow, BJS Statistician and project monitor. Ellen Goldberg edited the document. Contents of this report do not necessarily reflect the views or policies of the Bureau of Justice Statistics or the Department of Justice. This report and others from the Bureau of Justice Statistics are available through the Internet — http://www.ojp.usdoj.gov/bjs Table of Contents 1. Introduction 2 Limitations of the Common Rule with respect to survey research 2 2. Risks and benefits of participation in sample surveys 5 Standard risk issues, researcher responses, and IRB requirements 5 Long-term consequences 6 Background issues 6 3. Procedures to protect privacy and maintain confidentiality 9 Standard issues and problems 9 Confidentiality assurances and their consequences 21 Emerging issues of privacy and confidentiality 22 4. Other procedures for minimizing risks and promoting benefits 23 Identifying and minimizing risks 23 Identifying and maximizing possible benefits 26 5. Procedures for responding to requests for help or assistance 28 Standard procedures 28 Background considerations 28 A specific recommendation: An experiment within the survey 32 6. -
Esomar Guideline on Social Media Research
ESOMAR GUIDELINE ON SOCIAL MEDIA RESEARCH World Research Codes and Guidelines 1 | World Research Codes and Guidelines All ESOMAR world research codes and guidelines, including latest updates, are available online at www.esomar.org © 2011 ESOMAR. All rights reserved. Issued July 2011 No part of this publication may be reproduced or copied in any form or by any means, or translated, without the prior permission in writing of ESOMAR. ESOMAR codes and guidelines are drafted in English and the English texts are the definitive versions. 2 | World Research Codes and Guidelines ESOMAR GUIDELINE ON SOCIAL MEDIA RESEARCH CONTENTS 1. INTRODUCTION 3 1.1 Scope 3 1.2 Definitions 3 2. KEY PRINCIPLES 4 2.1 Distinguishing market, social and opinion research as a purpose 4 2.2 Conforming to law 5 2.3 Consent and notification 6 2.4 Protecting identifiable data 6 2.5 Ensuring no harm 7 2.6 Children 7 2.7 Reputation of the industry 8 2.8 Reporting 8 3. SOME SPECIFIC RECOMMENDATIONS 8 FOR CERTAIN SOCIAL MEDIA 3.1 Defining social media areas 8 3.2 Private social media areas issues 8 3.3 Market research social media areas issues 9 4. FURTHER INFORMATION 9 Appendix 1: Key fundamentals of the ICC/ESOMAR Code 10 Appendix 2: Contract/Policy advice with sub-contractors/third party suppliers of SMR 10 3 | World Research Codes and Guidelines 1. INTRODUCTION The evolution of social media in recent years has changed the way that hundreds of millions of people share information about themselves around the world. The concept of consumers generating their own content on the internet has become ubiquitous. -
The Evidence from World Values Survey Data
Munich Personal RePEc Archive The return of religious Antisemitism? The evidence from World Values Survey data Tausch, Arno Innsbruck University and Corvinus University 17 November 2018 Online at https://mpra.ub.uni-muenchen.de/90093/ MPRA Paper No. 90093, posted 18 Nov 2018 03:28 UTC The return of religious Antisemitism? The evidence from World Values Survey data Arno Tausch Abstract 1) Background: This paper addresses the return of religious Antisemitism by a multivariate analysis of global opinion data from 28 countries. 2) Methods: For the lack of any available alternative we used the World Values Survey (WVS) Antisemitism study item: rejection of Jewish neighbors. It is closely correlated with the recent ADL-100 Index of Antisemitism for more than 100 countries. To test the combined effects of religion and background variables like gender, age, education, income and life satisfaction on Antisemitism, we applied the full range of multivariate analysis including promax factor analysis and multiple OLS regression. 3) Results: Although religion as such still seems to be connected with the phenomenon of Antisemitism, intervening variables such as restrictive attitudes on gender and the religion-state relationship play an important role. Western Evangelical and Oriental Christianity, Islam, Hinduism and Buddhism are performing badly on this account, and there is also a clear global North-South divide for these phenomena. 4) Conclusions: Challenging patriarchic gender ideologies and fundamentalist conceptions of the relationship between religion and state, which are important drivers of Antisemitism, will be an important task in the future. Multiculturalism must be aware of prejudice, patriarchy and religious fundamentalism in the global South. -
Solvay 224 Avenue Louise 1050 Brussels
Mobilise! Incorporating Mobile Phones in Social and Policy-oriented Surveys ALEC M GALLUP FUTURE OF 1SURVEY RESEARCH FORUM 14 October, 2009 Hôtel Solvay 224 Avenue Louise 1050 Brussels % Dear Attendee, Mobile phones have had a remarkable impact on the world in a relatively short period of time. In all surveys, the overriding consideration is to reach all members of the public, young or old, male or female, employed or self- employed. In the nineties, fixed-line telephone coverage reached almost saturation point, but times are changing. In Europe, countries such as Finland and the Czech Republic now have a majority of citizens who are "mobile-only". Furthermore, as mobile phone ownership and usage is currently higher among certain groups, such as younger members of the population, the potential arises for mobile-phone non- coverage bias. This was a topic widely debated during the 2004 US Presidential election. Further discussion and research on the topic is vital. That's why Gallup has brought together the world's leading experts to thrash out issues that will undoubtedly impact the future of social research. Earlier this year, we were saddened by the death of Alec Gallup, a consummate polling professional who served the company for 60 years. If he was still with us, he would be watching the increase of the mobile-phone population with interest. Alec Gallup understood polling from A to Z and he knew that that the future of survey research depended on methodologies that would continue to give an equal opportunity of being polled … to all members of the public Bi-annual series of seminars: Future of Surveys We would therefore like to welcome you to "The 1st Alec Gallup Future of Survey Research Forum: Incorporating Mobile Phones in Social and Policy-oriented Surveys. -
Explaining Professed Popular Trust in Zimbabwe's Presidents
Dispatch No. 399 | 20 October 2020 Fear and trust: Explaining professed popular trust in Zimbabwe’s presidents Afrobarometer Dispatch No. 399 | Simangele Moyo-Nyede Summary Popular trust in public institutions and officials is an important indicator of political legitimacy, a key resource for the development and functioning of modern democracies (Freitag & Bühlmann, 2009; Chingwete, 2016; Mishler & Rose, 2001; Newton, 2001). However, some analysts argue that while trust is important in a democracy, citizens would be naïve if they didn’t have a certain level of distrust as well (van de Walle & Six, 2004). In Zimbabwe, almost two-thirds of Afrobarometer survey respondents in 2017 said they trusted then-President Robert Mugabe “somewhat” or “a lot.” The following year, after Mugabe ended his 37-year rule under pressure from the military, more than half of respondents expressed trust in his successor, President Emmerson Mnangagwa. At the same time, clear majorities said their country was “going in the wrong direction,” assessed the national economic situation as bad, rated the government’s performance on the economy as poor, and said they did not feel free to criticize the president. As they had for years, headlines portrayed a country contending with a ruined economy, a collapsing health care system, high unemployment and corruption, and poor public services (Pindula News, 2018; Muronzi, 2020). This raises the question: How can citizens who see their country as “going in the wrong direction” express trust in the person leading it there? Do substantial numbers of Zimbabweans really trust their president? If so, what drives this trust? An analysis of Afrobarometer survey data from 2017 and 2018 – during Mugabe’s last year in office and Mnangagwa’s first – suggests that in addition to any number of possible reasons that Zimbabweans may have had for trusting their president, fear of appearing anti- government was one factor contributing to high levels of professed trust. -
World Values Surveys and European Values Surveys, 1999-2001 User Guide and Codebook
ICPSR 3975 World Values Surveys and European Values Surveys, 1999-2001 User Guide and Codebook Ronald Inglehart et al. University of Michigan Institute for Social Research First ICPSR Version May 2004 Inter-university Consortium for Political and Social Research P.O. Box 1248 Ann Arbor, Michigan 48106 www.icpsr.umich.edu Terms of Use Bibliographic Citation: Publications based on ICPSR data collections should acknowledge those sources by means of bibliographic citations. To ensure that such source attributions are captured for social science bibliographic utilities, citations must appear in footnotes or in the reference section of publications. The bibliographic citation for this data collection is: Inglehart, Ronald, et al. WORLD VALUES SURVEYS AND EUROPEAN VALUES SURVEYS, 1999-2001 [Computer file]. ICPSR version. Ann Arbor, MI: Institute for Social Research [producer], 2002. Ann Arbor, MI: Inter-university Consortium for Political and Social Research [distributor], 2004. Request for Information on To provide funding agencies with essential information about use of Use of ICPSR Resources: archival resources and to facilitate the exchange of information about ICPSR participants' research activities, users of ICPSR data are requested to send to ICPSR bibliographic citations for each completed manuscript or thesis abstract. Visit the ICPSR Web site for more information on submitting citations. Data Disclaimer: The original collector of the data, ICPSR, and the relevant funding agency bear no responsibility for uses of this collection or for interpretations or inferences based upon such uses. Responsible Use In preparing data for public release, ICPSR performs a number of Statement: procedures to ensure that the identity of research subjects cannot be disclosed. -
Management of COVID-19 Measures
ESOMAR Statement: The role of Data, Research and Insights community in supporting global crisis and post-crisis management of Covid19 measures. Key recommendations to facilitate access and dissemination of our expertise Research has always been the cornerstone of informed decisions; why not lean on that expertise now and ensure evidence-based decision making and accelerate the termination of the crisis and the recovery post-crisis? For these reasons, ESOMAR is calling upon business leaders who commission research, national government leaders, international bodies, and the business community to take these following steps: 1. Maintain the current levels of funding and reallocate research spend to help improve our knowledge and evidence-base on Covid-19 related measures; 2. Enact government funding programmes to specifically support collaboration on Covid-19 thematic research for the general interest; 3. Issue immediately calls for tender to conduct comprehensive and wide-ranging social research by researchers that abide to the principles of accepted codes of conduct governing market, opinion, and social research; 4. Support our measures to collate and disseminate research expertise for the general public interest; 5. Establish multi-disciplinary research expert groups composed of academics, private experts and government representatives to provide up-to-date research expertise on the impact of the crisis and to support communication efforts both during and after the crisis has passed; 6. Work with these expert groups to evaluate and use the insights to inform government strategies moving forward. The research community stands ready to act in support of the general public interest. Page 2 A unique context, a watershed moment Our world is currently facing a watershed on the immediate crisis management moment. -
Interviewing Children and Young People
INTERVIEWING CHILDREN AND YOUNG PEOPLE ESOMAR WORLD RESEARCH CODES & GUIDELINES INTERVIEWING CHILDREN AND YOUNG PEOPLE ESOMAR WORLD RESEARCH CODES & GUIDELINES INTERVIEWING CHILDREN AND YOUNG PEOPLE All ESOMAR world research codes and guidelines, including latest updates, are available online at www.esomar.org Copyright © ESOMAR 1999 Latest reprint: 2009 ESOMAR WORLD RESEARCH CODES & GUIDELINES INTERVIEWING CHILDREN AND YOUNG PEOPLE ESOMAR WORLD RESEARCH CODES & GUIDELINES INTERVIEWING CHILDREN AND YOUNG PEOPLE CONTENTS Introduction 2 Requirements 3 ESOMAR WORLD RESEARCH CODES & GUIDELINES INTERVIEWING CHILDREN AND YOUNG PEOPLE ESOMAR WORLD RESEARCH CODES & GUIDELINES INTERVIEWING CHILDREN AND YOUNG PEOPLE INTRODUCTION A considerable amount of survey • the authorities, and the public research is carried out among children generally, must be confident that all and young people for both economic research carried out with children and and sociological purposes. This is a young people is conducted to the highest legitimate and valuable form of research ethical standards and that there can be but, as the ICC/ESOMAR International no question of any possible abuse of Code points out, it calls for special the children or young people involved. care and precautions on the part of the researcher. This Guideline specifies in One difficulty is that at present there is more detail what such “special care” no common international definition of involves. It concentrates on the ethical “child”, “young person” etc. Even within issues involved and does not deal a single country the definition may vary with the technical problems of such with the activity under consideration. research. Because it would be very difficult to agree any general definition based on In carrying out such research: factors such as the child’s cognitive powers, to fulfil the objectives outlined • the welfare of the children and above, this Guideline takes a straight- young people themselves is the over- forward, practical approach to the riding consideration - they must not be issue.