Online Surveys Wave 1
Total Page:16
File Type:pdf, Size:1020Kb
Data report: online surveys Wave 1 Authors1: Evelyn Ersanilli & Marieke van der Gaag Version: 4.0 Updated: September 2021 Please cite as: Ersanilli, E. & Van der Gaag, M. (2021). “Data report: online surveys. Wave 1” MOBILISE working papers. This work is part of “MOBILISE - Determinants of 'Mobilisation' at Home and Abroad: Analysing the Micro-Foundations of Out-Migration & Mass Protest” funded under the Open Research Area (ORA) scheme by ESRC (UK), DFG (Germany), ANR (France) and NWO Social Sciences and Humanities (the Netherlands). 1 We would like to thank Piotr Goldstein and Kostiantyn Fedorenko for providing us with data on election results and helpful suggestions during the data collection. We also thank Sorana Toma for her helpful suggestions. MOBILISE – ONLINE SURVEY DATA REPORT W1 Abstract The MOBILISE project examines why some people respond to discontent by protesting, others by migrating while yet others stay immobile. It focuses on four countries that have seen outmigration and protest in recent year (Ukraine, Poland, Morocco and Argentina) and migrants from these countries who live in Germany, the United Kingdom and Spain. Migrants were surveyed online and recruited into the sample through Facebook advertising. MOBILISE also conducted online surveys of the national populations of Argentina and Ukraine. This report explains why MOBILISE choose to recruit the sample through Facebook advertisements and provides detailed information on the set- up of the sampling. It also present an overview of the effectiveness of this method, in terms of costs, reach and bias, and of issues encountered. We find that sampling through Facebook advertisements is a cost-effective way to obtaining a large sample. The method seems particularly effective in reaching recent migrants and reaching migrants from small communities. There is some indication of a bias in gender, education and political interest. The paper ends with recommendations on the use of this approach for future surveys. 2 MOBILISE – ONLINE SURVEY DATA REPORT W1 Table of Contents Abstract .................................................................................................................................................................................. 2 Introduction ......................................................................................................................................................................... 7 Research design .................................................................................................................................................................. 7 Target groups ................................................................................................................................................................. 7 Size of target groups .................................................................................................................................................... 8 Sampling strategy .............................................................................................................................................................. 9 Choosing a strategy ...................................................................................................................................................... 9 Online strategies ........................................................................................................................................................ 10 Facebook ads ............................................................................................................................................................... 11 MOBILISE Facebook page ................................................................................................................................. 11 Ad design .................................................................................................................................................................. 11 Campaign objective, targeting settings and performance ................................................................... 13 Emerging issues .................................................................................................................................................... 15 Facebook community groups................................................................................................................................ 16 VK ads ............................................................................................................................................................................. 17 Google Ad Words........................................................................................................................................................ 17 Data collection .................................................................................................................................................................. 18 Questionnaire .............................................................................................................................................................. 19 Languages ..................................................................................................................................................................... 19 Survey duration .......................................................................................................................................................... 20 Ethics ............................................................................................................................................................................... 20 Data cleaning ..................................................................................................................................................................... 21 Response ............................................................................................................................................................................. 22 Sample composition and bias .................................................................................................................................... 23 Migrant surveys .......................................................................................................................................................... 23 Socio-demographic variables .......................................................................................................................... 23 Social media use .................................................................................................................................................... 28 Political interest and voting ............................................................................................................................. 28 National surveys ......................................................................................................................................................... 30 Socio-demographic variables .......................................................................................................................... 30 Social media use .................................................................................................................................................... 32 Political interest and voting ............................................................................................................................. 32 Migration aspirations.......................................................................................................................................... 35 Discussion and recommendations ........................................................................................................................... 36 Bibliography ...................................................................................................................................................................... 38 3 MOBILISE – ONLINE SURVEY DATA REPORT W1 Appendices ........................................................................................................................................................................ 40 Appendix 1. Targeting strategies for MOBILISE Facebook ads – first wave ..................................... 41 Appendix 2. Master survey .................................................................................................................................... 42 Appendix 3. Project Information Sheet .......................................................................................................... 108 4 MOBILISE – ONLINE SURVEY DATA REPORT W1 List of Tables Table 1. Size of migrant population by origin and destination country ......................................................... 8 Table 2. Sampling methods compared on selection conditions ......................................................................... 9 Table 3. Targeting strategies and cost per respondent for MOBILISE Facebook ads............................. 14 Table 4. Data collection period per online survey ............................................................................................... 18 Table 5. Language use by survey. ............................................................................................................................... 19 Table 6. Survey duration in minutes by target group. ......................................................................................