Presentation Abstracts
Total Page：16
File Type：pdf, Size：1020Kb
th Annual 7 Conference Interviewers and Interviewing Race an E S A l ection Po A tandards Questionnaire Pretesting ddress Based Samplin daptive Design / Responsive Desig Paradata Nonprobability Sampling Immigration Exit Polls Health and G International d / Sensitive Topics ll Regulations Et Non-Response Incentives ende Health Care in Public Opinion g Language Total Survey Error Aging h LGBT Research Translation nicit r Social Media Research Q Online Panel Surveys ualitative / Ethics y Mobile Device Data Collection Longitudinal Data Collection Fit for Purpose Big Data / Administrative Data / Auxiliary Data Media and Response Rate and Polling and Society g Public Opinion Other Quality Metrics Internet Data Collection Multimode Measurement Error Data Collection Cell Phone Sampling n E S mall Questionnaire Design stimati A Meeting Place Environment and Climate Change A Methods to Maximize Participation Proxy Responding rea on Sampling / Weighting Cross-Cultural Research 2015 Conference Abstracts May 14 - 17, 2015 The Diplomat • Hollywood, Florida www.aapor.org #aapor AAPOR 70th Annual Conference Thursday, May 14 1:30 p.m. – 3:00 p.m. Concurrent Session A Cross Cultural Measurement Innovative Uses of Paradata Across Diverse Contexts Beth-Ellen Pennell, Institute for Social Research, University of Michigan Gina Cheung, Institute for Social Research, University of Michigan This presentation will describe innovative uses of rich paradata to monitor production and quality indicators in household surveys in international settings. Data collection technologies that have been widely used in the United States for decades are increasingly being adapted and used in innovative ways in new contexts. This transfer of technology is facilitating new approaches that enable more efficient production and better quality control in these contexts through the collection and monitoring of rich paradata (process data). This diffusion of technology not only allows for immediate access to the survey and process data (including call records) to monitor field work quality but has also facilitated the use of other applications. These applications also include self-administered modes (e.g., audio computer-assisted self-interview [ACASI]), digital audio recordings, global positioning systems (GPS) for collecting contextual information or live tracking of interviewer travel to households, areal photography for sample selection, and the collection of various anthropometric data using digital devices, among other examples. With these innovations come new challenges, however. The presentation will discuss advantages, challenges and lessons learned across a diverse set of projects as well as make recommendations for new developments in this space. The presentation will provide examples from projects in five very different settings: China, Ghana, India, Nepal, and the Kingdom of Saudi Arabia. Culturally-Related Response Styles for Attitude Questions: A Comparative Analysis of Chinese and American Respondents Mengyang Wang, University of Nebraska–Lincoln The existence of culturally-based survey response styles represents a major threat to the interpretation of research findings. Researchers conducting cross-cultural surveys are particularly challenged in drawing valid conclusions from survey data when respondents demonstrate culturally-based response patterns that are systematically different, though unrelated to content. In China, the ‘Doctrine of the Mean’ is a central aspect of Chinese culture. Unlike American culture, Chinese principles encourage people to express neutral, instead of polarized, attitudes. Although this cultural difference may have the potential to impact survey response patterns, there is little research studying underlying cultural effects by comparing Chinese and American response styles. In this study, a comparative analysis of responses from Chinese and American respondents are examined, using data from the 2013 Gallup World Poll, a multinational probability-based survey. To examine whether variable response styles for attitude questions can be explained by the presence of an underlying construct related to cultural difference, simultaneous latent class analysis is employed to examine the structure of perception patterns, as well as differences in patterns of Chinese and American respondents. Specifically, this research seeks to examine three issues: (1) whether Chinese respondents AAPOR 70th Annual Conference demonstrate significantly different response patterns compared to American respondents, (2) whether the occurrence of extreme response styles is lower among Chinese respondents, and (3) whether Chinese respondents are more likely to give non-opinion responses. Preliminary results indicate a complex pattern in which the likelihood American respondents opt for extreme responses are double the likelihood Chinese respondents do so across a range of topics. Moreover, Chinese respondents appear, on average, six times more likely than American respondents to select non-opinion response. These findings raise a number of issues that are important to address, in order to assess the problem of measurement artifacts unrelated to the constructs of interest before cross-cultural comparisons can be made. Religion in the Soviet Bloc After the Fall of the Iron Curtain Neli Esipova, Gallup Dato Tsabutashvili, Gallup This paper will examine people’s attitudes toward religion in 29 former Soviet bloc countries, as well as their religious affiliation. While Soviet ideology sought to eliminate religion and replace it with universal atheism, the Catholic Church in Poland, for example, was able to resist. Given that religion was suppressed to different degrees in different countries under Communist rule, and is still suppressed in some of them today, religion is more important in some countries than others. People’s tolerance of different religions also varies throughout the region. Using data from the Gallup World Poll collected annually between 2005 and 2014, we are able to shed more light on trends in religious affiliation as well as on the importance that people place on religion. Furthermore, we compare attitudes regarding religious tolerance. In all former Communist countries, the Gallup World Poll asks self-declared believers whether marrying someone outside their own religion is acceptable. In addition, we ask believers if they consider their religion to be the one true religion in the world or as just one among many equally valuable religions. Finally, the World Poll provides public opinion data on religious education in schools from across the region. And special attention is paid to attitudinal differences among various demographic groups, with a particular focus on age groups to compare those who grew up under Communist rule versus the younger generation. Cognitive Testing of Survey Translations: Does Respondent Language Proficiency Matter? Patricia L. Goerman, U.S. Census Bureau Mikelyn Meyers, U.S. Census Bureau Hyunjoo Park, RTI International Alisu Schoua-Glusberg, Research Support Services, Inc. Mandy Sha, RTI International Historically, many researchers have followed the “rule of thumb” that translated survey instruments should be cognitively tested with only monolingual and limited source-language proficient respondents. There are various rationales for this practice, such as assumptions that 1) monolingual respondents are the intended users of translated survey instruments (Pan, et al., 2007); and 2) fully bilingual respondents might be more likely to understand a poorly translated phrase. Bilinguals are also more likely to understand inappropriately literal translations for concepts that do not exist in the target language. Whether pretesting translations with monolingual or bilingual respondents produces different results has rarely been studied empirically and most studies have not been designed to look at this issue specifically (Park, et al., 2014). This paper focuses on results from two different Spanish-language cognitive and usability studies with monolingual and bilingual Spanish-speaking respondents: 1) testing of a AAPOR 70th Annual Conference U.S. Census Test internet instrument and 2) testing of a U.S. Census Test CAPI instrument. In the first study, a small number of bilingual respondents were inadvertently included in the study. The second study was deliberately designed to compare testing with monolingual and bilingual respondents, with 20 interviews conducted with each type of respondent. Preliminary results from the first study indicate that bilingual respondents uncovered an equal or higher number of translation and usability problems as did the monolingual respondents. One limitation of these results is that the study was not specifically designed to examine this issue and thus bilingual respondents were not systematically recruited. In addition, there were correlations between English-language proficiency, computer proficiency and educational level, with the bilingual respondents having higher levels of each. We will compare the number and types of findings uncovered by monolingual and bilingual respondents in the internet and CAPI studies and will explore mode differences noted across the two studies. New Direction in Sampling Venue-Based and Real-Time Sampling Methodologies in an Intercept Survey of Cyclists Olivia Saucier, ICF International Ronaldo Iachan, ICF International Heather Driscoll, ICF International Intercept surveys can be useful for gathering information about travel to specific locations while the