Fourth In-Person Meeting of the NSF Standing Committee on the Future of NSF-Supported Social Science Surveys

Total Page:16

File Type:pdf, Size:1020Kb

Fourth In-Person Meeting of the NSF Standing Committee on the Future of NSF-Supported Social Science Surveys Fourth In-Person Meeting of the NSF Standing Committee on the Future of NSF-Supported Social Science Surveys December 1-2, 2016 The National Academies of Sciences, Engineering and Medicine The Keck Center - Room 209 500 Fifth Street NW, Washington, DC 20001 PARTICIPANT LIST Committee Members Dan Black Henry Brady Deputy Dean and Professor Professor of Political Science and Public Policy Harris School of Public Policy Director, UC Data Achieve and Survey Research University of Chicago University of California, Berkeley Angus Deaton Barbara Entwisle (chair) Dwight D. Eisenhower Professor of Economics Kenan Distinguished Professor of Sociology and International Affairs Emeritus Fellow, Carolina Population Center Woodrow Wilson School University of North Carolina, Chapel Hill Princeton University Morris Fiorina, Jr. Myron Gutmann Wendt Family Professor of Political Science Professor of History Hoover Institute Director, Institute of Behavioral Science Stanford University University of Colorado, Boulder Darrick Hamilton Pamela Herd Associate Professor of Economics and Urban Professor of Public Affairs and Sociology Policy Robert M. La Follette School of Public Affairs The New School University of Wisconsin, Madison Jon Krosnick (participating via WebEx) Michael Link (participating via WebEx) Professor of Communication, Political Science, President and CEO and Psychology Abt SRBI Stanford University Committee Members (con’t) Shelly Lundberg Leonard Broom Professor of Demography University of California, Santa Barbara NSF Staff Fay Cook Kellina Craig-Henderson Division of Social and Economic Sciences Division of Social and Economic Sciences National Science Foundation National Science Foundation Cheryl Eavey (participating via phone) Brian Humes Division of Social and Economic Sciences Division of Social and Economic Sciences National Science Foundation National Science Foundation Nancy Lutz Katherine Meyer Division of Social and Economic Sciences Division of Social and Economic Sciences National Science Foundation National Science Foundation Daniel Sui Alan Tomkins Division of Social and Economic Sciences Division of Social and Economic Sciences National Science Foundation National Science Foundation Patricia White Division of Social and Economic Sciences National Science Foundation National Academies Staff Constance Citro Eileen LeFurgy Director Program Coordinator Committee on National Statistics Committee on National Statistics Cynthia Thomas Senior Program Officer Committee on National Statistics .
Recommended publications
  • Jon Krosnick Frederic O
    Jon Krosnick Frederic O. Glover Professor of Humanities and Social Sciences, Professor of Communication and of Political Science and, by courtesy, of Psychology Curriculum Vitae available Online Bio BIO Jon Krosnick is a social psychologist who does research on attitude formation, change, and effects, on the psychology of political behavior, and on survey research methods. He is the Frederic O. Glover Professor in Humanities and Social Sciences, Professor of Communication, Political Science, and (by courtesy) Psychology. At Stanford, in addition to his professorships, he directs the Political Psychology Research Group and the Summer Institute in Political Psychology. To read reports on Professor Krosnick’s research program exploring public opinion on the environment visit the Woods Institute for the Environment and the Public Opinion on Climate Change web sites. Research Interests Author of four books and more than 140 articles and chapters, Dr. Krosnick conducts research in three primary areas: (1) attitude formation, change, and effects, (2) the psychology of political behavior, and (3) the optimal design of questionnaires used for laboratory experiments and surveys, and survey research methodology more generally. His attitude research has focused primarily on the notion of attitude strength, seeking to differentiate attitudes that are firmly crystallized and powerfully influential of thinking and action from attitudes that are flexible and inconsequential. Many of his studies in this area have focused on the amount of personal importance that an individual chooses to attach to an attitude. Dr. Krosnick’s studies have illuminated the origins of attitude importance (e.g., material self-interest and values) and the cognitive and behavioral consequences of importance in regulating attitude impact and attitude change processes.
    [Show full text]
  • The Impact of Candidates' Statements About Climate Change On
    The Impact of Candidates’ Statements about Climate Change on Electoral Success in 2008 and 2010: Evidence Using Three Methodologies Bo MacInnis Jon A. Krosnick Ana Villar Stanford University August, 2011 This research was supported by National Science Foundation grant 1042938 and by the Woods Institute for the Environment. Jon Krosnick is University Fellow at Resources for the Future. Address correspondence about this study to Jon A. Krosnick, McClatchy Hall, Stanford University, Stanford, CA 94305 (email: [email protected]). The Impact of Candidates’ Statements about Climate Change on Electoral Success in 2008 and 2010: Evidence Using Three Methodologies Abstract More than a decade of national surveys suggest that the vast majority of Americans who attach personal importance to the issue of climate change take what might be called “green” positions on that issue – endorsing the existence of warming, human causation, and the need for ameliorative action. This finding suggests that candidates running for office can gain votes by taking green positions and might lose votes by expressing skepticism about climate change. This paper describes tests of these hypotheses using three methodologies: (1) experiments embedded in a national survey and in three state surveys, (2) an analysis relating statement on climate change made by 2010 Congressional candidates with their victory rates, and (3) an analysis of the relation of climate change issue positions with votes during the 2008 Presidential election. All three methodologies yield evidence consistent with the notion that a candidate gained votes by taking a green position and lost votes by taking a not-green position. The effects of taking green and not green positions were larger among people who believed in anthropogenic warming than among people who did not, and the effects were stronger among people who attached more personal importance to the issue.
    [Show full text]
  • Comparing the Accuracy of Rdd Telephone Surveys and Internet Surveys Conducted with Probability and Non-Probability Samples
    Public Opinion Quarterly Advance Access published October 5, 2011 Public Opinion Quarterly, pp. 1–39 COMPARING THE ACCURACY OF RDD TELEPHONE SURVEYS AND INTERNET SURVEYS CONDUCTED WITH PROBABILITY AND NON-PROBABILITY SAMPLES DAVID S. YEAGER* JON A. KROSNICK* LINCHIAT CHANG HAROLD S. JAVITZ MATTHEW S. LEVENDUSKY ALBERTO SIMPSER RUI WANG Downloaded from poq.oxfordjournals.org Abstract This study assessed the accuracy of telephone and Internet surveys of probability samples and Internet surveys of non-probability samples of American adults by comparing aggregate survey results at University of Pennsylvania Library on October 6, 2011 against benchmarks. The probability sample surveys were consistently more accurate than the non-probability sample surveys, even after post-stratification with demographics. The non-probability sample survey measurements were much more variable in their accuracy, both across measures within a single survey and across surveys with a single measure. Post-stratification improved the overall accuracy of some of the non- probability sample surveys but decreased the overall accuracy of others. DAVID S. YEAGER is a PhD candidate at Stanford University, Stanford, CA, USA. JON A. KROSNICK is Frederic O. Glover Professor in Humanities and Social Sciences, Professor of Communication, Po- litical Science, and (by courtesy) Psychology at Stanford University, Stanford, CA, USA, and is Uni- versity Fellow at Resources for the Future. LINCHIAT CHANG is the owner of LinChiat Chang Consulting, LLC, San Francisco, CA, USA. HAROLD S. JAVITZ is Principal Scientist at SRI Interna- tional, Inc., Menlo Park, CA, USA. MATTHEW S. LEVENDUSKY is Assistant Professor of Political Sci- ence at the University of Pennsylvania, Philadelphia, PA, USA.
    [Show full text]
  • ' and ''Other People'
    Public Opinion Quarterly, Vol. 76, No. 1, Spring 2012, pp. 131–141 DOES MENTIONING ‘‘SOME PEOPLE’’ AND ‘‘OTHER PEOPLE’’ IN AN OPINION QUESTION IMPROVE MEASUREMENT QUALITY? DAVID SCOTT YEAGER* JON A. KROSNICK Downloaded from Abstract Researchers often measure attitudes and beliefs using ‘‘some/ other’’ questions (‘‘Some people think that ... but other people think that ...’’) instead of asking simpler ‘‘direct’’ questions. This article http://poq.oxfordjournals.org/ reports studies testing the hypothesis that the some/other question form yields improved response validity. Eight experiments embedded in na- tional surveys provided no evidence in support of this hypothesis. In- stead, validity was found to be greatest when employing the direct question format presenting response options in an order that did not violate conversational conventions. Furthermore, some/other questions take longer to ask and answer and, because they involve more words, require greater cognitive effort from respondents. Therefore, the some/ at University of Texas Austin on March 2, 2012 other format seems best avoided; direct questions that avoid unconven- tional response option ordering are preferable to maximize data quality. Researchers often measure attitudes and beliefs by stating both sides of an issue before asking for the respondentÕs opinion. This type of question, which we call a ‘‘some/other’’ question, first says what ‘‘some’’ people believe, then says what DAVID YEAGER is an Assistant Professor in the Department of Psychology, University of Texas at Austin, Austin, TX, USA. At the time this work was conducted, he was a Ph.D. candidate at Stan- ford University, Stanford, CA, USA. JON KROSNICK is Frederic O. Glover Professor in Humanities and Social Sciences, Professor of Communication, Political Science, and Psychology (by courtesy) at Stanford University, and is University Fellow at Resources for the Future.
    [Show full text]
  • Opportunity Through Diversity
    FINAL PROGRAM OppORTUNITY through DIVERSITY AAPOR 65th Annual Conference May 13-16, 2010 Chicago Marriott Downtown Magnificent Mile Chicago, IL WAPOR 63rd Annual Conference May 11–13, 2010 The Avenue Hotel | Chicago, IL www.aapor.org AAPOR 65th Annual Conference May 13-16, 2010 Chicago Marriott Downtown Magnificent Mile Chicago, IL ANNUAL CONFERENCE WAPOR 63rd Annual Conference May 11–13, 2010 The Avenue Hotel | Chicago, IL Table of Contents Welcome to Chicago, Illinois ..................................................................................5 General Meeting Information...........................................................................7 – 9 AAPOR Executive Council ..........................................................................10 – 13 Chapter Presidents ................................................................................................13 Past Presidents ......................................................................................................14 WAPOR Executive Council ................................................................................15 Honorary Life Members .......................................................................................16 Executive Office Staff ...........................................................................................17 Committees/Task Forces ..............................................................................18 – 24 Committee Meetings & Social Activities .....................................................25 – 26 Networking
    [Show full text]
  • Race of Interviewer Effects in Telephone Surveys Preceding The
    International Journal of Public Opinion Research Vol. 31 No. 2 2019 ß The Author(s) 2018. Published by Oxford University Press on behalf of The World Association for Public Opinion Research. All rights reserved. doi:10.1093/ijpor/edy005 Advance Access publication 3 March 2018 Race of Interviewer Effects in Telephone Surveys Downloaded from https://academic.oup.com/ijpor/article/31/2/220/4919655 by Stanford University user on 22 September 2020 Preceding the 2008 U.S. Presidential Election Nuri Kim1, Jon A. Krosnick2, and Yphtach Lelkes3 1Nanyang Technological University, Singapore; 2Stanford University, USA; 3University of Pennsylvania, USA Abstract Race of interviewer effects are presumed to occur in surveys because respondents answer questions differently depending on interviewer race. This article explored an alternative explanation: differential respondent recruitment. Data from telephone interviews conducted during the 2008 U.S. Presidential election campaign by major survey organizations (ABC News/Washington Post, CBS News/New York Times, and Gallup) indicate that African-American interviewers were more likely to elicit statements of the intent to vote for Barack Obama than White interviewers. But this effect occurred because African-American interviewers were more likely than White interviewers to elicit survey participation by African-American respondents, and/or White interviewers were more likely to elicit participation by White respondents. Thus, differences between interviewers in terms of responses obtained are not neces- sarily
    [Show full text]
  • 'Green Politics' on Recent National Elections 12 October 2011
    Researchers examine impact of 'green politics' on recent national elections 12 October 2011 A political candidate's electoral victory or defeat is whether they supported or opposed government influenced by his or her stance on climate change policies to reduce future greenhouse gas policy, according to new Stanford University emissions. The survey also asked what voters studies of the most recent presidential and thought of Barack Obama's and John McCain's congressional elections. positions on climate change. After the election, the voters reported if and for whom they had voted. "These studies are a coordinated effort looking at whether candidates' statements on climate change Not surprisingly, more people who said their own translated into real votes," said Jon Krosnick, views on climate change were closer to Obama's professor of communication and of political science position than to McCain's voted for Obama. This at Stanford, who led two new studies - one of the tendency was especially true among voters who 2008 presidential election and one of the 2010 cared a lot about climate change and persisted congressional elections. "All this suggests that regardless of the voter's ideology, party affiliation, votes can be gained by taking 'green' positions on preferred size of government and opinion about climate change and votes will be lost by taking 'not- President Bush's job performance. green' positions." Congress and climate The findings are consistent with Krosnick's previous research on voters' preferences in a Krosnick's new study on the 2010 congressional hypothetical election. Taken together, the studies election examined what the candidates' websites make a strong case that for candidates of any had said about climate change during their party, saying climate change is real and supporting campaigns, and whether the candidates won or lost policies aimed at tackling the issue is a good way their election.
    [Show full text]
  • Page 1 of 3 Summer Insitute in Political Psychology 12/25/2007 File
    Summer Insitute in Political Psychology Page 1 of 3 Venturing into the Inter-Disciplinary Frontier... Sponsored by For the past twelve years, the Ohio State University has organized a Summer Institute in Political Psychology (SIPP) in conjunction with the International Society of Political International Psychology. We feel that SIPP has been very successful, and we Society for have been pleased with the intellectual stimulation it provided to Political its participants, both teachers and students. Psychology This year, SIPP 2005 will be hosted by Stanford University. Click here for more information. Mershon Center for Studies in International Security and Public Policy The Departments of Psychology and Political Science at The Ohio State University Contact: Tom Dolan Assistant Director SIPP Dept. of Political Science 2140 Derby Hall 154 N. Oval Mall Columbus, OH file://C:\Documents and Settings\becker.271\My Documents\Old website files from Julie\... 12/25/2007 SIPP Faculty Page 1 of 2 Marilynn Brewer (Ph.D., Northwestern) is a Professor of Psychology at Ohio State. Her research focuses on persons and person “types;”intergroup relations, especially the study of ingroup loyalty, intergroup biases, and the effects of contact between groups on intergroup acceptance; and social identities and the self concept. Dr. Brewer’s current research includes the analysis of cross-cultural differences in values and identity. Among her many honors and achievements, she is a recipient of the Kurt Lewin Award from SPSSI and the Donald T. Campbell Award for Distinguished Research in Social Psychology. Co-Chair of SIPP Richard Herrmann (Ph.D., University of Pittsburgh) is a Professor of Political Science and Director of the Mershon Center at Ohio State University.
    [Show full text]
  • Brussels Wksp Panel Member Biographies (123KB PDF)
    Panel member biogs and photos Jon A. Krosnick Frederic O. Glover Professor in Humanities and Social Sciences Professor of Communication Professor of Political Science Email: [email protected] http://communication.stanford.edu/faculty/krosnick/ Jon Krosnick is a social psychologist who does research on attitude formation, change, and effects, on the psychology of political behavior, and on survey research methods. At Stanford, in addition to his professorships, he directs the Political Psychology Research Group and the Summer Institute in Political Psychology. Professional Experience Jon Krosnick received a B.A. degree in psychology from Harvard University and M.A. and Ph.D. degrees in social psychology from the University of Michigan. Prior to joining the Stanford faculty in 2004, Dr. Krosnick was professor of psychology and political science at Ohio State University, where he was a member of the OSU Political Psychology Program and co-directed the OSU Summer Institute in Political Psychology. From 2005 through 2010, he is co-Principal Investigator of the American National Election Studies. Research Interests Author of four books and more than 140 articles and chapters, Dr. Krosnick conducts research in three primary areas: (1) attitude formation, change, and effects, (2) the psychology of political behavior, and (3) the optimal design of questionnaires used for laboratory experiments and surveys, and survey research methodology more generally. His attitude research has focused primarily on the notion of attitude strength, seeking to differentiate attitudes that are firmly crystallized and powerfully influential of thinking and action from attitudes that are flexible and inconsequential. Many of his studies in this area have focused on the amount of personal importance that an individual chooses to attach to an attitude.
    [Show full text]
  • Running Head: CONCERN ABOUT GLOBAL WARMING
    Concern about Global Warming 1 Running Head: CONCERN ABOUT GLOBAL WARMING The Association of Knowledge With Concern about Global Warming: Trusted Information Sources Shape Public Thinking Ariel Malka1, Jon A. Krosnick1, and Gary Langer2 1 Stanford University 2 American Broadcasting Company IN PRESS, RISK ANALYSIS Address correspondence to: Ariel Malka Stanford University Building 120, Room 110 450 Serra Mall Stanford, California 94305-2050 [email protected] Concern about Global Warming 2 The Association of Knowledge With Concern about Global Warming: Trusted Information Sources Shape Public Thinking Abstract During the last decade, a great deal of news media attention has focused on informing the American public about scientific findings on global warming (GW). Has learning this sort of information led the American public to become more concerned about GW? Using data from two surveys of nationally representative samples of American adults, this paper shows that the relation between self-reported knowledge and concern about GW is more complex than previous research has suggested. Among people who trust scientists to provide reliable information about the environment and among Democrats and Independents, increased knowledge has been associated with increased concern. But among people who are skeptical about scientists and among Republicans, more knowledge was generally not associated with greater concern. The association of knowledge with concern among Democrats and Independents who trust scientists was mediated by perceptions of consensus among scientists about GW’s existence and by perceptions that humans are a principal cause of GW. Moreover, additional analyses of panel survey data produced findings consistent with the notion that more knowledge yields more concern among Democrats and Independents, but not among Republicans.
    [Show full text]
  • Report of the AAPOR Task Force on Online Panels
    AAPOR Report on Online Panels Prepared for the AAPOR Executive Council by a Task Force operating under the auspices of the AAPOR Standards Committee, with members including: Reg Baker, Market Strategies International and Task Force Chair Stephen Blumberg, U.S. Centers for Disease Control and Prevention J. Michael Brick, Westat Mick P. Couper, University of Michigan Melanie Courtright, DMS Insights Mike Dennis, Knowledge Networks Don Dillman, Washington State University Martin R. Frankel, Baruch College, CUNY Philip Garland, Survey Sampling International Robert M. Groves, University of Michigan Courtney Kennedy, University of Michigan Jon Krosnick, Stanford University Sunghee Lee, UCLA Paul J. Lavrakas, Independent Consultant Michael Link, The Nielsen Company Linda Piekarski, Survey Sampling International Kumar Rao, Gallup Douglas Rivers, Stanford University Randall K. Thomas, ICF International Dan Zahs, Market Strategies International JUNE, 2010 CONTENTS 1. Executive Summary ...................................................................................................................... 3 2. Background and Purpose of this Report ....................................................................................... 7 3. An Overview of Online Panels ..................................................................................................... 9 4. Errors of Nonobservation in Online Panel Surveys .................................................................... 18 5. Measurement Error in Online Panel Surveys .............................................................................
    [Show full text]
  • Developmental Psychology
    Developmental Psychology Does Mentioning “Some People” and “Other People” in a Survey Question Increase the Accuracy of Adolescents' Self-Reports? David Scott Yeager and Jon A. Krosnick Online First Publication, September 12, 2011. doi: 10.1037/a0025440 CITATION Yeager, D. S., & Krosnick, J. A. (2011, September 12). Does Mentioning “Some People” and “Other People” in a Survey Question Increase the Accuracy of Adolescents' Self-Reports?. Developmental Psychology. Advance online publication. doi: 10.1037/a0025440 Developmental Psychology © 2011 American Psychological Association 2011, Vol. ●●, No. ●, 000–000 0012-1649/11/$12.00 DOI: 10.1037/a0025440 BRIEF REPORT Does Mentioning “Some People” and “Other People” in a Survey Question Increase the Accuracy of Adolescents’ Self-Reports? David Scott Yeager and Jon A. Krosnick Stanford University A great deal of developmental research has relied on self-reports solicited using the “some/other” question format (“Some students think that . but other students think that. .”). This article reports tests of the assumptions underlying its use: that it conveys to adolescents that socially undesirable attitudes, beliefs, or behaviors are not uncommon and legitimizes reporting them, yielding more valid self-reports than would be obtained by “direct” questions, which do not mention what other people think or do. A meta-analysis of 11 experiments embedded in four surveys of diverse samples of adolescents did not support the assumption that the some/other form increases validity. Although the some/other form led adolescents to think that undesirable attitudes, beliefs, or behaviors were more common and resulted in more reports of those attitudes and behaviors, answers to some/other questions were lower in criterion validity than were answers to direct questions.
    [Show full text]