Download 2010 Census Race and Hispanic Origin Alternative
Total Page:16
File Type:pdf, Size:1020Kb
This document was prepared by and for Census Bureau staff to aid in future research and planning, but the Census Bureau is making the document publicly available in order to share the information with as wide an audience as possible. Questions about the document should be directed to Kevin Deardorff at (301) 763-6033 or [email protected] February 28, 2013 2010 CENSUS PLANNING MEMORANDA SERIES No. 211 (2nd Reissue) MEMORANDUM FOR The Distribution List From: Burton Reist [signed] Acting Chief, Decennial Management Division Subject: 2010 Census Race and Hispanic Origin Alternative Questionnaire Experiment Attached is the revised final report, “2010 Census Race and Hispanic Origin Alternative Questionnaire Experiment,” for the 2010 Census Program for Evaluations and Experiments (CPEX). This revision accounts for an update to Appendix A. If you have questions or comments about this report, please contact Joan Hill at (301) 763-4286 or Michael Bentley at (301) 763-4306. Attachment 2010 Census Program for Evaluations and Experiments 2010 Census Race and Hispanic Origin Alternative Questionnaire Experiment U.S. Census Bureau standards and quality process procedures were applied throughout the creation of this report. FINAL REPORT Elizabeth Compton Michael Bentley Sharon Ennis Sonya Rastogi Decennial Statistical Studies Division and Population Division This page intentionally left blank. i Table of Contents Executive Summary ........................................................................................................... vi 1. Introduction ..............................................................................................................1 1.1 Purpose of Study ...............................................................................................3 1.2 Research Questions ...........................................................................................3 2. Background ..............................................................................................................5 2.1 Example Modification Family of Panels (B1) ..................................................5 2.2 Combined Race and Hispanic Origin Family of Panels (B2) ...........................8 2.3 Spanner Format and Limiting of “Race” Term Family of Panels (B4) ..........11 3. Methodology ..........................................................................................................13 3.1 Panel Design ...................................................................................................14 3.2 Sample Design ................................................................................................17 3.3 Mailing Strategy..............................................................................................18 3.4 Reinterview Evaluation ...................................................................................19 3.5 Data Processing ...............................................................................................22 3.6 Data Analysis ..................................................................................................24 3.7 Variance Estimation ........................................................................................29 3.8 Decision Criteria and Making Conclusions ....................................................29 4. Limitations .............................................................................................................30 4.1 Mailout/Mailback Universe ............................................................................30 4.2 Nonresponse Bias............................................................................................31 4.3 Questionnaires in English Only ......................................................................31 4.4 Race and Ethnic “Truth” .................................................................................31 4.5 Possible Conditioning Effects in Reinterview ................................................32 4.6 Removal of Overcount Question ....................................................................32 4.7 Telephone Questionnaire Assistance Callers ..................................................32 4.8 Small Sample for Small Population Groups ...................................................33 4.9 Focus Group Research ....................................................................................33 5. Results ....................................................................................................................33 5.1 Mail Return Rates ...........................................................................................33 5.2 Overall Race and Origin Distributions ...........................................................35 5.3 Item Nonresponse Rates .................................................................................41 5.4 Specific Race and Origin Reporting ...............................................................49 5.5 Treatment-Level Analysis ...............................................................................52 5.6 Reinterview Analysis ......................................................................................55 5.7 Nonresponse Analysis .....................................................................................65 5.8 Focus Group Research ....................................................................................68 6. Related Evaluations, Experiments, and/or Assessments .......................................71 ii 7. Key Lessons Learned, Conclusions, and Recommendations .................................71 7.1 Answers to Research Questions ......................................................................71 7.2 Final Conclusions............................................................................................75 7.3 Recommendations ...........................................................................................78 8. Acknowledgements ................................................................................................79 9. References ..............................................................................................................80 Appendix A: Additional Analysis Tables ..............................................................85 Appendix B: 2010 Alternative Questionnaire Experiment Reinterview Race/Origin Excerpt........................................................................101 Appendix C: 2010 Alternative Questionnaire Experiment Race and Hispanic Origin Panel Questionnaire Images ................................................106 Appendix D: Focus Group Report Executive Summary ......................................123 iii List of Tables Table 1: Experimental Panels and Their Associated Treatments. .........................................14 Table 2: Final Mailout Sample Size for Each Panel and Stratum (Number of Housing Units). ....................................................................................................................18 Table 3: AQE Reinterview Response Rates by Panel and Stratum. ......................................21 Table 4: Sample counts of interview and reinterview responses for a single race /origin group (Hispanic is used as an example) ................................................................28 Table 5: Final Mail Return Rates for the Race and Hispanic Origin Panels by Stratum. ......34 Table 6: Race Question Item Nonresponse by Hispanic Origin. ...........................................36 Table 7: Item Nonresponse for the Separate Race and Hispanic Origin Questions and the Combined Question ...............................................................................................38 Table 8: Weighted Distributions for All Panels. ....................................................................42 Table 9: Weighted Combined Distribution. ...........................................................................45 Table 10: Hispanic Origin Weighted Distribution. ................................................................47 Table 11: Detailed Reporting for Select Race Groups and Hispanic Origin. ........................49 Table 12: Estimated Differences of Treatment-Level Comparisons of the Modified Race Example Treatment. ..............................................................................................52 Table 13: Estimated Differences of Treatment-Level Comparisons of the Modified Hispanic Examples and Removal of term “Negro” treatment. .............................53 Table 14: Estimated Differences of Treatment-Level Comparisons of the Multiple Hispanic Origin Response Treatment. ...................................................................54 Table 15: Percent Consistency between Reinterview Truth and Mailout/Mailback Response ................................................................................................................57 Table 16: Percentage of Consistent Responses between Reinterview Truth and Mailout/Mailback Response by Race and Origin Group ......................................58 Table 17: Gross Difference Rate between the Mailout/Mailback Questionnaires and Telephone Reinterview ..........................................................................................60 Table 18: Net Difference Rate between the Mailout/Mailback Questionnaires and Telephone Reinterview. .........................................................................................63 Table 19: Census Distribution of Respondents and