Race & Ethnicity
Total Page:16
File Type:pdf, Size:1020Kb
2020 Research and Testing: 2015 National Content Test Study Plan - Race & Ethnicity RACE & ETHNICITY [ This page intentionally left blank ] 2015 NATIONAL CONTENT TEST STUDY PLAN | RACE & ETHNICITY TABLE OF CONTENTS 1. INTRODUCTION ..............................................................................................................................7 2. BACKGROUND ................................................................................................................................8 2.1 | Major Census Content Tests Over Past 40 Years .................................................................... 11 2.2 | 2010 Census Race and Hispanic Origin Alternative Questionnaire Experiment ........................ 12 2.3 | Current Data on Race and Ethnicity ....................................................................................... 14 3. METHODOLOGY ........................................................................................................................... 15 3.1 | Research Dimensions for Race and Ethnicity ......................................................................... 15 3.2 | Overview of 2015 National Content Test ............................................................................... 28 3.3 | Sample Design...................................................................................................................... 29 3.4 | Reinterview Evaluation ........................................................................................................ 31 3.5 | Data Processing .................................................................................................................... 32 3.6 | Variance Estimation ............................................................................................................. 35 3.7 | Introduction to Data Analysis and Decision Criteria for Content Decisions ............................. 35 3.8 | Testing Alternative Question Formats (Separate vs. Combined) ............................................. 36 3.9 | Testing a Middle Eastern or North African Category .............................................................. 58 3.10 | Testing Alternative Instructions and Terminology ................................................................ 72 3.11 | Testing Performance of Questions in Paper and Web-Based Designs .................................... 83 4. LIMITATIONS ................................................................................................................................ 96 5. MILESTONE SCHEDULE ................................................................................................................. 96 6. DOCUMENT LOGS AND VERSION HISTORY .................................................................................... 97 7. REFERENCES ................................................................................................................................. 98 Appendix A. 2015 NCT Web-Based Question Designs ...................................................................... 100 Appendix B. 2015 NCT Paper-Based Question Designs ..................................................................... 191 Appendix C. 2015 NCT Reinterview Questions ................................................................................. 199 Appendix D. 2015 NCT Race, Ethnicity, or Origin Help Text .............................................................. 205 Appendix E. Race, Ethnicity, and Origin Code List ............................................................................ 208 Appendix F. Census Tract-Level Allocation of 2015 NCT Sample for Six Race/Ethnic Group Strata ..... 291 Appendix G. Measuring Race and Ethnicity Across the Decades: 1790-2010 ..................................... 292 3 2015 NATIONAL CONTENT TEST STUDY PLAN | RACE & ETHNICITY LIST OF TABLES Table 1. Contact Strategy Panel Design ............................................................................................. 28 Table 2. Estimates of Race/Ethnicity Strata in the 2015 NCT Sample .................................................. 30 Table 3. 2015 NCT Race/Ethnicity Sample Allocation ......................................................................... 30 Table 4. Consistency Between Self-Response and Reinterview for Major Race/Ethnicity Groups by Question Format .............................................................................................................................. 40 Table 5. Self-Response Compared to Reinterview Race/Ethnicity Group Distribution by Question Format ............................................................................................................................................ 42 Table 6. Race/Ethnicity Group Distribution by Question Format ........................................................ 44 Table 7. Distribution of Hispanic Responses and Non-Hispanic Responses by Question Format .......... 44 Table 8. Reporting of Multiple-Responses by Question Format .......................................................... 45 Table 9. Overall Consistency Between Self-Response and Reinterview for Multiple-Responses by Question Format .............................................................................................................................. 46 Table 10. Consistency Between Self-Response and Reinterview for Selected Multiple-Response Groups by Question Format ......................................................................................................................... 47 Table 11. Self-Response Compared to Reinterview for Selected Multiple-Response Groups by Question Format ............................................................................................................................................ 48 Table 12. Reporting Patterns of the Hispanic Reinterview Population by Self-Response Question Format ............................................................................................................................................ 50 Table 13. Pattern of Nonresponse by Question Format ..................................................................... 51 Table 14. Detailed Reporting for Major Race/Ethnicity Groups by Question Format ........................... 52 Table 15. Reporting of “Larger” Detailed Groups and “Smaller” Detailed Groups by Question Format 54 Table 16. Reporting of Detailed Groups by Question Format ............................................................. 55 Table 17. Race Distribution for Hispanic Respondents by Question Format ........................................ 57 Table 18. Reporting Patterns of the MENA Reinterview Population by Self-Response Question Format ............................................................................................................................................ 63 Table 19. Self-Response Compared to Reinterview Race/Ethnicity Group Distribution by Presence of Distinct MENA Category ................................................................................................................... 64 Table 20. Reporting of MENA Responses by Presence of Distinct MENA Category .............................. 65 Table 21. Consistency Between Self-Response and Reinterview for MENA Groups by Presence of Distinct MENA Category ................................................................................................................... 66 Table 22. Reporting of Detailed MENA Groups in Different Category Response Areas by Presence of Distinct MENA Category ................................................................................................................... 68 4 2015 NATIONAL CONTENT TEST STUDY PLAN | RACE & ETHNICITY Table 23. Self-Response Compared to Reinterview for Detailed MENA Groups by Presence of Distinct MENA Category ............................................................................................................................... 69 Table 24. Race/Ethnicity Group Distribution by Presence of Distinct MENA Category ......................... 71 Table 25. Item Nonresponse to Race/Ethnicity Question by Presence of Distinct MENA Category....... 72 Table 26. Overall Consistency Between Self-Response and Reinterview for Multiple-Responses by Instructions ..................................................................................................................................... 76 Table 27. Consistency Between Self-Response and Reinterview for Selected Multiple-Response Groups by Instructions ................................................................................................................................. 76 Table 28. Self-Response Compared to Reinterview for Selected Multiple-Response Groups by Instructions ..................................................................................................................................... 77 Table 29. Overall Consistency Between Self-Response and Reinterview for Multiple-Responses by Terminology .................................................................................................................................... 78 Table 30. Consistency Between Self-Response and Reinterview for Selected Multiple-Response Groups by Terminology .................................................................................................................... 78 Table 31. Self-Response Compared to Reinterview for Selected Multiple-Response Groups by Terminology ...................................................................................................................................