DOCSLIB.ORG

SAT Alignment to the Common Core State Standards Final Report

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
SAT Alignment to the Common Core State Standards Final Report 2016 No. 062 Delaware System of Student Assessment and Maine Comprehensive Assessment System: SAT Alignment to the Common Core State Standards Final Report Prepared Delaware Department of Education Prepared Contract Number #00000475 for: Maine Department of Education under: Contract Number #00000478 Authors: Yvette Nemeth Date: December 16, 2016 Hillary Michaels Carrie Wiley Jing Chen Headquarters: 66 Canal Center Plaza, Suite 700, Alexandria, VA 22314 | Phone: 703.549.3611 | Fax: 703.549.9025 | humrro.org Delaware System of Student Assessment and Maine Comprehensive Assessment System: SAT Alignment to the Common Core State Standards Table of Contents Executive Summary ................................................................................................................... iv Chapter 1: Introduction ............................................................................................................... 1 Overview ................................................................................................................................ 1 Organization and Contents of the Report ............................................................................... 1 Chapter 2: Alignment Study Design and Methodology ............................................................... 2 Alignment of Assessments and Standards on Content and Performance ............................... 2 SAT Overview .................................................................................................................... 2 Prior Studies Evaluating the Alignment of the SAT to the CCSS ........................................ 3 Challenges of Evaluating the Alignment of the SAT to the CCSS ....................................... 4 HumRRO Alignment Methodology ...................................................................................... 5 Special Study Evaluating the SAT Using the CCSSO Criteria. ........................................... 7 Alignment Study Procedure .................................................................................................... 9 Panelists............................................................................................................................. 9 Training .............................................................................................................................10 Test Security .....................................................................................................................10 Materials............................................................................................................................10 Procedures ........................................................................................................................11 Ratings ..............................................................................................................................12 Mid-Course Adjustments ...................................................................................................12 Chapter 3: Alignment Results ....................................................................................................14 Criterion 1: Items Represent Intended Content .....................................................................14 Comparison of College Board Ratings and Average Panelist Ratings ...............................21 Essay Results ...................................................................................................................22 Criterion 2: Items Represent Intended Categories .................................................................25 Criterion 3: Item DOK Represents Test Specifications ..........................................................27 Panelist Agreement ...........................................................................................................27 College Board DOK and Rigor Distributions ......................................................................28 Item DOK Compared to CCSS DOK ..................................................................................30 Criterion 4: Item Sufficiency for Category Reporting ..............................................................32 Chapter 4: Special Study Comparing the SAT to Selected CCSSO High Quality Assessment Results..................................................................................................................36 Chapter 5: Panelist Debriefing and Evaluation Survey ..............................................................41 Chapter 6: Summary and Recommendations ............................................................................43 SAT Alignment Summary ......................................................................................................43 Criterion 1: Items Represent Intended Content ..................................................................43 Table of Contents i Criterion 2: Items Represent Intended Categories .............................................................44 Criterion 3: Item DOK Represents Test Specifications.......................................................44 Criterion 4: Item Sufficiency for Category Reporting ..........................................................44 Special Study Evaluating the SAT Using the CCSSO Criteria Summary ...........................44 Suggestions ..........................................................................................................................45 References ...............................................................................................................................47 Appendix A. Sample Panelist Alignment Review Materials ..................................................... A-1 Appendix B. Summary of Item Workbook Ratings ................................................................... B-1 Appendix C. Graphical Representations of the Identified and Verified CCSS by College Board and Panelists ................................................................................................................ C-1 Appendix D. List of CCSS in Reading, Writing, and Language Arts ......................................... D-1 Appendix E. List of Mathematics Grade 11-12 CCSS.............................................................. E-1 Appendix F. List of Panelist Identified Off-Grade Level Mathematics CCSS ............................ F-1 Appendix G. CCSS Identified by College Board and Panelists ................................................G -1 Appendix H. SAT Alignment Workshop Evaluation Form ........................................................ H-1 List of Tables Table 1. Professional and Demographic Characteristics of Panelists ......................................... 9 Table 2. Item Counts Reviewed by Panelists ............................................................................11 Table 3. Math CCSS Organization ............................................................................................14 Table 4. English Language Arts CCSS Organization ................................................................14 Table 5. Mean Percentage of Items with No Link to Standards .................................................17 Table 6. Number of College Board Identified Standards ............................................................17 Table 7. Test and Subscore Distribution of Items ......................................................................26 Table 8. Rigor Levels of Math Items ..........................................................................................28 Table 9. Cognitive Demand Alignment of Items and Standards .................................................31 Table 10. Subscore Intercorrelations .........................................................................................33 Table 11. Coefficient Alphas by Subscores ...............................................................................33 Table 12. CFA Fit Indices ..........................................................................................................34 Table 13. Average Standardized Factor Loadings .....................................................................35 Table 14. CFA Factor Score Intercorrelations ...........................................................................35 Table 15. ELA CCSSO High Quality Assessment Results ........................................................36 Table 16. Additional Essay Criteria ...........................................................................................38 Table 17. Math CCSSO High Quality Assessment Results .......................................................39 Table 18. Means and Standard Deviations of the ELA Panelists’ General Alignment Opinions ..........................................................................................................................41 Table of Contents ii Table 19. Means and Standard Deviations of the Math Panelists’ General Alignment Opinions ..........................................................................................................................42 Table 20. Means and Standard Deviations for the Process and Procedure Survey Questions by Panelist Group ...........................................................................................42 List of Figures Figure 1. Panelist agreement with item to primary standard content alignment. ........................16 Figure 2. Panelist agreement with item to standard content alignment. .....................................18
Load more

Recommended publications
  • Gaokao Admission
    University of San Francisco Gaokao Admission Frequently Asked Questions What is Gaokao Direct Admission? USF offers a special, accelerated admission procedure for Chinese students who have achieved excellent Gaokao scores. Applicants will be admitted to USF based solely on their Gaokao test scores and a one-on-one interview with University staff, designed to evaluate English proficiency. There are no other admission requirements. Interviews in July enable students to begin their education in America immediately– –without spending an extra year preparing for IELTS, TOEFL or SAT tests. Interviews begin in mid-July, applicants receive their results within 24 hours of the interview, and formal admission letters are sent within a week. Students therefore have enough time to apply for F-1 student visas, and can attend USF in the Fall (August) Semester. Students who qualify in July can postpone their admission to the following Spring (January) Semester, if they prefer. Interviews are also held in late November or early December each year. Students who complete these interviews successfully can enter USF in the Spring (January) Semester or the next Fall (August) Semester. Why is USF doing this? For many decades, USF and the City of San Francisco have welcomed students from China. Our Chinese alumni have done very well in life after USF, both professionally and personally. Current Gaokao and other Chinese students enrich the educational experience of international and domestic students, alike; all benefit from the international network of friends made and colleagues introduced here at USF. Over the past few years, we have seen a steady increase in the academic ability and achievements of Chinese applicants to USF.
    [Show full text]
  • Japanese University Entrance Examination Problems in Mathematics
    Japanese University Entrance Examination Problems in Mathematics Edited by Ling-Erl Eileen T. Wu Mathematical Association of America Table of Contents Introduction .......................................................................................................3 1990 University Entrance Center Examination (UECE) ...............................................................4 Results of Performance on 1990 UECE ..............................................................................7 Evaluation of 1990 University Entrance Center Examination (UECE) I. Opinions of and Evaluations by Senior High School Teachers 1. Preface ....................................................................................................7 2. Content and Scope of the Exam Problems .....................................................................8 3. Analysis of the Exam Problems ..............................................................................9 4. Summary .................................................................................................10 II. Analysis by Division of Research, Senior High School Division, Association of Japanese Mathematical Education 1. Guidelines for Exam Problems ..............................................................................11 2. On This Year’s Problems ...................................................................................11 3. Students’ Group Divisions and Performances .................................................................11 4. Content and Intent of Math
    [Show full text]
  • The Relationship Between AP® Exam Performance and College Outcomes
    RESEaRch REpoRt 2009-4 The Relationship Between AP® Exam Performance and College Outcomes By Krista D. Mattern, Emily J. Shaw, and Xinhui Xiong VALIDITY College Board Research Report No. 2009-4 The Relationship Between AP® Exam Perfomance and College Outcomes Krista D. Mattern, Emily J. Shaw, and Xinhui Xiong The College Board, New York, 2009 Krista D. Mattern is an associate research scientist at the College Board. Emily J. Shaw is an assistant research scientist at the College Board Xinhui Xiong was a graduate student intern at the College Board. Researchers are encouraged to freely express their professional judgment. Therefore, points of view or opinions stated in College Board Reports do not necessarily represent official College Board position or policy. About the College Board The College Board is a mission-driven not-for-profit organization that connects students to college success and opportunity. Founded in 1900, the College Board was created to expand access to higher education. Today, the membership association is made up of more than 5,900 of the world’s leading educational institutions and is dedicated to promoting excellence and equity in education. Each year, the College Board helps more than seven million students prepare for a successful transition to college through programs and services in college readiness and college success — including the SAT® and the Advanced Placement Program®. The organization also serves the education community through research and advocacy on behalf of students, educators and schools. For further information, visit www.collegeboard.org. © 2009 The College Board. College Board, Advanced Placement Program, AP, SAT and the acorn logo are registered trademarks of the College Board.
    [Show full text]
  • Guide for IB Students Applying to US Institutions
    Guide for IB students applying to US institutions This guide provides a brief introduction to the US higher education system and its application process, as well as information specifically relevant to IB students applying to US institutions from outside of the US. The US context search opportunities and classes in a wide variety of fields of study. Because of the high number of faculty research More than 4,500 accredited institutions make up higher grants, public institutions tend to have large departments education in the US. Unlike in many countries, US higher offering a variety of degrees. These institutions tend to education institutions are not centrally organized or man- be very large and, because of government subsidies, are aged, but are autonomous and accredited by indepen- typically less expensive to attend than private institutions. dent regional bodies. Private institutions receive the majority or entirety of Bachelor’s degrees their funding from alumni donations, faculty research grants and tuition fees. This typically makes them more The bachelor’s degree is the main undergraduate degree expensive to attend, but allows for more resources avail- type at US universities and colleges. It is usually complet- able to students. ed in four years of full-time study and is awarded after completing a specified number of credits in a major field. Liberal arts institutions offer courses in the arts, hu- Students typically earn credits for courses they take, and manities, languages, mathematics and social and phys- these credits count towards the completion of a pro- ical sciences. The majority of liberal arts institutions are gramme.
    [Show full text]
  • The SAT® and SAT Subject Tests™: Discrepant Scores and Incremental Validity by Jennifer L
    RESEARCH REPORT 2012-2 The SAT® and SAT Subject Tests™: Discrepant Scores and Incremental Validity By Jennifer L. Kobrin and Brian F. Patterson VALIDITY Jennifer L. Kobrin is a research scientist at the College Board. Brian F. Patterson is an assistant research scientist at the College Board. Acknowledgments The authors would like to thank Suzanne Lane and Paul Sackett for their helpful suggestions on earlier versions of this report. Mission Statement The College Board’s mission is to connect students to college success and opportunity. We are a not-for-profit membership organization committed to excellence and equity in education. About the College Board The College Board is a mission-driven not-for-profit organization that connects students to college success and opportunity. Founded in 1900, the College Board was created to expand access to higher education. Today, the membership association is made up of more than 5,900 of the world’s leading educational institutions and is dedicated to promoting excellence and equity in education. Each year, the College Board helps more than seven million students prepare for a successful transition to college through programs and services in college readiness and college success — including the SAT® and the Advanced Placement Program®. The organization also serves the education community through research and advocacy on behalf of students, educators and schools. For further information, visit www.collegeboard.org. © 2012 The College Board. College Board, Advanced Placement Program, AP, SAT and the acorn logo are registered trademarks of the College Board. SAT Reasoning Test and SAT Subject Tests are trademarks owned by the College Board.
    [Show full text]
  • 2 Matura Exam Practice © Oxford University Press Speaking Discussing a Topic 10 Topic Shopping and Services
    HeadwayNew Matura Exam Practice and Culture & Literature Companion Basic Level 2 HeadwayNew Matura Exam Practice and Culture & Literature Companion Basic Level 3 Contents Matura Exam Practice 1 Reading Multiple matching People p4 2 Listening Multiple matching Education p5 3 Writing Informal letter Hospitality and food p6 4 Speaking Comparing and discussing Employment p7 5 Use of English Word formation Culture and sport p8 6 Reading Matching People p9 7 Reading Open cloze Shopping and services p10 8 Listening Multiple choice Science and technology p11 9 Reading Multiple choice State and society p12 10 Speaking Discussing a topic Shopping and services p13 11 Writing Discursive essays State and society p14 12 Reading Matching Travel and tourism p15 13 Use of English Multiple choice cloze Culture p16 14 Reading Multiple choice Travel and tourism p17 15 Writing Notes and messages People p18 16 Reading Gap fill Culture p19 17 Listening Multiple choice Leisure p20 18 Listening Multiple choice Children p21 Culture & Literature 1 Culture The British Empire p22 2 Culture The Globe Theatre p24 3 Culture Education in the UK and the US p26 4 Culture Super size America; super size world? p28 5 Culture English-speaking capitals p30 6 Culture Australia: Going to live Down Under p32 7 Culture Transport in London p34 8 Literature Sir Arthur Conan Doyle – The Hound of the Baskervilles p36 Matura Exam Practice Answer Key p38 Matura Exam Practice Tapescripts p41 Culture & Literature Answer Key p43 Culture & Literature Glossary p46 ReaDING Multiple matching 1 TOPIC People 3 In pairs, write a word or phrase to summarize the EXAM TIPS meaning of the sentences (1–5) below.
    [Show full text]
  • HB 3 College Preparation Assessment, Industry-Based Certification
    HB 3 College Preparation Assessment, Industry-Based Certification Reimbursement and AP/IB Testing April 21, 2020 TEA continues to work with the Office of the Governor, Texas Department of State Health Services (DSHS) and the Texas Division of Emergency Management (TDEM) to coordinate and plan the state’s response to COVID- 19. In addition, we are working with the College Board, ACT, Inc., and the Texas Higher Education Coordinating Board (THECB) to mitigate the impact on our many Texas students participating in these programs. This letter contains updates on the House Bill 3 (HB 3) SAT, ACT, TSIA and Industry-Based Certification (IBC) testing and reimbursements as well as Advanced Placement (AP) and International Baccalaureate (IB) testing. College Preparation Assessment Guidance: Section Topics Click on the section topics below to go directly to that section of the FAQ • SAT/ACT • Texas Success Initiative Assessment • IB Examinations • Advanced Placement (AP) • HB 3 College Preparation Assessment Reimbursements • HB 3 IBC Reimbursements • Additional Information SAT/ACT National Testing Revised The College Board cancelled both the May 2, 2020 and June 6, 2020 SAT and SAT Subject Test administration. 4/21/2020 Students who registered for May, whose March test centers were closed, or who do not receive March scores because of any irregularities will receive refunds. College Board plans to provide weekend SAT administrations every month through the end of the calendar year, beginning in August. This includes a new administration in September and the previously scheduled tests on August 29, October 3, November 7, and December 5. Students can register for these administrations starting in May and eligible students can register with a fee waiver.
    [Show full text]
  • Fairness on the SAT® Suite of Assessments
    Fairness on the SAT ® Suite of Assessments January 2021 About College Board College Board is a mission-driven not-for-profit organization that connects students to college success and opportunity. Founded in 1900, College Board was created to expand access to higher education. Today, the membership association is made up of over 6,000 of the world’s leading educational institutions and is dedicated to promoting excellence and equity in education. Each year, College Board helps more than seven million students prepare for a successful transition to college through programs and services in college readiness and college success—including the SAT® and the Advanced Placement® Program. The organization also serves the education community through research and advocacy on behalf of students, educators and schools. collegeboard.org. For further information, visit © 2021 College Board. College Board and the acorn logo are registered trademarks of College Board. PSAT/NMSQT is a registered trademark of the College Board and National Merit Scholarship Corporation. SAT®, PSAT™ 10, PSAT™ 8/9, AP®, AP Potential™, and Skills Insight™ are registered trademarks of College Board. Khan Academy® is a registered trademark of Khan Academy. Suggested citation: College Board. 2021. Fairness on the SAT Suite of Assessments. New York: College Board. Fairness on the SAT Suite of Assessments © 2021 College Board. II Contents Introduction .....................................................................................................................................................
    [Show full text]
  • Is the US at Risk of Losing Its Clear Edge in Higher Education?
    Penn State Journal of Law & International Affairs Volume 5 Issue 2 Contemporary Writings in a Global Society: Collected Works June 2017 We Don't Need no Education - Is the U.S. at Risk of Losing its Clear Edge in Higher Education? Ann M. Murphy Follow this and additional works at: https://elibrary.law.psu.edu/jlia Part of the Diplomatic History Commons, History of Science, Technology, and Medicine Commons, International and Area Studies Commons, International Law Commons, International Trade Law Commons, Law and Politics Commons, Political Science Commons, Public Affairs, Public Policy and Public Administration Commons, Rule of Law Commons, Social History Commons, and the Transnational Law Commons ISSN: 2168-7951 Recommended Citation Ann M. Murphy, We Don't Need no Education - Is the U.S. at Risk of Losing its Clear Edge in Higher Education?, 5 PENN. ST. J.L. & INT'L AFF. 464 (2017). Available at: https://elibrary.law.psu.edu/jlia/vol5/iss2/9 The Penn State Journal of Law & International Affairs is a joint publication of Penn State’s School of Law and School of International Affairs. Penn State Journal of Law & International Affairs 2017 VOLUME 5 NO. 2 WE DON’T NEED NO EDUCATION1 – IS THE U.S. AT RISK OF LOSING ITS CLEAR EDGE IN HIGHER EDUCATON? Ann M. Murphy* 1 PINK FLOYD, ANOTHER BRICK IN THE WALL (Sony/Columbia 1987). * Professor of Law, Gonzaga University School of Law. Professor Murphy expresses her profound gratitude to the Fulbright U.S. Scholar Program, U.S. Department of State, Bureau of Educational and Cultural Affairs. Through the generosity of this program, Professor Murphy taught law during the 2007-2008 academic year as a Fulbright Scholar in Beijing, PRC and during the 2014-2015 academic year as a Distinguished Chair, Fulbright Scholar in Shanghai, PRC.
    [Show full text]
  • Assessing the Chinese Gaokao Exam in the CONTEXT of the TEST-OPTIONAL TREND in INTERNATIONAL ADMISSIONS
    CHINA TEST OPTIONAL INITIATIVE www.sieconnection.com/ctoi Assessing the Chinese Gaokao Exam IN THE CONTEXT OF THE TEST-OPTIONAL TREND IN INTERNATIONAL ADMISSIONS BY DAVID WEEKS, HAO ZHOU, JACOB NEWTON-TANZER, AND YANG LIU A White Paper by Sunrise International Education 1 2 China’s National College Entrance seeking to recruitment qualified Chinese Section 1. Examination, often known as the applicants target the right gaokao-track gaokao is the largest college entrance students? BACKGROUND AND CONTEXT exam in the world. For international This white paper will aim to provide higher education, the gaokao poses historical and cultural background, — a number of difficult questions. Is the assessment process and structure, gaokao a useful metric of assessment students hailing from Tier 2 and Tier 3 scoring standards, comparisons with " for Chinese candidates applying for A.HOW DOES THE GAOKAO FIT Chinese cities. international examinations, and finally overseas universities? Is it a good INTO INTERNATIONAL HIGHER strategies and channels to find the right predictor of academic preparedness? ED TRENDS? Chinese students have better access gaokao and test optional students. We Is its English component a useful Since 2010, China has been the to international high schools than include a comprehensive comparison of metric for English proficiency? Does world’s largest sender of outbound ever before; the total enrollment at scoring rubrics in the appendix section. it have a place in a holistic admissions international students. The Chinese all international pre-tertiary schools assessment? How can universities international recruitment landscape in China is about 484,300. Assuming has transformed in recent years. an even distribution of students, Until the mid-1990’s, most Chinese about 40,000 high school students international students went abroad graduate from Chinese international on a scholarship, and the lion’s share schools each year.
    [Show full text]
  • COUNTRY QUALIFICATION AAA AAB ABB N/A International Baccalaureate
    Undergraduate A-level Equivalencies COUNTRY QUALIFICATION AAA AAB ABB N/A International Baccalaureate (IB) Diploma 32 with 666 at HL 32 with 665 at HL 32 with 655 HL European Baccalaureate 84% with 9 in relevant subjects 80% 77% Study Group Royal Holloway International Foundation Year 75% 70% 65% Cambridge Education Group Foundation Programme (CATS, OnCampus) AAA (Major modules) AAB (Major modules) ABB (Major modules) University of London International Foundation Programme (Also offered by Oncampus butDisctinction different (70%) grading system) Merit (65%) Merit (65%) David Game College A overall B overall B overall Bellerbys College 75% 70% 65% BTEC D*D*D* with AAAAA D*DD with AAABB DDD with AAABBB Please check directly with the Admissions team by emailing All other foundation programmes [email protected] Azerbaijan Students require foundation N/A Austria Reifezeugnis/Maturazeugnis 1 1.5 2 Bahrain Students require foundation N/A Bangladesh Students require foundation N/A Belgium 8/10 or 18/20 8/10 or 17/20 7/10 or 16/20 Certificate D Enseignement Secondaire Superieur or Diploma van Hoger Secundair Onderwijs Brazil Students require UK foundation N/A Brunei Students require UK Foundation N/A Bulgaria Diploma za Sredno Obrazovanie 5.7 5.6 5.5 Canada Canadian High School Diploma 85%+ 83% 80% Chile Students require UK Foundation N/A China Students require UK Foundation N/A Colombia Students require UK Foundation N/A France Baccalaureat 14/20 13/20 13/20 Ghana Students require UK Foundation N/A Germany Abitur 1.3 1.5 1.7 Greece average
    [Show full text]
  • 8 Reasons to Choose the ACT Test
    REASONS TO CHOOSE THE ACT® TEST STEM Readiness English Learner Support The ACT® test is the only admissions The ACT® test is the only college entrance test to measure science skills, including 1 a STEM score to let you know if you are 5 exam that provides support to English ready for a STEM major. learners on national test dates. Scholarships You can use your calculator for the whole math test—we don’t mind Taking the ACT® test can increase your chances of earning new or better ACT lets you use your calculator for the entire math section! That is not true on 2 scholarships. 6 the SAT. You’ve already been studying for Prep for All Learning Styles the ACT for years ACT offers test prep programs with live video lessons, interactive practice The test is designed so by the end of questions, full-length practice tests, 3 your junior year, you’ve likely covered all 7 and on-demand tutorials. the material that you will see on the test. More Opportunity College and Career Planning Many colleges and universities require or The ACT includes an education and consider college entrance scores as part career planning section to help you 4 of a holistic admissions process. 8 plan for life after high school. © 2020 by ACT, Inc. All rights reserved. MR018502 Find out more at act.org/student. Comparison of the ACT to the SAT* ACT SAT Accepted at all US colleges Calculator allowed for entire math test Essay is optional No penalty for guessing Free daily practice questions Free comprehensive test practice Test fees waived for eligible students Fee waiver
    [Show full text]