T E CH N IC AL M an U AL— G R AD E S 3–12 9V.5.0
Total Page:16
File Type:pdf, Size:1020Kb
TECHNICAL MANUAL—GRADES 3–12 REV. JULY. 24, 2019v.5.0 for READING ASSESSMENT PRESCRIPTIVE INSTRUCTIONAL DATA INSTRUCTIONAL PRESCRIPTIVE LEXIA® RAPIDTM ASSESSMENT Technical Manual for RAPID Version 5.0: Grades 3-12 © 2019 Lexia Learning, a Rosetta Stone Company. Lexia®, RAPID™, and other trademarks, names, and logos used herein are the property of Rosetta Stone Ltd. and/or its subsidiaries, and are registered and/or used in the United States and other countries. METAMETRICS® and LEXILE® are trademarks of MetaMetrics, Inc., and are registered in the United States and abroad. Additional trademarks included herein are the property of their respective owners. Information in this document is subject to change without notice and does not represent a commitment on the part of Lexia Learning Systems LLC. The software described in this document is furnished under a license agreement or non-disclosure agreement. The software may be used only in accordance with the terms of the agreement. It is against the law to copy the software on any medium except as specifically allowed in the license or non-disclosure agreement. No part of this manual may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopying and recording, for any purpose without the express written permission of Lexia Learning Systems LLC. www.lexialearning.com 300 Baker Avenue • Suite 320 • Concord, MA 01742 TECHNICAL MANUAL FOR RAPID V5.0: GRADES 3-12 tel: 800-435-3942 / 978-405-6200 fax: 978-287-0062 Contents Acknowledgments ................................................................................................................................. 5 Chapter 1 Introduction ......................................................................................................................... 6 Purpose ....................................................................................................................................... 7 Chapter 2 3–12 Tasks ........................................................................................................................... 8 Task Rules .................................................................................................................................... 8 Screening Assessment Periods ..................................................................................... 8 Recommended Comprehension Tasks .......................................................................... 9 Screening Task Descriptions ..................................................................................................... 9 Word Recognition Task ................................................................................................... 9 Vocabulary Knowledge Task ......................................................................................... 10 Syntactic Knowledge Task ............................................................................................ 10 Reading Comprehension Task ...................................................................................... 11 Chapter 3 Score Definitions ............................................................................................................... 12 Reading Success Probability .................................................................................................... 12 Percentile Ranks ....................................................................................................................... 13 Performance Scores ................................................................................................................. 13 Lexile Measures ........................................................................................................................ 14 Description of Sample .................................................................................................. 14 Study Design ................................................................................................................. 15 Reported Lexile Reader Measures and Lexile Text Ranges ........................................ 16 Chapter 4 Content and Item Development ...................................................................................... 17 Guidelines for Retaining Items ................................................................................................. 18 Chapter 5 Psychometric Development ............................................................................................. 20 Item Norming Sample .............................................................................................................. 20 Performance Score Alignment Sample ................................................................................... 22 Vertical Scaling and Data Collection Design ........................................................................... 22 Item Response Theory ............................................................................................................. 24 IRT and Its Role in Computer Adaptive Testing ...................................................................... 27 Chapter 6 Reliability ............................................................................................................................ 30 Marginal Reliability .................................................................................................................... 30 Standard Error of Measurement .............................................................................................. 31 Test-Retest Reliability .............................................................................................................. 31 Chapter 7 Validity ............................................................................................................................... 32 Evidence Based on the Internal Structure ............................................................................... 32 Evidence Based on Relations to Other Variables .................................................................... 34 Concurrent Validity ....................................................................................................... 34 Predictive Validity ......................................................................................................... 34 Differential Accuracy of Prediction .............................................................................. 36 Construct Validity ..................................................................................................................... 37 ii TECHNICAL MANUAL FOR RAPID V5.0: GRADES 3-12 Convergent Validity ...................................................................................................... 37 Word Recognition ......................................................................................................... 37 Vocabulary Knowledge ................................................................................................. 38 Syntactic Knowledge .................................................................................................... 38 Reading Comprehension .............................................................................................. 38 Discriminant Validity..................................................................................................... 40 Growth Reference Charts ............................................................................................. 40 References..... ....................................................................................................................................... 41 Appendix A..... ....................................................................................................................................... 45 Appendix B..... ....................................................................................................................................... 50 Appendix C..... ...................................................................................................................................... 56 Appendix D..... ...................................................................................................................................... 79 iii TECHNICAL MANUAL FOR RAPID V5.0: GRADES 3-12 Acknowledgments The Technical Manual for Lexia RAPID Assessment Version 5.0: Grades 3-12, the Lexia Reading Assessment for Prescriptive Instructional Data was written by the following authors in collaboration with Lexia Learning: Barbara R. Foorman, Ph.D. Yaacov Petscher, Ph.D. Chris Schatschneider, Ph.D. Florida Center for Reading Research Florida State University The items, dynamic flow, computer-adaptive task flow and placement algorithms, creation of the development application, and psychometric work for this component skills battery were funded by grants from the Institute of Education Sciences (IES) to Florida State University: • Institute of Education Sciences, USDOE (R305F100005; $4,447,990), entitled “Assessing Reading for Understanding: A Theory-Based, Developmental Approach,” subcontract to the Educational Testing Service for five years, 7/1/10-6/30/15 (Foorman, PI on subcontract; Petscher and Schatschneider, Co-Is). • Institute of Education Sciences, USDOE (R305A100301; $1,499,741), entitled “Measuring Reading Progress in Struggling Adolescents,” awarded for four years, 3/1/10-2/28/14. (Foorman, PI; Petscher and Schatschneider, Co-Is). The RAPID authors and Lexia Learning would like to acknowledge