Reading Inventory Technical Guide

Total Page:16

File Type:pdf, Size:1020Kb

Reading Inventory Technical Guide Technical Guide Using a Valid and Reliable Assessment of College and Career Readiness Across Grades K–12 Technical Guide Excepting those parts intended for classroom use, no part of this publication may be reproduced in whole or in part, or stored in a retrieval system, or transmitted in any form or by any means, electronic, mechanical, photocopying, recording, or otherwise, without written permission of the publisher. For information regarding permission, write to Scholastic Inc., 557 Broadway, New York, NY 10012. Scholastic Inc. grants teachers who have purchased SRI College & Career permission to reproduce from this book those pages intended for use in their classrooms. Notice of copyright must appear on all copies of copyrighted materials. Portions previously published in: Scholastic Reading Inventory Target Success With the Lexile Framework for Reading, copyright © 2005, 2003, 1999; Scholastic Reading Inventory Using the Lexile Framework, Technical Manual Forms A and B, copyright © 1999; Scholastic Reading Inventory Technical Guide, copyright © 2007, 2001, 1999; Lexiles: A System for Measuring Reader Ability and Text Difficulty, A Guide for Educators, copyright © 2008; iRead Screener Technical Guide by Richard K. Wagner, copyright © 2014; Scholastic Inc. Copyright © 2014, 2008, 2007, 1999 by Scholastic Inc. All rights reserved. Published by Scholastic Inc. ISBN-13: 978-0-545-79638-5 ISBN-10: 0-545-79638-5 SCHOLASTIC, READ 180, SCHOLASTIC READING COUNTS!, and associated logos are trademarks and/or registered trademarks of Scholastic Inc. LEXILE and LEXILE FRAMEWORK are registered trademarks of MetaMetrics, Inc. Other company names, brand names, and product names are the property and/or trademarks of their respective owners. Table of Contents Table of Contents Introduction ................................................................................... 7 Features of SRI College & Career: Foundational Reading Assessment and Reading Comprehension Assessment Subtests ....................................................... 9 Purposes and Uses of SRI College & Career .................................................. 11 Limitations of SRI College & Career .......................................................... 13 Theoretical Framework of Reading Ability and the Lexile Framework in Support of the Reading Comprehension Assessment ........................................ 15 Readability Formulas and Reading Levels ....................................................16 The Lexile Framework for Reading........................................................... 18 Validity of the Lexile Framework for Reading.................................................. 21 College and Career Readiness and Text Complexity............................................ 26 Lexile Item Bank ........................................................................... 30 Description of the Foundational Reading Assessment and Reading Comprehension Assessment Subtests of SRI College & Career ..................................................... 33 Test Materials.............................................................................. 34 Test Administration and Scoring ............................................................. 37 Interpreting SRI College & Career Scores ..................................................... 42 Using SRI College & Career Results .......................................................... 54 Development of SRI College & Career ......................................................... 61 The Foundational Reading Assessment Development .......................................... 63 The Reading Comprehension Assessment Development ....................................... 66 Copyright © 2014 by Scholastic Inc. All rights reserved. Copyright © 2014 by Scholastic Inc. All rights reserved. Reliability .................................................................................... 87 Internal Consistency Reliability Coefficients for the Foundational Reading Assessment............ 88 Standard Error of Measurement ............................................................. 89 Sources of Measurement Error for the Reading Comprehension Assessment .................... 91 Forecasted Comprehension Error for the Reading Comprehension Assessment ................ 102 Validity..................................................................................... 106 Content Validity .......................................................................... 107 Criterion-Related Validity.................................................................. 108 Construct Validity......................................................................... 120 Appendices ................................................................................ 133 Appendix A: Lexile Framework Map ........................................................ 134 Appendix B: Fall and Spring Norm Tables ................................................... 136 Appendix C: References................................................................... 138 2 SRI College & Career Table of Contents List of Figures and Tables List of Tables Table 17 ........................................ 84 Descriptive statistics for each test administration group Table 1.......................................... 22 in the comparison study, April and May 2005. Results from linking studies conducted with the Lexile Framework for Reading. Table 18 ........................................ 88 Internal consistency reliability coefficients (coefficient alpha) Table 2.......................................... 24 for Foundational Reading Assessment scores overall and Correlations between theory-based calibrations produced by grade. by the Lexile equation and rank order of unit in basal readers. Table 19 ........................................ 89 Table 3.......................................... 25 Standard errors of measurement (SEM) for selected Correlations between theory-based calibrations produced Foundational Reading Assessment scores, by grade. by the Lexile equation and the empirical item difficulty. Table 20 ........................................ 90 Table 4.......................................... 29 Mean SEM on the Reading Comprehension Assessment Lexile ranges aligned to college- and career-readiness by extent of prior knowledge. expectations, by grade. Table 21 ........................................ 92 Table 5.......................................... 44 Standard errors for selected values of the length of Foundational Reading Assessment total fluency scores the text. and the corresponding DIBELS Next composite score percentiles. Table 22 ........................................ 94 Analysis of 30 item ensembles providing an estimate Table 6.......................................... 51 of the theory misspecification error. Comprehension rates for the same individual with aterials of varying comprehension difficulty. Table 23 ........................................ 96 Old method text readabilities, resampled SEMs, and Table 7.......................................... 51 new SEMs for selected books. Comprehension rates of different-ability readers with the same material. Table 24 ........................................ 97 Lexile measures and standard errors across item writers. Table 8.......................................... 53 Performance standard proficiency bands for the Reading Table 25 ....................................... 101 Comprehension Assessment in Lexile measures, by grade. Reading Comprehension Assessment marginal reliability estimates. Table 9.......................................... 64 Percentages of students falling in three DIBELS Next Table 26 ....................................... 102 composite score benchmark classifications. Reading Comprehension Assessment reader consistency Copyright © 2014 by Scholastic Inc. All rights reserved. Copyright © 2014 by Scholastic Inc. All rights reserved. estimates over a four-month period, by grade. Table 10 ........................................ 65 Combining accuracy and latency into fluency scores: Table 27 ....................................... 103 Four possible response patterns. Confidence intervals (90%) for various combinations of comprehension rates and standard error of differences Table 11 ........................................ 70 (SED) between reader and text measures. Distribution of items in SRI item bank, by Lexile zone. Table 28 ....................................... 109 Table 12 ........................................ 71 Kindergarten predictive validity coefficients for Foundational ETS DIF categories. Reading Assessment scores as predictors of DIBELS Next Table 13 ........................................ 72 criterion scores, by grade. Reading Comprehension Assessment differential item Table 29 ....................................... 110 functioning, by comparison groups. First-grade predictive validity coefficients for Foundational Table 14 ........................................ 81 Reading Assessment scores as predictors of DIBELS Next Student responses to Question 7: preferred test format. criterion scores, by grade. Table 15 ........................................ 83 Table 30 ....................................... 111 Relationship between the Reading Comprehension Assessment Second-grade predictive validity coefficients for Foundational (interactive) and Reading Comprehension Assessment (print). Reading Assessment scores as predictors of DIBELS Next Table 16 .......................................
Recommended publications
  • Understanding Binomial Sequential Testing Table of Contents of Two START Sheets
    Selected Topics in Assurance Related Technologies START Volume 12, Number 2 Understanding Binomial Sequential Testing Table of Contents of two START sheets. In this first START Sheet, we start by exploring double sampling plans. From there, we proceed to • Introduction higher dimension sampling plans, namely sequential tests. • Double Sampling (Two Stage) Testing Procedures We illustrate their discussion via numerical and practical examples of sequential tests for attributes (pass/fail) data that • The Sequential Probability Ratio Test (SPRT) follow the Binomial distribution. Such plans can be used for • The Average Sample Number (ASN) Quality Control as well as for Life Testing problems. We • Conclusions conclude with a discussion of the ASN or “expected sample • For More Information number,” a performance measure widely used to assess such multi-stage sampling plans. In the second START Sheet, we • About the Author will discuss sequential testing plans for continuous data (vari- • Other START Sheets Available ables), following the same scheme used herein. Introduction Double Sampling (Two Stage) Testing Determining the sample size “n” required in testing and con- Procedures fidence interval (CI) derivation is of importance for practi- tioners, as evidenced by the many related queries that we In hypothesis testing, we often define a Null (H0) that receive at the RAC in this area. Therefore, we have expresses the desired value for the parameter under test (e.g., addressed this topic in a number of START sheets. For exam- acceptable quality). Then, we define the Alternative (H1) as ple, we discussed the problem of calculating the sample size the unacceptable value for such parameter.
    [Show full text]
  • Building Reading Proficiency at the Secondary Level
    BUILDING INTRODUCTION READING PROFICIENCY AT THE SECONDARY LEVEL A Guide to Resources Cynthia L. Peterson, Ph.D. David C. Caverly, Ph.D. Sheila A. Nicholson, M.S.Ed. Sharon O’Neal, Ph.D. Susen Cusenbary, M.Ed. Southwest Texas State University Southwest Educational Development Laboratory 211 East 7th Street Austin, TX 78701 ©Southwest Educational Development Laboratory, 2000. This guide is produced in whole or in part with funds from the Office of Educational Research and Improvement, U.S. Department of Education, under contract #RJ96006801. The con- tent herein does not necessarily reflect the views of the Department of Education, any other agency of the U.S. Govern- ment or any other source. You are welcome to reproduce Building Reading Proficiency at the Secondary Level and may distribute copies at no cost to recipients; please credit the Southwest Educational Development Laboratory as publisher. SEDL is an Equal Opportunity/ Affirmative Action Employer and is committed to affording equal employment opportunities to all individuals in all employ- ment matters. Available in alternative formats. CONTENTS INTRODUCTION ACKNOWLEDGMENTS iv INTRODUCTION 1 • How to Use the Guide 2 • How Resources Were Selected 3 PART I: PERSPECTIVES 6 • Struggling Secondary Readers: A Closer Look 6 • Informal Assessment 7 • Building Reading Proficiency at the Secondary Level 9 • Principles of Effective Reading Instruction 17 • Principles of Effective Professional Development 19 PART II: RESOURCES 22 • Five Questions Organize the Programs and Strategies 22 • Programs 23 • Strategies 23 • Definitions of Terms 70 PART III: PROCEDURES FOR COMPILING THE GUIDE 133 BIBLIOGRAPHY 136 ACKNOWLEDGMENTS his project was sponsored by South- • Dr. Shernaz García, The University of west Educational Development Lab- Texas at Austin oratory and prepared by a team of • Dr.
    [Show full text]
  • Supporting Special Education Students with System 44™
    Foundation Paper Supporting Special Education Students with System 44™ System 44 is a foundational reading program designed for the most challenged struggling readers in Grades 3-12. Intentionally metacognitive, System 44 helps students understand that the English language is a finite system of 44 sounds and 26 letters that can be mastered. System 44 was designed for students in Grades 3-12 reading at a BR-400 Lexile ® level, including Special Education students and English-Language learners. OVERVIEW OF THE SYSTEM 44 PROGRAM System 44 is designed so that the teacher, technology, and texts work together to deliver highly engaging, comprehensive, research-based instructional content to the older struggling reader. Through a combination of teacher-led and software-based instruction, the System 44 student is guided along a systematic path from phonemic awareness to fluent reading. System 44 includes research-based features designed for the most challenged older readers: Computer-Based Screening and Placement The Scholastic Phonics Inventory (SPI) collects data on students’ decoding accuracy as well as fluency. This helps to identify students whose lack of decoding proficiency impedes comprehension. The SPI uses real, as well as nonsense words, which assess students’ ability to apply decoding skills to unfamiliar words. Adaptive Software The System 44 adaptive software delivers, direct, systematic, research-based phonics instruction to students. Multiple points of entry allow students to work at the appropriate level based on their performance on the SPI. Independent Reading Beginning readers will always have something to read with the System 44 program. The Decodable Digest includes two passages for every sound-spelling correspondence taught in the program.
    [Show full text]
  • Research Paper
    Research-Based Vocabulary WORDLY WISE 3000® 3rd Edition Books K–12 Kenneth Hodkinson and Sandra Adams (Books 2–12), Cheryl Dressler (Books K–1) By Lee Mountain For young children, one of the most effective ways to learn new words is to listen to read- alouds. Older children, on the other hand, learn many new words through independent reading. Whether children are pre-readers or already reading independently, there is a growing consensus among educators regarding the need for direct teaching of academic vocabulary in a systematic program. In fact, recent research has shown not only that it is important, but that it is important much earlier than was previously thought. This is especially true for children who come from disadvantaged backgrounds, many of whom enter school knowing far fewer words than their middle class peers. The words in the Wordly Wise 3000® series will expand the vocabularies and minds of today’s students. The Third Edition, which extends from kindergarten through high school, Wordly Wise 3000® is a kindergarten provides teachers with effective research-based lessons for direct instruction in vocabulary. through grade 12 vocabulary series that includes reproducible tests and Today’s educators are becoming increasingly aware of the benefits of a structured vocabulary curriculum. Thomas Gunning, author of Creating Literacy Instruction for All an online test generator. The entire Children, calls a planned program of vocabulary development “highly advisable,” and he program introduces over 3,000 suggests that a certain amount of time be set aside each week for vocabulary instruction: words, and exercises become more “A planned approach ensures that vocabulary instruction is given the attention it deserves.
    [Show full text]
  • The Effect of Teaching Phonics and Phonemic Awareness Training To
    The Effect of Teaching Phonics and Phonemic Awareness Training to Adolescent Struggling Readers by Stephanie Hardesty Submitted in Partial Fulfillment of the Requirements for the Degree of Master of Education December 2013 Goucher College Graduate Programs in Education Table of Contents List of Tables i Abstract ii I. Introduction 1 Statement of the Problem 2 Hypothesis 3 Operational Definitions 3 II. Literature Review 6 Phonemic Awareness Training and Phonics 6 Reading Instruction in the High School Setting 7 Reading Remediation 10 Summary 13 III. Methods 14 Participants 14 Instrument 15 Procedure 16 IV. Results 19 V. Discussion 20 Implications 20 Threats to Validity 21 Comparison to Previous Studies 22 Suggestions for Future Research 24 References 25 List of Tables 1. Pre- and Post-SRI Test Results 19 i Abstract The purpose of this study was to determine the efficacy of teaching phonics and phonemic awareness training to adolescent struggling readers. The measurement tool was the Scholastic Reading Inventory (SRI). This study involved the use of a pretest/posttest design to compare data prior to the implementation of the reading intervention, System 44, to data after the intervention was complete (one to two years). Achievement gains were not significant, though results could be attributable to a number of intervening factors. Research in the area of high school reading remediation should continue given the continued disagreement over best practices and the new standards that must be met per the Common Core. ii CHAPTER I INTRODUCTION Advanced or proficient reading abilities are one of the primary yet essential skills that should be mastered by every student.
    [Show full text]
  • Reconciling Situation Calculus and Fluent Calculus
    Reconciling Situation Calculus and Fluent Calculus Stephan Schiffel and Michael Thielscher Department of Computer Science Dresden University of Technology stephan.schiffel,mit @inf.tu-dresden.de { } Abstract between domain descriptions in both calculi. Another ben- efit of a formal relation between the SC and the FC is the The Situation Calculus and the Fluent Calculus are successful possibility to compare extensions made separately for the action formalisms that share many concepts. But until now two calculi, such as concurrency. Furthermore it might even there is no formal relation between the two calculi that would allow to formally analyze the relationship between the two allow to translate current or future extensions made only for approaches as well as between the programming languages one of the calculi to the other. based on them, Golog and FLUX. Furthermore, such a formal Golog is a programming language for intelligent agents relation would allow to combine Golog and FLUX and to ana- that combines elements from classical programming (condi- lyze which of the underlying computation principles is better tionals, loops, etc.) with reasoning about actions. Primitive suited for different classes of programs. We develop a for- statements in Golog programs are actions to be performed mal translation between domain axiomatizations of the Situ- by the agent. Conditional statements in Golog are composed ation Calculus and the Fluent Calculus and present a Fluent of fluents. The execution of a Golog program requires to Calculus semantics for Golog programs. For domains with reason about the effects of the actions the agent performs, deterministic actions our approach allows an automatic trans- lation of Golog domain descriptions and execution of Golog in order to determine the values of fluents when evaluating programs with FLUX.
    [Show full text]
  • The Features-And-Fluents Semantics for the Fluent Calculus
    The Features-and-Fluents Semantics for the Fluent Calculus Michael Thielscher and Thomas Witkowski Department of Computer Science Dresden University of Technology, Germany Abstract fluent calculus, is expressive enough to be applicable to the full test suite of example reasoning problems in (Sandewall Based on an elaborate ontological taxonomy, the Features- 1994), let alone to be provably sound and complete wrt. one and-Fluents framework provides an independent action se- of the more expressive ontological classes in the taxonomy. mantics for assessing the range of applicability of action cal- culi. In this paper, we show how the fluent calculus can In this paper, we present a version of the fluent calculus be used to capture the full range of phenomena in K-IA, that is sufficiently expressive to capture K-IA, which is the the broadest ontological class that has been fully formalized broadest class that has been rigorously formalized and in- in (Sandewall 1994). To this end, we develop a significant tensively studied in (Sandewall 1994) and in which correct extension of the fluent calculus for modeling actions with du- knowledge and a fully inertial world is assumed. To this rations and with specific trajectories of changes. We present a end, we develop a significant extension of the basic fluent provably correct translation of scenario descriptions from the calculus by introducing an explicit model for the duration Features-and-Fluents semantics into fluent calculus axioma- of actions and for trajectories of changes. On this basis, we tizations. present a translation function that maps any K-IA scenario into a fluent calculus axiomatization, and we prove that the Introduction intended models of the former coincide with the classical models of the latter.
    [Show full text]
  • Fluent Tips & Tricks
    FluentFluent TipsTips && TricksTricks UGMUGM 20042004 Sutikno Wirogo Samir Rida 1/ 75 Outline List of Tips and Tricks collected from: Solution database available through the Online Technical Support (OTS) portal http://www.fluentusers.com Frequently Asked Questions Know-how of Fluent’s technical staff This presentation provides Tips and Tricks: For IO and Batch For Case Set-up and Mesh For Solving For Post-Processing For Reporting 2/ 75 This presentation provides Tips and Tricks: For IO and Batch For Case Set-up and Mesh For Solving For Post-Processing For Reporting 3/ 75 Miscellaneous on Parallel IO In parallel, the mesh is first read into the host and then distributed to the compute nodes If reading case into parallel solver takes unusually long time, do the following: • Merge as many zones as possible • Put the host and compute-node-0 on the same machine • Put the case and data files on a disk on the machine running the host and compute-node-0 processes Parallel Fluent will allocate buffers for exchanging messages while reading and building the grid • Default buffer size depends of the case that is being read For 4 million cell case on 4 CPUs, the buffer size will be 4M/4 = 1M • To query buffer size, use the following scheme command: (%query-parallel-io-buffers) • If the host machine does not have enough memory, using a large buffer will slow down the read case stage and thus can limit the maximum buffer size using: (%limit-parallel-io-buffer-size 0) ¾ Needs to be executed before reading the case file ¾ Will increase
    [Show full text]
  • The Lexile Framework: Unnecessary and Potentially Harmful
    The Lexile Framework: Unnecessary and Potentially Harmful Stephen Krashen CSLA (California School Library Association) Journal 24(2): 25-26, 2001 The Lexile Framework attempts to solve a problem that doesn't exist. It is a readability formula that "stands firmly in the tradition of classic readability formulas" (Stenner, 1996, p. 23) that assigns reading levels to texts based on word frequency and sentence length. The Lexile Framework is intended to help teachers and librarians recommend supplementary reading that is at the right reading level: "For example, an eighth-grade girl who is interested in sports but is not reading at grade level might be able to handle a biography of a famous athlete. The teacher may not know, however, whether that biography is too difficult or too easy for the student. " All the teacher has to do is use the Lexile Framework on the text and the student and select a book at the right level. Then, "as the reader improves, new titles with higher text measures can be chosen to match the growing person (sic) measure, thus keeping the comprehension rate at the chosen level." (Stenner, 1996, p. 22). Not Necessary None of this is necessary, and it is probably harmful. There is a much easier way for readers to select texts: Are they comprehensible and interesting? It doesn't take long for a reader to determine this: All it takes is sampling a little of the text (reading it). Our eighth grader simply needs to have a look at a few biographies. Teachers and librarians can certainly help in text selection and they do this all the time, with great success.
    [Show full text]
  • Fluent Getting Started Guide
    ANSYS Fluent Getting Started Guide ANSYS, Inc. Release 19.1 Southpointe April 2018 2600 ANSYS Drive Canonsburg, PA 15317 ANSYS, Inc. and [email protected] ANSYS Europe, Ltd. are UL http://www.ansys.com registered ISO (T) 724-746-3304 9001: 2008 (F) 724-514-9494 companies. Copyright and Trademark Information © 2018 ANSYS, Inc. Unauthorized use, distribution or duplication is prohibited. ANSYS, ANSYS Workbench, AUTODYN, CFX, FLUENT and any and all ANSYS, Inc. brand, product, service and feature names, logos and slogans are registered trademarks or trademarks of ANSYS, Inc. or its subsidiaries located in the United States or other countries. ICEM CFD is a trademark used by ANSYS, Inc. under license. CFX is a trademark of Sony Corporation in Japan. All other brand, product, service and feature names or trademarks are the property of their respective owners. FLEXlm and FLEXnet are trademarks of Flexera Software LLC. Disclaimer Notice THIS ANSYS SOFTWARE PRODUCT AND PROGRAM DOCUMENTATION INCLUDE TRADE SECRETS AND ARE CONFID- ENTIAL AND PROPRIETARY PRODUCTS OF ANSYS, INC., ITS SUBSIDIARIES, OR LICENSORS. The software products and documentation are furnished by ANSYS, Inc., its subsidiaries, or affiliates under a software license agreement that contains provisions concerning non-disclosure, copying, length and nature of use, compliance with exporting laws, warranties, disclaimers, limitations of liability, and remedies, and other provisions. The software products and documentation may be used, disclosed, transferred, or copied only in accordance with the terms and conditions of that software license agreement. ANSYS, Inc. and ANSYS Europe, Ltd. are UL registered ISO 9001: 2008 companies. U.S. Government Rights For U.S.
    [Show full text]
  • Ela Best Standards
    Table of Contents Table of Contents .......................................................................................................................................... 1 Introduction ................................................................................................................................................... 5 Standards Map ............................................................................................................................................ 10 Progression of Foundations Benchmarks .................................................................................................... 11 Spiraled Standards in a Vertical Progression .............................................................................................. 13 Kindergarten ........................................................................................................................................... 26 Foundational Skills ............................................................................................................................. 26 Reading ............................................................................................................................................... 27 Communication ................................................................................................................................... 29 Vocabulary .......................................................................................................................................... 32 Sample texts by
    [Show full text]
  • The Calculus of Newton and Leibniz CURRENT READING: Katz §16 (Pp
    Worksheet 13 TITLE The Calculus of Newton and Leibniz CURRENT READING: Katz §16 (pp. 543-575) Boyer & Merzbach (pp 358-372, 382-389) SUMMARY We will consider the life and work of the co-inventors of the Calculus: Isaac Newton and Gottfried Leibniz. NEXT: Who Invented Calculus? Newton v. Leibniz: Math’s Most Famous Prioritätsstreit Isaac Newton (1642-1727) was born on Christmas Day, 1642 some 100 miles north of London in the town of Woolsthorpe. In 1661 he started to attend Trinity College, Cambridge and assisted Isaac Barrow in the editing of the latter’s Geometrical Lectures. For parts of 1665 and 1666, the college was closed due to The Plague and Newton went home and studied by himself, leading to what some observers have called “the most productive period of mathematical discover ever reported” (Boyer, A History of Mathematics, 430). During this period Newton made four monumental discoveries 1. the binomial theorem 2. the calculus 3. the law of gravitation 4. the nature of colors Newton is widely regarded as the most influential scientist of all-time even ahead of Albert Einstein, who demonstrated the flaws in Newtonian mechanics two centuries later. Newton’s epic work Philosophiæ Naturalis Principia Mathematica (Mathematical Principles of Natural Philosophy) more often known as the Principia was first published in 1687 and revolutionalized science itself. Infinite Series One of the key tools Newton used for many of his mathematical discoveries were power series. He was able to show that he could expand the expression (a bx) n for any n He was able to check his intuition that this result must be true by showing that the power series for (1+x)-1 could be used to compute a power series for log(1+x) which he then used to calculate the logarithms of several numbers close to 1 to over 50 decimal paces.
    [Show full text]