The Relationship of Readability on the Science
Total Page:16
File Type:pdf, Size:1020Kb
THE RELATIONSHIP OF READABILITY ON THE SCIENCE ACHIEVEMENT TEST: A STUDY OF 5TH GRADE ACHIEVEMENT PERFORMANCE Zachary Scott Amos A Thesis Submitted to the Graduate College of Bowling Green State University in partial fulfillment of the requirements for the degree of MASTER OF EDUCATION May 2009 Committee: Dr. Cynthia Diane Bertelsen, Advisor Dr. Cindy Hendricks Dr. Mohammed Darabie i ABSTRACT Dr. Cynthia Bertelsen This study examined the relationship between readability and test performance. This study investigated the historical, theoretical, and research views of high stakes testing, out-of- level testing, and comprehension. The Ohio Fifth Grade Science Achievement tests’ individual test questions were examined based upon the Flesch Kincaid readability formula. A revised version of the test was created with a lower reading level. A study was conducted on 34 students from a rural midwestern community. The tests were both administered, with two weeks of separation. The data were collected and analyzed through the StatCrunch application using T- Statical and Summative data Analysis. From the results, their appeared to be a statistical difference in the test scores in favor of the revised version. ii I dedicate this thesis to all of the people who assisted me throughout this process. This includes my chair: Dr. Cynthia Bertelsen, my committee members: Dr. Cindy Hendricks, Dr. Mohammed Darabie, and my personal support of my family, friends, and colleagues. Without all of these people and the exceptional resources provided by Bowling Green State University’s Jerome Library, I would not be where I am today! iii ACKNOWLEDGEMENTS I would first like to acknowledge Dr. Cynthia Bertelsen, Dr. Cindy Hendricks, and Dr. Mohammed Darabie for their kind guidance and wisdom. I would also like to thank “The King of Stats” Dr. Craig Mertler for his wonderful statistical support. Finally, I would also like to recognize my mother and father who have been there with constant support and encouragement throughout this adventure, and my many other adventures in life. iv TABLE OF CONTENTS Page CHAPTER I. INTRODUCTION.....................................................................................................1 Statement of the Problem.....................................................................................................2 Research Questions..............................................................................................................3 Rationale ..............................................................................................................................3 Definitions of Terms............................................................................................................4 Limitations ...........................................................................................................................6 Summary..............................................................................................................................7 CHAPTER II. REVIEW OF LITERATURE ..................................................................................8 Historical Perspective ..........................................................................................................8 Theoretical Perspective......................................................................................................12 New Information and Research .........................................................................................15 Readability.................................................................................................................................. 25 Formulas ............................................................................................................................25 Summary............................................................................................................................27 CHAPTER III. METHODS AND PROCEDURES ......................................................................29 Methods..............................................................................................................................29 Research Design.....................................................................................................29 Participants.............................................................................................................30 Instrumentation ......................................................................................................30 Procedures..........................................................................................................................31 Data Collection ..................................................................................................................32 v Data Analysis.....................................................................................................................33 Summary............................................................................................................................33 CHAPTER IV. DATA ANALYSIS AND DISCUSSION OF RESULTS ...................................34 Data Analysis.....................................................................................................................34 Discussion of Results.........................................................................................................50 Summary............................................................................................................................51 CHAPTER V. SUMMARY, CONCLUSIONS, AND RECOMMENDATIONS ........................52 Summary............................................................................................................................52 Conclusions........................................................................................................................53 Recommendations..............................................................................................................54 Future Research ......................................................................................................55 Teachers ..................................................................................................................55 Teacher Educators...................................................................................................56 Educational Policy Makers .....................................................................................57 Summary..........................................................................................................................58 REFERENCES ..............................................................................................................................59 APPENDIX A. REGULAR ACHIEVEMENT TEST. ................................................................69 APPENDIX B. REVISED ACHIEVEMENT TEST ...................................................................84 APPENDIX C. ADMINISTRATION MANUAL .....................................................................100 APPENDIX D. STUDENT ANSWER DOCUMENT...............................................................119 APPENDIX E. ADMINISTRATOR LETTER..........................................................................125 APPENDIX F. TEACHER LETTER ........................................................................................127 APPENDIX G. PARENT LETTER ...........................................................................................129 vi APPENDIX H. STUDENT LETTER ........................................................................................131 APPENDIX I. SUMMARY STATISTICS TABLE.................................................................133 APPENDIX J. EVALUATING QUESTIONS READABILITY, T-STAT AND P-VALUE FOR TEST A AND TEST B.................................................136 vii LIST OF TABLES TABLE Page 1 Paired T Statistics: Evaluating The Mean Of Test Scores For Test 1A & 1B....................36 2 Paired T Statistics: Evaluating The Mean Of Test Scores For Test 2A & 2B....................37 3 Paired T Statistics: Evaluating The Mean Of Test Scores For Test 3A & 3B....................37 4 Paired T Statistics: Evaluating The Mean Of Test Scores For Test 4A & 4B....................38 5 Paired T Statistics: Evaluating The Mean Of Test Scores For Test 5A & 5B....................39 6 Paired T Statistics: Evaluating The Mean Of Test Scores For Test 6A & 6B....................40 7 Paired T Statistics: Evaluating The Mean Of Test Scores For Test 7A & 7B....................40 8 Paired T Statistics: Evaluating The Mean Of Test Scores For Test 8A & 8B....................41 9 Paired T Statistics: Evaluating The Mean Of Test Scores For Test 9A & 9B....................42 10 Paired T Statistics: Evaluating The Mean Of Test Scores For Test 10A & 10B................42 11 Paired T Statistics: Evaluating The Mean Of Test Scores For Test 11A & 11B................43 12 Paired T Statistics: Evaluating The Mean Of Test Scores For Test 12A & 12B................44 13 Paired T Statistics: Evaluating The Mean Of Test Scores For Test 13A & 13B................44 14 Paired T Statistics: Evaluating The Mean Of Test Scores For Test 14A & 14B................45 15 Paired T Statistics: Evaluating The Mean Of Test Scores For Test 15A & 15B................46 16 Paired T Statistics: Evaluating The Mean Of Test Scores For Test 16A & 16B................47 17 Paired T Statistics: Evaluating The Mean Of Test Scores For Test 17A & 17B................47