Evaluation of Electronic Assessment Systems and Their Ability to Meet NCATE Standard 2 Anthony Kirchner Western Kentucky University, [email protected]
Total Page:16
File Type:pdf, Size:1020Kb
Western Kentucky University TopSCHOLAR® Dissertations Graduate School 4-2012 Evaluation of Electronic Assessment Systems and Their Ability to Meet NCATE Standard 2 Anthony Kirchner Western Kentucky University, [email protected] Follow this and additional works at: https://digitalcommons.wku.edu/diss Part of the Educational Assessment, Evaluation, and Research Commons, Higher Education Administration Commons, and the Teacher Education and Professional Development Commons Recommended Citation Kirchner, Anthony, "Evaluation of Electronic Assessment Systems and Their Ability to Meet NCATE Standard 2" (2012). Dissertations. Paper 20. https://digitalcommons.wku.edu/diss/20 This Dissertation is brought to you for free and open access by TopSCHOLAR®. It has been accepted for inclusion in Dissertations by an authorized administrator of TopSCHOLAR®. For more information, please contact [email protected]. EVALUATION OF ELECTRONIC ASSESSMENT SYSTEMS AND THEIR ABILITY TO MEET NCATE STANDARD 2 A Dissertation Presented to The Faculty of the Educational Leadership Doctoral Program Western Kentucky University Bowling Green, Kentucky In Partial Fulfillment Of the Requirements for the Degree Doctor of Education By Anthony Kirchner May 2012 Dedicated to Jana, Caleb, and Caitlyn ACKNOWLEDGEMENTS Throughout most journeys, your life can be touched by many along your path. Numerous people have played important roles in my doctoral journey, and I would like to take this one last opportunity to thank you. First and most important, a great deal of credit and debt goes to my family. Their love, understanding, support, and sacrifice for the many Saturday classes, late nights, and missed opportunities allowed me to complete this degree and dissertation. Thank you, Jana. You set the example and showed me how to make it through a program like this. Thank you, Caleb and Caitlyn, for trying to understand just how important this was to me. To Dr. Tony Norman, my committee chair, advisor, and friend, thank you for your support, encouragement, and counsel through the past few years. You have provided me many things but most importantly your time. To my other committee members, Dr. William “Bud” Schlinker and Dr. Kyong Chon, thank you for your counsel and support throughout my study. Both of you made me a better researcher and this study a stronger piece of work. To my Cohort II colleagues, Benny Lile, Chris Schmidt, Tom Stewart, Bob Jackson, Adam Murray, and the many others – thank you for the many laughs, thoughts, support, and encouragement. It is probably the one thing I cherish the most from this program. Finally, thank you to the 225 respondents who participated in the survey and the numerous others who emailed their support and encouragement. Your time and effort allowed me to complete this study. iv TABLE OF CONTENTS LIST OF TABLES ........................................................................................................... viii ABSTRACT ........................................................................................................................ x CHAPTER 1: INTRODUCTION ...................................................................................... 1 NCATE Standard 2 ..................................................................................................... 4 Purpose of the Study ................................................................................................... 6 Significance of the Study ............................................................................................ 7 Definitions................................................................................................................. 10 CHAPTER 2: REVIEW OF LITERATURE .................................................................... 13 Reasons for Accountability ....................................................................................... 14 NCATE Standard 1 ................................................................................................... 17 NCATE Standard 2 ................................................................................................... 18 NCATE Standard 3 ................................................................................................... 19 NCATE Standard 4 ................................................................................................... 20 NCATE Standard 5 ................................................................................................... 21 NCATE Standard 6 ................................................................................................... 22 Commercial Systems ................................................................................................ 25 Blackboard ............................................................................................................ 26 Chalk & Wire ........................................................................................................ 27 Digication .............................................................................................................. 28 Epsilen ePortfolio.................................................................................................. 29 v Foliotek ................................................................................................................. 30 PASS-PORT ......................................................................................................... 31 LiveText ................................................................................................................ 33 RCampus ............................................................................................................... 34 TaskStream ........................................................................................................... 35 Tk20 ...................................................................................................................... 35 Nuventive TracDat ................................................................................................ 36 Waypoint Outcomes.............................................................................................. 37 Research Questions ................................................................................................... 38 CHAPTER 3: METHODOLOGY .................................................................................... 41 Research Design........................................................................................................ 42 Participants ................................................................................................................ 42 Instrument ................................................................................................................. 43 Procedures ................................................................................................................. 46 Analysis of Data ........................................................................................................ 47 CHAPTER 4: RESULTS ................................................................................................. 49 Introduction ............................................................................................................... 49 Response Rate Information ....................................................................................... 50 Participant and Institutional Demographics .............................................................. 51 Research Question 1 ................................................................................................. 62 vi Research Question 2 ................................................................................................. 63 Research Question 3 ................................................................................................. 64 Research Question 4 ................................................................................................. 68 Research Question 5 ................................................................................................. 71 Research Question 6 ................................................................................................. 73 CHAPTER 5: DISCUSSION ............................................................................................ 78 Research Question 1 ................................................................................................. 79 Research Question 2 ................................................................................................. 81 Research Question 3 ................................................................................................. 82 Research Question 4 ................................................................................................. 84 Research Question 5 ................................................................................................. 86 Research Question 6 ................................................................................................. 87 Research Limitations ................................................................................................ 91 Future Research ........................................................................................................ 93 REFERENCES ................................................................................................................. 95 Appendix A Commercial System Comparison Table ....................................................