Document-Oriented E-Learning Components
Total Page:16
File Type:pdf, Size:1020Kb
-UNIVER KE S C IT I Ä OTTO-VON-GUERICKE-UNIVERSITÄT MAGDEBURG R T E U M G A - G N D O E V B FAKULTÄT FÜR INFORMATIK - U O R T G T O Document-Oriented E-Learning Components Dissertation zur Erlangung des akademischen Grades Doktoringenieur (Dr.-Ing.) angenommen durch die Fakultät für Informatik der Otto-von-Guericke-Universität Magdeburg von Michael Piotrowski, M.A. geb. am 5. Juli 1972 in Aachen Gutachter: Prof. Dr. Dietmar Rösner Prof. Dr. Anne Brüggemann-Klein Prof. Dr. Helmut Schauer Promotionskolloquium: Magdeburg, den 17. April 2009 Document-Oriented E-Learning Components © 2009 Michael Piotrowski Design by Michael Piotrowski. Typeset with LATEX in Bitstream Zapf Elliptical 711, Linotype Basic Commercial, and Bitstream Prestige 12 Pitch. Abstract This dissertation questions the common assumption that e-learning requires a learning management system (LMS) such as Moodle or Black- board. Based on an analysis of the current state of the art in LMSs, we come to the conclusion that the functionality of conventional e-learn- ing platforms consists of basic content management and communica- tions facilities (such as forums, chats, wikis, etc.) and functionality for assessment (such as quizzes). However, only assessment functionality is actually specific to e-learning. Furthermore, the content management and communication functionality in e-learning platforms is typically restricted and often inferior when compared with the more general implementations available in Web content management systems. Since content management systems (CMS) offer more general and more robust functions for managing content, we argue that e-learning platforms should be based on content management systems. Only assessment functions are actually specific to e-learning and need to be added to a CMS; this requires the architecture of the CMS to be modular. As a proof of concept, we have designed and implemented the eduCom- ponents, a component-based e-learning system architecture, realized as software components extending a general-purpose content manage- ment system with facilities for course management and assessment. The eduComponents have been successfully used since several se- mesters at Otto von Guericke University and other institutions. The experience with the eduComponents gives practical evidence for the theses we have put forward in this dissertation and of the feasibility of the eduComponents approach. The research done for this dissertation has also resulted in practical definitions for e-learning and e-learning platform, terms which are notoriously ill-defined. Based on these definitions, we have developed an innovative way to assess and to visualize the areas of functionality of e-learning environments. 3 Zusammenfassung Diese Dissertation stellt die gängige Annahme in Frage, dass ein Lear- ning Management System (LMS) wie Moodle oder Blackboard eine Voraussetzung für E-Learning ist. Gestützt auf eine Analyse des aktuel- len Stands der Technik bei LMS kommen wir zu dem Schluss, dass die Funktionalität konventioneller Lernplattformen zum einen aus grundle- genen Content-Management- und Kommunikationsfunktionen (Foren, Chats, Wikis usw.) und zum anderen aus Funktionen für Leistungsüber- prüfungen (z. B. Tests) besteht; lediglich letztere sind jedoch tatsäch- lich e-learning-spezifisch. Darüber hinaus ist die Content-Management- und Kommunikationsfunktionalität von E-Learning-Plattformen häufig eingeschränkt und im Vergleich zu den allgemeineren Implementatio- nen in Content-Management-Systemen (CMS) oft schwach. Da CMS allgemeinere und ausgereiftere Funktionen für die Verwaltung von Inhalten bieten, fordern wir, dass E-Learning-Plattformen auf CMS aufbauen sollten. Lediglich die Funktionalität für Leistungsüberprüfun- gen ist e-learning-spezifisch und muss zum CMS hinzugefügt werden; dies erfordert eine modulare CMS-Architektur. Als Machbarkeitsnachweis haben wir die eduComponents entworfen und implementiert, eine komponentenbasierte E-Learning-Systemarchi- tektur, die in der Form von Softwarekomponenten für ein allgemeines CMS realisiert wurde und das CMS um Funktionalität für Kursverwal- tung und Leistungsüberprüfung erweitert. Die eduComponents sind seit mehreren Semestern an der Otto-von- Guericke-Universität und anderen Institutionen erfolgreich im Ein- satz. Die Erfahrungen mit den eduComponents sind der praktische Nachweis für die in dieser Dissertation aufgestellten Thesen und die Tauglichkeit des eduComponents-Ansatzes. In dieser Dissertation stellen wir außerdem praktische Definitionen für die notorisch unklaren Begriffe E-Learning und E-Learning-Platt- form auf. Auf der Basis dieser Definitionen haben wir einen neuen Ansatz zur Einschätzung und Visualisierung der Funktionalität von E-Learning-Umgebungen entwickelt. 5 Contents List of Figures 11 List of Tables 13 Acknowledgments 15 1 Introduction 17 1.1 Why E-Learning? . 17 1.2 Problem Statement . 20 1.3 Theses . 22 1.4 Outline . 24 2 Foundations and State of the Art 25 2.1 E-Learning . 25 2.1.1 What Is E-Learning? . 25 2.1.2 Corporate and Academic E-Learning . 30 2.1.3 E-Learning: A Practical Definition . 35 2.2 Software for E-Learning . 35 2.2.1 What Is an E-Learning Platform? . 37 2.2.2 Some Historical Notes . 37 2.2.3 E-Learning Platforms: A Practical Definition . 39 2.3 Do We Really Need Special Software for E-Learning? . 43 2.4 Content Management Systems . 45 2.5 State of the Art . 47 2.5.1 E-Learning Platforms . 48 2.5.2 Content Management Systems . 53 2.6 Summary . 56 7 3 The eduComponents Approach 59 3.1 Design and Implementation . 60 3.1.1 Design Considerations . 60 3.1.2 Implementation . 62 3.2 Short Description of the Individual Components . 66 3.2.1 ECLecture . 67 3.2.2 ECQuiz . 67 3.2.3 ECAssignmentBox . 68 3.2.4 ECAutoAssessmentBox . 69 3.2.5 ECReviewBox . 70 3.3 Related Work . 70 3.3.1 Architecture . 71 3.3.2 Systems . 73 3.3.3 Educational Uses of Plone . 74 3.3.4 Summary . 75 4 Assessment 77 4.1 Bloom’s Taxonomy . 77 4.2 Newer Taxonomies . 79 4.2.1 Revised Bloom’s Taxonomy . 79 4.2.2 Marzano’s New Taxonomy . 81 4.2.3 Summary . 82 4.3 E-Assessment . 83 4.3.1 Early Automatic Testing Systems . 84 4.3.2 Audience Response Systems . 85 4.3.3 Computer-Aided Instruction . 86 4.3.4 Web-Based Assessment . 90 4.3.5 Summary . 92 4.4 Design and Implementation of the Assessment-Related eduComponents Products . 93 4.4.1 ECQuiz . 93 4.4.2 ECAssignmentBox . 101 4.4.3 ECAutoAssessmentBox . 112 4.4.4 ECReviewBox . 116 4.5 Authoring and Interchange of Multiple-Choice Tests . 119 4.5.1 File Formats for Authoring . 120 4.5.2 Test Interoperability . 127 4.6 Summary . 143 8 5 Practical Use, Experience, and Evaluation 145 5.1 Infrastructure . 145 5.2 Usage . 147 5.3 Student Questionnaire Results . 150 5.3.1 Usability . 151 5.3.2 Organization . 152 5.3.3 Influence on Learning Processes . 152 5.4 Comments from Instructors . 155 5.5 User Questionnaire Results . 155 5.6 Summary and Discussion . 158 6 Outlook 161 6.1 eduComponents and the Plone roadmap . 161 6.2 Plone as a Learning Object Repository . 163 6.2.1 What are Learning Objects? . 163 6.2.2 Excursus: Learning Objects—A Critical Discussion165 6.2.3 Learning Object Repositories vs. CMSs . 167 6.3 Using Plone and the eduComponents for E-Portfolios . 168 6.4 Summary . 170 7 Summary and Conclusion 171 7.1 Component Synergy . 173 7.2 Concluding Remarks . 175 A Glossary 177 B Student Questionnaire 181 C User Questionnaire 185 Bibliography 187 Author’s Publications in the Context of this Dissertation 205 Theses Supervised by the Author in the Context of this Disserta- tion 207 9 List of Figures 2.1 PLATO V terminal . 38 2.2 Activities supported by e-learning platforms . 42 2.3 Demarcation of Web content management . 46 2.4 Typical CMS user interface (Contenido) . 48 2.5 Screenshot of Moodle . 51 2.6 Screenshot of OLAT . 52 2.7 Plone user interface . 54 3.1 Zope architecture . 62 3.2 eduComponents architecture . 65 3.3 Example course homepage realized with ECLecture . 67 3.4 A multiple-choice test in ECQuiz . 68 3.5 Student’s view of an assignment box . 69 3.6 Automatic feedback from ECAutoAssessmentBox . 70 3.7 ECReviewBox . 71 4.1 Pyramid of learning objectives . 78 4.2 Pressey Testing Machine . 85 4.3 Screenshots from PLATO I . 88 4.4 PLATO IV multiple-choice test . 89 4.5 ECQuiz quiz options . 95 4.6 ECQuiz question types . 97 4.7 Editing view of an ECQuiz question . 98 4.8 Editing view of an ECQuiz answer . 98 4.9 ECQuiz instant feedback option for self-assessment tests 99 4.10 Student’s view of an assignment box . 102 4.11 ECAssignmentBox editing view . 103 4.12 Relation of ECAssignmentBox and ECAssignmentTask . 106 11 4.13 ECAssignment workflow states . 108 4.14 Assignment box evaluation view . 109 4.15 Assignment box analysis view . 109 4.16 ECFolder statistics view . 110 4.17 Comparing two submissions . 111 4.18 A screenshot of PlagDetector . 111 4.19 Editing information required for automatic testing . 114 4.20 Automatic feedback from ECAutoAssessmentBox . 115 4.21 Student’s view of ECReviewBox . 118 4.22 MC Frog test editor . 121 4.23 Quick Edit view of a test . 128 4.24 Example test structure . 131 4.25 ECQuiz question groups . 132 5.1 Submissions during summer semester 2008 . 146 5.2 Submissions times during summer semester 2008 . 146 5.3 Students using eduComponents at WDOK . 150 5.4 Student responses: Usability . 152 5.5 Student responses: Organization . 153 5.6 Student responses: Learning process (diligence) . 153 5.7 Student responses: Learning process (elaborateness) . 154 5.8 Student responses: Learning process (automatic feedback)154 5.9 User responses: Roles . 156 5.10 User responses: Products . 157 7.1 Activities supported Plone with eduComponents .