Interoperability Gap Challenges for Learning Object Repositories & Learning Management Systems Robert T
Total Page:16
File Type:pdf, Size:1020Kb
Nova Southeastern University NSUWorks CEC Theses and Dissertations College of Engineering and Computing 2011 Interoperability Gap Challenges for Learning Object Repositories & Learning Management Systems Robert T. Mason Nova Southeastern University, [email protected] This document is a product of extensive research conducted at the Nova Southeastern University College of Engineering and Computing. For more information on research and degree programs at the NSU College of Engineering and Computing, please click here. Follow this and additional works at: https://nsuworks.nova.edu/gscis_etd Part of the Computer Sciences Commons Share Feedback About This Item NSUWorks Citation Robert T. Mason. 2011. Interoperability Gap Challenges for Learning Object Repositories & Learning Management Systems. Doctoral dissertation. Nova Southeastern University. Retrieved from NSUWorks, Graduate School of Computer and Information Sciences. (231) https://nsuworks.nova.edu/gscis_etd/231. This Dissertation is brought to you by the College of Engineering and Computing at NSUWorks. It has been accepted for inclusion in CEC Theses and Dissertations by an authorized administrator of NSUWorks. For more information, please contact [email protected]. Interoperability Gap Challenges for Learning Object Repositories & Learning Management Systems by Robert T. Mason A dissertation submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy in Computer Information Systems Graduate School of Computer and Information Sciences Nova Southeastern University 2011 We hereby certify that this dissertation, submitted by Robert T. Mason, conforms to acceptable standards and is fully adequate in scope and quality to fulfill the dissertation requirements for the degree of Doctor of Philosophy. _____________________________________________ ________________ Timothy J. Ellis, Ph.D. Date Chairperson of Dissertation Committee _____________________________________________ ________________ Maxine S. Cohen, Ph.D. Date Dissertation Committee Member _____________________________________________ ________________ Francisco J. Mitropoulos, Ph.D. Date Dissertation Committee Member Approved: _____________________________________________ ________________ Amon B. Seagull, Ph.D. Date Interim Dean Graduate School of Computer and Information Sciences Nova Southeastern University 2011 Acknowledgments I would like to thank my dissertation committee, Dr. Maxine Cohen, Dr. Tim Ellis and Dr. Francisco Mitropoulos for supporting me in this long and worthwhile journey that has spanned six years. I would especially like to thank Dr. Ellis for his patience during the entire process and for helping me to find the path when I wandered astray. I’d also like to thank my two sons Alex and Ben for their patience while I worked on the Ph.D. many evenings and weekends, instead of joining them for a game on the X-BOX 360. Needless to say, I am grateful for the growth that I experienced as a person and as a scholar during my educational experience at NSU. I plan to share my knowledge and experience with other students as I pursue my career as an assistant professor at Regis University. An Abstract of a Dissertation Submitted to Nova Southeastern University in Partial Fulfillment of the Requirements for the Degree of Doctor of Philosophy Interoperability Gap Challenges for Learning Object Repositories & Learning Management Systems by Robert T. Mason July 2011 An interoperability gap exists between Learning Management Systems (LMSs) and Learning Object Repositories (LORs). Learning Objects (LOs) and the associated Learning Object Metadata (LOM) that is stored within LORs adhere to a variety of LOM standards. A common LOM standard found in LORs is the Sharable Content Object Reference Model (SCORM) Content Aggregation Model (CAM). In contrast, LMSs are independent computer systems that manage and deliver course content to students via a web interface. This research addressed three important issues related to the interoperability gap: (a) a lack of a metadata standard that defined the format of how student assessment data should be communicated from LMSs to LORs, (b) a lack of an architectural standard for the movement of data from LMSs to LORs, and (c) a lack of middleware that facilitated the movement of the student assessment data from the LMSs to LORs. This research achieved the following objectives: (a) the SCORM CAM LOM standard was extended to facilitate the storage of student assessment data, (b) Service Oriented Architecture (SOA) was identified as the best architecture to resolve the interoperability gap between LMSs and LORs, (c) a panel of Computer Information Systems (CIS) experts participated in a five-stage, web-based, anonymous Delphi process that approved and ranked 28 functional requirements for a proposed middleware application, and (d) the functional requirements were verified via the development of a prototype that transferred student assessment data from a LMSs into the LOM of LOs that are stored within a LOR. In conclusion, the research demonstrated that there are three acceptable approaches to extending the SCORM LOM standard: (a) new metadata elements, (b) new vocabulary values, and (c) the reference of an internal or external XML file using a location element. The main accomplishments of the research were the gathering of SOA functional requirements and the development of a prototype that provided an approach for the resolution of the interoperability gap that exists between LMSs and LORs. Table of Contents Abstract iv List of Tables viii List of Figures ix Chapters 1. Introduction 1 Statement of the Problem to Be Investigated 1 Goals to Be Achieved 10 Research Questions 12 Relevance and Significance 12 Barriers and Issues 17 Limitations and delimitations of the study 18 Definition of terms 20 Summary 22 2. Review of the Literature (ROL) 24 Introduction to ROL 24 Overview of Learning Objects 26 Learning Object Metadata (LOM) Standards 30 Approaches for Extending SCORM 50 Learning Object Repositories (LORs) 65 Learning Management Systems (LMS), Content Management Systems (CMS) 82 Middleware, Data Movement Architecture and Technology 93 NCS Alternatives in Comparison to SOA 108 Summary of Data Movement Architecture and Recommendation 116 3. Methodology Phase I – Determining Middleware Application Functional Requirements 117 Introduction and Purpose 117 Determining the Middleware Application Functional Requirements 118 Gaining a Consensus of CIS Experts 119 Study Invitations 121 Research Sample Size 121 Defining Expertise 122 The Survey Tool 125 IRB Approval 125 Participant Demographic Data 126 Open Survey Questions 127 First Survey 127 Second Survey 129 Third Survey 131 v Statistical Analysis for Stability and Convergence 131 Analysis of Results for Stability and Convergence 133 Fourth Survey 135 Fifth Survey 135 Ranking the Requirements 135 Phase II – LMS to LOR Middleware Application (LLMA) Prototype 136 Defining a Prototype 137 Development Methodology 137 LLMA Analysis Modeling 138 LLMA Design Modeling 139 Design of a State Chart 139 Design of Web Pages 140 Design of Data Movement Process Flows 140 Incremental Software Construction 141 Construction of the Metadata Repository 141 Construction of the Web-based Interface 142 Construction of the LOM - Extending SCORM 144 Incremental Software Integration 146 System Testing 147 Resources 147 Summary 148 4. Results Introduction 149 Results for the Round Two Survey 149 Results for the Round Three Survey 150 Results for the Round Four Survey 151 Results for the Round Five Survey 152 Excluded Functional Requirement Justification 157 Summary of Phase I Results of the Research Study with a Panel of CIS Experts 159 Results for the Phase II Use Case Diagram Modeling Analysis Process 159 Results for the ERD Modeling Analysis Process 173 Results for High-Level Architecture Design 175 Results from WSCP State Chart Modeling Design Process 179 Results from the Web-based Interface Web Page Design Process 181 Results for Design Modeling of the WSCP 1st Data Push Web Service Process 192 Results for Design Modeling of the WSCP 2nd Data Push Web Service Process 194 Results of the Metadata Repository Construction Phase 196 Result of the Web-based Interface Construction Phase 200 Result of the WSCP Construction Phase 201 Results of Incremental Software Integration 102 Results of System Testing 206 Summary 209 vi 5. Conclusions, Implications, Recommendations and Summary 210 Conclusions 210 Research Answers and Implications for CIS Research 213 Recommendations 216 Unanswered Questions 217 Future Research 217 Summary of Research 218 Appendices A. SurveyShare Website 221 B. Invitation Letter (email) 224 C. Research Study Round 1 Functional Requirements Results 228 D. Research Study Round 2 Approved Functional Requirements Results 230 Reference List 232 vii List of Tables 1. Application Profile Limitations 43 2. A list of LORs with LOM standards and a URL 72 3. A List of Expert Qualifications for this study 125 4. An example of a requirement with stability and convergence 133 5. Ranked Middleware Application Functional Requirements 154 6. Functional Requirements excluded from the application prototype 157 viii List of Figures 1. An example of a LO in multiple LMSs 5 2. The evolution of LOM standards 45 3. An example of an evaluation question for an open question 128 4. An example of a 5 point Likert scale question 128 5. A sample Likert scale question followed by an open-ended question 130 6. LLMA XML Grades File 145 7. LLMA SCORM