COBEC Evaluation Report July 2018
Total Page:16
File Type:pdf, Size:1020Kb
Evaluating the Impact of the Consortium for Belize Educational Cooperation (COBEC) on Belizean and U.S. Partner Institutions Warren A. Hodge Emilia M. Hodge Betty Flinchum Kathaleena Edward Monds Deborah Davis Ethel Arzu Cynthia Thompson Eve Aird July 2018 COBEC Evaluation Report July 2018 TABLE OF CONTENTS Page TABLE OF CONTENTS ii LIST OF APPENDICES iv LIST OF TABLES v LIST OF FIGURES. vii ACKNOWLEDGEMENTS viii EXECUTIVE SUMMARY ix PART ONE: INTRODUCTION AND BACKGROUND 16 Introduction 16 COBEC’S Origin and Early History 17 Overarching Methodology 20 Evaluation Plan 20 Purpose and Evaluation Questions 20 Evaluation Design 22 Summary of Part One 23 PART TWO: QUANTITATIVE DESIGN, METHODOLOGY, AND RESULTS 24 Design and Methodology 24 Instrumentation and Participants 24 Data Collection 24 Data Management and Treatment 24 Data Analysis 25 Results 26 Question 1: Professionalization Programs and Activities 26 Question 2: Internationalization of Member Institutions 28 Question 3: COBEC’s Organizational Capacity 29 Responses to open-ended questions 34 Summary of Part Two 40 PART THREE: ECONOMIC IMPACT 42 Document Review and Economic Impact Analysis 42 Economic Impact Analysis 42 Economic Impact on the U.S 45 Summary of Part Three 46 ii COBEC Evaluation Report July 2018 PART FOUR: QUALITATIVE DESIGN, METHODOLOGY, AND RESULTS 47 Purpose and Design 47 Methodology 47 Instrumentation and Participants 47 Data Collection 47 Subjectivity and positionality 48 Confirming findings 49 Data Treatment and Management 49 Definition of Terms 49 Alignment of the survey and interview questions 50 Data Analysis Procedures 51 Section 1 Results 59 Question 1: Professionalization Programs and Activities 59 Question 2: Internationalization of Member Institutions 69 Question 3: COBEC’s Organizational Capacity 83 Section 2 Results 86 Policies and Membership 87 Substantive Accomplishments: Programs and Activities 87 Professional and Personal Benefits 89 Summary of the Qualitative Study 94 PART FIVE: INTEGRATION OF RESULTS 95 The Integration Process 95 Question 1: Professionalization Programs and Activities 96 Question 2: Internationalization of Member Institutions 101 Question 3: COBEC’s Organizational Capacity 107 First Group of Related Ancillary Questions: Challenges and Recommendations 109 Second Group of Related Ancillary Questions: Substantive Accomplishments 112 Third Group of Related Ancillary Questions: Positive, Negative, and Personal 114 Impacts Summary of Part Five 117 PART SIX: FINDINGS, CONCLUSIONS, AND RECOMMENDATIONS 119 Summary of the Methodology 119 Major Findings 120 Professionalization Findings, Conclusions, and Recommendations 120 Internationalization Findings, Conclusions, and Recommendations 124 Strengthening Capacity Findings, Conclusions, and Recommendations 126 COBEC’s Most Substantive Accomplishments 130 Limitations 130 Overall Impact 131 REFERENCES 133 iii COBEC Evaluation Report July 2018 LIST OF APPENDICES Appendix Page A. COBEC’s Early Meetings 142 B. COBEC Member Institutions 146 C. COBEC’s Goals and Objectives 149 D. Informed Consent and Survey Questionnaire 151 E. List of COBEC’s Past Projects and Programs 157 F. Categorization of COBEC’s Past Projects and Programs 161 G. COBEC Publications, Grants, and Media 162 H. Belize Visitor 8-Question Survey 163 I. Informed Consent and the Interview Questionnaire 164 J. Compiled Coded Text Segments for Participant 1 167 K. Compiled Coded Text Segments for Participant 5 169 L. Tables 18.2-18.13 Definition of the Categories 171 iv COBEC Evaluation Report July 2018 LIST OF TABLES Table Page 1. The Evaluation Plan 21 2. Number, Percent & Characteristics of Survey Participants 25 3. Participant’s level of agreement regarding COBEC’s collaborative 26 programs and activities 4. Participant’s level of agreement regarding COBEC’s contributions 28 to the internationalization of member institutions 5. Participant’s level of agreement regarding COBEC’s organizational 30 capacity to meet needs in Belize and COBEC’s member institutions 6. Participants’ level of satisfaction with various aspects of COBEC 31 7. Participant’s level of agreement regarding COBEC’s impact* on 33 specific sectors in Belize and the U.S. 8. Sample Study Abroad Economic Impact Model 44 9. Sample Study Abroad Model showing a Multiplier Effect of COBEC 45 Schools Using $38,272BZ as the Base Amount 10. Sample of US institutions that have hosted Belizean Students for 46 Higher Education Degrees 11. Description of Participants 48 12. Cohen’s Coefficients Between PI and Raters 1, 2 and 3* 50 13. Means-End Analysis Based on Spradley’s Semantic Relationships 51 14. Spradley’s Semantic Relationships 53 15. Relationships Across Categories and Terms for the Theme 54 “Advance Professionalization” 16. Relationships Across Categories and Terms for the Theme 54 “Internationalization of Member Institutions” 17. Relationships Across Categories and Terms for the Theme 55 “Strengthen Organizational Capacity” v COBEC Evaluation Report July 2018 18.1. Definition of the Category ‘Increase International Collaboration’ with 7 56 Three Characteristics 19. ‘Professionalization’ Categories, Subcategories, and Number of 59 Participants 20. ‘Internationalization’ Categories, Subcategories, Number Participants 70 21. ‘Strengthen Org Capacity’ Categories, Subcategories, Number of 84 Participants 22. Substantive Accomplishments with Number of Participants and 90 Excerpted Examples 23. Professional and Personal Benefits with Number of Participants and 92 Excerpted Examples 24. Side-by-Side Joint Display Showing Integration of Survey and 100 Interview Results for Professionalization 25. Side-by-Side Joint Display Showing Integration of Survey and 106 Interview Results for Internationalization 26. Side-by-Side Joint Display Showing Integration of Survey and 108 Interview Results for Strengthen Organizational Capacity 27. Side-by-Side Joint Display Showing Integration of Survey and 113 Interview Results for Substantive Accomplishments 28. Side-by-Side Joint Display Showing Integration of Positive, Negative, 116 and Personal Impacts vi COBEC Evaluation Report July 2018 LIST OF FIGURES Figure Page 1. Creswell’s Convergent Design 22 2. Agreement with COBEC’s Collaborative Programs and Activities 27 3. Agreement with COBEC’s Contributions to the Internationalization of 29 Member Institutions 4. Agreement with COBEC’s organizational capacity to meet needs in 31 Belize and COBEC’s member institutions 5. Participants’ level of satisfaction with various aspects of COBEC 32 6. Kuckartz’s evaluative text analysis process 52 7. MAXQDA collapsed code system showing themes and colored clusters 57 representing coded segments with weighted values 2-3 for each participant. 8. MAXQDA expanded code system showing themes, categories, and 58 colored clusters representing coded segments with weighted values 2-3 for each participant. vii COBEC Evaluation Report July 2018 ACKNOWLEDGMENTS This evaluation was a collaborative effort that involved a volunteer team of COBEC members from Belize and U.S. institutions. We were fortunate to have insight and advice from two of the founding members—Betty Flinchum, University of North Florida, and Cynthia Thompson, University of Belize. Other team members included Eve Aird, Galen University; Ethel Arzu, University of Belize; Deborah Davis, Valdosta State University; Emilia Hodge, University of Florida; Warren Hodge, University of North Florida; and Kathaleena Edward Monds, Albany State University. We would also like to recognize and acknowledge the vision and accomplishments of the other four founding members, who collaborated and jointly established and developed the consortium. These distinguished individuals were Tracy Harrington, Ernest Raymond, John Petersen, and Sir Colville Young. The evaluation team is also grateful for the support of past and present COBEC officers and their encouragement and moral and financial support from the inception of this project: Jane Bennett (Belize Co-chair), Neal McCrillis (U.S. Co-chair), Karen Martinez (Belize Treasurer & Secretary), and Deborah Davis (U.S. Treasurer). The team also expresses its appreciation to the following individuals for their assistance during different stages of the evaluation: Bradley Osburn, Academic Assistant, University of Florida Megan Crews, Graduate Assistant, Valdosta State University Kelly Ranch, Adjunct Professor, University of North Florida Tenae Branch, Doctoral Student, University of North Florida Shelletta Baker, Doctoral Student, University of North Florida Finally, our gratitude goes to the COBEC membership for their support of this work, in particular, those members who completed and returned the survey questionnaire, those who participated in individual interviews, and others who provided moral support throughout the project. viii COBEC Evaluation Report July 2018 EXECUTIVE SUMMARY International higher education consortia are vehicles that promote and support the internationalization of member institutions through intercultural collaboration and partnerships. They develop and maintain alliances based on compatibility and mutual respect (Beerkens, 2004). The Consortium for Belize Educational Cooperation (COBEC), established in 1988, is one such organization. This report is based on the evaluation of programs and activities associated with COBEC’s three overarching goals of professionalizing higher education in Belize, internationalizing member institutions, and strengthening its organizational capacity. Specifically, the evaluation was guided by three questions: