Green Run Collegiate: Comprehensive Evaluation Comprehensive Evaluation January 2018 By Robert A. Veigel, M.S., Research Specialist, Heidi L. Janicki, Ph.D., Director of Research and Evaluation, and Allison M. Bock, Ph.D., Program Evaluation Specialist Department of Planning, Innovation, and Accountability Office of Research and Evaluation Virginia Beach City Public Schools Table of Contents Executive Summary .............................................................................................................. 6 Key Evaluation Findings ................................................................................................................... 6 Recommendations and Rationale .................................................................................................... 12 Introduction ....................................................................................................................... 14 Background ................................................................................................................................... 14 Purpose......................................................................................................................................... 14 Program Overview ......................................................................................................................... 14 Program Goals and Objectives ............................................................................................. 15 Evaluation Design and Methodology .................................................................................... 15 Evaluation Design .......................................................................................................................... 15 Evaluation Questions .................................................................................................................................. 15 Instruments and Data Sources ........................................................................................................ 16 Surveys ....................................................................................................................................................... 16 Data Analysis................................................................................................................................. 17 Evaluation Results and Discussion ........................................................................................ 18 Actions Taken as a Result of the Recommendations From the Year-Two Implementation Evaluation .... 18 Student Application and Selection Process ....................................................................................... 19 Marketing of School .................................................................................................................................... 20 Student Application and Selection .............................................................................................................. 20 Characteristics of Students Enrolled ........................................................................................................... 21 Staff Selection Process and Professional Learning ............................................................................ 23 Process and Criteria for Staff Selection ....................................................................................................... 23 Professional Learning .................................................................................................................................. 24 Teachers’ Role in Instructional Process ........................................................................................................ 25 Green Run Collegiate Program Components ..................................................................................... 25 Program of Study ........................................................................................................................................ 25 GRC Curriculum and Courses ....................................................................................................................... 25 Personalized Learning Plan ......................................................................................................................... 28 Opportunities Provided for GRC Students ................................................................................................... 31 Parent Involvement ....................................................................................................................... 36 Opportunities for Parent Involvement and Participation ............................................................................. 36 Progress Towards Meeting Goals and Objectives .............................................................................. 38 Green Run Collegiate Goals and Objectives................................................................................................. 38 Comparison Group Performance Results..................................................................................................... 46 Green Run Collegiate Costs ............................................................................................................. 48 Recommendations and Rationale......................................................................................... 50 Office of Research and Evaluation GRC Comprehensive Evaluation 2 Appendices ......................................................................................................................... 52 Appendix A: Green Run Collegiate Newsletters ................................................................................ 52 Appendix B: Green Run Collegiate Goals and Objectives ................................................................... 55 Appendix C: GRC Cost Categories ................................................................................................... 58 Endnotes ............................................................................................................................ 59 Office of Research and Evaluation GRC Comprehensive Evaluation 3 Tables Table 1: Perceptions of Application and Selection Process ............................................................................. 21 Table 2: Demographic Characteristics of GRC Students ................................................................................. 21 Table 3: Characteristics of GRC Instructional Staff ......................................................................................... 24 Table 4: Instructional Staff Professional Learning .......................................................................................... 25 Table 5: Personalized Learning Plan Process .................................................................................................. 29 Table 6: Student Opportunities at GRC .......................................................................................................... 31 Table 7: Parent Involvement Activities Offered by GRC During 2016-2017 ..................................................... 36 Table 8: Perceptions of Parental Involvement From VBCPS Climate Survey Items ......................................... 37 Table 9: Number of Students Enrolled and Passing Coursework .................................................................... 38 Table 10: Percent of Students Passing IB Exams by Diploma Pathway ........................................................... 39 Table 11: Diploma Types Earned in 2013 and 2017 .......................................................................................... 39 Table 12: Dropout Rates ................................................................................................................................. 39 Table 13: Percent of African American and Military Connected Students Earning an Advanced Diploma ....... 40 Table 14: Percent Passing Spring 2017 SOL Assessments by Test .................................................................. 42 Table 15: Average SOL Scale Score by Assessment ........................................................................................ 44 Table 16: SOL Pass Rates Prior to Implementation in 2013 and After Full Implementation in 2017 ................. 45 Table 17: Percent Meeting SAT College and Career Readiness Benchmarks by Subgroup .............................. 45 Table 18: Percent of Tenth-Grade Students Meeting PSAT Benchmark by Test ............................................. 46 Table 19: Percent of Eleventh-Grade Students Meeting PSAT Benchmark by Test ........................................ 46 Table 20: Percent of Students Meeting SAT Benchmark by Test .................................................................... 46 Table 21: Comparison of Demographics for GRC and Comparison Group ...................................................... 46 Table 22: Average SOL Scores by Subject Area .............................................................................................. 47 Table 23: Percent of Students by SOL Proficiency Level ................................................................................. 47 Table 24: Average PSAT and SAT Scores and SAT Participation Rate ............................................................ 48 Table 25: Average Number of AP/IB Courses Taken, Graduation Details, and Plan ........................................ 48 Table 26: Average Referrals and Attendance