Florida Partnership Annual Report Annual Evaluation Report For Florida Partnership 2017-2018 Submitted August 31, 2018 by New Directions, New Ideas LLC Report by New Directions, New Ideas, LLC 1 Florida Partnership Annual Report Table of Contents Executive Summary…………………………………………………………………………………………….. 5 Section 1: Introduction to the Florida Partnership………………………………………………... 8 Section 2: Evaluation Methodology……………………………………………………………………… 8 Section 3: Florida Partnership Overview………………………………………………………………. 13 Section 4: Professional Development Opportunities and Feedback………………………... 18 Section 5: Community Engagement and Training………………………………………………….. 29 Section 6: College Board Suite of Assessments: Participation and Performance……… 33 Section 7: AVID Student Enrollment…………………………………………………………………….. 52 Section 8: College Board AP Exam Participation and Performance………………………… 59 Section 9: Conclusion and Recommendations………………………………………………………. 67 List of Tables and Exhibits Exhibit A: Evaluation Questions…………………………………………………………………………. 10 Exhibit B: Data Sources for Indicators………………………………………………………………… 11 Exhibit C: Demographic Profile of Florida Partnership Districts…………………………… 14 Exhibit D: Trainings Conducted During the 2016-2017 Grant Period…………………….. 15 Exhibit E: Developing a Culture of Readiness Workshops……………………………………… 16 Table 4.1 Rating Scale Response Counts for AP Symposia Learning Objective 1: Understanding AP Resources and Tools………………………………………………………. 20 Table 4.2 Rating Scale Response Counts for AP Symposia Learning Objective 2: Understanding of the AP Curricular Requirements in Your Subject Area……….. 20 Table 4.3 Rating Scale Response Counts for AP Symposia Learning Objective 3: Understanding of AP Exam and Grading Process………………………………………… 21 Figure 4.1AVID Summer Institute Participant Satisfaction Levels……………………….... 22 Table 4.4 AVID Summer Institute Knowledge Gains Rating Scale………………………….. 22 Table 4.5 Knowledge Gains for Khan Academy Coaching Workshop – Flagler and St. Lucie………………………………………………………………………………… 23 Table 4.6 Knowledge Gains for Khan Academy Coaching Workshop – St. Lucie……... 24 Table 4.7 Knowledge Gains for Khan Academy Coaching Workshop - Alachua and Marion………………………………………………………………………………… 24 Table 4.8 Knowledge Gains for Preparing and Empowering Students Workshop- St. Lucie and Okeechobee………………………………………………………………….…….. 25 Table 4.9 Knowledge Gains for Connecting Students to Opportunity-Franklin……… 25 Table 4.10 Confidence Level for Understanding Algebra I Workshop Learning Objectives………………………………………………………………………………………………. 26 Table 4.11 Level of Satisfaction with Pre-AP ELA Workshop……………………………….. 27 Table 4.12 Understanding District Leadership Training Topics…………………………… 27 Table 4.13 Understanding MLC Topics Before and After Colloquium…………………… 28 Table 5.1 Rating Scale Scores Before and After IRSC Parent Workshop……………….. 31 Table 5.2 Rating Before and After IRSC Summer Program…………………………………... 32 Table 6.1 Three Year Comparison of PSAT 8/9 Test Takers by FLP District…………. 34 Figure 6.1 Three Year Comparison of PSAT 8/9 Test Takers by FLP District………... 35 Table 6.2 Top Five Districts: Percentage Change in Number of PSAT 8/9 Test Takers 35 Report by New Directions, New Ideas, LLC 2 Florida Partnership Annual Report Table 6.3 Three Year Comparison of Percentage of Students Who Met Both ERW and Math Benchmarks on PSAT 8/9 in FLP Districts…………………………. 36 Figure 6.2 Mean Total Score on PSAT 8/9 by FLP Districts in 2015 -16 to 2017-18.. 37 Table 6.4 Top Five FLP Districts: Percentage Change from 2015-2016 to 2017-2018 in Percentage of Students Who Met Both ERW and Math Benchmarks on PSAT 8/9…………………………………………………………………………………………….. 37 Table 6.5 Three Year Comparison of PSAT/NMSQT Test Takers by FLP Districts…… 38 Figure 6.3 Three Year Comparison of PSAT/NMSQT Test Takers by FLP Districts…. 39 Table 6.6 Top Five FLP Districts: Percentage Change from 2015-2016 to 2017-2018 in Number of PSAT/NMSQT Test Takers……………………………………………………. 39 Table 6.7 Three Year Comparison of Percentage Change in the Percentage of Students Who Met Both ERW and Math Benchmarks on PSAT/NMSQT by FLP District………………………………………………………………… 40 Figure 6.4 Mean Total Score on PSAT/NMSQT by FLP Districts in 2015 -16 to 2017-18…………………………………………………………………………………………………. 41 Table 6.8 Top Five FLP Districts: Percentage Change from 2015-2016 to 2017-2018 in Students Who Met Both ERW and Math Benchmarks on PSAT/NMSQT…….. 41 Table 6.9 Two Year Comparison of Number of SAT Saturday Test Takers………………... 42 Figure 6.5 Two Year Comparison in Number of SAT Saturday Test Takers by FLP Districts…………………………………………………………………………………………. 43 Table 6.10 Top Five Districts: Percentage Change from 2016-2017 to 2017-2018 in the Number of SAT Saturday Test Takers………………………………………………… 43 Table 6.11 Two Year Comparison of the Number of SAT School Day Test Takers by FLP Districts………………………………………………………………………………………….. 44 Figure 6.6 Two Year Comparison in the Number of SAT School Day Test Takers by FLP Districts………………………………………………………………………………………….. 45 Table 6.12 Top Five Districts: Percentage Change from 2016-2017 to 2017-2018 in the Number of SAT School Day Test Takers……………………………………………… 45 Table 6.13 Two Year Comparison of Percentage Change in the Percentage of Students Who Met Both ERW and Math Benchmarks on SAT Saturdays by FLP District………………………………………………………………… 46 Figure 6.7 Mean Total Score on SAT by Saturday Test Takers in FLP Districts in 2016 -17 to 2017-18……………………………………………………………………………….. 47 Table 6.14 Top Five FLP Districts: Percentage Change from 2016-2017 to 2017-2018 in Students Who Met Both ERW and Math Benchmarks on SAT Saturdays……. 47 Table 6.15 Two Year Comparison of Percentage Change in the Percentage of Students Who Met Both ERW and Math Benchmarks on SAT School Days by FLP District…………………………………………………………………………………………… 48 Table 6.16 Two Year Comparison of Percentage of Students Who Met Both ERW and Math Benchmarks on SAT Saturdays vs. School Days by FLP District………. 49 Table 6.17 Two Year Comparison of Percentage of Students Earning ERW Concordance Scores by FLP Districts……………………………………………………………. 50 Figure 6.8 Two Year Comparison of the Percentage of Students Achieving Concordance Scores by FLP District……………………………………………………………… 51 Table 6.18 Top Three FLP Districts: Percentage Change in Students Earning ERW Concordance Scores by FLP Districts…………………………………………………... 51 Report by New Directions, New Ideas, LLC 3 Florida Partnership Annual Report Table 7.1 AVID Strategies Used in Other Classrooms……………………………………………. 52 Table 7.2 Middle School AVID Elective Students Who Would be 1st Generation College Going Students……………………………………………………………………………… 53 Table 7.3 Number of High School AVID Elective Students by Respondent……………… 53 Table 7.4 Overview of AVID Elective Course by School…………………………………………. 54 Table 7.5 Number of Students Enrolled in AVID Elective Courses by grade level In FLP funded schools………………………………………………………………………………. 55 Table 7.6 AVID Elective Middle School Student Outcomes…………………………………….. 56 Table 7.7 AVID Elective High School Student Outcomes………………………………………... 57 Table 7.8 AVID Elective High School Student Postsecondary Enrollment………………. 58 Table 8.1 Three Year Comparison of Number of Students Who Took an AP Exam and Percentage Change by FLP Districts…………………………………………………… 59 Figure 8.1 Three Year Comparison of the Number of Students Who Took an AP Exam by FLP Districts…………………………………………………………………….. 60 Table 8.2 Top Ten FLP Districts: Percentage Change For Number of Students Who Took an AP Exam…………………………………………………………………………….. 60 Table 8.3 Three Year Comparison of the Number of Minority Students Who Took an AP Exam and Percentage Change by FLP Districts………………… 61 Figure 8.2 Three Year Comparison of the Number of Minority Students Who Took an AP Exam and Percentage Change by FLP Districts………………… 62 Table 8.4 Top Ten FLP Districts: Percentage Change For Number of Minority Students Who Took an AP Exam……………………………………………………………….. 62 Table 8.5 Three Year Comparison of the Number of AP Exams with Scores of 3+ and Percentage Change by FLP Districts……………………………………………………. 63 Figure 8.3 Three Year Comparison of the Number of AP Exams with Scores of 3+ by FLP Districts………………………………………………………………………………………… 64 Table 8.6 Top Ten FLP Districts: Percentage Change in the Number of AP Exams with Scores of 3+………………………………………………………………………………………. 64 Table 8.7 Three Year Comparison of the Number of AP Exams with Scores 3+ Taken by Minority Students and Percentage Change by FLP Districts………….. 65 Figure 8.4 Three Year Comparison of the Number of AP Exams with Scores 3+ Taken by Minority Students for All FLP Districts………………………………………… 66 Table 8.8 Top Five FLP Districts: Percentage Change in the Number of AP Exams with Scores 3+ Taken by Minority Students………………………………………………… 66 Appendices Appendix A: 2017-2018 Overview of PSAT 8/9 Test Takers and Scores Appendix B: 2017-2018 Overview of PSAT/NMSQT Test Takers and Scores Appendix C: 2017-2018 Overview of SAT Test Takers and Scores Appendix D: Overview of SAT School Day Test Takers and Scores Appendix E: Overview of AP Exam Test Takers and Scores This report was written by Shannon Calhoun. If you have any questions about this report, please call Shannon at (850) 228-0973 or send an email to [email protected] Report by New Directions, New Ideas, LLC 4 Florida Partnership Annual Report Executive Summary In 2004, the Florida legislature passed the Florida Partnership for Minority and Underrepresented Student Achievement Act and, according to F.S. 1007.35(2)(a), the legislature