Impacting Student Learning and Growth in Utah Schools Annual Evaluation Report (2019-2020)
Total Page:16
File Type:pdf, Size:1020Kb
2020 Shutterstock.co m Assessment to Achievement: Impacting Student Learning and Growth in Utah Schools Annual Evaluation Report (2019-2020) Prepared by the Utah Education Policy Center June, 2020 6 | Page Bridging Research, Policy, & Practice The Utah Education Policy Center (UEPC) is a research-based center at the University of Utah founded in the Department of Educational Leadership and Policy in 1990 and administered through the College of Education since 2007. As an integral part of the College’s commitment to improving educational access and opportunities, the purpose of the UEPC is to improve the quality of educational policies, practices, and leadership in public schools and higher education by informing and influencing educational policy and practice in Utah and the surrounding region through research, evaluation, and technical assistance. The UEPC provides advanced and balanced research and evaluation to facilitate sound and informed decisions about educational leadership, policy and practice. We are committed to helping our clients understand whether educational policies, programs, and practices are being implemented as intended, whether they are effective and impactful, and how they might be improved. Please visit our website for more information about the UEPC. http://uepc.utah.edu Andrea K. Rorrer, Ph.D., Director Phone: 801-581-4207 [email protected] Cori Groth, Ph.D., Associate Director Phone: 801-581-4207 [email protected] Acknowledgements The Utah Education Policy Center (UEPC) thanks Allison Miller, Jessica Vidal, and Luis Cantu from Ed Direction and Lisa McLachlan from Utah State Board of Education (USBE) for their ongoing leadership and commitment to serving administrators, teachers, and students through the work of this project. We thank administrators and teachers from the Cohort 3 schools, including the four San Juan School District participating schools: Blanding Elementary School, Montezuma Creek Elementary, ARL Middle School, and Monticello High School, and well as the nine participating charter schools: Dual Immersion Academy, Entheos Academy (Kearns), Mana Academy, Mountainville Academy, Monticello Academy, Reagan Academy, Terra Academy, Utah Military Academy (Camp Williams), and Utah Military Academy (Hill Field) for their time to complete surveys and engage in the evaluation work of the project. We recognize this dedicated group of individuals for their persistence, collegiality, and commitment to promote success for all students. We also thank the schools in Cohort 4, who are just starting their engagement with A2A, for their time to complete the data use baseline survey. From San Juan School District, we thank Monument Valley High School and San Juan High School. From Granite School District, we thank Copper Hills Elementary School, Elk Run Elementary, Gourley Elementary, Lake Ridge Elementary, Orchard Elementary, Silver Hills Elementary, Truman, Elementary, and Western Hills Elementary. We also thank the following charter schools for their participation: CS Lewis Academy, Merit Preparatory Academy, SJ Hawthorn Academy, SJSD Monticello Academy, and WJ Hawthorn Academy. From the UEPC evaluation team, we thank Kristen Weissinger, Felicia Onuma, and Magda Tsagaris for providing assistance with report creation and editing. Citation: Groth, C. & Auletto, A. (2020). Assessment to Achievement: Impacting Learning and Growth in Utah Schools, Annual Evaluation Report (2019-2020). Salt Lake City, UT: Utah Education Policy Center. 2 | Page Table of Contents Acknowledgements ................................................................................................................ 2 Executive Summary ................................................................................................................ 5 Key Findings ..................................................................................................................................... 5 Considerations for Ongoing Improvement ....................................................................................... 9 Introduction .......................................................................................................................... 11 A2A Project Overview .................................................................................................................... 11 Project Objectives and Activities ....................................................................................................................... 12 Data Use Conceptual Framework ..................................................................................................................... 13 How to Use This Report ................................................................................................................. 15 Evaluation Methods .............................................................................................................. 16 Purpose of the Evaluation .............................................................................................................. 16 Data Sources ..................................................................................................................................................... 16 Data Analysis ..................................................................................................................................................... 18 Changes in Data Use Practices .............................................................................................. 20 Survey Respondent Demographics ................................................................................................. 22 Organizational Resources ............................................................................................................... 24 Support for Data Use ........................................................................................................................................ 24 Leadership ......................................................................................................................................................... 27 Technology ........................................................................................................................................................ 30 Attitudes Toward Data ................................................................................................................... 33 Data’s Effectiveness for Pedagogy .................................................................................................................... 33 Data Overall ...................................................................................................................................................... 35 Collaboration ................................................................................................................................. 38 Frequency, Time, and Quality ........................................................................................................................... 38 Trust .................................................................................................................................................................. 41 Teamwork ......................................................................................................................................................... 43 Rapid Improvement Cycle ................................................................................................................................. 46 Implementation of Data Use Practices ........................................................................................... 49 Frequency and Usefulness ................................................................................................................................ 49 Data Use for Instructional Decision-Making ..................................................................................................... 51 Communicating with Data ................................................................................................................................ 56 Competence in Using Data ............................................................................................................. 59 Data Use for Instructional Planning and Delivery ............................................................................................. 59 Influence of Professional Learning on Practice ..................................................................... 63 Professional Learning Feedback Survey Findings ............................................................................ 64 3 | Page School Objectives .............................................................................................................................................. 64 Standards for Professional Learning ................................................................................................................. 66 Area of Focus .................................................................................................................................................... 68 Site Visits to Support Implementation ................................................................................... 70 Breakdown of Site Visit Feedback Forms ........................................................................................ 71 Conclusions and Considerations ............................................................................................ 73 Considerations for