DOCSLIB.ORG

Emerging Leaders Program: Impacts on Students, Teachers, and Leaders in Three Sites

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Emerging Leaders Program: Impacts on Students, Teachers, and Leaders in Three Sites Emerging Leaders Program: Impacts on Students, Teachers, and Leaders in Three Sites December 2019 Prepared for: Prepared by: Brenda Neuman-Sheldon SRI International Executive Director, Evaluation Nicole L. Arshan New Leaders Katrina G. Laguarda [email protected] Jared Boyce Andrea D. Beesley Rebecca L. Goetz Xin Wei Elise Levin-Guracar SRI Project Number: P23751 Suggested citation: Arshan, N. L., Laguarda, K. G., Boyce, J., Beesley, A. D., Goetz, R. L., Wei, X., Levin-Guracar, E. (December 2019). Emerging Leaders program: Impacts on students, teachers, and leaders in three sites. Menlo Park, CA: SRI International. This report was developed by SRI International with funds provided by New Leaders under a Supporting Effective Educator Development grant from the U.S. Department of Education (grant #U367D150015). However, these contents do not necessarily represent the policy of the U.S. Department of Education, and you should not assume endorsement by the U.S. Federal Government. Contents Executive Summary ...................................................................................................................... x Emerging Leaders Program Implementation ............................................................................ xi Impacts on DDI Leadership Knowledge and Instructional Team Practices .............................. xii Impacts on Students ................................................................................................................ xiii Sustaining Leadership Gains After the Emerging Leaders Year ............................................. xiv Conclusions and Implications .................................................................................................. xv Chapter 1: Introduction and Study Design .................................................................................... 1 Study Design ............................................................................................................................. 1 Recruitment and Randomization ............................................................................................... 6 Samples .................................................................................................................................... 8 Report Overview ...................................................................................................................... 11 Chapter 2: Emerging Leaders Program Implementation ............................................................ 12 Implementation Fidelity ........................................................................................................... 13 Successes and Challenges to Program Implementation During the RCT Year ...................... 17 Treatment-Control Contrast ..................................................................................................... 26 Summary and Discussion ........................................................................................................ 27 Chapter 3: Impacts on Leaders and Instructional Team Practices ............................................. 29 Impacts on DDI Leadership Knowledge .................................................................................. 29 Impacts on Teacher Instructional Practice .............................................................................. 31 Summary and Discussion ........................................................................................................ 39 Chapter 4: Impacts on Student Achievement ............................................................................. 41 Primary Impacts on Math and English Language Arts Achievement ...................................... 42 Impacts by Student Subgroup ................................................................................................. 44 Impacts on Student Achievement on District Benchmark Assessments ................................. 48 Relationship Between Elements of the Emerging Leaders Logic Model and Student Achievement ............................................................................................................................ 49 Summary and Discussion ........................................................................................................ 52 Chapter 5: Sustaining Leadership Gains After the Emerging Leaders Year ............................... 55 Leadership Opportunities Following Emerging Leaders Training ............................................ 55 Sustainability of Emerging Leaders Work Following the RCT Year ........................................ 60 Summary and Discussion ........................................................................................................ 68 Impacts on Students, Teachers, and Leaders in Three Sites iii Chapter 6: Conclusions and Implications .................................................................................... 69 Implications for Data-Driven Instruction .................................................................................. 70 Implications for Leadership Development ............................................................................... 70 Implications for New Leaders Program Development and the Emerging Leaders Program in Particular ............................................................................................................... 71 References .................................................................................................................................. 73 Technical Appendix ................................................................................................................... A-1 Districts .................................................................................................................................. A-1 Randomization and Baseline Samples: Emerging Leaders Participants and Instructional Team Members ..................................................................................................................... A-2 Implementation Fidelity ......................................................................................................... A-6 Qualitative Methods ............................................................................................................. A-13 Survey Methods .................................................................................................................. A-16 Impacts on Instructional Leadership as Measured by Emerging Leaders’ Outcomes on the New Leaders’ Data-Driven Instruction Assessment ................................................. A-32 Impacts on Instruction ......................................................................................................... A-38 Impacts on Student Achievement ........................................................................................ A-67 iv Emerging Leaders Program List of Exhibits Exhibit ES-1. Emerging Leaders Impacts on Student Achievement: Main Impacts and Impacts Mediated by Students’ Experience of the Program and Participants’ DDI Leadership Knowledge ........................................................... xiv Exhibit 1. Emerging Leaders Program Logic Model .............................................................. 3 Exhibit 2. School-Level Demographic Characteristics, Fall 2017 Baseline Sample .............. 9 Exhibit 3. Emerging Leader Job Assignments, Fall 2017 Baseline Sample ........................ 10 Exhibit 4. Emerging Leaders Admissions Criteria, Fall 2017 Baseline Sample .................. 10 Exhibit 5. Instructional Team Members by Grade Level and Subject Area, Fall 2017 Baseline Sample ................................................................................................. 11 Exhibit 6. Emerging Leaders Program Fidelity of Implementation, 2017–18 ...................... 14 Exhibit 7. Distribution of Scores on Assessments of Seven Target Leadership Concepts, 2017–18 ............................................................................................. 16 Exhibit 8. Impacts on DDI Leadership Knowledge Competencies ...................................... 31 Exhibit 9. Primary Teacher Outcomes Measured................................................................ 34 Exhibit 10. Impacts on Math Teachers’ Instructional Practices: Reviewing Assessment Data and Corrective Instruction Action Planning ............................ 35 Exhibit 11. Impacts on ELA and Math Teachers’ Instructional Practices: Activities to Develop Student Efficacy ................................................................................ 36 Exhibit 12. Impacts on Emerging Leaders Program Participants: Reviewing Assessment Data and Corrective Instruction Action Planning ............................ 37 Exhibit 13. Emerging Leaders Program Impacts on Teacher Outcomes .............................. 38 Exhibit 14. Estimated Treatment Effects on State Assessment Outcomes ........................... 44 Exhibit 15. Estimated Treatment Effects by Student Subgroup ............................................ 46 Exhibit 16. Estimated Treatment Effects by Student Subgroup ............................................ 47 Exhibit 17. Estimated Treatment Effects on District Benchmark Outcomes .......................... 49 Exhibit 18. Estimated Treatment-on-Treated Effect for Students Who Experienced the Full Dosage of the Emerging Leaders Program ............................................ 51 Exhibit 19. Estimated Mediated Treatment Effect of DDI
Load more

Recommended publications
  • Principals' Role Perception and Implementation of Educational
    PRINCIPALS’ ROLE PERCEPTION AND IMPLEMENTATION OF EDUCATIONAL REFORM Jesse A. Hotmire A Dissertation Submitted to the Graduate College of Bowling Green State University in partial fulfillment of the requirements for the degree of DOCTOR OF EDUCATION May 2018 Committee: Patrick Pauken, Advisor Stephen Demuth Graduate Faculty Representative Jamison Grime Tracy Huziak-Clark Paul Johnson © 2018 Jesse A. Hotmire All Rights Reserved iii ABSTRACT Patrick Pauken, Advisor A theme in education stems from comparing international students’ scores on standardized tests with sub-par American students’ scores. The gap between the scores of international students and American students has prompted educational reforms to be passed by state and federal legislatures in the United States. This study begins with an investigation in the A Nation at Risk report and includes No Child Left Behind, Race to the Top, Common Core, and the Every Student Succeeds Act. States and school districts across the United States have struggled with adapting these educational reforms over the last few decades. Therefore, research on educational leadership over the decades has provided insight into strategies educational leaders can utilize to successfully implement educational reform. Additionally, the National Policy Board for Educational Administration (NPBEA) established the Professional Standards for Educational Leaders (2015) to provide a set of updated standards for educational leaders. Often tasked with implementing educational reform, principals routinely bear the brunt of guiding the people in their buildings through the maze of changes. The purpose of this phenomenological study is to discover how six principals see their role and what those six principals do to implement educational reforms.
    [Show full text]
  • Louisiana Department of Education—School Redesign 1
    Louisiana Department of Education—School Redesign 1. Partner Background Organization Name New Leaders Summarize organization’s mission and its connection to Louisiana’s plan for struggling schools New Leaders prepares education leaders to deliver breakthrough results in America’s highest-need schools and advocate for the conditions that will enable great leaders—and their students—to thrive. We develop dedicated, skilled education leaders at every level—from teacher leaders to superintendents—equipping them to strengthen teaching and accelerate learning. Our programs cultivate instructional, adult, personal, organizational, and cultural leadership skills in a natural progression that ensures participants’ success in real time and as they grow. Since 2000, we have developed nearly 2,400 leaders who have impacted 450,000 students. We have an unmatched record of developing dedicated, highly effective leaders for the students who need them most. - 74% of New Leaders remain as principals for 3+ years, while less than 50% do nationally - 78% of Emerging Leaders raise achievement across the classrooms they supervise - 64% of New Leaders alumni are people of color, compared with 20% of principals and teachers nationally In Memphis, iZone schools—defined as those in the bottom 5% of schools with the mandate to move into the top 25% in the state of Tennessee—are fastest gaining turnarounds in state; half of these schools are New Leader-led. New Leaders’ programs are built on the research of our Transformational Leadership FrameworkTM (TLFTM, formerly the Urban Excellence Framework), a tool outlining leadership practices in the highest-gaining, high-poverty schools, similar to those we might partner with in Louisiana.1 By translating this research into professional development, New Leaders has already succeeded in a variety of the most challenging environments because we train leaders to be incredibly adaptive—to lead, not just manage.
    [Show full text]
  • New Leaders Putting Principal Evaluation Into Practice
    New Leaders Putting Principal Evaluation into Practice New Leaders is a national non-profit organization committed to developing transformational school leaders and advancing the policies and practices that allow great leaders to succeed. Over the past decade, we have trained over 800 school leaders who have made a difference in the lives of over 250,000 students. Based on our experience training leaders and carefully studying the things they do to get better results for students, we have expanded our work to share lessons learned and offer states and districts with tools and strategies to get more excellent leaders into schools and help all principals get better. In addition to this principal evaluation model, we are developing additional open-source tools for use by states and districts. Visit our website at www.newleaders.org for all of the resources currently available and enter your contact information at the bottom of the page to keep updated. We gratefully acknowledge the support of America Achieves in developing this model. America Achieves helps communities and states leverage policy, practice, and leadership to build high-quality educational systems and prepare each young person for success in careers, college, and citizenship. We also gratefully acknowledge the leaders of states and school systems with whom we have partnered on building better principal evaluation systems and whose work informs ours. They include districts in Los Angeles, New Orleans and Newark as well as the states of Connecticut, Indiana, Illinois, Louisiana, Minnesota, and Tennessee. © 2012 New Leaders, Inc. All rights not expressly granted by New Leaders, Inc. are hereby reserved.
    [Show full text]
  • Teach for America – Texas Program Overview & Evolution, As Required by Texas Legislature, 84Th Regular Session HB1, Article III, Rider 50
    Teach For America – Texas Program Overview & Evolution, as required by Texas Legislature, 84th Regular Session HB1, Article III, Rider 50 Contact: Robert Carreon, [email protected] Teach For America – Texas, Report to the Texas Education Agency Page 1 of 48 Table of Contents 1. Executive Summary page 3 Vision, Mission & Our Theory of Change Clarification of Information included in Legislative Budget Board, Strategic Fiscal Review, 84th Legislative Session Timeline of Activities Summary of Activities Conclusions 2. Teacher & Education Professional Retention page 11 Articulation of Program Model Teach For America & Comparative Data 3. Efforts to Improve Retention: Past & Present page 17 Past Efforts to Improve Retention & Challenges Current Efforts to Improve Retention Region-Specific Activities Lessons Learned 4. Teach For America’s Finances page 33 Overview of Financial Model Program Expenses Non-Program Expenses 5. Conclusion page 38 Lessons Applicable to Other Teacher Preparation Organizations 6. Appendices page 40 A: America Institutes for Research External Evaluation: Retention (2016) B: Center for Research, Evaluation and Advancement of Teacher Education Report to Teach For America (2016) C: List of School Employers of Teach For America Alumni (2015-2016) D: Sources of Funds (2015-2016) & Expenditures (2015-2016) E: Charity Navigator Record & Research about Teach For America Teach For America – Texas, Report to the Texas Education Agency Page 2 of 48 1. Executive Summary Vision, Mission & Our Theory of Change Teach For America works in partnership with communities to expand educational opportunity for children facing the challenges of poverty. Founded in 1990, Teach For America recruits and develops a diverse corps of outstanding college graduates and professionals to make an initial two-year commitment to teach in high-need schools and become lifelong leaders in the effort to end educational inequity.
    [Show full text]
  • Evaluation of New Leaders' Aspiring Principals Program, 2012-2017
    Preparing School Leaders for Success Evaluation of New Leaders’ Aspiring Principals Program, 2012–2017 Susan M. Gates, Matthew D. Baird, Christopher Joseph Doss, Laura S. Hamilton, Isaac M. Opper, Benjamin K. Master, Andrea Prado Tuma, Mirka Vuollo, Melanie A. Zaber C O R P O R A T I O N For more information on this publication, visit www.rand.org/t/RR2812 Library of Congress Cataloging-in-Publication Data is available for this publication. ISBN: 978-1-9774-0214-1 Published by the RAND Corporation, Santa Monica, Calif. © Copyright 2019 RAND Corporation R® is a registered trademark. Cover: GettyImages: DigitalVision/Jose Luis Pelaez Inc. Limited Print and Electronic Distribution Rights This document and trademark(s) contained herein are protected by law. This representation of RAND intellectual property is provided for noncommercial use only. Unauthorized posting of this publication online is prohibited. Permission is given to duplicate this document for personal use only, as long as it is unaltered and complete. Permission is required from RAND to reproduce, or reuse in another form, any of its research documents for commercial use. For information on reprint and linking permissions, please visit www.rand.org/pubs/permissions. The RAND Corporation is a research organization that develops solutions to public policy challenges to help make communities throughout the world safer and more secure, healthier and more prosperous. RAND is nonprofit, nonpartisan, and committed to the public interest. RAND’s publications do not necessarily reflect the opinions of its research clients and sponsors. Support RAND Make a tax-deductible charitable contribution at www.rand.org/giving/contribute www.rand.org Preface The mission of New Leaders is “to ensure high academic achievement for all children, especially students in poverty and students of color, by developing transformational school leaders and advancing the poli- cies and practices that allow great leaders to succeed” (New Leaders, undated-b).
    [Show full text]
  • Exponential Growth, Unexpected Challenges How Teach for America Grew in Scale and Impact
    FEBRUARY 2015 Exponential Growth, Unexpected Challenges How Teach For America Grew in Scale and Impact Sara Mead, Carolyn Chuong, and Caroline Goodson IDEAS | PEOPLE | RESULTS Table of Contents Executive Summary 3 Introduction 7 From the “Dark Years” to a Strong Organization: 1990–2000 14 Starting to Grow: 2000–2005 18 Growing Rapidly: 2005–2008 34 Growing Education Reform Movement Creates New Opportunities and Challenges: 2008–2011 55 Adapting to a New Landscape: 2011–Present 62 What Others Can Learn from Teach For America’s Experience 77 Conclusion 92 Endnotes 94 Acknowledgments 95 Executive Summary ver the past 15 years, Teach For America has grown nearly tenfold, from 1,260 corps members and 3,500 alumni in 2000 to 10,500 corps members and 37,000 Oalumni today. This type of growth is incredibly rare in education and in the nonprofit sector more broadly. As more proven “social entrepreneurial” organizations seek to grow to scale, they will face decisions similar to those that Teach For America has faced. Any organization’s growth strategy must reflect the nature of its work, the pool of talent it has access to, and the external political and community context in which it operates, so the choices that Teach For America has made may not be right for other organizations. And Teach For America has made mistakes. But in the process it has learned many lessons that can benefit other scaling organizations. Teach For America’s growth since 2000 has occurred in roughly four phases: • From 2000 to 2005, as Teach For America began to grow, it developed an approach that integrated growth strategy, programming, and development, and was rooted in its Theory of Change.
    [Show full text]
  • New Leaders Urban Excellence Framework | Introduction | Uef Structure and Key Insights
    NEW LEADERS URBAN EXCELLENCE FRAMEWORK | INTRODUCTION | UEF STRUCTURE AND KEY INSIGHTS Why we developed the UEF Categories A principal’s job, first and foremost, is to diagnose their The Urban Excellence Framework focuses on five categories of school’s needs and match them to effective principal actions school practices. Among them are two primary drivers of student and school practices that drive student success. Successful prin- achievement: rigorous, goal and data-driven learning and teaching cipals use their diagnosis to build an action plan that pushes and achievement and belief-based school-wide culture. Two addi- their school—and student achievement—to the next level. tional categories of a principal’s work are essential to supporting these drivers: building and managing a high-quality aligned staff ™ New Leaders developed the Urban Excellence Framework to to the school’s vision and instituting operations and systems to put understand exactly what schools achieving dramatic gains are the vision into place. Undergirding all of these categories is the doing and to share that knowledge throughout our community of personal leadership modeled by a principal who sets the tone for leaders. Armed with this knowledge and aligned system supports, all student and adult relationships and practices in the school. we have every confidence that schools led by New Leader Principals will see the transformative success necessary to drive significant Key Levers gains in student achievement and close the achievement gap. Each category is divided into
    [Show full text]
  • Education Leadership Consulting
    B8558: Education Leadership Spring 2019 Syllabus (Updated as of 11/16/18) Instructor: Class: Erin McMahon 3/26 (Tues) 2:15 – 5:30pm [email protected] 4/5 (Fri) 9:15am -12:30pm 4/12 (Fri) 9:15am -12:30pm 4/16 (Tues) 2:15 – 5:30pm Teaching Assistant: 4/23 (Tues) 2:15 – 5:30pm Katherine Bergstrom 4/30 (Tues) 2:15 – 5:30pm [email protected] Location: Uris Hall, Room TBD Office Hours: By appointment COURSE OVERVIEW Background Once a world leader in educational performance, the U.S. now faces a national crisis in education. As a whole, the U.S. public education system does not prepare students who are ready for college or competition in the global marketplace. In fact, students in the U.S. perform significantly less well academically than their peers from other industrialized nations: Of 35 OECD countries, the United States now scores 31st in math, 19th in science, and 20th in reading, as measured by the Program for International Student Assessment (PISA) in 2015. In addition, there is a persistent student achievement gap along income and ethnic lines. In order to maintain our position in the competitive world economy, our schools and systems of schools must improve dramatically. Over the last decade, a number of results-oriented leaders in states, districts, charter management organizations, and nonprofits have led the reform of U.S. public education. These leaders bring a sense of urgency and new strategies to address current challenges, but also, face significant resistance or political challenges. All hold lessons for how future leaders can contribute to solving one of the most important issues facing our nation: education.
    [Show full text]
  • Evaluation Rubric
    New Leaders is a national non-profit organization committed to developing transformational school leaders and advancing the policies and practices that allow great leaders to succeed. Over the past decade, we have trained over 800 school leaders who have made a difference in the lives of over 250,000 students. Based on our experience training leaders and carefully studying the things they do to get better results for students, we have expanded our work to share lessons learned and offer states and districts with tools and strategies to get more excellent leaders into schools and help all principals get better. In addition to this principal evaluation model, we are developing additional open-source tools for use by states and districts. Visit our website at www.newleaders.org for all of the resources currently available and enter your contact information at the bottom of the page to keep updated. We gratefully acknowledge the support of America Achieves in developing this model. America Achieves helps communities and states leverage policy, practice, and leadership to build high-quality educational systems and prepare each young person for success in careers, college, and citizenship. We also gratefully acknowledge the leaders of states and school systems with whom we have partnered on building better principal evaluation systems and whose work informs ours. They include districts in Los Angeles, New Orleans and Newark as well as the states of Connecticut, Indiana, Illinois, Louisiana, Minnesota, and Tennessee. © 2012 New Leaders, Inc. All rights not expressly granted by New Leaders, Inc. are hereby reserved. Non-profit organizations, state government education agencies, and local government education agencies (each, a “Licensee”) may reproduce, distribute, publicly display and perform, and create derivative works based upon this work for such Licensee’s own use in all media now known or hereafter developed.
    [Show full text]
  • New Leaders Principal Evaluation Handbook
    New Leaders Principal Evaluation Handbook New Leaders is a national non-profit organization committed to developing transformational school leaders and advancing the policies and practices that allow great leaders to succeed. Over the past decade, we have trained over 800 school leaders who have made a difference in the lives of over 250,000 students. Based on our experience training leaders and carefully studying the things they do to get better results for students, we have expanded our work to share lessons learned and offer states and districts with tools and strategies to get more excellent leaders into schools and help all principals get better. In addition to this principal evaluation model, we are developing additional open-source tools for use by states and districts. Visit our website at www.newleaders.org for all of the resources currently available and enter your contact information at the bottom of the page to keep updated. We gratefully acknowledge the support of America Achieves in developing this model. America Achieves helps communities and states leverage policy, practice, and leadership to build high-quality educational systems and prepare each young person for success in careers, college, and citizenship. We also gratefully acknowledge the leaders of states and school systems with whom we have partnered on building better principal evaluation systems and whose work informs ours. They include districts in Los Angeles, New Orleans and Newark as well as the states of Connecticut, Indiana, Illinois, Louisiana, Minnesota, and Tennessee. © 2012 New Leaders, Inc. All rights not expressly granted by New Leaders, Inc. are hereby reserved.
    [Show full text]
  • New Leaders (PDF)
    GROWING THE SEED: CULTIVATING GREAT TEACHER AND SCHOOL LEADERSHIP Growing the SEED: Cultivating Great Teacher and School Leadership ............................... 1 A. Significance ............................................................................................................................... 2 A1) National Significance ........................................................................................................... 2 A2) Advancement of School Leadership Theory, Knowledge and Practice ............................... 5 A3) Magnitude of Results ........................................................................................................... 7 B. Quality of Project Design and Services .................................................................................. 8 B1) Project Design, Goals, Objectives, and Outcomes ............................................................... 8 B2) A Comprehensive Effort .................................................................................................... 15 B3) Sufficient Quality, Intensity and Duration ......................................................................... 16 B4) Preparing Personnel for Shortages ..................................................................................... 19 B5) Focus on the Needs of Disadvantaged Students................................................................. 20 C. Quality of Management Plan and Personnel ....................................................................... 21 C1) Qualifications
    [Show full text]
  • Prioritizing Leadership: New Leaders' Federal Policy
    PRIORITIZING LEADERSHIP: NEW LEADERS’ FEDERAL POLICY PLATFORM ABOUT NEW LEADERS Founded in 2000 by a team of social entrepreneurs, New Leaders is a national nonprofit that develops transformational school leaders and designs effective leadership policies and practices for school systems across the country. Research shows—and our experience confirms—that strong school leaders have a pow- erful multiplier effect, dramatically improving the quality of teaching and raising student achievement in a school. New Leaders now operates in eight regions of the United States. We have developed over 1,000 leaders who are impacting the States and LEAs lives of 300,000 students. recognize the importance of principals in the successful THE IMPORTANCE OF LEADERSHIP implementation of new Principals are the leverage point for education reform. They reforms are the primary drivers of school improvement1 and, quite simply, are the best long-term investment to ensure effective teaching and learning at scale. “New Leaders is playing a key role School leaders are responsible for ensuring that students in the state’s ability to support receive high-quality instruction across classrooms, year after districts in the selection and hiring year. In this way, they yield an even greater influence on student learning than an individual teacher.2 In fact, princi- of highly effective school leaders. pals account for 25 percent of a school’s impact on student We strongly believe that hiring the achievement,3 not including effects related to their influence right school leader is a critical step over teacher effectiveness. in creating conditions that lead to improved student outcomes, As talent managers, principals that recruit great teachers, and we feel lucky to have New implement new teacher evaluation and support systems, and Leaders as a partner in this work.” develop and retain the best educators.
    [Show full text]