Making Out-Of-School-Time Matter: Evidence for an Action Agenda
Total Page:16
File Type:pdf, Size:1020Kb
EDUCATION and RAND LABOR AND POPULATION CHILD POLICY This PDF document was made available CIVIL JUSTICE from www.rand.org as a public service of EDUCATION the RAND Corporation. ENERGY AND ENVIRONMENT HEALTH AND HEALTH CARE Jump down to document6 INTERNATIONAL AFFAIRS NATIONAL SECURITY The RAND Corporation is a nonprofit POPULATION AND AGING research organization providing PUBLIC SAFETY SCIENCE AND TECHNOLOGY objective analysis and effective SUBSTANCE ABUSE solutions that address the challenges TERRORISM AND facing the public and private sectors HOMELAND SECURITY TRANSPORTATION AND around the world. INFRASTRUCTURE Support RAND Purchase this document Browse Books & Publications Make a charitable contribution For More Information Visit RAND at www.rand.org Explore RAND Education RAND Labor and Population View document details Limited Electronic Distribution Rights This document and trademark(s) contained herein are protected by law as indicated in a notice appearing later in this work. This electronic representation of RAND intellectual property is provided for non- commercial use only. Permission is required from RAND to reproduce, or reuse in another form, any of our research documents. This product is part of the RAND Corporation monograph series. RAND monographs present major research findings that address the challenges facing the public and private sectors. All RAND mono- graphs undergo rigorous peer review to ensure high standards for research quality and objectivity. Making Out-of-School- Time Matter Evidence for an Action Agenda Susan Bodilly, Megan K. Beckett Prepared for The Wallace Foundation The research described in this report was conducted by RAND Education and RAND Labor and Population for The Wallace Foundation. Library of Congress Cataloging-in-Publication Data is available for this publication. ISBN: 0-8330-3734-X The RAND Corporation is a nonprofit research organization providing objective analysis and effective solutions that address the challenges facing the public and private sectors around the world. RAND’s publications do not necessarily reflect the opinions of its research clients and sponsors. R® is a registered trademark. © Copyright 2005 RAND Corporation All rights reserved. No part of this book may be reproduced in any form by any electronic or mechanical means (including photocopying, recording, or information storage and retrieval) without permission in writing from RAND. Published 2005 by the RAND Corporation 1776 Main Street, P.O. Box 2138, Santa Monica, CA 90407-2138 1200 South Hayes Street, Arlington, VA 22202-5050 201 North Craig Street, Suite 202, Pittsburgh, PA 15213-1516 RAND URL: http://www.rand.org/ To order RAND documents or to obtain additional information, contact Distribution Services: Telephone: (310) 451-7002; Fax: (310) 451-6915; Email: [email protected] Preface The need and desire for a supervised setting and activities for children and youth during nonschool hours that contribute positively to their progress toward productive adulthood has grown over the last several decades. Interest groups, including school-age child-care providers, youth-development experts, educators, criminal- and juvenile-justice experts, and poverty experts, have called for increasing public support for or improving the quality of out-of-school-time (OST) programs. Some improvement suggestions are modest (requests for expansion of child-care programming to more needy families); others are more am- bitious (that programs can and should aspire to improve academics, reduce crime, prevent unsafe behaviors, and/or improve social interac- tions). Stakeholders in this conversation offer varying pieces of evi- dence to support their cases. Seeking to engage the public in an informed dialogue over the needs for and the effectiveness of improving or spreading OST pro- gramming, the Wallace Foundation asked the RAND Corporation to conduct a broad-ranging literature review to identify, frame, and assess the relevant issues in the OST field. This report presents the findings of that review. We identified and addressed several major issues: the level of demand for OST ser- vices, the effectiveness of offerings, what constitutes quality in OST programs, how to encourage participation, and how to build further community capacity. The audience for the report is policymakers, providers, and users of services interested in improved formal programs for OST and pos- sible ways to expand provision. iii iv Making Out-of-School-Time Matter: Evidence for an Action Agenda The research was undertaken by staff in RAND Education and RAND Labor and Population as part of their mission to provide ob- jective policy analysis and effective solutions to address the challenges facing public and private sectors. The research sponsor, The Wallace Foundation, seeks to support and share effective ideas and practices that expand learning and en- richment opportunities for all people. Its three current objectives are to: strengthen education leadership to improve student achievement; improve out-of-school learning opportunities; and expand participa- tion in arts and culture. For more information and research on these and other related topics, please visit its Knowledge Center at www. wallacefoundation.org. Contents Preface ...................................................................iii Figures and Tables ........................................................ ix Summary ................................................................. xi Acknowledgments .......................................................xxi Abbreviations .......................................................... xxiii CHAPTER ONE Introduction ............................................................. 1 Research Purpose and Questions .......................................... 3 Methods and Caveats ..................................................... 5 Organization of Report ................................................... 8 CHAPTER TWO Historical Context ...................................................... 11 Early Phases of Development ............................................ 12 Through the 1920s .................................................... 12 From 1930 to 1950 ................................................... 14 From 1950 to 1970 ................................................... 15 From 1970 to 2000 ................................................... 16 Current Scene ......................................................... 19 Changing Actors and Roles ............................................ 22 The Debate ............................................................ 27 Implications ............................................................. 30 v vi Making Out-of-School-Time Matter: Evidence for an Action Agenda CHAPTER THREE Unmet Demand for Out-of-School-Time Services ...................... 31 Findings from Surveys or Polls ........................................... 32 Assumption-Based Estimates of Unmet Demand ........................ 34 Program-Level Enrollment Data ......................................... 35 Program-Level Attendance Data ......................................... 36 Implications ............................................................. 37 CHAPTER FOUR Potential Effectiveness OST Programs .................................. 41 Nature of the Existing Program-Evaluation Literature .................... 42 Measured Effects ...................................................... 43 Internal Validity, or Whether the Evaluations Measured and Isolated Program Effects ....................................... 44 Generalizability and External Validity ................................. 45 Findings in the Literature ................................................ 46 Findings from Existing Syntheses ...................................... 46 Evidence Concerning School-Age Care ................................ 47 Evidence Concerning Academic Achievement and Attainment ......... 48 Evidence Concerning Social Behavior ................................. 49 Evidence Concerning Social Interactions .............................. 50 Evidence by Grade Level .............................................. 50 Other Findings and Issues Raised ........................................ 51 Participation Effects ................................................... 52 Establishing Reasonable Expectations for Academic Achievement ...... 53 Paying Attention to Program Content and Implementation to Ensure Positive Impact .......................................... 54 Program Targeting ..................................................... 55 Needed Cost Information ............................................. 56 Implications ............................................................. 58 CHAPTER FIVE Assessment of Quality in OST Programs ............................... 61 Literature Sources ....................................................... 62 The School-Age-Care Literature ......................................... 63 Findings from Statistical Correlations ................................. 64 Contents vii Findings Based on Expert Opinion .................................... 65 RAND Synthesis ...................................................... 65 The Youth-Development Literature ..................................... 66 The Education Literature ................................................ 69 Effective Schools ...................................................... 70 Class Size ............................................................. 70 Evidence That