DOCSLIB.ORG

The Evaluation of Enhanced Academic Instruction in After-School Programs

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
The Evaluation of Enhanced Academic Instruction in After-School Programs NCEE 2008-4021 U. S. DEPARTMENT OF EDUCATION The Evaluation of Enhanced Academic Instruction in After-School Programs Findings After the First Year of Implementation The Evaluation of Enhanced Academic Instruction in After-School Programs Findings After the First Year of Implementation June 2008 Authors: Alison Rebeck Black Fred Doolittle Pei Zhu Rebecca Unterman MDRC Jean Baldwin Grossman Public/Private Ventures Project Officer: Elizabeth Warner Institute of Education Sciences NCEE 2008-4021 U.S. Department of Education U.S. Department of Education Margaret Spellings Secretary Institute of Education Sciences Grover Whitehurst Director National Center for Education Evaluation and Regional Assistance Phoebe Cottingham Commissioner June 2008 This report was prepared for the National Center for Education Evaluation and Regional Assistance, Institute of Education Sciences, under contract no. ED-01-CO-0060/0004 with MDRC. This report is in the public domain. Authorization to reproduce it in whole or in part is granted. While permission to reprint this publication is not necessary, the citation should read: Black, A. R., Doolittle, F., Zhu, P., Unterman, R., and Grossman, J. B. (2008). The Evaluation of Enhanced Academic Instruction in After-School Programs: Findings After the First Year of Implementation (NCEE 2008-4021). Washington, DC: National Center for Education Evaluation and Regional Assistance, Institute of Education Sciences, U.S. Department of Education. IES evaluation reports present objective information on the conditions of implementation and impacts of the programs being evaluated. IES evaluation reports do not include conclusions or recommendations or views with regard to actions policymakers or practitioners should take in light of the findings in the report. To order copies of this report, • Write to ED Pubs, Education Publications Center, U.S. Department of Education, P.O. Box 1398, Jessup, MD 20794-1398. • Call in your request toll free to 1-877-4ED-Pubs. If 877 service is not yet available in your area, call 800-872-5327 (800-USA-LEARN). Those who use a telecommunications device for the deaf (TDD) or a teletypewriter (TTY) should call 800-437-0833. • Fax your request to 301-470-1244 or order online at www.edpubs.org. This report is also available on the IES website at http://ncee.ed.gov. Alternate Formats Upon request, this report is available in alternate formats, such as Braille, large print, audiotape, or computer diskette. For more information, call the Alternate Format Center at 202-205-8113. Contents List of Exhibits ................................................................................................................................ v Acknowledgments......................................................................................................................... ix Disclosure of Potential Conflicts of Interest ........................................................................... x Executive Summary ..................................................................................................................... xi 1 Overview of the Study.......................................................................................................... 1 Origins of the Study ................................................................................................................... 1 The Theory of Action for the Intervention ................................................................................ 2 Key Research Questions ............................................................................................................ 3 The Selection of the Instructional Models................................................................................. 4 Overview of the Intervention ..................................................................................................... 4 Overview of the Regular After-School Services ..................................................................... 10 The Structure of the Report.................................................................................................. .... 11 2 Sample Selection, Study Design, and the Analytic Approach ................................ 13 Sample Selection ...................................................................................................................... 13 Study Design ............................................................................................................................ 17 Overview of the Analytic Approach........................................................................................ 20 Measures..................................................................................................................... .............. 20 Analytical Approaches ............................................................................................................ 29 3 The Implementation of Enhanced After-School Math Instruction and the Contrast with Regular After-School Services ...................................................... 33 The Math Analysis Sample..................................................................................................... 33 The Implementation of the Enhanced Math Instruction ......................................................... 40 The Difference in After-School Academic Services Received by the Enhanced Program Group and the Regular Program Group .............................................................. 50 4 The Impact of Enhanced After-School Math Instruction ....................................... 59 Program Impacts on Student Academic Achievements and Behaviors ................................. 59 Variation in Impacts ................................................................................................................. 65 Linking Impact on Total Math Scores with School Characteristics ....................................... 67 Conclusion ................................................................................................................................ 71 5 The Implementation of Enhanced After-School Reading Instruction and the Contrast with Regular After-School Services ...................................................... 73 The Reading Analysis Sample ................................................................................................. 73 The Implementation of the Enhanced Reading Instruction .................................................... 81 The Difference in After-School Academic Services Received by the Enhanced Program Group and the Regular Program Group .............................................................. 93 iii 6 The Impact of Enhanced After-School Reading Instruction................................ 103 Program Impacts on Student Academic Achievements and Behaviors ............................... 103 Variation in Impacts ............................................................................................................... 109 Linking Impact on Total Reading Scores with School Characteristics ............................... 111 Conclusion .............................................................................................................................. 113 Appendixes A Random Assignment and the Target Sample Sizes............................................................... 117 B Statistical Precision and Minimum Detectable Effect Size ................................................... 119 C Response Rates for Outcome Measures and the Creation of the Analysis Sample ............. 123 D Structured Protocol Observations .......................................................................................... 139 E Outcome Measures............................................................................................................. .... 155 F Estimating Effects and Assessing Robustness ...................................................................... 165 G Exploratory Analysis......................................................................................................... ..... 189 H Service Contrast Subgroups................................................................................................... 193 References .................................................................................................................................... 203 iv List of Exhibits Box 2.1 Description of the Calculation and Presentation of Outcome Levels ................................... 31 D.1 Math Instructional Elements: Guidelines for Assigning Points .......................................... 140 D.2 Reading Instructional Elements: Guidelines for Assigning Points..................................... 143 Table 2.1 Sites Selected to Implement Mathletics and Adventure Island ............................................. 15 2.2 Data Collected for the Evaluation .......................................................................................... 21 2.3 Key Outcome Measures for the Impact Analysis.................................................................. 28 3.1 Characteristics of Schools Housing After-School Centers Implementing Mathletics ............................................................................................................................... 34 3.2 Characteristics of the Regular School Day in Schools Housing After-School Centers Implementing Mathletics.................................................................... 35 3.3 Baseline Characteristics of Students
Load more

Recommended publications
  • Lei Lo¯Kahi I Ka Lanakila Unity Is Adorned in Victory 2 About OHA
    2016 Office Of Hawaiian affairs annUal repOrt Lei lo¯kahi i ka lanakila Unity is adorned in victory 2 About OHA Vision “Ho‘oulu Lāhui Aloha” - To Raise a Beloved Nation. OHA’s vision statement blends the thoughts and leadership of both King Kalākaua, and his sister, Queen Lili‘uokalani. Both faced tumultuous times as we do today, and met their challenges head on. “Ho‘oulu Lāhui” was King Kalākaua’s motto. “Aloha” expresses the high values of Queen Lili‘uokalani. Mission Statement To mālama (protect) Hawai‘i’s people and environmental resources Table of Contents Table and OHA’s assets, toward ensuring the perpetuation of the culture, the enhancement of lifestyle and the protection of entitlements of Native Hawaiians, while enabling the building of a strong and healthy Hawaiian people and nation, recognized nationally and internationally. Overview The Office of Hawaiian Affairs is a public agency with a high degree of autonomy. OHA is responsible for improving the well-being of Native Hawaiians. OHA is governed by a Board of Trustees made up of nine members who are elected statewide for four-year terms to set policy for the agency. OHA is administered by a Ka Pouhana (Chief Executive Officer) who is appointed by the Board of Trustees to oversee a staff of about 170 people. about OHa Our Focus 2 Our Hawaiian ancestors understood that the well-being of our community rested upon Message the inter-relationship of how we conduct ourselves, steward the islands we call home, and 3 fulfill the responsibility of caring for our families, all within the physical and spiritual executives realms.
    [Show full text]
  • Making Out-Of-School-Time Matter: Evidence for an Action Agenda
    EDUCATION and RAND LABOR AND POPULATION CHILD POLICY This PDF document was made available CIVIL JUSTICE from www.rand.org as a public service of EDUCATION the RAND Corporation. ENERGY AND ENVIRONMENT HEALTH AND HEALTH CARE Jump down to document6 INTERNATIONAL AFFAIRS NATIONAL SECURITY The RAND Corporation is a nonprofit POPULATION AND AGING research organization providing PUBLIC SAFETY SCIENCE AND TECHNOLOGY objective analysis and effective SUBSTANCE ABUSE solutions that address the challenges TERRORISM AND facing the public and private sectors HOMELAND SECURITY TRANSPORTATION AND around the world. INFRASTRUCTURE Support RAND Purchase this document Browse Books & Publications Make a charitable contribution For More Information Visit RAND at www.rand.org Explore RAND Education RAND Labor and Population View document details Limited Electronic Distribution Rights This document and trademark(s) contained herein are protected by law as indicated in a notice appearing later in this work. This electronic representation of RAND intellectual property is provided for non- commercial use only. Permission is required from RAND to reproduce, or reuse in another form, any of our research documents. This product is part of the RAND Corporation monograph series. RAND monographs present major research findings that address the challenges facing the public and private sectors. All RAND mono- graphs undergo rigorous peer review to ensure high standards for research quality and objectivity. Making Out-of-School- Time Matter Evidence for an Action Agenda Susan Bodilly, Megan K. Beckett Prepared for The Wallace Foundation The research described in this report was conducted by RAND Education and RAND Labor and Population for The Wallace Foundation. Library of Congress Cataloging-in-Publication Data is available for this publication.
    [Show full text]
  • Making the Match: Finding Funding for After School Education and Safety Programs
    Making the Match: Finding Funding for After School Education and Safety Programs AUGUST 2007 ASES Basics Making the Match: Finding Funding for After School Education and Safety Programs Kate Sandel, Cheryl Hayes, Brittany Anuszkiewicz, Carol Cohen and Sharon Deich AUGUST 2007 Contents Foreword 5 Finding Funding to Make the ASES Match 7 How to Make Your ASES Match About This Guide The ABCs of ASES 9 Purposes and Objectives Required Program Elements Operational Requirements Funding Priorities and Requirements Key Steps to Get Funding Using the Match to Expand and Enhance ASES Programs 17 Adopting a Strategic Financing Approach Assessing the Potential Value of Funding Sources and Financing Strategies Choosing Funding Sources and Financing Strategies Strategy 1: Accessing School and Community Resources 33 Who Are Potential School and Community Partners? What Types of Resources Do School and Community Partners Provide? How Should Donations Be Valued and Tracked? Tips for Accessing School and Community Resources Strategy 2: Accessing Business and Foundation Support 53 Who Are Potential Business Partners? Who Are Potential Foundation Partners? What Types of Resources Do Business and Foundation Partners Provide? Tips for Making Successful Connections with Businesses Tips for Successfully Accessing Foundation Funding Strategy 3: Accessing Local Government Resources 69 Who Are Potential Local Government Partners? Making the Case for Local Support What Types of Resources Do Local Government Partners Provide? Tips for Building Support Among Local
    [Show full text]
  • Children's Fall Programs
    Children’s Programs (continued) Trails and Tales Jr. For students in grades K-3 Mini Makerspace Exploration Wednesdays, September 22, October 20, 4:00 to 4:45 pm, Registration required. For students in grades K-3 Elmwood Park Wednesday, December 29, 2:00 to 4:00 pm, Purple Room Do you enjoy the parks around town? Are reading, doing crafts It’s Almost Halloween: A Costume Storytime Drop in anytime from 2:00 to 4:00 pm for some hands-on outside and learning about our parks, trails, and animals your For babies, toddlers, preschoolers & their caregivers activities to explore, create, build, tinker, and invent to stretch idea of fun? Grab your hiking boots and join us to explore Monday, October 18, 9:15 am or your imagination! Check out our new STEAM collection items. nature, local trails, and animals. In case of inclement weather, Wednesday, October 20, 1:30 or 6:30 pm, Auditorium No registration required. rain location will be in the Green Room. Permission slips are Wear your favorite costume and join us for a fun, non-spooky required and parents must remain onsite. storytime with songs and stories. Tween Book Clubs & Fall Programs Smart Art @ Home For ages 5-10 Registration required. Movin’ with Books & Music For ages 4-6 Saturdays, September 25 & November 6 Monday, November 22, 7:00 to 7:30 pm, Purple Room Show us your creativity with Smart Art @ Home. Explore the Join us for a fun-filled 30 minutes of stories, music, and lots of Tween Cooking Club history of famous artists and art techniques.
    [Show full text]
  • Cultural Production in Transnational Culture: an Analysis of Cultural Creators in the Korean Wave
    International Journal of Communication 15(2021), 1810–1835 1932–8036/20210005 Cultural Production in Transnational Culture: An Analysis of Cultural Creators in the Korean Wave DAL YONG JIN1 Simon Fraser University, Canada By employing cultural production approaches in conjunction with the global cultural economy, this article attempts to determine the primary characteristics of the rapid growth of local cultural industries and the global penetration of Korean cultural content. It documents major creators and their products that are received in many countries to identify who they are and what the major cultural products are. It also investigates power relations between cultural creators and the surrounding sociocultural and political milieu, discussing how cultural creators develop local popular culture toward the global cultural markets. I found that cultural creators emphasize the importance of cultural identity to appeal to global audiences as well as local audiences instead of emphasizing solely hybridization. Keywords: cultural production, Hallyu, cultural creators, transnational culture Since the early 2010s, the Korean Wave (Hallyu in Korean) has become globally popular, and media scholars (Han, 2017; T. J. Yoon & Kang, 2017) have paid attention to the recent growth of Hallyu in many parts of the world. Although the influence of Western culture has continued in the Korean cultural market as well as elsewhere, local cultural industries have expanded the exportation of their popular culture to several regions in both the Global South and the Global North. Social media have especially played a major role in disseminating Korean culture (Huang, 2017; Jin & Yoon, 2016), and Korean popular culture is arguably reaching almost every corner of the world.
    [Show full text]
  • Boston, Massachusetts 02115
    If you have issues viewing or accessing this file contact us at NCJRS.gov. U.S. Department of Justice Office of Justice Programs National Institute of Justice Preventing Interpersonal Violence Among Youth An Introduction to School, Community, and Mass Media Strategies 150484 U.S. Department of Justice National Institute of Justice ~ This document has been reproduced exactly as received from the person or organization originating it. Points of view or opinions stated in CO this document are those of the authors and do not necessarily represent the official position or policies of the National Institute of Justice. Permission to reproduce this .n'lFtl material has been ~ granted by Pl ill] i c ]"bma j n/O.TP/NIJ o U.S. IBpartment of Justice to the National Criminal Justice Reference Service (NCJRS). l!) Further reproduction outside of the NCJRS system requires permission of the _owner. About the National Institute of Justice The National Institute of Justice (NIJ), a component of the The research and development program that resulted in Office ofJustice Programs, is the research and development the creation of police body armor that has meant the agency of the U.S. Department of Justice. NIJ was estab­ difference between life and death to hundreds of police lished to prevent and reduce crime and to improve the officers. criminal justice system. Specific mandates established by Congress in the Omnibus Crime Control and Safe Streets Pioneering scientific advances such as the research and Act of 1968, as amended, and the Anti-Drug Abuse Act of development of DNA analysis to positively identify 1988 direct the National Institute of Justice to: suspects and eliminate the innocent from suspicion.
    [Show full text]
  • North Haverhill Fair Sets Attendance Records
    A1 CLOSE TO HOME A Tale Of Two Summers THURSDAY, AUG. 5, 2021 Page 15 Cyan Magenta Yellow Yellow Black Big Turnout. North Haverhill Fair Sets Attendance Records. Page 4 A2 2 The Record Thursday, August 5, 2021 News Briefs Haverhill School Board Cooperative School District will open the school partment of Transportation emergency order cinated (and eligible) students bringing the del- year on Aug. 30 without a mask mandate. already requires masks on school buses, and ta variant to school with unvaccinated students Stands By No Mask However, if COVID case numbers rise dra- indoor transmission rates remain high. bringing measles to school. Decision matically, the school board could be forced to “I don’t think we should take a risk,” he said. “I agree that the parents know what’s best for revisit its decision as soon as its next meeting Regardless of the criteria, School Board their children. But when their decisions impact HAVERHILL — The Haverhill Cooperative on Sept. 13. Chairman Richard Guy (who abstained from the others at school, it’s a different story,” he School Board on Monday stuck by its decision The highly contagious delta variant, which Monday’s vote) said the Haverhill Cooperative said. to open the 2021-2022 school year without a the Centers for Disease Control has called “as School District needed to have a plan in place. The district will conduct a parent survey be- mask mandate. contagious as chickenpox,” has already been de- He called for a plan with clear guidelines on fore deciding if and when to hold a vaccination By a 3-1 vote, they rejected a proposal by tected in the Upper Valley, noted SAU 23 Super- when mask use would be triggered.
    [Show full text]
  • December 2016
    Hoofbeat J.W. Mitchell High School’s Student Newspaper Volume 15 Issue 3 Jazz Ensemble Showcase Jazz band takes the stage to showcase their skills. Photo by Samantha Burchick (Page 4) 2 HB News The fute section perform “Send my love” The funk band performs “Brick House,” in their small groups, arranged by Jordan arranged by Parker Marchant. Bunker. Photo by Sam Burchick Photo by Sam Burchick Banding together in holiday celebration The annual Prism concert performed by the JWMHS Band, Colorguard, and Chorus shows off the hard work accomplished all year Sam Burchick Reporter Every December the band, that are continuously playing. only choose the music and at Mitchell is so exciting, I feel this event is supported by not chorus, and color guard put The music literally doesn’t stop. rehearse the full group band that I’m a part of something only the band and band family, on a show titled Prism, where As soon as one act is fnished, performances. There’s also really impressive, and I’m but those who have nothing to they showcases their talents to another starts to play,” Noemi not only Christmas music and so proud of my fellow band do with band. It’s something for fellow students. Prism started Rivera (’17) said. instrument performances; some members for making these everyone to enjoy,” Russell Kahn out as a one day production, One way this concert is made students sing, there are dancing programs the best they can be,” (’17) said. but due to the extreme turn special is that it gives the band and color guard performances, Walkup said.
    [Show full text]
  • Volume 15, See ED 401 AVAILABLE from School Age NOTES, PO
    DOCUMENT RESUME ED 423 952 PS 026 092 AUTHOR Scofield, Richard T., Ed. TITLE School-Age NOTES. 1997. ISSN ISSN-0278-3126 PUB DATE 1997-00-00 NOTE 98p.; For volume 14, see ED 382 331; volume 15, see ED 401 998, volume 16, see ED 402 083. AVAILABLE FROM School Age NOTES, P.O. Box 40205, Nashville, TN 37204; phone: 615-242-8464; fax: 615-242-8260 (1-year, 12-issue subscription, $24.95). PUB TYPE Collected Works Serials (022) JOURNAL CIT School-Age NOTES; v17 n1-12 EDRS PRICE MF01/PC04 Plus Postage. DESCRIPTORS *After School Education; *After School Programs; Computer Uses in Education; *Conflict Resolution; Elementary Education; *Elementary School Students; Enrichment; Interfaith Relations; Motivation Techniques; Newsletters; Noise (Sound); Professional Development; *School Age Day Care IDENTIFIERS Pennsylvania (Philadelphia); Philadelphia School District PA ABSTRACT These 12 newsletter issues offer support and information for providers of child care for school-age children. The featured articles for each month are: (1) "ASCAP [American Society of Composers, Authors, and Publishers] Retreats on Camp Song Use";(2) "Walking the Talk: Modeling Conflict Resolution Behaviors"; (3) "10 Staff Motivation Tips"; (4) "Anxious Moments, Friendships and Developmental Needs"; (5) "Interfaith Efforts in Philadelphia Lead to 'SAM'[School-Age Ministry] Program"; (6) "Computer Room Observations: Seeing the Whole Picture"; (7) "Reflections on Our Profession"; (8) "Academic Enrichment Programs: Coming Soon to Your Town!"; (9) "Have We Really Seen the Light?"; (10)"The Noise Factor--A Place for Everything"; (11) "Grace Mitchell's Reflections"; and (12)"Get Jump on $50 Million for After School Learning Centers." (SD) ******************************************************************************** Reproductions supplied by EDRS are the best that can be made from the original document.
    [Show full text]
  • Analysis of Afterschool Tutoring Programs in Northwest Ohio: A
    A FRAMEWORK FOR TUTORING SERVICES Authors Ryan D. Butt, J.D., M.S.A. Dean, College of Business and Leadership, Lourdes University Chairperson, Department of Business and Leadership Associate Professor, College of Business and Leadership Regular Graduate Faculty B.A., M.S.A. University of Notre Dame J.D. Valparaiso University Joyce Litten, Ed.D., L.I.S.W.-S. Associate Professor, Social Work B.A., University of Akron M.S.S.A., Mandel School of Applied Social Science, Case Western Reserve University E.d.D., Bowling Green State University Patrice McClellan, Ed.D. Director, Masters of Organizational Leadership Associate Professor, College of Business and Leadership B.S., The University of Toledo M.O.D., Ed.D., Bowling Green State University Walter Ryley, MAEcon Instructor, College of Business and Leadership B.Sc., MAEcon., Bowling Green State University Kara Thomas Graduate Assistant, College of Business and Leadership M.B.A. Candidate, Lourdes University B.S., Lourdes University Special Thanks To Information Technology Review: Scott Crow, Chief Information Officer, Lourdes University Cover Design: Carla Woodell, Graphic Designer, Lourdes University A FRAMEWORK FOR TUTORING SERVICES i Table of Contents Acknowledgments ..................................................................................................................................... 1 Scope of the Project .................................................................................................................................. 2 Introduction ..............................................................................................................................................
    [Show full text]
  • Miranda & Melanie Wilking
    9 Time GM “Mark of Excellence” Award Winner Family Owned & Operated Since 1956 www.wcskids.net/wcspa Presenting the WCSPA’s 2014-2015 Season BUSINESS AD DIRECTORY BUSINESS PAGE # BUSINESS PAGE # You Can’t Take It With You • November 21 & 22, 2014 Alexander A. Dutko DDS, PC ...................................51 My Suburban Gardener ............................................56 You Can’t Take it With You introduces audiences to the freethinking Sycamore family and the mayhem An Affair to Remember ............................................56 National Coney Island ..............................................14 that ensues when their daughter Alice’s fiancé (Tony Kirby) brings his conservative, straight-laced Angus Elementary PTO ............................................83 Nu New York Deli .....................................................24 parents to dinner on the wrong night. This hilarious comedy written by Moss Hart and George S. Birmingham Jewelry ..................................................8 Oakland University Music, Theatre & Dance .............34 Kaufman is timelessly told through these quirky characters of the Sycamore family, who remain full Campbell’s Farm Market ..........................................55 Octavia Hair Design .................................................14 of a sincere zest for life; as they are contrasted by the Kirby family’s world driven by strict schedules Century Banquet Center ...........................................13 Orange Leaf .............................................................20
    [Show full text]
  • HERE`S a LITTLE STORY THAT MUST BE TOLD Microphone Grandmistresses, Lady Def Jams, Battle Queens, Mixmistresses, Fly Emcees, Spinderellas from the Late 70S to 1990
    JEE-NICE PRESENTS: HERE`S A LITTLE STORY THAT MUST BE TOLD Microphone Grandmistresses, Lady Def Jams, Battle Queens, Mixmistresses, Fly Emcees, Spinderellas from the late 70s to 1990. Enjoy & spread the word! This Booklet is dedicated to all the ladies who rock da mike and spin the turntables. This copied fan-mag tries to discover the story of female hiphop activity from the beginning of hiphop culture in the late 70s to 1990. There is a cut in 1990. It was difficult to draw that line, to decide which artists to include and which not. Yo Yo, Queen Mother Rage, Sister Souljah, BWP, Conscious Daughters are not in it because they are more 90s then 80s. Nikki D, Tairrie B. and L.A. Star are on the edge, but I included them, because they are more 80s. What I did was to collect all the lyrics and pictures, which I could find and republish facts which are important for making history. I didn’t want to write anything new, I wanted to collect, to see what you can find out (in Germany), if you want to. In the end it’s not much and nothing that was published in the german language. You will find the source material in an appendix, so that you can check out where it comes from and read more, if you want to. Pictures without numbers are from my own record collection. This compilation can’t be complete and some facts will be wrong, but I have tried to make it as accurate as I can.
    [Show full text]