Evaluation of Adolescent Pregnancy Prevention Approaches (PPA) Is a Response to Persistent Concerns About the Consequences of Teen Sexual Activity
Total Page:16
File Type:pdf, Size:1020Kb
Contract Number: Evaluation of Adolescent Pregnancy HHSP23320082911YC Prevention Approaches: Design of the Mathematica Reference Number: Impact Study 06549.070 Final Report Submitted to: Office of Adolescent Health Division of Policy, Planning & October 2012 Communication Department of Health & Human Services Primary Authors: 1101 Wootton Parkway, Suite 700 Kimberly Smith, Mathematica Rockville, MD 20852 Silvie Colman, Mathematica Project Officer: Amy Farb With Support From: Submitted by: Mathematica Policy Research Mathematica: P.O. Box 2393 Christopher Trenholm Princeton, NJ 08543-2393 Telephone: (609) 799-3535 Alan Hershey Facsimile: (609) 799-0005 Brian Goesling Project Director: Alan Hershey Anastasia Erbe Caitlin Davis Brice Overcash Child Trends: Kristine Andrews Amanda Berger Lori Ann Delale-OConnor Mindy Scott THIS PAGE IS INTENTIONALLY BLANK CONTENTS I OVERVIEW OF THE IMPACT EVALUATION ........................................................ 1 A. Background and Goals for the Evaluation .................................................. 1 B. Selection and Description of the Evaluation Sites ....................................... 4 1. Selection of Sites ............................................................................... 5 2. Key Features of Program Models ....................................................... 7 C. Overview of Impact Study Designs ........................................................... 9 1. Research Questions and Key Outcomes ............................................. 9 2. Study Samples ................................................................................. 10 3. Data Collection and Timeline ........................................................... 12 D. Analytic Approach and Reporting ........................................................... 13 1. Baseline Analysis ............................................................................. 13 2. Primary Impact Analysis .................................................................. 14 3. Analysis of Secondary Research Questions ...................................... 15 4. Reporting ........................................................................................ 16 AIM 4 TEEN MOMS II EVALUATION OF .............................................................. 17 A. Program Features and Evaluation Setting ............................................... 17 B. Evaluation Design .................................................................................. 19 GENDER MATTERS III EVALUATION OF .............................................................. 25 A. Program Features and Evaluation Setting ............................................... 25 B. Evaluation Design .................................................................................. 27 HEALTHTEACHER IV EVALUATION OF ENHANCED ............................................. 33 A. Program Features and Evaluation Setting ............................................... 33 B. Evaluation Design .................................................................................. 36 POWER THROUGH CHOICES 2010 V EVALUATION OF ....................................... 41 A. Program Features and Evaluation Setting ............................................... 41 B. Evaluation Design .................................................................................. 43 iii PPA Evaluation Design Report Mathematica Policy Research T.O.P.P. VI EVALUATION OF ............................................................................. 51 A. Program Features and Evaluation Setting ............................................... 51 B. Evaluation Design .................................................................................. 53 TEEN PEP VII EVALUATION OF ........................................................................... 59 A. Program Features and Evaluation Setting ............................................... 59 B. Evaluation Design .................................................................................. 62 WAIT TRAINING VIII EVALUATION OF .................................................................. 69 A. Program Features and Evaluation Setting ............................................... 69 B. Evaluation Design .................................................................................. 72 REFERENCES ............................................................................................................... 77 APPENDIX A: PPA PROGRAM IMPLEMENTATION AND DATA COLLECTION SCHEDULE ......................................................................................A.1 iv TABLES I.1 Key Features of Programs Evaluated, by Site .................................................. 8 I.2 Random Assignment Approach and Target Sample Size, by Program Site .............................................................................................................. 11 I.3 Data Collection Waves, Timing, and Mode, by Program Site.......................... 12 II.1 Summary of Contrast Between the Treatment and Control (AIM 4 Teen Moms) Conditions ..................................................................... 20 (AIM 4 Teen II.2 Planned Outcomes for Measuring Program Impacts Moms) ......................................................................................................... 22 (AIM 4 Teen II.3 Minimum Detectable Impacts for Illustrative Outcomes Moms) ......................................................................................................... 23 III.1 Summary of Contrast Between the Treatment and Control (GEN.M) Conditions ...................................................................................... 27 (GEN.M) III.2 Planned Outcomes for Measuring Program Impacts ......................... 30 (GEN.M) III.3 Minimum Detectable Impactsfor Illustrative Outcomes .................... 31 IV.1 Summary of Contrast Between the Treatment and Control (HealthTeacher) Conditions ......................................................................... 36 (HealthTeacher) IV.2 Planned Outcomes for Measuring Program Impacts ............ 38 IV.3 Minimum Detectable Impactsfor Illustrative Outcomes (HealthTeacher) ........................................................................................... 39 V.1 Summary of Contrast Between the Treatment and Control (PTC 2010) Conditions ................................................................................. 44 (PTC 2010) V.2 Planned Outcomes for Measuring Program Impacts ................... 46 (PTC 2010) V.3 Minimum Detectable Impactsfor Illustrative Outcomes ............... 48 VI.1 Summary of Contrast Between the Treatment and Control (T.O.P.P.) Conditions .................................................................................... 54 (T.O.P.P.) VI.2 Planned Outcomes for Measuring Program Impacts ...................... 57 (T.O.P.P.) VI.3 Minimum Detectable Impactsfor Illustrative Outcomes .................. 58 VII.1 Summary of Contrast Between the Treatment and Control (Teen PEP) Conditions .................................................................................. 63 (Teen PEP) VII.2 Planned Outcomes for Measuring Program Impacts ..................... 66 v PPA Evaluation Design Report Mathematica Policy Research (Teen PEP) VII.3 Minimum Detectable Impactsfor Illustrative Outcomes ................ 67 VIII.1 Summary of Contrast Between the Treatment and Control (WAIT Training) Conditions .......................................................................... 72 (WAIT Training) VIII.2 Planned Outcomes for Measuring Program Impacts ............ 74 (WAIT VIII.3 Minimum Detectable Impactsfor Illustrative Outcomes Training) ..................................................................................................... 76 vi FIGURES I.1 Conceptual Framework Guiding the PPA Evaluation ........................................ 4 II.1 Logic Model of the AIM 4 Teen Moms Intervention ....................................... 18 II.2 Timeline for the Evaluation of AIM 4 Teen Moms.......................................... 24 GEN.M III.1 Logic Model of the Intervention......................................................... 26 III.2 Timeline for the Evaluation of GEN.M ........................................................... 32 IV.1 Logic Model of the HealthTeacher Intervention ............................................ 34 HealthTeacher IV.2 Timeline for the Evaluation of ............................................... 40 POWER Through Choices 2010 V.1 Logic Model for ............................................ 42 PTC 2010 V.2 Timeline for the Evaluation of ...................................................... 49 T.O.P.P. VI.1 Logic Model of the Intervention ...................................................... 52 T.O.P.P. VI.2 Timeline for the Evaluation of ......................................................... 58 Teen PEP VII.1 Logic Model of the Intervention ..................................................... 60 TEEN PEPa VII.2 Timeline for the Evaluation of ...................................................... 68 WAIT Training VIII.1 Logic Model of the Intervention ............................................ 70 WAIT Training VIII.2 Timeline for the Evaluation of ............................................... 76 A.1 PPA Program Implementation and Data Collection Schedule ........................A.3 vii THIS PAGE IS INTENTIONALLY BLANK I. OVERVIEW OF THE IMPACT EVALUATION Adolescent sexual activity and its consequences