Evaluation of the Innovations in Community-Based Crime Reduction (CBCR) Program: Executive Summary and Final Report
Total Page:16
File Type:pdf, Size:1020Kb
The author(s) shown below used Federal funding provided by the U.S. Department of Justice to prepare the following resource: Document Title: Evaluation of the Innovations in Community-Based Crime Reduction (CBCR) Program: Executive Summary and Final Report Author(s): Natalie Kroovand Hipple, Ph.D., Jessica Saunders, Ph.D. Document Number: 254623 Date Received: April 2020 Award Number: 2016-BJ-BX-K069 This resource has not been published by the U.S. Department of Justice. This resource is being made publically available through the Office of Justice Programs’ National Criminal Justice Reference Service. Opinions or points of view expressed are those of the author(s) and do not necessarily reflect the official position or policies of the U.S. Department of Justice. Evaluation of the Innovations in Community-Based Crime Reduction (CBCR) Program* (formerly known as Byrne Criminal Justice Innovation [BCJI]) Executive Summary and Final Report Submitted to the National Institute of Justice Natalie Kroovand Hipple, PhD – PI Jessica Saunders, PhD – Co-PI February 2020 Indiana University Department of Criminal Justice rd 1033 E. 3 Street 302 Sycamore Hall Bloomington, IN 47401 This project was supported by Award No.2016-BJ-BX-K069 awarded by the National Institute of Justice, Office of Justice Programs, U.S. Department of Justice. The opinions, findings, and conclusions or recommendations expressed in this publication/program/exhibition are those of the author(s) and do not necessarily reflect those of the Department of Justice. This resource was prepared by the author(s) using Federal funds provided by the U.S. Department of Justice. Opinions or points of view expressed are those of the author(s) and do not necessarily reflect the official position or policies of the U.S. Department of Justice. TABLE OF CONTENTS Table of Contents .................................................................................................................................. i List of Tables ........................................................................................................................................ ii List of Figures ....................................................................................................................................... ii Acknowledgments: .............................................................................................................................. ii Purpose of the Project ......................................................................................................................... 1 Project Design and Methods ................................................................................................................ 2 Data Analysis and Project Findings ....................................................................................................... 6 Understanding Fidelity and Successful Implementation ........................................................................... 6 In-Depth Process and Evaluability Assessment ....................................................................................... 12 Implementation Science Framework for Cross-Site Evaluation ........................................................... 16 Implications for Criminal Justice Policy and Practice in the United States ........................................... 25 References ......................................................................................................................................... 27 i This resource was prepared by the author(s) using Federal funds provided by the U.S. Department of Justice. Opinions or points of view expressed are those of the author(s) and do not necessarily reflect the official position or policies of the U.S. Department of Justice. LIST OF TABLES Table 1. Data Collection Efforts. ........................................................................................................... 4 Table 2. Site and Program Characteristics. ............................................................................................ 4 Table 3. Measures of Training and Technical Assistance ....................................................................... 5 Table 4. Items Used to Assess Fidelity to Pillar Alignment. ................................................................... 6 Table 5. Items Used to Assess Implementation Success. ..................................................................... 11 Table 6. Pillar Fidelity Correlations with Measures of Implementation Success .................................. 11 Table 7. Mapping Strategies to Pillars ................................................................................................ 12 Table 8. Pillar Ratings ......................................................................................................................... 15 LIST OF FIGURES Figure 1. CBCR sites 2012-2016 ............................................................................................................. 2 Figure 2. Sample sites and award type ................................................................................................. 3 Figure 3. Pillar Alignment Across Sites, full sample ............................................................................... 9 Figure 4. Pillar Correlations, full sample ............................................................................................. 10 Figure 5. CBCR Logic Model ................................................................................................................ 17 Figure 6. Implementation Science Framework for a generic crime intervention .................................. 18 Figure 7. Process (detail) .................................................................................................................... 20 Figure 8. Outcomes (detail) ................................................................................................................ 21 APPENDIX A APPENDIX B ACKNOWLEDGMENTS We would like to thank Linda Truitt at the National Institute of Justice for her consistent support and expertise. We would also like to thank Alissa Huntoon, Marc Roscoe, Kathy Browning, and Laura Wyckoff at the Bureau of Justice Assistance. We appreciate your programmatic expertise and support for our project. We thank all the BCJI/CBCR sites that participated in our project. We are especially grateful to the sites that hosted our fieldwork. We thank Kayla Allison, our research assistant for the entirety of the project, and Jessica Peterson for helping us finish up. ii This resource was prepared by the author(s) using Federal funds provided by the U.S. Department of Justice. Opinions or points of view expressed are those of the author(s) and do not necessarily reflect the official position or policies of the U.S. Department of Justice. PURPOSE OF THE PROJECT The purpose of this project was to conduct a multimethod study to 1) understand successful implementation of the Innovations in Community Based Crime Reduction program (CBCR) (formerly known as the Byrne Criminal Justice Innovation) and to 2) provide guidance and identify sites for a possible follow-up impact evaluation. CBCR is a comprehensive strategy developed to help neighborhoods address crime and improve community safety. CBCR is place-based and built around four pillars that differentiate it from other similar data-driven, multi-agency, problem-solving collaborative programs in the Innovation Suite: (1) CBCR is data-driven, meaning that evidence-based programs that address the specific problems identified in the community through multiple data sources must be incorporated into the approach [Data and Research], (2) CBCR includes a strong community engagement component, where residents of the target area are given a voice in the process [Community Oriented], (3) the neighborhood revitalization component allows grantees to specifically incorporate neighborhood revitalization into their project goals with residents as key partners [Spurs Revitalization], and (4) all efforts must include a strong multi-agency partnership to build strong connections across government and non-government sectors [Builds Partnerships]. While CBCR is a Department of Justice (DOJ) initiative, this interagency effort aligns federal programs from the Departments of Education, Housing and Urban Development, Health and Human Services, and Treasury. In addition, collaborating with a research partner helps teams target crime hot spots while tailoring the initiative to their local context. The action research model used in CBCR supports data-driven problem solving, along with the implementation of evidence-informed or evidence-based solutions. 1 This resource was prepared by the author(s) using Federal funds provided by the U.S. Department of Justice. Opinions or points of view expressed are those of the author(s) and do not necessarily reflect the official position or policies of the U.S. Department of Justice. PROJECT DESIGN AND METHODS We employed a mixed methodology (Creswell & Creswell, 2018) in an effort to answer our research questions. Our sample included CBCR grant awards from the Bureau of Justice Assistance (BJA) in federal fiscal years (FY) 2012 through FY2016 (see Figure 1). There were 70 grantees which encompassed 60 sites (Figure 1). Figure 2 displays the sites in our sample and their award categorization. The majority of sites were Planning and Implementation sites, meaning that the site received a single award that included a planning period