A Process and Impact Evaluation of the Agricultural Crime, Technology, Information, and Operations Network (ACTION) Program
Total Page:16
File Type:pdf, Size:1020Kb
The author(s) shown below used Federal funds provided by the U.S. Department of Justice and prepared the following final report: Document Title: A Process and Impact Evaluation of the Agricultural Crime, Technology, Information, and Operations Network (ACTION) Program Author(s): Daniel P. Mears; Michelle L. Scott; Avinash S. Bhati; John Roman; Aaron Chalfin; Jesse Jannetta Document No.: 217906 Date Received: March 2007 Award Number: 2003-DD-BX-1017 This report has not been published by the U.S. Department of Justice. To provide better customer service, NCJRS has made this Federally- funded grant final report available electronically in addition to traditional paper copies. Opinions or points of view expressed are those of the author(s) and do not necessarily reflect the official position or policies of the U.S. Department of Justice. AGRICULTURAL CRIME URBAN INSTITUTE A Process and Impact Evaluation of the Agricultural Crime, Technology, Information, and Operations Network (ACTION) Program by Daniel P. Mears, Florida State University Michelle L. Scott, The Urban Institute Avinash S. Bhati, The Urban Institute with John Roman, The Urban Institute Aaron Chalfin, The Urban Institute Jesse Jannetta, Center for Evidence-Based Corrections National Institute of Research Grant #2003-DD-BX-1017 Abstract Research Goals and Objectives Agricultural crime is a serious problem in the United States, with significant financial consequences for farmers, insurers, and consumers—some sources estimate that agricultural crime results in $5 billion in economic losses annually. Yet few prevention or reduction interventions have been developed, and fewer still have been evaluated. As a result, policy makers and practitioners lack critical information about how to deal with this costly problem. The Urban Institute and Florida State University multi-disciplinary research team employed a multi-method approach to evaluate one promising initiative, the Agricultural Crime, Technology, Information, and Operations Network (ACTION) project, located along the southern coast and Central Valley of California and supported by the Bureau of Justice Assistance. The goal of the proposed research was to provide policymakers, practitioners, program developers, and funders with empirically-based information about whether ACTION works. The specific objectives were: • To assess the effectiveness of the ACTION project in reducing agricultural crime; • To provide a cost-benefit analysis of ACTION; and • To identify how programs like ACTION can be effectively adopted by other jurisdictions. 1 This document is a research report submitted to the U.S. Department of Justice. This report has not been published by the Department. Opinions or points of view expressed are those of the author(s) and do not necessarily reflect the official position or policies of the U.S. Department of Justice. AGRICULTURAL CRIME URBAN INSTITUTE Research Design and Methodology The study involved: collection of Agricultural Census and Census Bureau data; collection and analysis of two victimization surveys, administered one year apart from one another to farmers; and interviews with ACTION staff, and law enforcement and agriculture officials in the intervention site and other states. The impact evaluation entailed a diverse set of analyses, including assessment of the causal logic of ACTION, extent to which the “dose” of ACTION (i.e., the level of implementation in various areas and counties) influenced victimization outcomes, and a range of measures that collectively could be used to provide a balanced assessment of impact. In general, the results suggest that ACTION may have changed law enforcement and farmer behaviors, as well as reduced victimization, increased prosecution, and increased recovery of stolen property. Spatial mapping analyses indicated the need for more complete geographic information on agricultural crime incidents and highlighted the potential for such analyses to inform crime prevention efforts. Cost-benefit analysis is an empirical technique used to systematically compare the economic efficiency of two or more policies or programs. In a separate, stand-alone report, the research team created a report describing the CBA methodology as a means of evaluating the effectiveness of crime prevention programs, with a specific focus on ACTION. The report describes the key steps in formulating a CBA design, discusses the trade-offs implicit in specific design decisions, and then concludes by applying the principles of CBA to assess ACTION. Interview data were examined to identify lessons about how to improve ACTION and features of ACTION that could be feasibly adopted and sustained by other jurisdictions. The results suggest that ACTION could easily be adopted in many other places, but that successful implementation requires sustained attention to forging and maintaining collaborative relationships across a range of law enforcement and justice system agencies. 2 This document is a research report submitted to the U.S. Department of Justice. This report has not been published by the Department. Opinions or points of view expressed are those of the author(s) and do not necessarily reflect the official position or policies of the U.S. Department of Justice. FINAL REPORT A Process and Impact Evaluation of the January 2007 Agricultural Crime, Technology, Information, and Operations Network (ACTION) Program Daniel P. Mears, Florida State University Michelle L. Scott, The Urban Institute Avinash S. Bhati, The Urban Institute with John Roman, The Urban Institute Aaron Chalfin, The Urban Institute Jesse Jannetta, Center for Evidence-Based Corrections URBAN INSTITUTE Justice Policy Center Florida State University research for safer communities College of Criminology This document is a research report submitted to the U.S. Department of Justice. This report has not been published by the Department. Opinions or points of view expressed are those of the author(s) and Criminal Justice and do not necessarily reflect the official position or policies of the U.S. Department of Justice. AGRICULTURAL CRIME URBAN INSTITUTE Acknowledgements The authors thank our colleagues, especially Shelli Rossman, Nancy La Vigne, and Janine Zweig, and the staff at ACTION, especially Bill Yoshimoto and Mary Beth Hash, for their considerable support and assistance. Lou Barrett, Claudia Canales, Josh Rowlett, David Singleton, and Patrick Warner, all current or past members of the ACTION team, were extremely helpful throughout the study and uniformly accommodated our many requests for assistance. Ed Zedlewski and Maggie Heisler, with the National Institute of Justice, provided guidance and insights that greatly improved the project’s design and execution, and Sandy Woerle helped guide us through the final stages of the project. Joe Donnermeyer offered many helpful ideas for improving the research design. We give special thanks to the many farmers who participated in the study, without whom there would not have been anything to report. John Roman and Aaron Chalfin were primarily responsible for the cost-benefit analysis discussions, which are detailed in a separate report. (Chalfin, Aaron, John Roman, Daniel P. Mears, and Michelle L. Scott. 2007. The Costs and Benefits of Agricultural Crime Prevention. Washington, D.C.: The Urban Institute.) John Kempf, at Allied Insurance, provided many insights about ACTION and agricultural crime. Jesse Jannetta, who worked on this project while at the Urban Institute, conducted, analyzed, and summarized interviews for the transferability analyses and discussion. Elisa Ranck, formerly of the Urban Institute, assisted with the transferability analyses. Some of the findings in this report have been presented in a number of settings and meetings, including: • Mears, Daniel P., and Michelle L. Scott. 2006. “Results from an Impact Evaluation of an Agricultural Crime Prevention Initiative.” American Society of Criminology Annual Meeting, Los Angeles, CA. • Chalfin, Aaron, and John Roman. 2006. “The Crowding Out Effect: Does Government Provision of Crime Prevention Reduce Crime?” College Park, MD: University of Maryland. • Mears, Daniel P., and Michelle L. Scott. 2005. “Opportunity Theory and Agricultural Crime Victimization.” American Society of Criminology Annual Meeting, Toronto, Canada. • Scott, Michelle L., and Daniel P. Mears. 2005. “Applying Spatial Analysis to Survey Research of California Farmers.” Annual Meeting of the Rural Sociological Society, Tampa, FL. • Scott, Michelle L., and Daniel P. Mears. 2005. “Agricultural Crime: It’s More than Cow- Tipping.” The Urban Institute, Washington, D.C. • Scott, Michelle L., and Daniel P. Mears. 2005. “Understanding and Reducing Survey Nonresponse Rates among Rural Farming Populations through Spatial Analysis.” National Institute of Justice Annual Crime Mapping Research Conference, Savannah, GA. • Mears, Daniel P. 2004. “Reliability and Validity Issues in Evaluation Research.” National Institute of Justice Evaluation Cluster Conference, Arlington, VA. • Scott, Michelle L., and Daniel P. Mears. 2004. “Where’s the Beef? Agricultural Crime Victimization and What Can Be Done About It.” Annual Meeting of the Rural Sociological Society, Sacramento, CA. This project was supported by Grant No. 2003-DD-BX-1017, awarded by the National Institute of Justice, Office of Justice Programs, U.S. Department of Justice. Points of view in this report are those of the authors and do not necessarily represent the official position or policies of the U.S. Department