Monitoring and Evaluating Adolescent Reproductive Health Programs
Total Page:16
File Type:pdf, Size:1020Kb
A Guide to Monitoring and Evaluating Adolescent Reproductive Health Programs Susan Adamchak Katherine Bond Laurel MacLaren Robert Magnani Kristin Nelson Judith Seltzer FOCUS on Young Adults Tool Series 5, June 2000 A Guide to Monitoring and Evaluating Adolescent Reproductive Health Programs © FOCUS on Young Adults, 2000 Any part of this publication may be copied, reproduced, distributed, or adapted without permission from the author or publisher, provided the recipient of the materials does not copy, reproduce, distribute, or adapt material for commercial gain and provided that the author and FOCUS on Young Adults are credited as the source on all copies, reproductions, distributions, and adaptations of the material. The FOCUS on Young Adults program promotes the well-being and reproductive health of young people. FOCUS is a program of Pathfinder International in partnership with The Futures Group International and Tulane University School of Public Health and Tropical Medicine. FOCUS is funded by USAID, Cooperative Agreement # CCP-A-00-96-90002-00. The opinions expressed herein are those of the authors and do not necessarily reflect the views of the U.S. Agency for International Development. Please send suggestions or comments to: FOCUS on Young Adults Attn: Communications Advisor 1201 Connecticut Avenue, NW, Suite 501 Washington, DC 20036, USA Tel: 202-835-0818 Fax: 202-835-0282 Email: [email protected] 2 Acknowledgements he authors are indebted to Hollerbach (Academy for Educational the many people who con- Development), Marge Horn (USAID), Merita tributed to the development Irby (International Youth Foundation), Lily and review of this Guide. Kak (CEDPA), Rebecka Lundgren T (Georgetown Institute for Reproductive We wish to acknowledge the dedicated Health), Matilde Maddaleno (Pan American efforts made by several graduate research Health Organization), Leo Morris (Centers assistants working with FOCUS on Young for Disease Control), Lisa Mueller (John Adults at the Tulane University School of Snow International), Ian Tweedie (Johns Public Health and Tropical Medicine, Hopkins University Center for Department of International Health and Communications Programs), Stephanie Development. Stephanie Mullen began the Mullen (Tulane University), Phyllis detailed project of compiling program indi- Scattergood (Education Development cators. Gwendolyn Morgan prepared the Center, Inc.), Annetta Seecharan appendices listing recommended refer- (International Youth Foundation), Linda ences and Internet Web sites, and provided Sussman (USAID), Katherine Weaver (Pan formulae for the Indicator Tables. Emily American Health Organization), Ellen Weiss Zielinski assisted with the Indicator Tables (Population Council/Horizons) and Anne and appendices. Wilson (PATH). Our FOCUS colleagues, Sharon Epstein, Those who provided critical comments and Lindsay Stewart, Barbara Seligman and Lisa feedback during the field review of this Weiss, read early versions of this Guide and Guide include Jane Bertrand (Tulane offered helpful suggestions. Their com- University), Carlos Brambila (Population ments reminded us to keep in the forefront Council, Mexico), Eunyong Chung (USAID), of our efforts the many program staff we Charlotte Colvin (The Futures Group hope will find this volume useful. International), Shanti Conly (USAID), Barbara deZalduondo (USAID), Joyce The authors would like to express their Djaelani (PATH Indonesia), Maricela Dura appreciation to FOCUS staff member (Fundaci—n Mexicana para la Planeaci•n Christine Stevens for her critical review and Familiar), Natalia Espinoza (CEMOPLAF recommendations for reorganizing several Ecuador), Julie Forder (CARE Cambodia), chapters of the Guide. We would also like Phyllis Gestrin (USAID), Evam Kofi Glover to recognize Laura Sedlock, whose accom- (Planned Parenthood Association of plished editing did much to clarify concepts Ghana), Y.P. Gupta (CARE India), Lisa and blend the voices of the authors. Howard-Grabman (Save the Children), Ideas and concepts that shaped the devel- Douglas Kirby (ETR Associates), Rekha opment of this Guide were discussed at a Masilamani (Pathfinder International, India), FOCUS Research and Evaluation working Ruth Maria Medina (Population Council, group meeting in April 1998. Those who Honduras), Dominique Meekers participated in the discussion included (Population Services International), Irene Lisanne Brown (Tulane University), Nicola Moyo (JSI/SEATS), Nancy Murray (FOCUS Bull (UNICEF), James Chui (UNFPA), on Young Adults), Mary Myaya (CARE Richard Colombia (Pathfinder Lesotho), Sonia Odria (Pathfinder International), Bruce Dick (UNICEF), Jane International, Peru), Oladimeji Oladepo Ferguson (World Health Organization), Alix (Department of Preventive and Social Grubel (John Snow International), Paula Medicine, Nigeria), Anne Palmer (PATH i A Guide to Monitoring and Evaluating Adolescent Reproductive Health Programs Philippines), Susan Pick de Weiss (Instituto Presentations and participant discussion at Mexicano de Investigaci—n de Familia y the YARH Measurement Meeting sponsored Poblaci—n), Gabriela Rivera (Pathfinder by the Centers for Disease Control (CDC) International, Mexico), William Sambisa Division of Reproductive Health and FOCUS (PACT Zimbabwe), Jessie Schutt-Aine on Young Adults in September 1999 helped (International Planned Parenthood shape the discussion of data collection. In Federation), Alfonso Sucrez (Fundaci—n particular, presentations by Gary Lewis Mexicana para la Planeaci—n Familiar), (Johns Hopkins University Center for Oswaldo Tanako (Pan American Health Communications Programs), Paul Stupp Organization), John Townsend (Population (CDC Division of Reproductive Health) and Council/Frontiers), Laelani L.M. Utama Cynthia Waszak (Family Health (Pathfinder International, Indonesia), Pilar International) were helpful in finalizing this Vigal (CEBRE, Chile), Amy Weissman (Save Guide. the Children), Anne Wilson (PATH) and Kate Winskell (Global Dialogues). Health and Human Development Programs staff of the Education Development Center, Inc. (EDC), managed the review process Acronyms and Abbreviations under the able direction of Phyllis Scattergood and Carmen Aldinger. ARH adolescent reproductive health EDCÕs Editing and Design Services, led by BCC behavior change communication Jennifer Roscoe, was responsible for the CEA census enumeration area production of this Guide, including design and coordination by Cathy Lee and revisions DHS Demographic and Health Survey and copyediting by the editorial staff. Their creative input is very much appreciated. FLE family life education IEC information, education and communication M&E monitoring and evaluation MIS management information system MOS measure of size NGO nongovernmental organization PPS probability-proportional-to-size RH reproductive health RTI reproductive tract infection STD sexually transmitted disease STI sexually transmitted infection USAID United States Agency for International Development ii About the Authors Susan E.Adamchak is president of Planning & Evaluation Resources, Inc. Her areas of expertise include population and health policy development, program assessment and eval- uation of reproductive health and public health programs. She holds a PhD in Sociology from Brown University. Katherine Bond is Research Assistant Professor at the Tulane University School of Public Health and Tropical Medicine, and Research and Evaluation Advisor at FOCUS on Young Adults. She has managed HIV/AIDS programs for youth in the United States and Thailand, and has trained governmental and nongovernmental organizations in Asia and Africa on the use of social research methods for program design and evaluation. She has a doctorate in international health from Johns Hopkins University. Laurel MacLaren was the Communications Coordinator at FOCUS on Young Adults. She founded and managed an adolescent sexual health program with the Indonesia Planned Parenthood Association in Yogyakarta and has provided technical assistance on adolescent reproductive health program design, monitoring and evaluation in South and Southeast Asia. She has a master’s degree in public policy from Harvard University. Robert J. Magnani, PhD, is currently an Associate Professor in the Department of International Health and Development of the Tulane School of Public Health and Tropical Medicine. He has worked in the international population and health fields in the areas of data collection systems and methodology, program/project monitoring and evaluation, and information systems support to program management and policy decisionmaking. He has worked in 27 developing countries in all regions of the world, with specialization in East/Southeast Asia and Latin America. Kristin Nelson is a DrPH candidate at Tulane University and has a master’s degree in medical anthropology from Case Western University. She has conducted extensive review of qualitative and quantitative instruments and youth programs for FOCUS on Young Adults. She lived and worked in Tanzania for two years and has experience working in AIDS education for youth in Ethiopia. Judith R. Seltzer is an independent consultant and population specialist with an empha- sis on population policy, family planning and reproductive health, and design and evaluation of international population assistance programs. She has a PhD from Johns Hopkins University. iii Table of Contents TO: JHU/CCP PHO iv A Guide to Monitoring and Evaluating Adolescent Reproductive Health Programs Table of Contents INTRODUCTION