Monitoring and Evaluation at Room to Read: Concepts and Practice in an International Education Organization

Total Page:16

File Type:pdf, Size:1020Kb

Monitoring and Evaluation at Room to Read: Concepts and Practice in an International Education Organization Monitoring and Evaluation at Room to Read: Concepts and Practice in an International Education Organization November 2010 Michael Wallace Rebecca Dorman Peter Cooper Monitoring and Evaluation (M&E) at Room to Read: Concepts and Practice in an International Education Organization Introduction Room to Read is a nonprofit organization committed to transforming the lives of children in developing countries by focusing on literacy and gender equality in education. Working in collaboration with local communities, partner organizations and governments, we develop literacy skills and a habit of reading among primary school children, and support girls to complete secondary school with the relevant life skills to succeed in school and beyond. In 2000, Room to Read began working with rural communities in Nepal to build schools and establish libraries, and now we are working in nine countries—seven in Asia and two in Africa. We have four core programs: Reading Room. We establish school libraries and stock them with local-language children’s books, original Room to Read titles, donated English-language books, games and furniture to create a child-friendly learning environment. (9,696 libraries established) School Room. We partner with local communities to build schools so children can learn in a safe, child-friendly environment. (1,129 schools constructed) Local Language Publishing. We source new content from local writers and illustrators and publish high-quality children's books in the local language to distribute throughout our networks. (553 titles, 4.2 million books published) Girls' Education. We provide long-term, holistic support enabling girls to pursue and complete their secondary education. (10,042 girl scholars supported) Our recently completed strategic plan is transforming our four core programs into two “pillars”: literacy and girls’ education. The theory of change for our new strategic direction is reflected in “the house” (see Appendix 1), which rests on the foundation of our activities, contains our literacy and girls’ education outcomes, and reaches toward our long-term impact of independent readers, skilled secondary graduates, and educated children. M&E: People and Systems The M&E Team has staff members at the Global Office in San Francisco, Regional Offices in Asia and Africa, and individual Country Offices. The Global Office leads activities related to our program indicators (common measures across all projects) and cross-national studies and evaluations. The Regional Office leads in supporting country-level research, monitoring, and evaluation activities. The Country Offices lead the field-level implementation of both monitoring and evaluation activities. Our monitoring system is based on program-specific conceptual frameworks that include goals, objectives, and indicators (see Appendix 2). Each program has an overall goal—such as promoting literacy and the habit of reading in children—that is elaborated in program objectives, and which we measure using our program indicators, which are collected on an annual basis for all of our active projects. 1 Our evaluation efforts include both cross-national evaluations and studies that are initiated and managed by the Global Office and in-country evaluations and studies that are initiated and led by our individual Country Offices. An example of the former is our school library cross-national evaluation, which is designed around the following research questions: 1. What is the impact of our school library program on students’ reading habits and attitudes towards reading? 2. How do different school and student background characteristics (teacher attitudes towards reading, the existence of a reading curriculum in schools, students’ home languages, parents’ education and attitudes towards reading) influence the effect of our program on students’ reading habits and attitudes towards reading? The cross-national evaluation began in 2009 in Laos, Nepal, and Zambia, and expanded this year to include India, Sri Lanka, and South Africa. An example of an in-country effort is our study of girl dropouts in Cambodia, which has the highest dropout rate of any of our countries. This study will examine the factors that lead girls to leave school early and assess changes in their lives after leaving school. Lessons Learned Key lessons learned in M&E thus far include the following: Monitoring: o “What gets measured gets done.” This is perhaps best illustrated by one of our program indicators, “Percentage of libraries in which school personnel received training.” This indicator captures training in library services for librarians, teachers, and administrators. In 2008 this indicator was 67 percent. This result was communicated to our Country Offices, and training was identified as an area needing improvement. As a result of increased attention to training, this indicator increased to 92 percent in 2009. o Push ownership/responsibility/accountability down. As our use of monitoring data increases, our need for quality data at all levels of the organization also increases. Quality control must start at the Country Office level, where the data is collected and input into our project database. We formally designated the most senior M&E Officer in each country as the person responsible for high quality data and timely reporting. The Global Office communicates directly with this person for all matters related to program indicators. This has streamlined communication and resulted in increased awareness of the importance of program indicators, as well as greater ownership of the quality of this data. o Use past data to inform future program targets. Each country develops an annual plan that includes program implementation targets. For 2011, program indicators became part of this planning process, and our 2008 and 2009 indicator results provided a basis for 2011 targets. 2 Evaluation: o Collect only data that will be used. We had 56 program indicators in 2008, and reduced that to 46 in 2009. Going forward, we will eliminate indicators that are not useful for program planning and improvement, and add indicators to measure our evolving program initiatives. In 2011, for example, we are adding an indicator for book leveling (labeling and organizing books according to reading level) to give us more information than our book classification indicator currently provides. o Link recommendations to data analysis. In 2007, we conducted in-country evaluations of our school library and local language publishing programs. These evaluations, designed and carried out by our Country Offices, varied in topic and rigor. We worked with our Country M&E and Program Teams to ensure that the recommendations were directly linked to the evaluation analysis. For example, one country found that the library training was too complicated, and recommendations were made to tailor the training to be more appropriate for the audience. o Ensure feedback to program implementation. To help ensure that the 2007 in-country evaluations led to program improvements, we followed up with the Country Teams to identify the specific program actions that were taken to implement the recommendations of these evaluations. Challenges Ahead Challenges in monitoring are mostly related to our evolving program directions, which require ever-evolving metrics to measure progress toward program objectives. For example, our school library program has moved from establishing libraries to improving reading skills, and we have evolved from training librarians to becoming involved in the reading curriculum and classroom teaching. Our metrics—the indicators that we use to assess progress and results—are evolving from inputs and outputs to outcomes and impacts. The level of measurement is moving from schools to students, and from populations to samples. We need to measure progress and change at the final beneficiary level (students), not just at the intermediate output level (schools and libraries), and to do that we can no longer expect to collect all indicators for the entire population. We can check all of the schools where we have libraries, but not all of the students at those schools. Overall, we are moving from (easy) counting to (difficult) measuring. Our greatest challenges in evaluation are related to balancing the concerns that define evaluation design and implementation. What should the main purpose of an evaluation be—to improve programs or to demonstrate results? Should the main focus of an evaluation be process or impact? We must demonstrate results to donors, who are asking increasingly sophisticated questions about outcomes, and want to see demonstrated results in terms of beneficiary change. They want improved reading attitudes and habits and skills, not just more libraries established and more books printed and delivered and more librarians trained. Our first cross-national evaluation, of our school library program, focuses on results and impact. 3 Should the evaluator be internal or external? An external evaluator may be more objective than an internal one, and capacity constraints may prohibit internal staff from conducting a rigorous evaluation. However, an external evaluator can never know exactly what is most important to an organization, or why, and as a result the direction of an external evaluation can easily get at least a little off track. How should internal capacity building be valued and/or incorporated into evaluation design? It is almost impossible for an external evaluator to conduct an evaluation without logistical and/or
Recommended publications
  • Director of Elearning and Educational Technology St
    Driving Change in Asia Pacific’s Education Landscape The demand for education in the Asia Pacific region is expected to face exponential growth in the next decade. With increasing Internet penetration, new technologies that reduce the need for physical classrooms and a growing middle class, the world’s largest pool of K-12 and college enrollments is only set to continue growing. At the same time, having new technologies to enhance learning is not enough. Innovative teaching methods and creative strategies are required to engage a generation of learners who are living in a digital era. Not forgetting, the region’s diverse socioeconomic issues which will continue to affect the quality and level of access to education for youths. Amidst these various challenges we’ve identified a group of 50 influencers who we think are making a mark in the region’s education landscape. They are individuals who are inspiring change, driving education reform and injecting innovation into today’s learning and teaching methods. From experienced educators to technology experts, from entrepreneurs to social activists, these individuals have one thing in common – they’re improving education for future generations of students. Enjoy the read! 1 Vincent Quah Business Development Lead Education, Research and Not for Profits, Asia Pacific Amazon Web Services Vincent Quah is currently the Business Development Lead, responsible for the Education, Research and Not For Profit sectors, covering the Asia Pacific region for Amazon Web Services. He has been involved in the education and research field for the past 20+ years and has held many different roles – educator, curriculum and instructional designer, e-learning consultant– driving regional and global education projects, programs and business.
    [Show full text]
  • 'Room to Read' in Nepal
    Supporting girls’ education: an evaluation of ‘Room to Read’ in Nepal Emerging baseline findings Executive summary Zara Khan, Emma Jackson, Cari Jo Clark, Irina Bergenfeld, Mahesh Puri and Kathryn M. Yount December 2018a Executive summary Background and report 24 schools (12 per district). It also included, as a control objectives group, 1,126 girls the same age who live in randomly selected Nepal, a small mountainous country situated between adjacent areas and are not participating in the programme. China and India, is one of the world’s poorest countries. Data was collected between July and September 2018 Of its nearly 30 million inhabitants, adolescent girls are by Nepali female enumerators who had been carefully amongst the most disadvantaged. Due to a traditional trained in survey administration and ethics. Face-to-face preference for sons, which first manifests itself soon after interviews were computer-assisted via android tablets children are born but which is amplified as they grow up as (where connectivity allowed) and with paper-based forms a result of increased pressure to conform to gender norms, (where connectivity was absent). While interviews were adolescent girls have less access to secondary schooling conducted with girls as well as with their caregivers and than do boys, face a variety of restrictions associated with school administrators, this report focuses on the findings menstruation, are highly vulnerable to child marriage, and from core adolescent respondents. have limited access to mobility and decision-making. Surveys completed by adolescent girls included 18 Room to Read, a US-based charity, is working to address modules encompassing topics ranging from educational these disadvantages by focusing on literacy and gender experiences and outcomes to gender attitudes and equality in education in Nepal.
    [Show full text]
  • Assessing Girls' Life Skills and Children's Reading Habits
    2015 Assessing Girls’ Life Skills and Children’s Reading Habits in Marginalized Districts in Nepal Claudia Cadena Consepsión Rodríguez Jacqueline Muñoz Paola González-Rubio May 8, 2015 ACKNOWLEDGMENTS The Capstone Team (the team) completed this report to fulfill the capstone research project requirement for the International Development Studies program at the Elliott School of International Affairs, George Washington University. The team would like to make the following special acknowledgements: First and foremost, to the Nepali people who enthusiastically supported this project and are now struggling to find peace and safety in the aftermath of the recent earthquake: 1. To Room to Read Nepal and Mr. Vishnu Karki, for granting us this opportunity, for collaborating with us, and for providing continuous support every step of the way. Specifically, we would like to thank Prashanta Thapa for his involvement in this project, for guiding our work, for our long Skype conversations, and for his enthusiasm to answer the team’s infinite questions. 2. To translators and facilitators, Dinesh Sanjel, Sumitra Chaudhary, and Shyam Gyawali, who supported the fieldwork that helped construct this report. Their close work with the team made the fieldwork an enjoyable and productive experience that added permanent value to both our personal and professional lives. 3. To the interviewees and members of the community who participated in all fieldwork activities. To the Social Mobilizers, Field Facilitators, and Literacy Coaches who dedicate every day of their lives to improve children’s access to a better life through education. To the boys and girls, who openly and happily shared their stories with the team, and who with their enthusiasm for education are changing cultural norms to make their country better.
    [Show full text]
  • School Libraries Are Not Sufficiently Valued in Vietnam
    World Change Starts with Educated Children.® Room to Read and Efforts to Build Habit of Reading in Vietnam TK Forum 2011 READ Neighbours: Sharing Reading Promotion Experience Bangkok – May 11th, 2011 World Change Starts with Educated Children.® Presentation Overview • Introduction of RtR • Barriers to establishing a reading culture in Vietnam • Room to Read’s current efforts to address these barriers • Moving forward – Next Steps World Change Starts with Educated Children.® Introduction About Room to Read World Change Starts RtR’s History with Educated Children.® • Room to Read was founded in 2000 to help provide much needed books to a single rural community. Today, we are a global organization - working in 10 countries across Asia and Africa - that helps millions of children in the world gain access to education through a variety of programs. Since 2000, Room to Read has. Established over 11,000 libraries . Built 1,442 schools . Published over 550 original hildre’s titles . Supported over 10,000 girls Nepal 2000 Sri Lanka 2005 Vietnam 2001 South Africa 2006 Cambodia 2002 Zambia 2007 4 India 2003 Bangladesh 2008 Laos 2005 Tanzania 2011 World Change Starts Our Theory of Change with Educated Children.® IF ROOM TO READ’S PROGRAMS work i ollaoratio THEN THERE WHICH ULTIMATELY with local communities, partner organizations, and WILL BE: RESULTS IN MORE: government towards ensuring that: MoreMore Primary school children will become Empowered, independent readers EducatedEducated Empowered, Active and ChildrenChildren Active and Responsible inin
    [Show full text]
  • Holding up Half the Sky Global Narratives of Girls at Risk and Celebrity Philanthropy
    Holding Up Half the Sky Global Narratives of Girls at Risk and Celebrity Philanthropy Angharad Valdivia a Abstract: In this article I explore the Half the Sky (HTS) phenomenon, including the documentary shown on the Public Broadcasting Service (PBS) network in 2014. I explore how the girls in whose name the HTS movement exists are repre- sented in relation to Nicholas Kristoff and six celebrity advocates. This analysis foregrounds Global North philanthropy’s discursive use of Global South girls to advance a neoliberal approach that ignores structural forces that account for Global South poverty. The upbeat use of the concept of opportunities interpellates the audience into participating in individualized approaches to rescuing girls. Ulti- mately girls are spoken for while celebrities gain more exposure and therefore increase their brand recognition. Keywords: Global South, Media Studies, neoliberalism, philitainment, representation, white savior b Girls figure prominently as a symbol in global discourses of philanthropy. The use of girls from the Global South lends authority and legitimacy to Western savior neoliberal impulses, in which the logic of philanthropy shifts responsibility for social issues from governments to individuals and corpo- rations through the marketplace, therefore help and intervention are “encouraged through privatization and liberalization” (Shome 2014: 119). Foregrounding charitable activities becomes an essential component of celebrity branding and corporate public relations that seek representation of their actions as cosmopolitan morality and global citizenry. Focusing on the Half the Sky (HTS) phenomenon that culminated in a documentary by Maro Chermayeff (2012) shown on the PBS network in 2014, in this article I examine the agency and representation of six celebrity advocates in relation to the girls in whose name the HTS movement exists.
    [Show full text]
  • Impact of COVID-19 on the Education Sector in Nepal: Challenges and Coping Strategies Saraswati Dawadi1, Ram Ashish Giri2 and Padam Simkhada3
    Impact of COVID-19 on the Education Sector in Nepal: Challenges and Coping Strategies Saraswati Dawadi1, Ram Ashish Giri2 and Padam Simkhada3 Abstract The pandemic spread of Novel Coronavirus, also known as COVID-19, has significantly disrupted every aspects of human life, including education. The alarming spread of the virus caused a havoc in the educational system forcing educational institutions to shut down. According to a UNESCO report, 1.6 billion children across 191 countries have been severely impacted by the temporary closure of the educational institutions. In order to mitigate the impact, educational institutions have responded to the closure differently in different contexts with a range of options for students, teachers, managers and parents, depending on the resources, both materials and human, available to them. Most of the options have to incorporate innovative technologies (e.g., digital and mobile technologies combined with traditional technologies such as radio and TV) in order to provide at least some form of educational continuity. As distance and online education is dependent on technological facilities, including internet and Wi-Fi, the discrepancies that exist in their availability are widening the gaps in access and quality of education. This article investigates the impact of COVID-19 on the Nepalese education system, with a focus on the school education. Based on the published documents, reports and news commentaries, the article provides a critical analysis and reflection on the opportunities and challenges the pandemic has presented for the technolization of the education systems. The findings indicate that the pandemic has had serious impacts on students’ learning and well-being, and that it potentially widens the gaps between advantaged and disadvantaged children in their equitable access to quality education.
    [Show full text]
  • Room to Read Scaling up Literacy Through Localized Solutions Across Asia and Africa
    ROOM TO READ SCALING UP LITERACY THROUGH LOCALIZED SOLUTIONS ACROSS ASIA AND AFRICA Jenny Alexander, Christina Kwauk, and Jenny Perlman Robinson ROOM TO READ SCALING UP LITERACY THROUGH LOCALIZED Sincere gratitude and appreciation to Priyanka Varma, research assistant, who has been instrumental in the production of the Room to Read case study. SOLUTIONS ACROSS ASIA We are also thankful to a wide-range of colleagues who generously shared their knowledge and AND AFRICA feedback on the Room to Read case study, including: Sourav Banerjee, Unmesh Brahme, Tim Carlberg, Luis Crouch, Lauren Hadi, Cory Heyman, Tressa Johnson, Matthew Jukes, Vishnu Karki, Phong Le, Emily Leys, Cynthia Lloyd, Lynn Murphy, Sara Peracca, and Kim Wright Violich. Lastly, we would like to extend a special thank you to the following: our copy-editor, Alfred Imhoff, our designer, blossoming.it, and our colleagues, Kathryn Norris and Jennifer Tyre. The Brookings Institution is a nonprofit organization devoted to independent research and policy solutions. Its mission is to conduct high-quality, independent research and, based on that research, to provide innovative, practical recommendations for policymakers and the public. The conclusions and recommendations of any Brookings publication are solely those of its author(s) and do not reflect the views of the Institution, its management, or its other scholars. Support for this publication and research effort was generously provided by the John D. and Catherine T. MacArthur Foundation and The MasterCard Foundation. The authors also wish to acknowledge the broader programmatic support of the William and Flora Hewlett Foundation, the LEGO Foundation, and the Government of Norway.
    [Show full text]
  • Room to Read Annual Report 2016 GETTING ACTIVE for EDUCATION 1 | INTRODUCTION
    Room to Read Annual Report 2016 GETTING ACTIVE FOR EDUCATION 1 | INTRODUCTION WORKING TOGETHER TO CREATE A BETTER FUTURE THROUGH EDUCATION While we may be separated around the world by immense distances, languages and cultures, we are connected in our desire to create a better future for the next generation. Whether they live in rural mountain ranges, With your support, Room to Read is scaling our programs to marshy river deltas or urban metropolises, all respond to this need. The success you’ve helped us achieve — parents want to see their children succeed. By the learnings we’ve garnered from each child reached, each acting together and investing in education, book published and each educator trained — has allowed we can make sure every child, everywhere, us to create effective, adaptable solutions for addressing gaps in literacy and girls’ education. We’re now focused receives the opportunities they deserve. on delivering these interventions more widely and with Tackling global illiteracy and gender inequality in greater efficiency through improvements in our programs education is a huge undertaking, but I know that and business operations, and the expansion of our capacity- every single child we reach is significant. Every student building work with governments and other nonprofits. The who learns to read and every girl who graduates from investments you’ve made are paying dividends through secondary school can access a lifetime of new possibilities each child supported and the reputation you’ve helped us and open doors for those around them as well. Every build. Our programs work, and our track record is enabling investment you make reaches across the world and forever us to multiply your impact across entire districts, states and alters the trajectory of a child’s life by putting a book in countries to bring education to more children, more rapidly.
    [Show full text]
  • Christina Ting Kwauk [email protected]
    Christina Ting Kwauk [email protected] Current Affiliations University of Saskatchewan 9/2020-present • Associate Director, Monitoring and Evaluation of Climate Change Education (MECCE) Project • Adjunct Professor, Department of Educational Foundations, College of Education The Brookings Institution 1/2021-present • Non-Resident Fellow, Center for Universal Education, Global Economy and Development Program Publications Books & monographs Iyengar, R., & Kwauk, C. (Eds.) (forthcoming). Charting an SDG 4.7 roadmap for radical, transformative change in the midst of climate breakdown. UNESCO-IBE Book Series. Brill Publishers. Sperling, G., Winthrop, R., & Kwauk, C. (2016). What works in girls’ education: Evidence for the world’s best investment. Washington: Brookings Press. Kwauk, C. (2014). Playing for the future: Sport and the production of healthy bodies in policy and practice. Doctoral thesis. Minneapolis: University of Minnesota. Peer-reviewed journal articles Hardin, J. & Kwauk, C. (2019). Elemental eating: Samoan public health and valuation in health promotion. The Contemporary Pacific, 31(2), 381-415. Hardin, J. & Kwauk, C. (2015). Producing markets, producing people. The food environment, health, and globalization in Samoa. Food, Culture and Society: An International Journal of Multidisciplinary Research, 18(3), 519-539. Kwauk, C. (2016). “Let them see a different path”: Social attitudes toward sport, education, and development in Samoa. Sport, Education and Society, 21(4), 644-660. Kwauk, C. (2014). “No longer just a pastime”: Sport for development in times of change. The Contemporary Pacific, 26(2), 303-323. Kwauk, C. (2012). Obesity and the “healthy living” apparatus: Discursive strategies and the struggle for power. Critical Discourse Studies, 9(1), 39-57. Kwauk, C.
    [Show full text]
  • Fall 2007 80 Baker Cres
    LETTER oF THE LAA Issue 156 Reddy the Reader, the new mascot at Strathcona County Library, p.22 Inside: The Partnership: What it is and How You Benefit Edmonton Welcomes 2007 PNLA Conference Around Red Deer in 60 Days with the mezz Summer Reading Program The Centennial Series Unveiled Venezuela's Four-Legged Mobile Libraries Letter of the LAA Fall 2007 80 Baker Cres. NW, Calgary, AB T2L 1R4 Phone: 403/284-5818 FAX: 403/282-6646 http://www.laa.ca ISSUE NUMBER 156 FALL 2007 ISSN 0705-4890 People ....................................................................................................................... 1 From the President's Desk .................................................................................................. 2 From the Executive Director ................................................................................................ 3 Association News The Partnership: What it is and How You Benefit ..................................................... 4 LAA Members Win Tickets to see JK Rowling........................................................... 8 Call for Nominations for Award of Excellence in Library Service ............................... 9 Around the Province Librarians Run for the Cure 2007 ............................................................................. 10 Renovations Improve City Centre Campus at GMC ................................................... 11 Innisfail Announces Plans for New Library ............................................................... 11 Edmonton Welcomes 2007
    [Show full text]
  • Global Monitoring Report
    Global Monitoring Report 2014 Putting the Pieces Together in Research, Monitoring, and Evaluation Dear Friends, It is a great pleasure to introduce Room to Read’s seventh annual Global Monitoring Report. The pages that follow present evidence of the progress that we have made as an organization on several fronts. Following the lead of our 2014 Annual Report (Solving the Puzzle: Children’s Literacy and Girls’ Education1 ), I particularly want to highlight the progress Room to Read has made in our continued efforts to bring together the various elements of our work into an effective, comprehensive whole. Over the past few years we have brought together a range of once-separate program components, such as libraries and literacy instruction, to establish our integrated Literacy Program. This shift in program implementation requires a corresponding shift in our approach to measurement and reporting. Reflecting this shift, the structure of this year’s report has been updated to present a consolidated view of the results of our Literacy Program. The report’s structure also reflects our efforts to better integrate the components of research, monitoring, and evaluation. When deployed strategically, these complement one another: • Research enables us to tackle forward-looking, exploratory questions of critical interest to programs teams; • Monitoring tracks our activities and results on an ongoing basis, shows trends over time, and raises questions for further study; • Evaluation tells us whether outcomes are improving for children and whether Room to Read is responsible for this improvement. This includes our Reading Skills Evaluations—a highlight in this year’s report, as 2014 marks the first year we are able to report findings for every country where we have implemented literacy instruction.
    [Show full text]
  • 2019 Annual Report
    EDUCATION ENDURES ANNUAL REPORT 2019 Room to Read | i ANNUAL REPORT 2019 It all starts with education. Education is the most effective tool for solving the world’s greatest challenges, including poverty, environmental degradation, racial injustice and inequality. In schools, young people learn the skills that enable them to become changemakers and solve difficult problems in new ways. These skills help them define their place in the world and seek a fulfilling future. As our world faces an increasing number of crises and threats to children’s access to quality education, we at Room to Read are committed to making sure that education endures. We know that a quality education will prepare every generation of students to become adults who are equipped to create a safer and more just world. We have incorporated illustrations from our original children’s books throughout this report. At Room to Read, we know books give children new ways of looking at the world and themselves, helping them to develop as global citizens. Stories can connect and inspire us all, regardless of where we come from. EVERYONE SEES / MIMI NINAONA Written and illustrated by Dani Jones South Africa, Tanzania and Zambia The world is full of many things to see. The mouse sees the hen and her chicks in the morning. The cat chases the bird in the day. But who sees at night when the sky gets dark? ii Room to Read | 1 ANNUAL REPORT 2019 “We know our team has the expertise “Together, we can ensure and dedication to meet this moment. that education endures for We also know that never has it been millions of children, so that more urgent and obvious to ensure they can turn their obstacles that all children have the education into opportunities and be they need to contribute in meaningful well-equipped to play a role in ways to their communities.
    [Show full text]