Readers are Leaders Project USAID READERS ARE LEADERS PROJECT ANNUAL REPORT 2013 Under Cooperative Agreement No. AID-165-A-13-00002 Submitted by: Foundation for Education and Cultural Initiatives “Step by Step” - Macedonia Readers are Leaders Project Table of Contents 1. EXECUTIVE SUMMARY ............................................................................................... 3 1.1. Component 1: Reading and Numeracy Assessment ................................... 4 1.1.2 Development and adaptation of EGRA and EGMA instruments ................... 4 1.1.3 Training for administration of EGRA and EGMA tools .................................... 5 1.1.4 Pilot study ............................................................................................................... 5 1.1.5 Roundtables on language and mathematics curricula .................................... 6 2.1 Component 2: Professional Development ...................................................... 7 3.1 Component 3: Learning Communities ............................................................. 7 4.1 Component 4: Digital Learning Resources .................................................... 7 4.1.1 Digital Repository................................................................................................... 7 4.1.2 Cooperation with other projects and institutions ............................................... 7 4.1.3 Localization of books............................................................................................. 8 5.1 Component 5: Family and Community Involvement ................................... 8 5.1.1 Cooperation with the Youth Cultural Center ................................................ 8 5.1.2 Magic Literacy Van .......................................................................................... 9 5.1.3 Reading Roadshow and Reading and Math are Fun activities in pilot schools 9 5.2 Cross-cutting activities ........................................................................................ 9 Annual Report 2013 2 Readers are Leaders Project – Under Cooperative Agreement No. AID-165-A-13-00002 Readers are Leaders Project 1. EXECUTIVE SUMMARY On May 15, 2013, the Foundation for Education and Cultural Initiatives “Step by Step” - Macedonia signed the cooperative agreement with USAID agreeing to provide support to USAID’s Readers are Leaders (RAL) Project. USAID’s Readers are Leaders Project aims to improve children reading and numeracy skills, strengthen teacher pedagogical skills, especially diagnostic and formative assessment skills, and increase overall community recognition of the value of reading and numeracy skills. The Step by Step Foundation allied with the Institute of Social Sciences and Humanities – Skopje and builds partner relations with Macedonia’s national education institutions - the Bureau for Development of Education (BDE) and the National Examinations Center (NEC) to ensure high quality results and sustainability of project activities. To assist in community involvement activities, the Step by Step Foundation has established cooperation with ZELS and with the Youth Cultural Center. All project activities, with due concern to geographical, ethnic, gender and social diversity, are aimed at addressing the needs of the children in the early grades within the formal education system, children from vulnerable and marginalized groups, including Roma children, children with special needs and residents in remote rural areas, and children residing in institutions, including: hospitals, orphanages, etc. The project objectives are defined in such a way so as to contribute to, support and enhance the accomplishment of USAID priorities and relevant USAID/Macedonia strategic goals. Main project objectives are to: Adapt and administer EGRA and EGMA, USAID funded assessment tools for math and literacy skills in early-grade students, and use collected data to support teachers, school and institutional decision-making; Provide baseline data on early grade reading and mathematics outcomes; Improve teaching in reading and numeracy by providing professional development activities to early grade teachers and thus improving student achievements; Build regional networks that support teachers’ professional development and promote teacher – leaders; Design/localize and publish different digital reading and math resources; Develop online repository of learning resources and seek to ensure its sustainability; Carry out initiatives and creative activities that will raise interest for reading and numeracy in students, engage their families and the wider community. Readers are Leaders Project is comprised of five components, each having multiple activities to encourage reading and numeracy skills in early grade children: Component 1: Reading and Numeracy Assessment Component 2: Professional Development Component 3: Learning Communities Component 4: Digital Learning Resources Component 5: Family and Community Involvement Annual Report 2013 3 Readers are Leaders Project – Under Cooperative Agreement No. AID-165-A-13-00002 Readers are Leaders Project 1.1. Component 1: Reading and Numeracy Assessment 1.1.2 Development and adaptation of EGRA and EGMA instruments All activities within Component 1: Reading and Numeracy Assessment were planned and implemented in close cooperation and coordination with the main education institutions in the country, the Bureau for Development of Education (BDE) and the National Examinations Center (NEC). Memorandum of Understanding was signed with both institutions. Each institution nominated advisors to be members of the Work Groups, tasked to work on adaptation of international Early Grade Reading and Mathematics Assessments (EGRA and EGMA) and their development in Macedonian and Albanian language. The other members of the Work Groups included members of teaching colleges and practitioners (pedagogues, psychologists and early grade teachers). Furthermore, four short-term international consultants for early grade reading and mathematics assessment were hired to lead the Work Groups. Helen Abadzi, a senior education specialist who has collaborated closely with Research Triangle International (RTI), an organization that developed the EGRA and EGMA tools, with USAID funding, provided her valuable input on designing the most suitable EGRA subtests that would be valid and reliable instrument for measuring the language literacy. José Noijons, a staff member at the Dutch National Institute for Educational Measurement, led the adaptation and development of EGMA instrument. David Carrol helped the team with the Tangerine software used for administration of EGRA and EGMA on tablets, uploading the tests and provided directions for analyzing and reporting on the pilot data. Jehona Shala provided her hands-on experience as skilled facilitator for the training on administration of EGRA and EGMA with the help of tablets. A general workshop aimed at presenting the Early Grade Reading Assessment (EGRA) and Early Grade Mathematics Assessment (EGMA) to education stakeholders was delivered on October 14, 2013 by the international consultant Helen Abadzi to representatives from the selected schools, BDE, NEC, teaching colleges and other USAID-funded projects. The presentations gave education officials and local curriculum and assessment specialists a global understanding of how the two instruments should be adapted to the local context, aligned to the curricula and the basic rules and conditions that apply for their administration. EGRA should provide a picture of reading levels within our country to help identify priority areas for instructional improvement and teacher training, so the members of EGRA work groups for both Macedonian and Albanian language had four-day workshop during which they reviewed the instrument components and linkages to curriculum objectives and instruction and adapted the instrument to local conditions using the item construction guidelines (including translating the instrument instructions; developing a local language versions; and modifying the word and passage reading components to reflect locally and culturally appropriate words and concepts). Annual Report 2013 4 Readers are Leaders Project – Under Cooperative Agreement No. AID-165-A-13-00002 Readers are Leaders Project The EGRA work group agreed that the EGRA tool would contain four subtasks, including letter recognition, familiar word reading, reading fluency and reading comprehension. The purpose of the EGMA instrument is to provide information on the level of competency in foundational numeracy skill areas. EGMA implementation should identify particular areas of need warranting further attention, which will allow education stakeholders to consider options for next steps for improving early grade numeracy, and importantly ensuring ownership and sustainability of reforms for the country. The EGMA Work Group involved in the adaptation process selected relevant overall tasks from the core EGMA tool to be used in Macedonia, aligned the subtasks to the curriculum for 2nd and 3rd grade standards, localized the contexts used in word problems, and translated and adjusted instructions into Macedonian and Albanian language. The selected subtasks for EGMA instrument for Macedonia included: number identification, number discrimination, naming missing numbers, addition and subtraction, word problems, geometry: shape recognition and pattern extension. 1.1.3 Training for administration of EGRA and EGMA tools Assessors responsible