Study: Impact of Ekal’s model of education (Ekal Vidyalaya Foundation) by Aspiring Minds Assessment Pvt. Ltd. An IIT-MIT(USA) Alumni Venture Index

 Acknowledgement  Executive Summary  Recommendations  About Ekal Vidyalaya Foundation & Aspiring Minds  Purpose and Scope of work  Assessment Instrument: Design & Development  Sampling: Selection of Schools for Pilot  Operational Design & Methodology  Analytics  Observations  Appendix  Highs & Lows

http://www.aspiringminds.in Acknowledgement

 Ekal Vidyalaya Foundation -  Sh. Pradeep Goyal – Chairman, Trust Board – EVF  Smt. Ranjani Saigal – Executive Director, EVF USA  Sh. Vijay Maroo – Trustee, EVF India  Sh. Ravi Dev Gupta – General Secretary, EVF India  Sh. Praveen Arya – General Secretary, Ekal Sansthan  Sh. Ajay Singh – Project Coordinator, EVF USA  Dr. (Sh.) C. Satheesh Kumar – Project Coordinator, EVF India  Sh. Joginder Lal – Admin, EVF India  Sh. Rajneesh Kumar – Anchal Pramukh  Sh. Dinesh Pawar – Anchal Pramukh  Sh. Sanjay Kumar – Mulyankan Pramukh, North India  Teachers & Anchal Karyakarta’s

http://www.aspiringminds.in Executive Summary

 Ekal students on average score more than 55% marks in English, local language and General Awareness. The only area of concern is Mathematics.

 Around 58% of Ekal students in the age 6-10yrs demonstrate learning* expected in a Class 2 nd student.

 Around 52% of Ekal students in the age 10-14yrs demonstrate learning* expected in a Class 4 th student.

 Ekal students score above 55% marks even in General Awareness which isn't covered in formal schooling system.

 Ekal students are learning concepts and not only having rote learning.

+Reference statistics: Pratham ASER 2013 • For Std. III, the proportion of children able to read at least a Std. I level paragraph is 40.2% •In government schools the proportion of children able to read Std. I level text is around 32%+

* A student is accepted as having learning at a class level if he/she can answer atleast 60% of the concepts required in that class. Executive Summary (contd.)

Ekal only students consistently rank at par in values of benevolence, security, tradition and conformity with those students which also go to another school.

Females at Ekal schools do as well as males. Also, great to see more females than males in Ekal schools!

The performance of Ekal students is correlated to the quality of the teacher as measured by an assessment and the literacy rate. Where the literacy rate is better and Ekal has better teachers, students show better results. This indicates that Ekal's teacher has an impact on student's learning.**

Performance of Ekal students is at par with their peers at Government schools.

** Correlation doesn't mean causality. This is an initial indication which can be validated by further experimentation. Recommendations

 Ekal Vidyalaya should intervene to provide better math education to their students. Among the states tested, Uttarakhand needs specific attention.  Better teachers mean better student learning. Ekal should set a minimum learning standard for their teachers (established through a test) and do regular trainings and assessments.  The good teachers should be identified and should help teachers in adjoining areas.  Assessment should be made a regular feature across all learners to get student- wise feedback and village-wise feedback. Feedback will help teachers concentrate on the right areas for the students.  Specific village-wise and state-wise findings and recommendations are provided.  Ekal students show decent learning of current material. Ekal should strive to introduce higher level knowledge to their students.

http://www.aspiringminds.in About Ekal Vidyalaya

 The Ekal Vidyalaya Foundation is a charitable trust that initiates, supports, and runs one-teacher schools (popularly known as Ekal Vidyalayas) all over the country.

 The Ekal Vidyalaya movement aims to help eradicate illiteracy from rural and tribal India by 2015.

 To date, Ekal Vidyalaya is a movement of over 51,943 teachers, 6,000 (Approximately) voluntary workers, 35 field organizations (scattered in 22 Indian states), and 8 support agencies as on August 2013.

 With this tremendous human force, the Ekal Vidyalaya movement strives to create a network of literacy centers that will educate and empower children in rural and tribal India.

 With the participation of numerous non-profit trusts and organizations, this program has now become the greatest education movement in the country. http://www.aspiringminds.in About Aspiring Minds

 Established in 2008 currently 350+ people across India  Pan-India network of assessment delivery with 1.2M+ computer based proctored tests conducted in 21+ Indian states; adding ~500,000 an year.  Over 75000+ offers made to AMCAT assessed candidates in 2011-12 covering over 3000 colleges across India  Over 700 corporate customers including 60+ large global corporations  Core Product IP:  AMCAT®: An IRT based computer Adaptive Testing Platform for employability  AMPI®: Big 5 personality inventory for job suitability fitment  SVAR®: A fully automated spoken English evaluation tool  Automata®: Patent Pending automated computer programming evaluation  Tesla®: Technology driven vocational assessment and certification solutions  Situational Judgment Tests: For entry, mid and senior level management  90+ domain modules including IT, ITeS, Engineering, banking/finance, hospitality, etc  Thought Leadership:  AMCAT is already recognized as India’s Largest Employability Test covered by national and international media very regularly  Aspiring Minds’ research covered by “ The Economist ”, HBR, WSJ, leading media worldwide  Rated by Business Week as one of world’s 25 most intriguing startups. Auto mata Automated Computer  Professional Board and Investors: Programming Evaluation  Omidyar Networks: US Based VC firm established by founder of eBay Aspiring Minds Team

Varun Aggarwal, MS EECS, MIT, USA Himanshu Aggarwal, B Tech CSE, IIT, D  CTO and COO, Aspiring Minds  CEO, Aspiring Minds  More than 20 publications in AI and  Experience in Large scale enterprise class statistical pattern recognition. technology development and deployment  Co-founder of www.noragging.com &  Over 8 years of technology & operational MIT India Reading Group experience in the US and India.  Winner of HUMIES at GECCO 2006, Bruce  More than half a dozen US patents Kelley Award for best article in AWA.

Aspiring Minds team is 350 people strong, boasting of alumni of premier institutions such IIMs, IITs & NITs with dozens of years of experience at large corporate and MNCs. Board of Directors Jayant Sinha Mukund Rajan Sachin Kamath MD. Omidyar (Independent Director) Chief Investment Networks Brand Custodian, Tata Officer, Ajit Khimji Previously Partner Group Group at McKinsey ex Managing Partner, Qualified CA Tata Capital Advisory Team

Prof. Tarun Khanna, Dr. Una-May Prof. Vijay Dr. Steven Harvard Business O’Reilly, Bhushan, Stemler, School CS & AI Lab, MIT Ph.D. UIUC, USA Asst .Prof., Founder Investor, AM Founder MCA Wesleyan Univ, Program Psychology Deptt. http://www.aspiringminds.in Aspiring Minds 700+ Corporate Clients Aspiring Minds 2500+ Academic Institutions

Delhi Indira Gandhi National IIT, Kanpur Jami Millia Lucknow Shivaji SRM University Open University Islamia University University University University

MD University MLS University Kanpur Sant Gadge Baba University of Calcutta Jawaharlal Nehru Technological University Rohtak University Amravati University Kashmir University

IIT, Ropar BITS, Pilani Dhirubhai Ambani Institute Amrita University Galgotias Lovely Professional Mumbai of Information and University Communication Technology University University

Rajasthan HNB Garhwal Central Kumaun Kurukshetra Central University of Graphic Era Sharda University University University University University University Aspiring Minds Affiliations in Vocational Assessment Space

National Skill Development Telecom Healthcare Council

Agriculture Information Technology Rubber

Gems and Jewelry Electronics Plumbing

Media and Entertainment Retail Purpose and Scope of Work

Ekal Vidyalaya Foundation is interested to track the effectiveness of the Ekal’s teaching program by assessing the learning levels of the students and teachers in various Ekal schools, districts and states, by an objective and standardized assessment.

Objectives:  Help Ekal establish the impact of its of model of education  Deploy scientific assessment solutions for credible, objective & standardized evaluation  Be able to objectively track learning deficiencies in different areas and provide the right interventions at the local and national level.  Provide teachers a tool to provide personalized feedback and intervention to each student. Create a quality control mechanism for teachers.  Track Ekal’s progress in impacting learning annually and setting an objective target for each region each year.

http://www.aspiringminds.in Assessment Design Process

Research Visit to Ekal schools, Ekal study material, Assessment standards (Pratham)

Syllabus/Framework Basic yet essential life skills: Language, Math, General Awareness, Values

Test Development In-house experts, Advisor from US (For Values)

Translation Hindi (Northern states), Tamil (Tamil Nadu)

Quality Control Detailed content review, Quality checks, Balanced test-forms

http://www.aspiringminds.in Assessment Suite

The following aspects were considered while deciding the suite of assessments:  What are the basic life skills that can help child in day to day living?  What will help a child to transition to a government school after a certain age?  What do parents and elders in the society expect from their children?  Learning levels required at the age based on the school system. Knowledge/Skills  Language skills :  Hindi/Tamil : For day-to-day conversation in the vernacular language  Basic English : To understand the language and for reading books in English

 Numeracy skills :  Mathematics : For basic calculations used in daily life, like dealing with money, etc.

 General Knowledge :  General Awareness: To learn about basic general science, Indian history, and social awareness  Values  Benevolence, Tradition, Conformity, Security, Achievement: To understand to what extent the Ekal teaching imbibes basic human values in children. Based on Schwartz model Test Construction A snapshot

 Two different tests were constructed for Level I (age: 6- 10 years) and Level II (age: 11-14 years) students taking in to consideration the varied learning levels for the two groups.  Item types within each test were balanced on the following:  Topics Covered (Discussed in later slides)  What the items tests: Factual knowledge, Basic concepts, Application  Question format: Fill in the blanks, True/False, Image-based vs. text-based, multiple choice, etc.  Difficulty level: Easy, Medium, Difficult  Test neutrality basis gender, caste, creed, religion, etc. was ensured.  The tests were translated in the vernacular languages.  The language of the questions was kept easy ensuring there is no ambiguity in the student’s understanding of the questions.  A modified version of the Schwartz Values Inventory was used basis internal deliberation and consultation with our advisor: Dr. Steven Stemler (Wesleyan University)  Access rights were clearly defined & restricted to avoid unapproved access to questions .

http://www.aspiringminds.in Topic Coverage Students’ Assessment

• Alphabets • Numbers Hindi/Tamil • Gender and Plural form • Addition, Subtraction, • Synonyms & Antonyms Mathematics Multiplication and Division • Measurement Language • Contextual Vocabulary (15 questions) • Basic Shapes (15 questions) • Grammar • Fractions, Decimals & • Reading Comprehension** Percentages**

• Alphabets English • Spellings General • General Science Language • Synonyms Awareness • General knowledge (12 questions) • Contextual Vocabulary (12 questions) • Social awareness • Grammar**

*Additionally students took the Values Inventory (explained in a later slide) **These topics were included only in the Level II assessment

Total time duration: 2 hours Topic Coverage Teachers’ Assessment

Mathematics English • Vocabulary and • Basic Algebra Language • Grammar Analytical • Calculations (15 questions) • Comprehension Ability • Logical Ability (12 questions)

• Benevolence General • General Science Values • Tradition Awareness • General knowledge Inventory • Security (10 questions) • Social awareness (20 items) • Conformity • Achievement

Total time duration: 2 hours Values Inventory Based on Schwartz Inventory

Tradition Acceptance of social customs and traditional ideas in a society Benevolence Conformity *Based on Schwartz Inventory The desire to protect the *Likert based scoring Being motivated by being well-being of the people self-disciplined and who are close to the person *20 items (4 items for each trait) obedient *Five traits (Hedonism, Self- direction, Universalism, Stimulation and Power ) dropped since they are irrelevant for this age-group.

Achievement Security

Desire for personal success Valuing safety and stability Sampling of schools

 Objective: Choose a set of schools representative of Ekal schools pan India. The plan was to test 1000 students from 40 Ekal Schools. The understanding is that there will be 30-40 students in each school. Aspiring Minds’ team coordinated with Ekal’s central team to identify these schools.

 Methodology: 8 8 11 Parameters chosen: Each school was Identified demographic categorized as high, and geographic 1. Distance of village medium, low on each of parameters which might from railway station. the chosen parameters. be affecting a child’s 2. Literacy rate of the A stratified sample of overall academic village. schools was then chosen development in Ekal from over 3000 Ekal schools. 3. Population of the village. schools. 11

*The number indicates the number of villages chosen in that particular state.

http://www.aspiringminds.in Assessment Methodology

 Pre-Assessment Scheduling – Ekal Schools & Govt. Schools  AM Central team shared the list of shortlisted Ekal schools with Ekal SPOC  AM central team coordinated with the Ekal SPOC & Schools for scheduling of assessments and confirming the date of assessment for each location  Ekal team shared the list of Govt. Schools which are in the same area where Ekal Schools are assessed  AM proceeded with the assessment according to the pre-confirmed plan  A day before the assessment, AM central team called up school coordinators to confirm their visit to the school  Number of test papers were generated as per the number of candidate enrolled in the schools  Ekal’s volunteers support was sought to plan travel at some remote locations  Dedicated Client Servicing Manager available on call for all these assessment events

 Due to technical limitations (non-availability of continuous power supply), we opted for paper- based assessments. Assessment Methodology

 Assessment Day  Students are made available for the assessment by the school teacher for required assessment duration  The assessment is taken by the candidate. The questions asked are mapped to the curriculum/ framework defined by Ekal for a particular level. The questions were Image- based, MCQs, Simulations, Text-based etc.  Level 1, Level 2 and Level 3 assessments were conducted in parallel, as per the process plan.  The testing team ensured that relevant parameters of students are captured apart from delivery of test.  Post-Assessment  Result Generation - Student responses were digitized for every School in the prescribed format  Score sheet cross-checked and results validated before starting the analysis Analytics Data Distribution Properties

Data Characteristics Statistics

Assessed for L1 (Students with age 6-10 years) 624 No. of students Assessed for L2 (Students with age 11-14 years) 324 Only Ekal school 124 No. of students as per schools Ekal & Government both 518 attended Ekal & Private both 226 Only Govt 80 Average Age of Level 1 (Students with age 6-10 years) 8 Students/Teachers of Ekal Level 2 (Students with age 11-14 years) 12 Schools Level 3 (Teachers) 26 Total no. of States 4 Demographic Information Total no. of Villages 38 Average Population 1063 Parameters affecting exposure Average Literacy Rate 45 level of students Average Distance from Railway Station (Kms.) 49

L1: Students aged 6-10 years. L2: Students aged 11-14 years Level-Wise Mean Scores across Modules

Level English Hindi/Tamil Mathematics General Awareness

L1 57 54 47 58

L2 62 59 43 56

 Students at all levels show scores higher than 55% on average for both L1 and L2 levels.  The scores are lower in Mathematics which requires attention. More attention is required at L2 level.

All scores are reported on a scale of 100 Schools Attended Mean Scores across Modules

Schools Attended English Hindi/Tamil Mathematics General Awareness

Only Ekal 56 52 42 58

Ekal & Govt. 68 65 53 66

Ekal & Private 62 62 52 62

All Ekal (Ekal, 65 62 51 64 Ekal+Govt, Ekal+Pvt)

Only Govt. 56 53 48 52

 Performance of students attending only Ekal schools is at par with those attending Ekal schools & private schools both.  Small differences in scores of Only Ekal school students and Ekal & Govt. school students  This implies Ekal is able to deliver almost as good education as in a private or govt. school

All scores are reported on a scale of 100 Ekal Teacher Scores

State Villages English Math & Logical Gen. Awareness Rajasthan Nerwala Ka Was (Alwar) 65 87 80 Uttar Pradesh Birampur 55 53 70 Uttar Pradesh Fagujot 55 40 90 Uttar Pradesh Nagli 55 40 90 Wide variation in Uttar Pradesh Sevka Dad (Sonbhadra) 50 53 70 Rajasthan Radhswmi Ki Dhani () 45 80 80 teacher ability from Tamil Nadu Haripuram 45 33 70 high to very low. Tamil Nadu K C Patti 45 40 40 Rajasthan Nayara (Ajmer) 40 20 50 Rajasthan Ranf (Bharatpur) 40 33 70 Recommendation : Rajasthan Sadivas (Bharatpur) 35 40 70 A minimum Tamil Nadu Komaiur 35 17 15 Uttar Pradesh Baleem Ganj 35 27 50 benchmark of scores Uttar Pradesh Jhadyahi(Allahbad) 35 27 20 for teachers at Ekal be Uttarakhand Sampatpur 1 (Udham Singh) 33 20 65 Tamil Nadu Naganthal 31 42 63 instituted. Rajasthan Murata (Alwar) 30 53 70 Rajasthan Naogel (Alwar) 30 53 0 Uttar Pradesh Girgitiya (Gorakhpur ) 30 47 70 Uttarakhand Patyashar (Almoda) 30 53 60 Rameswsarpur (Udham Singh Uttarakhand 30 27 70 Nagar) Uttarakhand Gaushala (Udham Singh Ngr) 28 37 60 Tamil Nadu Gandijipuram 25 20 50 Uttarakhand Loharkhet (Almoda) 25 27 60 Tamil Nadu Vapanatham 15 37 20 Uttarakhand Matai (Chamoli) 15 47 70 Govt. Teacher Scores

Mathematics General State Villages English & Logical Awareness Wide variation in Rajasthan Radhswmi ki Dhani 90 80 70 teacher ability from Uttarakhand Bangali Colony 85 80 90 very high high to very Rajasthan Murthala 75 73 100 low. Rajasthan Atru 65 27 70 Uttar Pradesh Badi Baguliya 65 93 90 Uttarakhand Bedi bhud 65 93 90 Rajasthan Sadivas 55 20 70 Uttar Pradesh Gopal Pur 55 40 90 Uttar Pradesh Nagli 30 40 70

Gradient in color represents variation in scores with Darker color representing higher score Quality of Teachers

Ekal School Teachers Govt. School Teachers 23% 11% Score Above 27% 0% Score Above 60 22% 60

Score between Score 50 & 60 between 40 & Score between 50 40 & 50 Score Score less than between 50 & 19% 40 60 31% 67%

Approx. 3/4 th of the The majority of Govt. teachers have scored teachers score above above 40% average score 60% State-Wise Analysis (Ekal Students) Mean Scores across Modules

General State Level English Hindi/Tamil Mathematics Awareness L1 67 60 56 58 Rajasthan L2 52 53 40 51 L1 64 61 56 59 Tamil Nadu L2 64 70 34 53 L1 58 56 48 60 Uttar Pradesh L2 65 60 54 60 L1 50 49 36 53 Uttarakhand L2 49 53 31 43 Uttarakhand needs  Rajasthan, Tamil Nadu performed better attention than peer states  L1 performed better in Rajasthan, whereas L2 performed better in UP. Math is a concern

Gradient in color represents variation in scores with Darker color representing higher score State-Wise Analysis (Govt. Schools) Mean Scores across Modules

General State Level English Hindi Mathematics Awareness

L1 44 37 35 43 Rajasthan L2 67 77 53 38 Uttar L1 33 26 21 26 Uttar Pradesh Pradesh L2 29 29 17 21 needs attention  Scores in UP are low across all subject

Math is a concern

High Medium Gradient in color represents variation in scores with Darker color representing Low higher score State-wise (Ekal Students) Variance in Scores

English General Awareness 100% 100%

80% 80%

60% 60%

40% 40%

Percentage Percentage Score 20% Percentage Score 20%

0% 0% Rajasthan Tamil Nadu Uttar Pradesh Uttarakhand Rajasthan Tamil Nadu Uttar Pradesh Uttarakhand

Tamil Nadu has high variation in scores in English

Local Language Mathematics 100% 100%

80% 80%

60% 60%

40% 40%

20% Percentage Score 20%

0% 0% Rajasthan Tamil Nadu Uttar Pradesh Uttarakhand Rajasthan Tamil Nadu Uttar Pradesh Uttarakhand

Tamil Nadu has high variation in scores in local language State-wise (Govt. Schools Only) Variance in Scores

Rajasthan has some very good and some very poor villages

Uttarakhand performs better relative to other states Rote learning or conceptual learning? (Ekal Students)

State Level Rote Learning Conceptual Learning L1 62% 50% Rajasthan L2 51% 53% L1 63% 52% Tamil Nadu L2 56% 65% L1 60% 59% Uttar Pradesh L2 61% 57% L1 55% 44% Uttarakhand L2 46% 44%

Overall 58% 53%

 Ekal students are learning concepts rather than just rote learning.  Rajasthan (L1), Tamil Nadu (L1) and Uttarakhand (L1) show lower conceptual learning than rote-based learning.

Gradient in color represents variation in percentage with Darker color representing higher percentage Rote learning or conceptual learning? (Govt. Schools Only)

Conceptual State Level Rote Learning Learning L1 58% 51% Rajasthan L2 48% 45% L1 39% 36% Uttar Pradesh L2 30% 25% Overall L1&L2 55% 49%

 Students are learning concepts rather than just rote learning.  Uttar Pradesh(L2) shows very low conceptual learning

Gradient in color represents variation in percentage with Darker color representing higher percentage State-wise Mean Scores Ekal Schools - Rajasthan Mean Scores

Students Teacher Village General Quantitative & General English Hindi Mathematics Awareness English Logical Ability Awareness Nayara (Ajmer) 83 70 67 72 65 87 80 Nerwala Ka Was (Alwar) 78 78 77 85 45 80 80 Radhswami Ki Dhani (Ajmer) 67 72 71 70 40 20 50 Naogel (Alwar) 62 59 51 63 40 33 70 Sadivas (Bharatpur) 56 43 31 25 35 33 70 Ataru (Baran) 55 48 36 37 35 40 70 Murata (Alwar) 55 47 46 52 30 53 70 Ranf (Bharatpur) 53 54 44 58 30 53 -  Highest performance observed for Nayara, Nerwala Ka Was & Radhswami Ki Dhani villages  Schools which need attention include Sadivas, Ataru, Muruta and Ranf.  Sadivas and Ataru need more attention in Math and General awareness than language  Schools with better teachers have better student quality. English of teacher most important predictor.

High Medium All scores are reported on a scale of 100 *The gradient of color in the cells represents the variation in scores Low Ekal Schools - UP Mean Scores

Student Teacher Village (UP) General Mathematics & General English Hindi Mathematics English Awareness Logical Ability Awareness Guladia 83 82 81 98 Gopal pur (Shahjahanpur) 76 85 73 91 Baleem Ganj 76 88 81 91 35 27 50 Birampur 72 70 58 68 55 53 70 Kanaura (Mirzapur) 69 61 56 61 Sevka Dad (Sonbhadra) 66 45 37 65 50 53 70 Girgitiya (Gorakhpur ) 55 47 46 52 30 47 70 Nagli 55 50 39 47 55 40 90 Fagujot 40 39 28 36 55 40 90 Chhivrau (Mathura) 38 42 34 42 Jhadyahi(Allahbad) 34 42 44 41 35 27 20

 Highest performance observed for Guladia, Gopal pur & Baleem Ganj villages  Schools which need attention include Fagujot, Cchivaru & Jhadyahi  Schools are either high or low in all subject consistently.

*The gradient of color in the cells represents the variation in scores High **Test was conducted with the help of Ekal coordinators in the villages where Medium All scores are reported on a scale of 100 teacher’s scores are not mentioned Low Ekal Schools - Uttarakhand Mean Scores

Student Teacher Mathematics Uttarakhand General General English Hindi Mathematics English & Logical Awareness Awareness Ability Rameswsarpur (Udham 58 57 43 54 30 27 70 Singh Nagar) Patyashar (Almoda) 56 60 27 46 30 53 60 Matai (Chamoli) 56 58 38 50 15 47 70 Bidhunia (Almoda) 51 50 34 52 Gaushala (Udham Singh 47 48 32 57 28 37 60 Nagar) Loharkhet (Almoda) 46 52 36 63 25 27 60 Sampatpur No 1 (Udham 29 23 33 23 33 20 65 Singh Nagar)

 Highest performance observed for Rameswarpur & Patyashar villages  School which needs very high attention is Sampatpur no.1  Schools with better teachers had better learning in students. (Apart from Rameswsarpur)

*The gradient of color in the cells represents the variation in scores High **Test was conducted with the help of Ekal coordinators in the villages where Medium All scores are reported on a scale of 100 teacher’s scores are not mentioned Low Ekal Schools – Tamil Nadu Mean Scores

Student Teacher Mathematics Village General General English Tamil Mathematics English & Logical Awareness Awareness Ability Panaikadu 99 85 37 72 Gandijipuram 86 77 76 82 25 20 50 Haripuram 83 81 72 45 33 70 K c patti 80 88 56 73 45 40 40 Manjakambi 79 84 44 68 Naganthal 73 79 52 63 31 42 63 Sanmugavalasu 67 82 67 86 K kurumapati 67 83 67 81 35 17 15 Vapanatham 23 29 16 4 15 37 20 Makapallayam 18 25 19 11 Komaiur 13 22 10 3  Highest performance observed Panaikadu & Gandijipuram  Schools which need attention include Vapantham, Makapallayam & Komaiur  Sanmugavalasu and Kuumapati are good in all areas other than English.  Schools with better teachers had better learning in students. (Apart from Gandijipuram)

*The gradient of color in the cells represents the variation in scores High **Test was conducted with the help of Ekal coordinators in the villages where Medium All scores are reported on a scale of 100 teacher’s scores are not mentioned Low Question-Endorsements Analysis English Question-Endorsements

Question : 'J' के तुरंत बाद कौन सा अर आता है?

Conclusion: 77 % of the EKAL candidates (6-10 years) were able to answer this question correctly. Similar percentage observed at government schools

Endorsements : Answer options EKAL Govt. Answer A G 9% 4% Answer B K 77% 77% Answer C I 10% 2% Answer D H 5% 17% English Question-Endorsements Question : "कु स" को अँेज़ी म या कहते है?

Conclusion: 84 % of the EKAL candidates (10-14 years) were able to answer this question correctly as compared to govt. school students where the percentage was 73%

Endorsements :

Answer options EKAL Govt. Answer A Chair 84% 73% Answer B Table 8% 18% Answer C Bat 5% 5% Answer D Ball 3% 5% Hindi Question-Endorsements Question : वण!माला के अनुसार #रत $थान क& पू)त! करो| अ ____ इ ई उ ऊ ए

Conclusion: 81 % of the EKAL candidates (6-10 years) were able to answer this question correctly as compared to government school students where the percentage was 76%

Endorsements : Answer options EKAL Govt. Answer A आ 81% 76% Answer B ओ 10% 7% Answer C औ 5% 4% Answer D ऐ 4% 13% Mathematics Question-Endorsements

Question : 220 + 380 = _____ + 400 ऊपर खाल5 $थान म या आना चा7हए?

Conclusion: 35 % of the EKAL candidates (6-10 years) were able to answer this question correctly as compared to government schools where the percentage was 41%

EndorsementsAnswer options : EKAL Govt. Answer A 200 35% 41% Answer B 380 11% 8% Answer C 600 35% 19% Answer D 1000 20% 32% General Awareness Question-Endorsements Question : भारत का $वत9:ता 7दवस ;कस 7दन मनाया जाता है?

Conclusion: 76% of the EKAL candidates (10-14 years) were able to answer this question correctly as compared to government school students where the percentage was 63%

Endorsements : Answer options EKAL Govt. Answer A 26 जनवर 15% 16% Answer B 15 अग त 76% 63% Answer C 26 अग त 5% 16% Answer D 15 जनवर 3% 5% General Awareness Question-Endorsements

Question : 7दए गये लोग> म से कौन आज िज़ंदा है?

Conclusion: 56 % of the EKAL candidates were able to answer this question correctly as compared to govt. school students where the percentage was 50%

Endorsements : Answer options EKAL Govt. Answer A महा@मा 21% 15% गाँधी Answer B इं7दरा 15% 10% गाँधी Answer C राजीव 8% 25% गाँधी Answer D सो)नया 56% 50% गाँधी Extra Slides Schools Attended Mean Scores across Modules

Type State English Hindi Maths General Awareness Rajasthan 49 46 39 42 Govt. Only Uttar Pradesh 32 27 19 24 Uttarakhand 89 86 87 88 Rajasthan 48 46 40 54 Ekal Only Uttarakhand 40 43 25 42 Uttar Pradesh 66 59 51 68 Rajasthan 57 57 47 57 Tamil Nadu 87 91 74 76 Ekal+Pvt. Only Uttarakhand 56 47 38 51 Uttar Pradesh 56 59 51 62 Rajasthan 63 57 52 60 Tamil Nadu 84 82 60 80 Ekal+Govt. Only Uttarakhand 56 56 45 55 Uttar Pradesh 68 64 54 67

Gradient in color represents variation in scores with Darker color representing higher score All scores are reported on a scale of 100 Snapshot of chosen schools (Ekal)

Rajasthan Uttrakhand Village Population Literacy Rate Dist. from railway station Literacy Distance from Village Population Ataru(Baran) High Low Low Rate railway station Murata (Alwar) Low High High Bidhunia (Almoda) Low High High Naogel (Alwar) High High High Gaushala (Udham Singh Nagar) Low High Low Nayara (Ajmer) High Low High Loharkhet(Almoda) Low Low High

Nerwala Ka Was (Alwar) Low High Low Matai (Chamoli) Low Low High Nagli (Saharanpur) High High Low Radhswmi Ki Dhani (Ajmer) Low Low Low Patyashar (Almoda) Low High High Ranf(Bharatpur) Low Low High Rameswsarpur (Udham Singh Nagar) High High Low Sadivas (Bharatpur) High Low High Sampatpur No 1 (Udham Singh Nagar) High Low Low

Uttar Pradesh Tamil Nadu Distance from railway Distance from Village Population Literacy Rate Village Population Literacy Rate station railway station Baleem Ganj Low High High Gandijipuram Low Low Low Chhivrau(Mathura) High Low Low Haripuram High High Medium Fagujot Low Low Low K C Patti Low High High Girgitiya (Gorakhpur ) Low Low Medium K Kurumapati Low High Medium Gopal Pur (Shahjahanpur) High High High Komaiur Low Low High Guladia High High Low Makapallayam Low Low High Birampur High High Low Naganthal High High Low Kanaura (Mirzapur) Low Low Low Manjakambi High Low Low Nagli High High Medium Panaikadu Low Low Low Jhadyahi(Allahbad) High Low Low Sanmugavalasu Low Low Low Sevka Dad (Sonbhadra) Low Low High Vapanatham High Low Medium Snapshot of chosen schools (Govt.)

Village Village City State Government School Atru Bara Rajasthan Rajkiya prathmik vidhyalaya Chhivrau Mathura Uttar Pradesh Rajkiya prathmik vidhyalaya Gopal Pur Powayan Uttar Pradesh Rajkiya prathmik vidhyalaya Murthala Alwar Rajasthan Rajkiya prathmik vidhyalaya Nagli Saharanpur Uttar Pradesh Rajkiya prathmik vidhyalaya Nerwalaka was Alwar Rajasthan Government School Radhswmi ki Dhani Ajmer Rajasthan Rajkiya prathmik vidhyalaya Sadivas Bharatpur Rajasthan Learn-ability Analysis English

Application- Conceptual State Level Rote Learning based Learning Learning L1 70% 69% 65% Rajasthan L2 61% 53% 41% L1 64% 64% 69% Tamil Nadu L2 65% 67% 60% L1 62% 58% 68% Uttar Pradesh L2 71% 62% 59% L1 52% 51% 47% Uttarakhand L2 55% 41% 48% Grand Total 63% 59% 60% Learn-ability Analysis Hindi/Tamil

Rote Conceptual Application- State Level Learning Learning based Learning

L1 59% 56% 68% Rajasthan L2 44% 52% 56% L1 33% 29% 15% Tamil Nadu L2 55% 32% 8% L1 56% 55% 57% Uttar Pradesh L2 57% 60% 62% L1 50% 44% 50% Uttarakhand L2 48% 52% 55% Grand Total 51% 48% 47% Learn-ability Analysis Mathematics

Conceptual Application- State Level Rote Learning Learning based Learning

L1 62% 64% 45% Rajasthan L2 55% 31% 31% L1 57% 64% 44% Tamil Nadu L2 50% 23% 22% L1 43% 59% 47% Uttar Pradesh L2 61% 49% 48% L1 37% 38% 30% Uttarakhand L2 41% 21% 25% Grand Total 50% 49% 40% Learn-ability Analysis General Awareness

State Level Rote Learning Conceptual Learning

L1 62% 50% Rajasthan L2 51% 53%

L1 63% 52% Tamil Nadu L2 56% 65%

Uttar L1 60% 59% Pradesh L2 61% 57%

L1 55% 44% Uttarakhand L2 46% 44%

Grand Total 58% 53% Operational Challenges: Highs and Lows

 Non availability of power supply and power backup led to the assessment happening only in pen- paper mode  Assessment at 3 schools in Rajasthan got cancelled due to flood – (1) Naya Gaav (Baran), (2) Kudaka (Baran) and (3) Bandipura (Baran)  Assessment at 3 schools in Uttarakhand got cancelled due to heavy rains and land slide – (1) Saije Talla (Chamoli), (2) Geera (Chamoli) and (3) Khargola (Chamoli)  Assessment at Madari (Pilibhit) got cancelled at the last moment as the School coordinator was not aware about the assessment till a day before the scheduled date  The assessment team could not reach Pindari (Sonbhadra) because no public transport was available and the team lost its way  In one of the school in Tamil Nadu (closer to Tamil Nadu – Karnataka border), students were not able to read Tamil and were more comfortable in Kannada. Teacher’s help was taken in translating the instructions and questions.  Assessment could not be done in one School in south as it was a Saturday and students were not available. When the same event was re-planned, again it could not be conducted as the school coordinator was not reachable throughout the day and team waited the entire day. Operational Challenges: Highs and Lows

 At many locations in North India, students were facing dialect issues and were able to understand local dialect better than Hindi. In such cases, teacher’s help was taken in explaining the test instructions  There is no common fixed ‘School start time’ and different schools started at different times of the day (some start as late as 3:00 PM) which caused the assessment team to wait for long hours at many locations.  Assessment in South was coordinated smoothly and no difficulty was faced in locating the schools  Overall, students were found to be very curious, enthusiastic and excited to participate in the test  There was no (near negligible) resistance by teachers and Ekal karyakarta’s to conduct the test.  Students were seen active while participating in the prayer sessions and interaction with teachers Rajasthan Male-Female Mean Score Difference

Difference Rajasthan English Hindi Mathematics General Awareness Murata (Alwar) 6 18 14 21 Radhswmi Ki Dhani (Ajmer) 2 4 16 11 Nerwala Ka Was (Alwar) -5 15 10 9 Naogel (Alwar) -7 8 13 11 Ranf (Bharatpur) -10 -15 -20 -6 Nayara (Ajmer) -18 4 -15 13 Ataru (Baran) -29 -9 0 5 Sadivas (Bharatpur) -35 -30 -6 -3

 Highest & lowest male-female mean score difference is observed for Murata & villages respectively.  Maximum variance in male-female mean score difference observed for English & General Awareness Modules.

High Medium All scores are reported on a scale of 100 *The gradient of color in the cells represents the variation in scores Low Tamil Nadu Male-Female Mean Score Difference

Difference Villages English Hindi Mathematics General Awareness Gandijipuram 23 8 -31 -14 Makapallayam 10 -3 -5 -6 K kurumapati 8 9 -19 11 Sanmugavalasu 6 22 -2 12 Naganthal 4 4 11 1 K c patti 4 5 2 9 Vapanatham -1 2 -2 -2 Panaikadu -2 15 15 -4 Haripuram -6 0 1 13 Komaiur -11 3 -4 -6 Manjakambi -23 -8 6 -17  Highest & lowest male-female mean score difference is observed for Gandijipuram & Manjakambi villages respectively

High Medium All scores are reported on a scale of 100 *The gradient of color in the cells represents the variation in scores Low Uttar Pradesh Male-Female Mean Score Difference

Difference Villages English Hindi Mathematics General Awareness Chhivrau (Mathura) 29 33 16 34 Jhadyahi(Allahbad) 18 16 13 24 Fagujot 17 22 4 10 Kanaura (Mirzapur) 7 1 2 11 Girgitiya (Gorakhpur ) 2 16 10 15 Baleem Ganj -1 1 -9 1 Nagli -3 -2 1 2 Sevka Dad (Sonbhadra) -3 8 5 2 Birampur -8 -7 -2 1 Guladia -9 -10 -5 6 Gopalpur (Shahjahanpur) -12 -1 1 -5

 Males out perform females significantly across General Awareness module in Cchivaru & Jhadyahi

High Medium All scores are reported on a scale of 100 *The gradient of color in the cells represents the variation in scores Low Uttarakhand Male-Female Mean Score Difference

Difference Uttarakhand English Hindi Mathematics General Awareness

Loharkhet (Almoda) 6 -9 -13 -12

Rameswsarpur (Udham Singh Nagar) 5 -4 -4 -4

Sampatpur No 1 (Udham Singh Nagar) 4 12 -3 12

Patyashar (Almoda) 0 -4 -11 -16

Gaushala (Udham Singh Nagar) -3 -23 -21 -18

Bidhunia (Almoda) -13 -17 -3 -12

Matai (Chamoli) -14 1 1 -14

 Females have out-performed Males in most of the villages including Gaushala & Bidhunia

High Medium All scores are reported on a scale of 100 *The gradient of color in the cells represents the variation in scores Low What determines student learning

Student Teacher Parameters Distance Villages General Mathematics & General Literacy from English Hindi Mathematics English Awareness Logical Ability Awareness Rate Railway Station panaikadu gandijipuram Nayara (Ajmer) Guladia haripuram k c patti Manjakambi Nerwala Ka Was (Alwar) Gopal pur (Shahjahanpur) Baleem Ganj naganthal Birampur Kanaura (Mirzapur) sanmugavalasu Radhswmi Ki Dhani (Ajmer) k kurumapati Sevka Dad (Sonbhadra) Naogel (Alwar) Rameswsarpur (Udham Singh Nagar) Patyashar (Almoda) Sadivas (Bharatpur) Matai (Chamoli) Ataru (Baran) Girgitiya (Gorakhpur ) Murata (Alwar) Nagli Ranf (Bharatpur) Bidhunia (Almoda) Gaushala (Udham Singh Nagar) Loharkhet (Almoda) Fagujot Chhivrau (Mathura) Jhadyahi(Allahbad) Sampatpur No 1 (Udham Singh Nagar) vapanatham makapallayam Komaiur