From Digital Studyhall to Digital Publichealth
Total Page:16
File Type:pdf, Size:1020Kb
9/21/2012 Tutored Video Instruction • Video of expert teacher • Presented with the aid of the facilitator • Theory: Interaction with the video better than ‘just watching TV’ Aug 24, 2012 From Digital Aug 24, 2012 • Initial work: Gibbons, Stanford, 1977. • Tutored Videotape Instruction StudyHall to Digital • University of Washington • Introductory programming offerings to Community Colleges • Recorded UW lectures used by existing community college Microsoft Research Microsoft Research India Microsoft Research India PublicHealth instructors Richard Anderson Department of Computer Science and Engineering University of Washington, Seattle, USA 1 2 Digital StudyHall Digital StudyHall Hubs • Founded by Randy Wang, ex-Princeton • Lucknow • Collaboration with Urvashi Sahni, Studyhall School • Pune • Top private school in Lucknow • Calcutta Aug 24, 2012 • DSH Methodology Aug 24, 2012 • Bangalore • Create videos of classes taught by expert teachers to low-income students • Bangladesh • Train teachers to facilitate videos • Pakistan • Target rural schools • Nepal • Randy Wang timeline Microsoft Research Microsoft Research India Microsoft Research India • Start DSH independently • Join MSRI • Depart MSRI, continue DSH independently • Leave India for Intel Shanghai 3 4 Does facilitated video Digital StudyHall instruction work? methodology • Lesson videos recorded at hub school • Use of interactive pedagogy Aug 24, 2012 Aug 24, 2012 • Careful matching of students • Tie to regular curriculum • Training of facilitators • Facilitation model Microsoft Research Microsoft Research India Microsoft Research Microsoft Research India • Mix of video use and activities NSF Funded project conducted by University of • Cost realism in Washington 5 technology deployment 6 2008-2011 1 9/21/2012 Project domain: Primary Does it work? education in rural India • Study of eleven • Does the use of Digital StudyHall improve learning outcomes? government schools in Uttar Pradesh, India • Pre-test / Post-test performance of control and treatment classes • Rural schools outside of • Does Digital StudyHall lead to pedagogical change in the Aug 24, 2012 large city Aug 24, 2012 school? • Introduction of • Observe differences in classroom activities between DSH and methodology to new non-DSH classes schools • Does Digital StudyHall improve indicators such as attendance or hours of instruction? Microsoft Research Microsoft Research India Microsoft Research Microsoft Research India • Is Digital StudyHall sustainable? • Do schools continue to use DSH on their own with modest supervision and support resources 7 8 The main result Caveats There are significant obstacles to scalability and • We are not claiming generality of the result sustainability of Digital StudyHall in Government • Other types of schools? Other geographies? primary schools in Uttar Pradesh, India • Favorable evaluation from teachers and students Aug 24, 2012 Aug 24, 2012 • Two of eleven schools wanted to continue after the end of the study • We believe that the vast majority of government schools • Example of a successful DSH school from outside of the study would not continue to use DSH without frequent monitoring area visits • Rural government school in Uttar Pradesh Microsoft Research Microsoft Research India • Our outcome testing was inconclusive, yielding no meaningful Microsoft Research India results 9 10 Study Design Failure in testing • 11 schools (out of 20) selected from the block we Even if the use of Digital StudyHall produced substantial had permission to work in • Schools had not previously improvements in learning, we would not have been able worked with DSH to measure it Aug 24, 2012 Aug 24, 2012 • Introduction through principals and teacher training workshops • Study design rd th • Regular observation visits • Alternate use of 3 grade English and 5 grade Math as control • Interviews or treatment class • Year one: • Why testing was inconclusive Microsoft Research Microsoft Research India • Pre-test/Post-test with controls Microsoft Research India • No culture of evaluative testing in the classroom • Year two: • Low attendance Pre • No testing • Gradual start/end, holidays, missing tests • Expanded observations • High variability in school performance and student Mid 11 12 performance Post 2 9/21/2012 Relationship with Student view of video students implementing organization • Implementing organization: StudyHall, well regarded private • Content creation school • Lessons by expert • Implementation team primarily Indian teachers Aug 24, 2012 • Adequate buy-in from principals Aug 24, 2012 • Poor, urban students • With official permission • Students identified • Teachers generally favorable to implementing organization with video students • Trainings, involvement with StudyHall and other teachers a • The students said the positive Microsoft Research Microsoft Research India Microsoft Research Microsoft Research India video students were • Students had a very positive view of implementing “just like them.” organization • Validation of video • Novelty creation strategy • Disruption 13 14 Facilitator understanding and Facilitator buy in to use of methodology methodology • Interactive pedagogy • Mixed level of • Activities adoption by teachers • Poems, songs, drama • Issues • • Urban/Rural split Aug 24, 2012 Intervention had goal Aug 24, 2012 of changing teaching • Lack of incentives to • Training of facilitators teach and monitoring visits • Alternate usage • Observations models • Video lessons for review Microsoft Research Microsoft Research India confirmed use of Microsoft Research India interactive techniques • Facilitated by studens • Unexpected • Difference between • Teachers viewing lessons regular teachers and in advance at home 15 para-teachers 16 • Education levels Sustainability challenges Counterpoint: Bhal Vidyalaya • Evidence of non- • School has been using sustainability DSH for six years • In year one, level of use • Limited monitoring was strongly correlated • School purchased second Aug 24, 2012 with monitoring visits Aug 24, 2012 set of equipment • Long interruptions of • Regular use of DSH in many electrical supplies to classes schools, where schools did little to restore • Full buy in from school power • Struggled with DSH Microsoft Research Microsoft Research India • Some schools did not Microsoft Research India introduction want replacement equipment after theft • Eventually, championed • General problems with by principal teacher absenteeism 17 • Rural school 18 3 9/21/2012 Evaluating technology DSH Update interventions • Study took an intervention to “next level” of scale • Randy Wang’s involvement severely limited • New deployment in eleven schools over two years • External support from MONA Foundation • Challenging environment, but with very high impact if successful • Existing assets for DSH Aug 24, 2012 • We were naïve to think we could measure educational Aug 24, 2012 • Lucknow based organizations (~6 people) outcomes • Technical capacity in video production, distribution, and use • Randomized trials are out of reach for this type of intervention • Base in StudyHall school • There were conflicts between the research project and • Content library teaching the kids • Several sustained DSH deployments Microsoft Research Microsoft Research India Microsoft Research India • Example – study staff would give lessons to the kids when the • Hired Lucknow based manager teachers were absent • Shift in strategy • Recognition of a complex system where a technology • DIETs – teacher training colleges intervention is a modest part 19 20 • Girls residential school DStar • Developed community video education for Agriculture • Original vision – Apply Digital StudyHall methodology to • Started as a project at Microsoft Research multiple domains • Formed NGO, currently reaching 1200 villages • Scaling with NRLM to reach 10000 villages • DSH Methodology • Digital Green model Aug 24, 2012 • Locally created video Aug 24, 2012 • Livelihood education conducted by community facing organizations • Facilitated use • Agricultural messaging developed by experts • Members of the community filmed demonstrating or talking about the • Hub and spoke model techniques • Content archive • Videos reviewed for content and quality • Digital Green – MSRI project by Rikin Gandhi • Videos shown by facilitators in community group meetings Microsoft Research Microsoft Research India Microsoft Research Microsoft Research India • Digital Polyclinic – DSH Lucknow efforts in health 21 22 Digital Public Health PATH • PATH / UW / Digital Green collaboration • Seattle based NGO working in health technologies • Application of Digital Green methodology to maternal health • Founded 1977 • One year pilot starting August 2012 • Now working in 70 countries Aug 24, 2012 Aug 24, 2012 • • Goal: demonstrate feasibility Program for Appropriate Technology in Health • Approximately 1000 employees world wide, 400 in Seattle • Five offices in India Microsoft Research Microsoft Research India Microsoft Research India 23 24 4 9/21/2012 SureStart: Improving maternal and child Key aspects of Digital Green health in India • Digital Green supports field based organizations using community • Community engagement to support video in their agricultural programs maternal and newborn health • Key innovations of Digital Green . Governance and public health interventions • Model for community creation of video content . Mentoring support for accredited social health activists (ASHAs) Aug 24, 2012 • Model for facilitated uses of videos in the