IBM Research

HCI for the Next Billions

Nitendra Rajput IHCI, Las Pamas, July 22, 2015 IBM Research, New

© 2013 IBM Corporation HCI for the Next Billions Overview

Style Content

§ The real situation § Education § Where HCI can help § Healthcare § Some examples § Agriculture

2 © 2013 IBM Corporation HCI for the Next Billions Overview

Style Content

§ The real situation § Education § Where HCI can help § Some examples

3 © 2013 IBM Corporation HCI for the Next Billions

4 © 2013 IBM Corporation HCI for the Next Billions

Challenges in Indian Education System Poor quality of educaon at all levels

It is estimated that ~75% of technical graduates and ~85% of general graduates are unemployable by India’s high-growth global industries.

“Our university system is, in many parts, in a state of disrepair….in almost half the districts in the country, higher education enrollment is abysmally low…almost two thirds of our universities and 90% of our colleges are rated as below average on quality parameters”. Dr. Manmohan Singh, 150th Anniversary, Univ. of (2007) © 2013 IBM Corporation HCI for the Next Billions Poor Quality of Instruction….. • According to a 2004 report, at school levels, ~51% of teachers • Low teacher movaon results in high degree of are higher secondary qualified or below - including ~24% absenteeism secondary, 4% below secondary. Only 31% are graduates. ―According to a World Bank report, 25% of teachers were absent from school and only half were teaching, during unannounced visits • Only 44% of teachers have received some form of in-service to a naonally representave sample of training. government primary schools in India.

• Teacher-student rao has sharply deteriorated e.g. from 1:20 in 1951 to 1:43 in 2002 (primary level). Difficult to provide individual aenon

• Nearly 20% of primary schools have just one teacher and 43% have just two teachers. 1.4% primary schools have no teacher. (District Informaon System for Educaon Report for 2003)

• At the University level, >50 % of teaching posts are lying vacant on an average, amongst universies surveyed by UGC.

Table: Vacant Posiitons in Sample Universities © 2013 IBM Corporation HCI for the Next Billions Poor Quality of Infrastructure

• Educaonal infrastructure ―Teachers are largely dependent on convenonal tools like chalk-boards for teaching and have almost no access to other supporve materials, or any means to or re-use resources ―Text books are updated infrequently , oen contain errors, and due to lack of localizaon, they are oen not engaging. Learning by rote is encouraged.

• Physical infrastructure ―Poor quality of buildings, inaccessible roads, lack of basic facilies, shortage of electricity; 90% of school budget in government school goes towards salary payment ―A study of 188 government-run primary schools in central and northern India revealed that 59% of the schools had no drinking water facility, and 89% had no toilets.

Thus despite basic education being virtually free, a large segment of our population does not see or receive the intended benefits of education.

Drop out rates are still very high: 95% join primary education, only 40% proceed to secondary, and only 7% reach beyond 10th grade. © 2013 IBM Corporation HCI for the Next Billions Possibilities for HCI in Education Transformation Space

Interaction Transformation Creation • 3D content Transformation • Wearables/tablets • Collaborative Creation • Gesture interfaces • Personalization The new wave of sensors, • Augmented Reality wearables, cognition and mobile computing provides endless possibilities for IBM to define and Analytics lead the changes in (a) the manner Transformation Education • Interaction Sensing Transformation in which this content can be • Social sensing created, (a) the educational content • Location Sensing and its consumption patterns that can be analyzed, and (c) the

manner in which the interaction Collaboration can change for effective learning. Transformation Experiments • Across students Transformation • Across teachers • Virtual science • Across devices experiments • Laboratory

8 IBM Confidential © 2013 IBM Corporation HCI for the Next Billions Creation Transformation

§ Understand the unique value proposition of mobile for content creation as opposed to content consumption/delivery Most content creation is § Exploit unique sensors such as location, now from mobile camera, microphone etc. devices

§ Collaborative content creation and verification as Derive additional meta- data about content, such opposed to single point of creation in LCMS as location, state, etc. (multiple authors) Will enable possibilities § Crowdsourced meta-data a la ESP game of faster and localized content creation § Demand visibility for content creation § Experts know what content users are Develop mechanisms to enable easier content demanding and stress on that creation from mobile devices

§ Incentive mechanisms for quality content creation § On demand content creation § Fair usage policy (use if you create)

§ Interesting visualization and consumption of the data on mobile from the cloud

9 IBM Confidential © 2013 IBM Corporation HCI for the Next Billions Creation Transformation Example: EduBay

10 IBM Confidential © 2013 IBM Corporation HCI for the Next Billions Interaction Transformation

Gesture Based Haptics Google Glasses Augmented Reality Interface • No longer passive • Make the teacher- • Bridge the gap • Build systems, content streaming student interaction between real world especially for to the student richer and and the virtual accessibility, that • Detect user meaningful by world by building can take user input attention and overlaying student technologies that through gestures interest through information can interact with • Borrow from various sensors • Make passive text the real world gesture based • Students interact books more • Develop games to the not only through interactive by mechanisms to education world touch screens, but detecting related make a paper rich! • Provide richer and by tilting the content and • Use QR code differentiated device, gesturing to beaming on based technologies education the device glasses to bridge this gap experience through richer user input mechanisms

© 2013 IBM Corporation HCI for the Next Billions Interaction Transformation Example: Learning Path using QR Codes 1

Students checks out a job 50% opportunity and captures the skills required for the job that are provided as a QR code in a news paper.

2

The mobile scans the QR code and shows the 3 Find Learning Path target skills that the user needs to acquire The user can overlay his for this job knowledge graph (skills that he has already acquired) and generate a learning path. Click on a node to get Content 4

The user then selects a parcular concept idenfied in the learning path and starts the learning 12 © 2013 IBM Corporation HCI for the Next Billions Analytics Transformation

§ Using Smart Phone sensors to Mobile sensors determine the context of the student GPS/WiFi – GPS: Outdoor location – WiFi: Indoor location Accelerometer

– Accelerometer: User movement Barometer – Bluetooth: User group Dynamic Microphone Context – Barometer: User height Attributes – Microphone: Noise level of Orientation environment § Conducts situation-centric deep context data collection about users via smartphones

§ Opportunities to perform analytics not only at a course/performance level, but also at an interaction level to – increase user attention – provide real-time feedback – adapt to the environment – enable real-time collaboration

13 © 2013 IBM Corporation HCI for the Next Billions Analytics Transformation Example: VibRein

© 2013 IBM Corporation HCI for the Next Billions Experiments Transformations

• One can learn science through lectures, but there remains a huge gap in terms of conducting experiments. No physical school is without a chemistry or physics lab. The Gap • However, none of the current solutions in the Online Education space cater to experiments • Need to develop methodology and set of technologies to create virtual experiments toolkit to complete the online education story

• Use the gyroscope and accelerometer sensor to determine effect of moving physical objects

• Use advanced visualization techniques to enable changing of the objects based on the movements and the associated events Opportunities • Identify the physical objects that can be modeled by the mobile device and then determine the experiments that can be conducted on such an object.

• Develop a platform that can model the reaction of the physical objects and can enable creation and customization of virtual experiments.

15 © 2013 IBM Corporation HCI for the Next Billions Chemistry Experiments Example

Chemistry Repository

Pour chemicals using the lt sensor. Models Tangible chemical experiments with safety of no actual chemicals. Engine

Shake aer mixing chemicals as required in chemistry, using shake (accelerometer). Improper shake can be made to result in improper reacon as it happens in real.

Chemistry Repository

Models

Engine Srring and centrifugal mixing using rotaon of phone on the table (gyroscope, accelerometer).

16 © 2013 IBM Corporation HCI for the Next Billions Chemistry Experiments Example

Chemistry Repository

Pour chemicals using the lt sensor. Models Tangible chemical experiments with safety of no actual chemicals. Engine

Shake aer mixing chemicals as required in chemistry, using shake (accelerometer). Improper shake can be made to result in improper reacon as it happens in real.

Chemistry Repository

Models

Engine Srring and centrifugal mixing using rotaon of phone on the table (gyroscope, accelerometer).

17 © 2013 IBM Corporation HCI for the Next Billions Spoken-English Learning Cricket Game

. An after-school mobile phone based audio game for students in rural India.

. Primary aim is to improve the Spoken-English language skills. The game also incorporates English spelling learning and word-meaning learning.

. The content of the game is based on the books and the curriculum of the schools.

. The game can be used by calling the toll-free number: 1800-1020-426. The users does not have to pay for using the game. © 2013 IBM Corporation HCI for the Next Billions Overview

Style Content

§ The real situation § Healthcare § Where HCI can help § Some examples

19 © 2013 IBM Corporation HCI for the Next Billions The Healthcare Landscape

Economy, Selling Environment Regulatory Environment q Healthcare spending is 5% of GDP – q India has a social security-type public health insurance system, but covers only 20% of among the lowest in the world; government population; as a result, citizens’ pocket expenses are high at 68% of total healthcare spending – funds ~33% of expenses – also the lowest one of the highest in the world q 2011 IT spend within 1,000+ market: Payor q The government funds 26% of healthcare spending; 74% from out of pocket expenses and private $50M; Provider $60M; CAGR 2011-15: insurance (20% of population has private insurance) 13.4% and 14.7% respectively q The Dept. of Health sets national healthcare policies and establishes spending priorities; initiatives are set in 5-year plans; the central government oversees 28 states and 7 territories

Technology Adoption End-user Trends Industry Leaders, Local M&A, Key Alliances & Drivers / Inhibitors Ecosystem Announcements q The healthcare market is $70B q Shortage of doctors and q 11,289 hospitals; 70% are q The government is pushing in 2010; will grow to $125B in 5 other clinicians – below WHO public, but private hospitals private-public partnerships years; hospitals are 50% of limits treat 70% of all patients; (PPP) to expand healthcare spend; private hospitals to q Private providers offer world q Government-run General q July 2011 Fortis has 8 hospitals benefit due to poor public class care and invest heavily Insurance Company and its 4 in development for 1,400 beds health in IT and new technology, subsidiaries are key insurers q May 2011 Apollo Hospital is q High-growth IT areas will be in while public providers lag q Foreign-based insurers include expanding in by 100 analytics and collaborative tools q Foreign-based insurers must Cigna, NY Life-UK insurer beds for medical tourism, and q Telematics and telemedicine form joint ventures with local BUPA partnership, MetLife, Hyderguda hospital by 175 are increasingly being used companies to operate Aetna, UnitedHealth beds to reach a wider group of q Private health insurance grew q Apollo, Fortis Healthcare, q May 2011 Fortis acquired patients, especially in rural 41% over the past 4 years and CARE Hospitals, Manipal 71.5% of Super Religare areas is expected to reach $7.7B by Group, and MAX Healthcare Laboratories (SRL) q Videoconferencing with 2015 are the top private hospital electronic medical records have chains q Medical tourism expected to be enabled patients to gain access $2B in 2012; govt investing q IT leaders are Wipro, GE to doctors and avoid health $6.5B in next 2 years to support Healthcare, Microsoft, centers that often lack skilled medical tourism and is offering Siemens, Vepro, Tata, BirlaSoft, medical personnel special medical visas Sobha Renaissance 20 © 2013 IBM Corporation HCI for the Next Billions The Challenges

Ref21 : “THE BEST & WORST PLACES TO BE A MOTHER” in state of world’s mother report by save the children charity organisation© 2013 IBM Corporation HCI for the Next Billions Solution… Motivation… • Gesture based health information system • Women are mostly shy discussing issues • Low literate pregnant women from villages in with male doctors, so an automated system Assam. will be much less intrusive • Mostly Assamese, with a variation in the local dilect. • Useful for low literate users • Currently works on Kinect (can be deployed • Women can gesture a speciic action to using another Camera) explain a problem rather than speak to it • A voice IVR system to record questions from • Conducted a enthnographic study for 2 the women, which doctor can answer through months in Remote areas in Assam to derive their phone. these insights • Health care information on medical checkups, food habits, good practices etc.

22 © 2013 IBM Corporation HCI for the Next Billions Overview

Style Content

§ The real situation § Agriculture § Where HCI can help § Some examples

23 © 2013 IBM Corporation HCI for the Next Billions Sugarcane Farming

§ Sugarcane farming scenario – Collect sugarcane from farmers around the state – Cane is processed at the Mill to produce several products – If Mill has reached its capacity to process sugarcane, it rejects the farmer’s produce that day – Results in drying of the sugarcane and loss of revenue to farmer 24 IBM India Research Lab © 2013 IBM Corporation HCI for the Next Billions System Usage § Information announcement system to farmers from the sugar factory § 6500+ registered farmers § Integrated Web front-end § Launched in January, 2010 § Received more than 30,000 calls from 1600+ unique callers in 3 months § Farmers recorded 7000+ questions

Jun 25 IBM India Research Lab © 2013 IBM Corporation e 24, 200 8 HCI for the Next Billions The Farmer’s Facebook(?) on Voice

Entry

Signature Tune

New Message? No 1. Main Menu Yes

Queson Announcements New Queson Board & Answers Radio Board Response

26 © 2013 IBM Corporation HCI for the Next Billions Usage Statistics

§ Pilot Launch: Dec 24, 2008 § Report Summary (as of Feb 29, 2012) – Total number of calls received = 52428

§ Services Accessed – Question & Answers 34211 – Announcements 1243 – Radio Programs 7529

27 © 2013 IBM Corporation HCI for the Next Billions Overview

Style Content

§ The real situation § Education § Where HCI can help § Healthcare § Some examples § Agriculture

28 © 2013 IBM Corporation

IBM Research India

HCI for the Next Billions is not good to have – but is essential

Nitendra Rajput ([email protected]) (@nitendrar on Twitter)

IBM Research, New Delhi

© 2013 IBM Corporation