November 2019 The self-driving car that witnessed a murder Ethical dilemmas in AI Martin Hamilton, Futurist, Jisc @martin_hamilton 1. Ethical dilemmas 2. Data and ethics for AI in education 3. UK lawmakers’ recommendations 1. Ethical dilemmas 3 The self-driving car that witnessed a murder - HEANet 2019 It begins with the racist soap dispenser 4 The self-driving car that witnessed a murder - HEANet 2019 My friend’s not a gorilla 5 The self-driving car that witnessed a murder - HEANet 2019 My friend’s not a gorilla 6 The self-driving car that witnessed a murder - HEANet 2019 In memoriam, Elaine Herzberg The death of Elaine Herzberg (August 2, 1968 – March 18, 2018) was the first recorded case of a pedestrian fatality involving a self-driving (autonomous) car, after a collision that occurred late in the evening of March 18, 2018. Herzberg was pushing a bicycle across a four-lane road in Tempe, Arizona, United States, when she was struck by an Uber test vehicle, which was operating in self-drive mode with a human safety backup driver sitting in the driving seat. Herzberg was taken to the local hospital where she died of her injuries. https://en.wikipedia.org/wiki/Death_of_Elaine_Herzberg 7 The self-driving car that witnessed a murder - HEANet 2019 In memoriam, Elaine Herzberg The death of Elaine Herzberg (August 2, 1968 – March 18, 2018) was the first recorded case of a pedestrian fatality involving a self-driving (autonomous) car, after a collision that occurred late in the evening of March 18, 2018. Herzberg was pushing a bicycle across a four-lane road in Tempe, Arizona, United States, when she was struck by an Uber test vehicle, which was operating in self-drive mode with a human safety backup driver sitting in the driving seat. Herzberg was taken to the local hospital where she died of her injuries. https://en.wikipedia.org/wiki/Death_of_Elaine_Herzberg 8 The self-driving car that witnessed a murder - HEANet 2019 Autonomous emergency breaking 9 The self-driving car that witnessed a murder - HEANet 2019 Autonomous emergency breaking (maybe) 10 The self-driving car that witnessed a murder - HEANet 2019 Your plastic pal who’s fun to be with https://www.youtube.com/watch?v=G6fMV1UPzkg&featur e=youtu.be&t=120 11 The self-driving car that witnessed a murder - HEANet 2019 New Robot Makes Soldiers Obsolete 12 The self-driving car that witnessed a murder - HEANet 2019 Introducing the Flamethrower Drone 13 The self-driving car that witnessed a murder - HEANet 2019 Introducing the Flamethrower Drone 14 The self-driving car that witnessed a murder - HEANet 2019 Welcome to the Uncanny Valley ? 15 The self-driving car that witnessed a murder - HEANet 2019 Adversarial AI – from gun turtles to CVDazzle https://cvdazzle.com/ 16 The self-driving car that witnessed a murder - HEANet 2019 2. Data and ethics for AI in education 17 The self-driving car that witnessed a murder - HEANet 2019 About Jisc Our vision is for the UK to be the most digitally advanced higher and further education and research nation in the world. We provide Shared digital Sector-wide vendor and Expert trusted advice infrastructure publisher deals 18 The self-driving car that witnessed a murder - HEANet 2019 Jisc in numbers 18 million 310 160 40 Colleges Universities Research institutes Users 19 The self-driving car that witnessed a murder - HEANet 2019 Janet network jisc.ac.uk/janet 20 The self-driving car that witnessed a murder - HEANet 2019 Building digital capability 21 The self-driving car that witnessed a murder - HEANet 2019 https://digitalcapability.jisc.ac.uk/ Envisioning Education 4.0 Teaching transformed – how should human teachers focus their efforts if AI and other technologies become used to their full potential in the university experience Personalised adaptive learning – an individualised approach that takes learner diversity, performance and behaviour into account Assessment re-imagined – can AI, digital experiential learning and micro-credentials replace high stakes summative tests? Intelligent digital and physical estates – which work together and are responsive to student journeys and interactions 22 The self-driving car that witnessed a murder - HEANet 2019 Beyond learning analytics Intelligent campus Curriculum analytics Employability and Wellbeing analytics apprenticeship analytics 23 The self-driving car that witnessed a murder - HEANet 2019 Mental health and wellbeing jisc.ac.uk/reports/horizons-report-emerging-technologies-and-the-mental-health-challenge 24 The self-driving car that witnessed a murder - HEANet 2019 Artificial intelligence 25 The self-driving car that witnessed a murder - HEANet 2019 3. UK lawmakers’ recommendations 26 The self-driving car that witnessed a murder - HEANet 2019 Action from UK parliamentarians • All-Party Parliamentary Group on Data Analytics, supported by Jisc • Enquiry into data ethics kicked off Autumn 2018 – focus on healthcare, education, policing and autonomous vehicles • “Trust, transparency and tech” report launched May 2019 • Now following up with a series of implementation roundtables https://www.policyconnect.org.uk/appgda 27 The self-driving car that witnessed a murder - HEANet 2019 Options for enforcement ? https://privacyinternational.org/long-read/3196/no-bodys-business-mine-how-menstruation-apps- are-sharing-your-data 28 The self-driving car that witnessed a murder - HEANet 2019 29 The self-driving car that witnessed a murder - HEANet 2019 Recommendations 30 The self-driving car that witnessed a murder - HEANet 2019 Recommendations 31 The self-driving car that witnessed a murder - HEANet 2019 Recommendations 32 The self-driving car that witnessed a murder - HEANet 2019 Ethical issues around Autonomous Vehicles Some ethical issues we identified around AVs: • What does an MOT look like ? Five.AI suggest an industry wide certification framework and Digital Highway Code is needed • Do we need something like Toby Walsh’s Turing Red Flag – some visual indicator that a vehicle is operating autonomously ? • Can and should we permit AVs to give evidence when they witness an accident or a crime taking place ? • Who owns which of the data streams that AVs collect, like LIDAR mapping of their operating environment ? • How can we ensure that vulnerable or marginalised members of society have equitable access to AVs ? • If AVs prove to be significantly safer than human drivers, might we one day ban manual driving altogether ? • What does insurance cover look like for flocks of AVs collaborating to reduce impact/damage in the milliseconds before an unavoidable accident ? Images CC BY-SA by Dllu, Wikimedia Commons CC BY WiNG, Wikimedia Commons 33 The self-driving car that witnessed a murder - HEANet 2019 Conclusions 34 The self-driving car that witnessed a murder - HEANet 2019 Conclusions Five key ideas: • General Data Minimisation Regulation • Data nutrition labelling • Right of explanation • Turing Red Flag • License to operate And one big takeaway: • We in research and education can lead by example https://datanutrition.media.mit.edu/ 35 The self-driving car that witnessed a murder - HEANet 2019 Many thanks! Martin Hamilton Futurist [email protected] @martin_hamilton Except where otherwise noted, this work is licensed under CC-BY 36 The self-driving car that witnessed a murder - HEANet 2019.