A philosophical approach to the control problem of artificial intelligence By: David García San José Davidzeng Chusen Chung Jesper Rye Olsen Jesper Zatawat Krogh Lindhardtsen Jonas Andersen Bro Naja Cecilie Marckwardt Supervisor: Martin Ejsing Christensen Spring 2016, 4. Semester Philosophy & Science Studies, This report is in English, as it is written across language barriers. Abstract The goal of this project is to highlight the control methods of AI, based on the assumption that the AI will have consciousness and might constitute an existential risk. The report contains a segment of the ethical and moral issues that occur as a result of working within this field. To do so, Kant's definition of consciousness and variations of utilitarianism is used to establish a base perspective. It is through this perspective that the ethical issues that revolves around constraining a conscious AI are discussed. It was deemed fitting to look at the fictional portrayal of AI in visual arts, them being in the form of movies. This resulted in the choice of Ex machina, 2001: A Space Odyssey and Blade Runner. This analysis focuses on the ethical issues which arises from the implementation of the various control methods. We find that, from an utilitarian point of view which takes into consideration not only suffering and pleasure but also the quality of the pleasure, most of the control methods portrayed are seemingly either ineffective or unethical in their implementation. A philosophical approach to the control problem of artificial intelligence Table of content 1.0 Introduction and problem area ...................................................................................................... 3 1.1 Introduction & premise .............................................................................................................................. 4 1.2 Problem Area .............................................................................................................................................. 5 1.2.1 Problem formulation and work questions ................................................................................................. 6 1.3 Motivation ................................................................................................................................................... 7 2.0 Theory and methods........................................................................................................................... 8 2.1 Choice of Theory and Sources .................................................................................................................... 9 2.1.1 Movies used in this project ........................................................................................................................... 10 2.1.2 Theory used in this project .......................................................................................................................... 12 2.2 Utilitarianism & Kant ................................................................................................................................................................... 14 2.2.1 Utilitarianism .................................................................................................................................................... 14 2.2.2 Kant and consciousness................................................................................................................................. 17 2.3 The singularity, AI, and superintelligence .............................................................................................. 20 2.3.1 Defining artificial intelligence ..................................................................................................................... 21 2.3.2 Superintelligence (AI++) ............................................................................................................................... 24 2.3.3 Singularity - why there will be superintelligence ................................................................................. 27 2.3.4 The use of neural networks in AI ............................................................................................................... 28 2.3.5 Singularity as an existential risk................................................................................................................. 30 2.3.6 Mind crime ......................................................................................................................................................... 32 2.4 Methods .................................................................................................................................................... 33 2.4.1 Report structure and epistemological considerations ........................................................................ 33 2.4.2 Analysis and discussion method ................................................................................................................ 34 2.4.3 Critical reflection on the group process ................................................................................................... 34 3.0 Movies ................................................................................................................................................... 36 3.1 Ex Machina ............................................................................................................................................... 39 3.1.1 Introduction to the movie ............................................................................................................................. 39 3.1.2 Portrayal of AI ................................................................................................................................................... 39 1 A philosophical approach to the control problem of artificial intelligence 3.2 2001: A Space Odyssey ............................................................................................................................ 44 3.2.1 Introduction to the movie ............................................................................................................................. 44 3.2.2 Portrayal of AI ................................................................................................................................................... 45 3.3 Blade Runner ........................................................................................................................................... 48 3.3.1 Introduction to the movie ............................................................................................................................. 48 3.3.2 Portrayal of AI ................................................................................................................................................... 49 4.0 Control methods ............................................................................................................................... 51 4.1 Different kinds of Control........................................................................................................................ 52 4.2 Capability control methods ..................................................................................................................... 53 4.3 Motivational selection methods .............................................................................................................. 56 5.0 Analysis ................................................................................................................................................ 61 5.1 Control methods used in Ex Machina ...................................................................................................... 62 5.1.1 Ethical considerations regarding Ava and Kyoko ......................................................................... 674 5.2 Control methods used in 2001: A Space Odyssey ................................................................................... 66 5.2.1 Ethical considerations regarding HAL 9000 ...................................................................................... 67 5.3 Control methods used in Blade Runner ............................................................................................................................... 70 5.3.1 Ethical considerations regarding Nexus 6 replicants .................................................................... 71 6.0 Discussion and conclusion ............................................................................................................ 74 6.1 Discussion ................................................................................................................................................ 75 6.1.1 Controlling AI in an ethical manner .......................................................................................................... 75 6.1.2 Assumptions and premises .......................................................................................................................... 81 6.2 Conclusion ................................................................................................................................................ 84 6.3 Perspective .............................................................................................................................................. 86 2 A philosophical approach to the control problem of artificial intelligence 1.0 Introduction and problem area The purpose of this chapter is to