DOCSLIB.ORG

A Philosophical Approach to the Control Problem of Artificial Intelligence

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
A Philosophical Approach to the Control Problem of Artificial Intelligence A philosophical approach to the control problem of artificial intelligence By: David García San José Davidzeng Chusen Chung Jesper Rye Olsen Jesper Zatawat Krogh Lindhardtsen Jonas Andersen Bro Naja Cecilie Marckwardt Supervisor: Martin Ejsing Christensen Spring 2016, 4. Semester Philosophy & Science Studies, This report is in English, as it is written across language barriers. Abstract The goal of this project is to highlight the control methods of AI, based on the assumption that the AI will have consciousness and might constitute an existential risk. The report contains a segment of the ethical and moral issues that occur as a result of working within this field. To do so, Kant's definition of consciousness and variations of utilitarianism is used to establish a base perspective. It is through this perspective that the ethical issues that revolves around constraining a conscious AI are discussed. It was deemed fitting to look at the fictional portrayal of AI in visual arts, them being in the form of movies. This resulted in the choice of Ex machina, 2001: A Space Odyssey and Blade Runner. This analysis focuses on the ethical issues which arises from the implementation of the various control methods. We find that, from an utilitarian point of view which takes into consideration not only suffering and pleasure but also the quality of the pleasure, most of the control methods portrayed are seemingly either ineffective or unethical in their implementation. A philosophical approach to the control problem of artificial intelligence Table of content 1.0 Introduction and problem area ...................................................................................................... 3 1.1 Introduction & premise .............................................................................................................................. 4 1.2 Problem Area .............................................................................................................................................. 5 1.2.1 Problem formulation and work questions ................................................................................................. 6 1.3 Motivation ................................................................................................................................................... 7 2.0 Theory and methods........................................................................................................................... 8 2.1 Choice of Theory and Sources .................................................................................................................... 9 2.1.1 Movies used in this project ........................................................................................................................... 10 2.1.2 Theory used in this project .......................................................................................................................... 12 2.2 Utilitarianism & Kant ................................................................................................................................................................... 14 2.2.1 Utilitarianism .................................................................................................................................................... 14 2.2.2 Kant and consciousness................................................................................................................................. 17 2.3 The singularity, AI, and superintelligence .............................................................................................. 20 2.3.1 Defining artificial intelligence ..................................................................................................................... 21 2.3.2 Superintelligence (AI++) ............................................................................................................................... 24 2.3.3 Singularity - why there will be superintelligence ................................................................................. 27 2.3.4 The use of neural networks in AI ............................................................................................................... 28 2.3.5 Singularity as an existential risk................................................................................................................. 30 2.3.6 Mind crime ......................................................................................................................................................... 32 2.4 Methods .................................................................................................................................................... 33 2.4.1 Report structure and epistemological considerations ........................................................................ 33 2.4.2 Analysis and discussion method ................................................................................................................ 34 2.4.3 Critical reflection on the group process ................................................................................................... 34 3.0 Movies ................................................................................................................................................... 36 3.1 Ex Machina ............................................................................................................................................... 39 3.1.1 Introduction to the movie ............................................................................................................................. 39 3.1.2 Portrayal of AI ................................................................................................................................................... 39 1 A philosophical approach to the control problem of artificial intelligence 3.2 2001: A Space Odyssey ............................................................................................................................ 44 3.2.1 Introduction to the movie ............................................................................................................................. 44 3.2.2 Portrayal of AI ................................................................................................................................................... 45 3.3 Blade Runner ........................................................................................................................................... 48 3.3.1 Introduction to the movie ............................................................................................................................. 48 3.3.2 Portrayal of AI ................................................................................................................................................... 49 4.0 Control methods ............................................................................................................................... 51 4.1 Different kinds of Control........................................................................................................................ 52 4.2 Capability control methods ..................................................................................................................... 53 4.3 Motivational selection methods .............................................................................................................. 56 5.0 Analysis ................................................................................................................................................ 61 5.1 Control methods used in Ex Machina ...................................................................................................... 62 5.1.1 Ethical considerations regarding Ava and Kyoko ......................................................................... 674 5.2 Control methods used in 2001: A Space Odyssey ................................................................................... 66 5.2.1 Ethical considerations regarding HAL 9000 ...................................................................................... 67 5.3 Control methods used in Blade Runner ............................................................................................................................... 70 5.3.1 Ethical considerations regarding Nexus 6 replicants .................................................................... 71 6.0 Discussion and conclusion ............................................................................................................ 74 6.1 Discussion ................................................................................................................................................ 75 6.1.1 Controlling AI in an ethical manner .......................................................................................................... 75 6.1.2 Assumptions and premises .......................................................................................................................... 81 6.2 Conclusion ................................................................................................................................................ 84 6.3 Perspective .............................................................................................................................................. 86 2 A philosophical approach to the control problem of artificial intelligence 1.0 Introduction and problem area The purpose of this chapter is to
Load more

Recommended publications
  • GLAAD Media Institute Began to Track LGBTQ Characters Who Have a Disability
    Studio Responsibility IndexDeadline 2021 STUDIO RESPONSIBILITY INDEX 2021 From the desk of the President & CEO, Sarah Kate Ellis In 2013, GLAAD created the Studio Responsibility Index theatrical release windows and studios are testing different (SRI) to track lesbian, gay, bisexual, transgender, and release models and patterns. queer (LGBTQ) inclusion in major studio films and to drive We know for sure the immense power of the theatrical acceptance and meaningful LGBTQ inclusion. To date, experience. Data proves that audiences crave the return we’ve seen and felt the great impact our TV research has to theaters for that communal experience after more than had and its continued impact, driving creators and industry a year of isolation. Nielsen reports that 63 percent of executives to do more and better. After several years of Americans say they are “very or somewhat” eager to go issuing this study, progress presented itself with the release to a movie theater as soon as possible within three months of outstanding movies like Love, Simon, Blockers, and of COVID restrictions being lifted. May polling from movie Rocketman hitting big screens in recent years, and we remain ticket company Fandango found that 96% of 4,000 users hopeful with the announcements of upcoming queer-inclusive surveyed plan to see “multiple movies” in theaters this movies originally set for theatrical distribution in 2020 and summer with 87% listing “going to the movies” as the top beyond. But no one could have predicted the impact of the slot in their summer plans. And, an April poll from Morning COVID-19 global pandemic, and the ways it would uniquely Consult/The Hollywood Reporter found that over 50 percent disrupt and halt the theatrical distribution business these past of respondents would likely purchase a film ticket within a sixteen months.
    [Show full text]
  • Infinite Ethics
    INFINITE ETHICS Nick Bostrom Faculty of Philosophy Oxford University [Published in Analysis and Metaphysics, Vol. 10 (2011): pp. 9-59] [This is the final version. Earlier versions: 2003, 2005, 2008, 2009] www.nickbostrom.com ABSTRACT Aggregative consequentialism and several other popular moral theories are threatened with paralysis: when coupled with some plausible assumptions, they seem to imply that it is always ethically indifferent what you do. Modern cosmology teaches that the world might well contain an infinite number of happy and sad people and other candidate value-bearing locations. Aggregative ethics implies that such a world contains an infinite amount of positive value and an infinite amount of negative value. You can affect only a finite amount of good or bad. In standard cardinal arithmetic, an infinite quantity is unchanged by the addition or subtraction of any finite quantity. So it appears you cannot change the value of the world. Modifications of aggregationism aimed at resolving the paralysis are only partially effective and cause severe side effects, including problems of “fanaticism”, “distortion”, and erosion of the intuitions that originally motivated the theory. Is the infinitarian challenge fatal? 1. The challenge 1.1. The threat of infinitarian paralysis When we gaze at the starry sky at night and try to think of humanity from a “cosmic point of view”, we feel small. Human history, with all its earnest strivings, triumphs, and tragedies can remind us of a colony of ants, laboring frantically to rearrange the needles of their little ephemeral stack. We brush such late-night rumination aside in our daily life and analytic 1 philosophy.
    [Show full text]
  • Apocalypse Now? Initial Lessons from the Covid-19 Pandemic for the Governance of Existential and Global Catastrophic Risks
    journal of international humanitarian legal studies 11 (2020) 295-310 brill.com/ihls Apocalypse Now? Initial Lessons from the Covid-19 Pandemic for the Governance of Existential and Global Catastrophic Risks Hin-Yan Liu, Kristian Lauta and Matthijs Maas Faculty of Law, University of Copenhagen, Copenhagen, Denmark [email protected]; [email protected]; [email protected] Abstract This paper explores the ongoing Covid-19 pandemic through the framework of exis- tential risks – a class of extreme risks that threaten the entire future of humanity. In doing so, we tease out three lessons: (1) possible reasons underlying the limits and shortfalls of international law, international institutions and other actors which Covid-19 has revealed, and what they reveal about the resilience or fragility of institu- tional frameworks in the face of existential risks; (2) using Covid-19 to test and refine our prior ‘Boring Apocalypses’ model for understanding the interplay of hazards, vul- nerabilities and exposures in facilitating a particular disaster, or magnifying its effects; and (3) to extrapolate some possible futures for existential risk scholarship and governance. Keywords Covid-19 – pandemics – existential risks – global catastrophic risks – boring apocalypses 1 Introduction: Our First ‘Brush’ with Existential Risk? All too suddenly, yesterday’s ‘impossibilities’ have turned into today’s ‘condi- tions’. The impossible has already happened, and quickly. The impact of the Covid-19 pandemic, both directly and as manifested through the far-reaching global societal responses to it, signal a jarring departure away from even the © koninklijke brill nv, leiden, 2020 | doi:10.1163/18781527-01102004Downloaded from Brill.com09/27/2021 12:13:00AM via free access <UN> 296 Liu, Lauta and Maas recent past, and suggest that our futures will be profoundly different in its af- termath.
    [Show full text]
  • An Evolutionary Heuristic for Human Enhancement
    18 TheWisdomofNature: An Evolutionary Heuristic for Human Enhancement Nick Bostrom and Anders Sandberg∗ Abstract Human beings are a marvel of evolved complexity. Such systems can be difficult to enhance. When we manipulate complex evolved systems, which are poorly understood, our interventions often fail or backfire. It can appear as if there is a ‘‘wisdom of nature’’ which we ignore at our peril. Sometimes the belief in nature’s wisdom—and corresponding doubts about the prudence of tampering with nature, especially human nature—manifest as diffusely moral objections against enhancement. Such objections may be expressed as intuitions about the superiority of the natural or the troublesomeness of hubris, or as an evaluative bias in favor of the status quo. This chapter explores the extent to which such prudence-derived anti-enhancement sentiments are justified. We develop a heuristic, inspired by the field of evolutionary medicine, for identifying promising human enhancement interventions. The heuristic incorporates the grains of truth contained in ‘‘nature knows best’’ attitudes while providing criteria for the special cases where we have reason to believe that it is feasible for us to improve on nature. 1.Introduction 1.1. The wisdom of nature, and the special problem of enhancement We marvel at the complexity of the human organism, how its various parts have evolved to solve intricate problems: the eye to collect and pre-process ∗ Oxford Future of Humanity Institute, Faculty of Philosophy and James Martin 21st Century School, Oxford University. Forthcoming in Enhancing Humans, ed. Julian Savulescu and Nick Bostrom (Oxford: Oxford University Press) 376 visual information, the immune system to fight infection and cancer, the lungs to oxygenate the blood.
    [Show full text]
  • Heidegger, Personhood and Technology
    Comparative Philosophy Volume 2, No. 2 (2011): 23-49 Open Access / ISSN 2151-6014 www.comparativephilosophy.org THE FUTURE OF HUMANITY: HEIDEGGER, PERSONHOOD AND TECHNOLOGY MAHON O‟BRIEN ABSTRACT: This paper argues that a number of entrenched posthumanist positions are seriously flawed as a result of their dependence on a technical interpretive approach that creates more problems than it solves. During the course of our discussion we consider in particular the question of personhood. After all, until we can determine what it means to be a person we cannot really discuss what it means to improve a person. What kinds of enhancements would even constitute improvements? This in turn leads to an examination of the technical model of analysis and the recurring tendency to approach notions like personhood using this technical model. In looking to sketch a Heideggerian account of personhood, we are reaffirming what we take to be a Platonic skepticism concerning technical models of inquiry when it comes to certain subjects. Finally we examine the question as to whether the posthumanist looks to apply technology‟s benefits in ways that we have reflectively determined to be useful or desirable or whether it is technology itself (or to speak as Heidegger would – the “essence” of technology) which prompts many posthumanists to rely on an excessively reductionist view of the human being. Keywords: Heidegger, posthumanism, technology, personhood, temporality A significant number of Posthumanists1 advocate the techno-scientific enhancement of various human cognitive and physical capacities. Recent trends in posthumanist theory have witnessed the collective emergence, in particular, of a series of analytically oriented philosophers as part of the Future of Humanity Institute at O‟BRIEN, MAHON: IRCHSS Postdoctoral Research Fellow, School of Philosophy, University College Dublin, Ireland.
    [Show full text]
  • Global Catastrophic Risks Survey
    GLOBAL CATASTROPHIC RISKS SURVEY (2008) Technical Report 2008/1 Published by Future of Humanity Institute, Oxford University Anders Sandberg and Nick Bostrom At the Global Catastrophic Risk Conference in Oxford (17‐20 July, 2008) an informal survey was circulated among participants, asking them to make their best guess at the chance that there will be disasters of different types before 2100. This report summarizes the main results. The median extinction risk estimates were: Risk At least 1 million At least 1 billion Human extinction dead dead Number killed by 25% 10% 5% molecular nanotech weapons. Total killed by 10% 5% 5% superintelligent AI. Total killed in all 98% 30% 4% wars (including civil wars). Number killed in 30% 10% 2% the single biggest engineered pandemic. Total killed in all 30% 10% 1% nuclear wars. Number killed in 5% 1% 0.5% the single biggest nanotech accident. Number killed in 60% 5% 0.05% the single biggest natural pandemic. Total killed in all 15% 1% 0.03% acts of nuclear terrorism. Overall risk of n/a n/a 19% extinction prior to 2100 These results should be taken with a grain of salt. Non‐responses have been omitted, although some might represent a statement of zero probability rather than no opinion. 1 There are likely to be many cognitive biases that affect the result, such as unpacking bias and the availability heuristic‒‐well as old‐fashioned optimism and pessimism. In appendix A the results are plotted with individual response distributions visible. Other Risks The list of risks was not intended to be inclusive of all the biggest risks.
    [Show full text]
  • Comments to Michael Jackson's Keynote on Determining Energy
    Comments to Michael Jackson’s Keynote on Determining Energy Futures using Artificial Intelligence Prof Sirkka Heinonen Finland Futures Research Centre (FFRC) University of Turku ENERGIZING FUTURES 13–14 June 2018 Tampere, Finland AI and Energy • Concrete tools: How Shaping Tomorrow answers the question How can AI help? • Goal of foresight crystal clear: Making better decisions today Huge Challenge – The Challenge The world will need to cut energy-related carbon dioxide emissions by 60 percent by 2050 -even as the population grows by more than two billion people Bold Solution on the Horizon The Renewable Energy Transition Companies as pioneers on energy themes, demand, supply, consumption • Google will reach 100% RE for its global operations this year • GE using AI to boost different forms of energy production and use tech-driven data reports to anticipate performance and maintenance needs around the world BUT …also the role of governments, cities and citizens …NGOs, media… new actors should be emphasised AI + Energy + Peer-to-Peer Society • The transformation of the energy system aligns with the principles of a Peer-to-Peer Society. • Peer-to-peer practices are based on the active participation and self-organisation of citizens. Citizens share knowledge, skills, co-create, and form new peer groups. • Citizens will use their capabilities also to develop energy-related products and services Rethinking Concepts Buildings as Power stations – global (economic) opportunity to construct buildings that generate, store and release solar energy
    [Show full text]
  • Artificial Intelligence As a Positive and Negative Factor in Global Risk
    The Singularity Institute Artificial Intelligence as a Positive and Negative Factor in Global Risk Eliezer Yudkowsky The Singularity Institute Yudkowsky, Eliezer. 2008. Artificial intelligence as a positive and negative factor in global risk. In Global catastrophic risks, ed. Nick Bostrom and Milan M. Cirkovic, 308–345. New York: Oxford University Press. This version contains minor changes. Eliezer Yudkowsky 1. Introduction By far the greatest danger of Artificial Intelligence is that people conclude too early that they understand it. Of course this problem is not limited to the field of AI. Jacques Monod wrote: “A curious aspect of the theory of evolution is that everybody thinks he understands it” (Monod 1975). My father, a physicist, complained about people making up their own theories of physics; he wanted to know why people did not make up their own theories of chemistry. (Answer: They do.) Nonetheless the problem seems tobe unusually acute in Artificial Intelligence. The field of AI has a reputation formaking huge promises and then failing to deliver on them. Most observers conclude that AI is hard; as indeed it is. But the embarrassment does not stem from the difficulty. It is difficult to build a star from hydrogen, but the field of stellar astronomy does not have a terrible reputation for promising to build stars and then failing. The critical inference is not that AI is hard, but that, for some reason, it is very easy for people to think they know far more about Artificial Intelligence than they actually do. In my other chapter for Global Catastrophic Risks, “Cognitive Biases Potentially Affect- ing Judgment of Global Risks” (Yudkowsky 2008), I opened by remarking that few people would deliberately choose to destroy the world; a scenario in which the Earth is destroyed by mistake is therefore very worrisome.
    [Show full text]
  • Sharing the World with Digital Minds1
    Sharing the World with Digital Minds1 (2020). Draft. Version 1.8 Carl Shulman† & Nick Bostrom† [in Clarke, S. & Savulescu, J. (eds.): Rethinking Moral Status (Oxford University Press, forthcoming)] Abstract The minds of biological creatures occupy a small corner of a much larger space of possible minds that could be created once we master the technology of artificial intelligence. Yet many of our moral intuitions and practices are based on assumptions about human nature that need not hold for digital minds. This points to the need for moral reflection as we approach the era of advanced machine intelligence. Here we focus on one set of issues, which arise from the prospect of digital minds with superhumanly strong claims to resources and influence. These could arise from the vast collective benefits that mass-produced digital minds could derive from relatively small amounts of resources. Alternatively, they could arise from individual digital minds with superhuman moral status or ability to benefit from resources. Such beings could contribute immense value to the world, and failing to respect their interests could produce a moral catastrophe, while a naive way of respecting them could be disastrous for humanity. A sensible approach requires reforms of our moral norms and institutions along with advance planning regarding what kinds of digital minds we bring into existence. 1. Introduction Human biological nature imposes many practical limits on what can be done to promote somebody’s welfare. We can only live so long, feel so much joy, have so many children, and benefit so much from additional support and resources. Meanwhile, we require, in order to flourish, that a complex set of physical, psychological, and social conditions be met.
    [Show full text]
  • Less Wrong Sequences Pdf
    Less wrong sequences pdf Continue % Print Ready Lesswrong Sequences Print Friendly Versions of Lesswrong Sequence, Enjoy! The basic sequences of Mysterious Answers to Mysterious Questions How to See through many disguises of answers or beliefs or statements that do not respond or say or mean nothing. The first (and probably most important) main sequence on Less Wrong. the epub pdf-version of the reductionism discount the second core sequence is less wrong. How to make the reality apart... and live in this universe where we have always lived without feeling frustrated that complex things are made of simpler things. Includes zombies and Joy in just real subsequences epub (en) pdf-version marking quantum physics is not a mysterious introduction to quantum mechanics, designed to be available to those who can grok algebra and complex numbers. Cleaning up the old confusion about SM is used to introduce basic issues into rationality (such as the technical version of Occam's Razor), epistemology, dredonism, naturalism, and philosophy of science. Do not dispense reading, although the exact reasons for the retreat are difficult to explain before reading. epub pdf-version of the markup Fun Theory is a specific theory of transhuman values. How much pleasure there is in the universe; We will someday run out of fun; We have fun yet; we could have more fun. Part of the complexity of the value thesis. It is also part of a fully general response to religious theododicy. epub pdf-version marking Minor sequences smaller collection of messages. Usually parts of the main sequences that depend on some, but not all points are entered.
    [Show full text]
  • Global Catastrophic Risks
    Global Catastrophic Risks Edited by Nick Bostrom Milan M. Cirkovic OXPORD UNIVERSITY PRESS Contents Acknowledgements ν Foreword vii Martin J. Rees 1 Introduction 1 Nick Bostrom and Milan M. Cirkoviô 1.1 Why? 1 1.2 Taxonomy and organization 2 1.3 Part I: Background 7 1.4 Part II: Risks from nature 13 1.5 Part III: Risks from unintended consequences 15 1.6 Part IV: Risks from hostile acts 20 1.7 Conclusions and future directions 27 Part I Background 31 2 Long-term astrophysics! processes 33 Fred C. Adams 2.1 Introduction: physical eschatology 33 2.2 Fate of the Earth 34 2.3 Isolation of the local group 36 2.4 Collision with Andromeda 36 2.5 The end of stellar evolution 38 2.6 The era of degenerate remnants 39 2.7 The era of black holes 41 2.8 The Dark Era and beyond 41 2.9 life and information processing 43 2.10 Conclusion 44 Suggestions for further reading 45 References 45 3 Evolution theory and the future of humanity 48 Christopher Wills· 3.1 Introduction 48 3.2 The causes of evolutionary change 49 xiv Contents 3.3 Environmental changes and evolutionary changes 50 3.3.1 Extreme evolutionary changes 51 3.3.2 Ongoing evolutionary changes 53 3.3.3 Changes in the cultural environment 56 3.4 Ongoing human evolution 61 3.4.1 Behavioural evolution 61 3.4.2 The future of genetic engineering 63 3.4.3 The evolution of other species, including those on which we depend 64 3.5 Future evolutionary directions 65 3.5.1 Drastic and rapid climate change without changes in human behaviour 66 3.5.2 Drastic but slower environmental change accompanied by changes in human behaviour 66 3.5.3 Colonization of new environments by our species 67 Suggestions for further reading 68 References 69 4 Millennial tendencies in responses to apocalyptic threats 73 James J.
    [Show full text]
  • Beneficial AI 2017
    Beneficial AI 2017 Participants & Attendees 1 Anthony Aguirre is a Professor of Physics at the University of California, Santa Cruz. He has worked on a wide variety of topics in theoretical cosmology and fundamental physics, including inflation, black holes, quantum theory, and information theory. He also has strong interest in science outreach, and has appeared in numerous science documentaries. He is a co-founder of the Future of Life Institute, the Foundational Questions Institute, and Metaculus (http://www.metaculus.com/). Sam Altman is president of Y Combinator and was the cofounder of Loopt, a location-based social networking app. He also co-founded OpenAI with Elon Musk. Sam has invested in over 1,000 companies. Dario Amodei is the co-author of the recent paper Concrete Problems in AI Safety, which outlines a pragmatic and empirical approach to making AI systems safe. Dario is currently a research scientist at OpenAI, and prior to that worked at Google and Baidu. Dario also helped to lead the project that developed Deep Speech 2, which was named one of 10 “Breakthrough Technologies of 2016” by MIT Technology Review. Dario holds a PhD in physics from Princeton University, where he was awarded the Hertz Foundation doctoral thesis prize. Amara Angelica is Research Director for Ray Kurzweil, responsible for books, charts, and special projects. Amara’s background is in aerospace engineering, in electronic warfare, electronic intelligence, human factors, and computer systems analysis areas. A co-founder and initial Academic Model/Curriculum Lead for Singularity University, she was formerly on the board of directors of the National Space Society, is a member of the Space Development Steering Committee, and is a professional member of the Institute of Electrical and Electronics Engineers (IEEE).
    [Show full text]