The Ethics of Artificial Intelligence
Total Page:16
File Type:pdf, Size:1020Kb
Load more
Recommended publications
-
Infinite Ethics
INFINITE ETHICS Nick Bostrom Faculty of Philosophy Oxford University [Published in Analysis and Metaphysics, Vol. 10 (2011): pp. 9-59] [This is the final version. Earlier versions: 2003, 2005, 2008, 2009] www.nickbostrom.com ABSTRACT Aggregative consequentialism and several other popular moral theories are threatened with paralysis: when coupled with some plausible assumptions, they seem to imply that it is always ethically indifferent what you do. Modern cosmology teaches that the world might well contain an infinite number of happy and sad people and other candidate value-bearing locations. Aggregative ethics implies that such a world contains an infinite amount of positive value and an infinite amount of negative value. You can affect only a finite amount of good or bad. In standard cardinal arithmetic, an infinite quantity is unchanged by the addition or subtraction of any finite quantity. So it appears you cannot change the value of the world. Modifications of aggregationism aimed at resolving the paralysis are only partially effective and cause severe side effects, including problems of “fanaticism”, “distortion”, and erosion of the intuitions that originally motivated the theory. Is the infinitarian challenge fatal? 1. The challenge 1.1. The threat of infinitarian paralysis When we gaze at the starry sky at night and try to think of humanity from a “cosmic point of view”, we feel small. Human history, with all its earnest strivings, triumphs, and tragedies can remind us of a colony of ants, laboring frantically to rearrange the needles of their little ephemeral stack. We brush such late-night rumination aside in our daily life and analytic 1 philosophy. -
Apocalypse Now? Initial Lessons from the Covid-19 Pandemic for the Governance of Existential and Global Catastrophic Risks
journal of international humanitarian legal studies 11 (2020) 295-310 brill.com/ihls Apocalypse Now? Initial Lessons from the Covid-19 Pandemic for the Governance of Existential and Global Catastrophic Risks Hin-Yan Liu, Kristian Lauta and Matthijs Maas Faculty of Law, University of Copenhagen, Copenhagen, Denmark [email protected]; [email protected]; [email protected] Abstract This paper explores the ongoing Covid-19 pandemic through the framework of exis- tential risks – a class of extreme risks that threaten the entire future of humanity. In doing so, we tease out three lessons: (1) possible reasons underlying the limits and shortfalls of international law, international institutions and other actors which Covid-19 has revealed, and what they reveal about the resilience or fragility of institu- tional frameworks in the face of existential risks; (2) using Covid-19 to test and refine our prior ‘Boring Apocalypses’ model for understanding the interplay of hazards, vul- nerabilities and exposures in facilitating a particular disaster, or magnifying its effects; and (3) to extrapolate some possible futures for existential risk scholarship and governance. Keywords Covid-19 – pandemics – existential risks – global catastrophic risks – boring apocalypses 1 Introduction: Our First ‘Brush’ with Existential Risk? All too suddenly, yesterday’s ‘impossibilities’ have turned into today’s ‘condi- tions’. The impossible has already happened, and quickly. The impact of the Covid-19 pandemic, both directly and as manifested through the far-reaching global societal responses to it, signal a jarring departure away from even the © koninklijke brill nv, leiden, 2020 | doi:10.1163/18781527-01102004Downloaded from Brill.com09/27/2021 12:13:00AM via free access <UN> 296 Liu, Lauta and Maas recent past, and suggest that our futures will be profoundly different in its af- termath. -
UC Santa Barbara Other Recent Work
UC Santa Barbara Other Recent Work Title Geopolitics, History, and International Relations Permalink https://escholarship.org/uc/item/29z457nf Author Robinson, William I. Publication Date 2009 Peer reviewed eScholarship.org Powered by the California Digital Library University of California OFFICIAL JOURNAL OF THE CONTEMPORARY SCIENCE ASSOCIATION • NEW YORK Geopolitics, History, and International Relations VOLUME 1(2) • 2009 ADDLETON ACADEMIC PUBLISHERS • NEW YORK Geopolitics, History, and International Relations 1(2) 2009 An international peer-reviewed academic journal Copyright © 2009 by the Contemporary Science Association, New York Geopolitics, History, and International Relations seeks to explore the theoretical implications of contemporary geopolitics with particular reference to territorial problems and issues of state sovereignty, and publishes papers on contemporary world politics and the global political economy from a variety of methodologies and approaches. Interdisciplinary and wide-ranging in scope, Geopolitics, History, and International Relations also provides a forum for discussion on the latest developments in the theory of international relations and aims to promote an understanding of the breadth, depth and policy relevance of international history. Its purpose is to stimulate and disseminate theory-aware research and scholarship in international relations throughout the international academic community. Geopolitics, History, and International Relations offers important original contributions by outstanding scholars and has the potential to become one of the leading journals in the field, embracing all aspects of the history of relations between states and societies. Journal ranking: A on a seven-point scale (A+, A, B+, B, C+, C, D). Geopolitics, History, and International Relations is published twice a year by Addleton Academic Publishers, 30-18 50th Street, Woodside, New York, 11377. -
An Evolutionary Heuristic for Human Enhancement
18 TheWisdomofNature: An Evolutionary Heuristic for Human Enhancement Nick Bostrom and Anders Sandberg∗ Abstract Human beings are a marvel of evolved complexity. Such systems can be difficult to enhance. When we manipulate complex evolved systems, which are poorly understood, our interventions often fail or backfire. It can appear as if there is a ‘‘wisdom of nature’’ which we ignore at our peril. Sometimes the belief in nature’s wisdom—and corresponding doubts about the prudence of tampering with nature, especially human nature—manifest as diffusely moral objections against enhancement. Such objections may be expressed as intuitions about the superiority of the natural or the troublesomeness of hubris, or as an evaluative bias in favor of the status quo. This chapter explores the extent to which such prudence-derived anti-enhancement sentiments are justified. We develop a heuristic, inspired by the field of evolutionary medicine, for identifying promising human enhancement interventions. The heuristic incorporates the grains of truth contained in ‘‘nature knows best’’ attitudes while providing criteria for the special cases where we have reason to believe that it is feasible for us to improve on nature. 1.Introduction 1.1. The wisdom of nature, and the special problem of enhancement We marvel at the complexity of the human organism, how its various parts have evolved to solve intricate problems: the eye to collect and pre-process ∗ Oxford Future of Humanity Institute, Faculty of Philosophy and James Martin 21st Century School, Oxford University. Forthcoming in Enhancing Humans, ed. Julian Savulescu and Nick Bostrom (Oxford: Oxford University Press) 376 visual information, the immune system to fight infection and cancer, the lungs to oxygenate the blood. -
Blame, What Is It Good For?
Blame, What is it Good For? Gordon Briggs1 Abstract— Blame is an vital social and cognitive mechanism [6] and reside in a much more ambiguous moral territory. that humans utilize in their interactions with other agents. In Additionally, it is not enough to be able to correctly reason this paper, we discuss how blame-reasoning mechanisms are about moral scenarios to ensure ethical or otherwise desirable needed to enable future social robots to: (1) appropriately adapt behavior in the context of repeated and/or long-term outcomes from human-robot interactions, the robot must interactions and relationships with other social agents; (2) avoid have other social competencies that support this reasoning behaviors that are perceived to be rude due to inappropriate mechanism. Deceptive interaction partners or incorrect per- and unintentional connotations of blame; and (3) avoid behav- ceptions/predictions about morally-charged scenarios may iors that could damage long-term, working relationships with lead even a perfect ethical-reasoner to make choices with other social agents. We also discuss how current computational models of blame and other relevant competencies (e.g. natural unethical outcomes [7]. What these challenges stress is the language generation) are currently insufficient to address these need to look beyond the ability to simply generate the proper concerns. Future work is necessary to increase the social answer to a moral dilemma in theory, and to consider the reasoning capabilities of artificially intelligent agents to achieve social mechanisms needed in practice. these goals. One such social mechanism that others have posited as I. INTRODUCTION being necessary to the construction of a artificial moral agent is blame [8]. -
Heidegger, Personhood and Technology
Comparative Philosophy Volume 2, No. 2 (2011): 23-49 Open Access / ISSN 2151-6014 www.comparativephilosophy.org THE FUTURE OF HUMANITY: HEIDEGGER, PERSONHOOD AND TECHNOLOGY MAHON O‟BRIEN ABSTRACT: This paper argues that a number of entrenched posthumanist positions are seriously flawed as a result of their dependence on a technical interpretive approach that creates more problems than it solves. During the course of our discussion we consider in particular the question of personhood. After all, until we can determine what it means to be a person we cannot really discuss what it means to improve a person. What kinds of enhancements would even constitute improvements? This in turn leads to an examination of the technical model of analysis and the recurring tendency to approach notions like personhood using this technical model. In looking to sketch a Heideggerian account of personhood, we are reaffirming what we take to be a Platonic skepticism concerning technical models of inquiry when it comes to certain subjects. Finally we examine the question as to whether the posthumanist looks to apply technology‟s benefits in ways that we have reflectively determined to be useful or desirable or whether it is technology itself (or to speak as Heidegger would – the “essence” of technology) which prompts many posthumanists to rely on an excessively reductionist view of the human being. Keywords: Heidegger, posthumanism, technology, personhood, temporality A significant number of Posthumanists1 advocate the techno-scientific enhancement of various human cognitive and physical capacities. Recent trends in posthumanist theory have witnessed the collective emergence, in particular, of a series of analytically oriented philosophers as part of the Future of Humanity Institute at O‟BRIEN, MAHON: IRCHSS Postdoctoral Research Fellow, School of Philosophy, University College Dublin, Ireland. -
Global Catastrophic Risks Survey
GLOBAL CATASTROPHIC RISKS SURVEY (2008) Technical Report 2008/1 Published by Future of Humanity Institute, Oxford University Anders Sandberg and Nick Bostrom At the Global Catastrophic Risk Conference in Oxford (17‐20 July, 2008) an informal survey was circulated among participants, asking them to make their best guess at the chance that there will be disasters of different types before 2100. This report summarizes the main results. The median extinction risk estimates were: Risk At least 1 million At least 1 billion Human extinction dead dead Number killed by 25% 10% 5% molecular nanotech weapons. Total killed by 10% 5% 5% superintelligent AI. Total killed in all 98% 30% 4% wars (including civil wars). Number killed in 30% 10% 2% the single biggest engineered pandemic. Total killed in all 30% 10% 1% nuclear wars. Number killed in 5% 1% 0.5% the single biggest nanotech accident. Number killed in 60% 5% 0.05% the single biggest natural pandemic. Total killed in all 15% 1% 0.03% acts of nuclear terrorism. Overall risk of n/a n/a 19% extinction prior to 2100 These results should be taken with a grain of salt. Non‐responses have been omitted, although some might represent a statement of zero probability rather than no opinion. 1 There are likely to be many cognitive biases that affect the result, such as unpacking bias and the availability heuristic‒‐well as old‐fashioned optimism and pessimism. In appendix A the results are plotted with individual response distributions visible. Other Risks The list of risks was not intended to be inclusive of all the biggest risks. -
Comments to Michael Jackson's Keynote on Determining Energy
Comments to Michael Jackson’s Keynote on Determining Energy Futures using Artificial Intelligence Prof Sirkka Heinonen Finland Futures Research Centre (FFRC) University of Turku ENERGIZING FUTURES 13–14 June 2018 Tampere, Finland AI and Energy • Concrete tools: How Shaping Tomorrow answers the question How can AI help? • Goal of foresight crystal clear: Making better decisions today Huge Challenge – The Challenge The world will need to cut energy-related carbon dioxide emissions by 60 percent by 2050 -even as the population grows by more than two billion people Bold Solution on the Horizon The Renewable Energy Transition Companies as pioneers on energy themes, demand, supply, consumption • Google will reach 100% RE for its global operations this year • GE using AI to boost different forms of energy production and use tech-driven data reports to anticipate performance and maintenance needs around the world BUT …also the role of governments, cities and citizens …NGOs, media… new actors should be emphasised AI + Energy + Peer-to-Peer Society • The transformation of the energy system aligns with the principles of a Peer-to-Peer Society. • Peer-to-peer practices are based on the active participation and self-organisation of citizens. Citizens share knowledge, skills, co-create, and form new peer groups. • Citizens will use their capabilities also to develop energy-related products and services Rethinking Concepts Buildings as Power stations – global (economic) opportunity to construct buildings that generate, store and release solar energy -
On How to Build a Moral Machine
On How to Build a Moral Machine Paul Bello [email protected] Human & Bioengineered Systems Division - Code 341, Office of Naval Research, 875 N. Randolph St., Arlington, VA 22203 USA Selmer Bringsjord [email protected] Depts. of Cognitive Science, Computer Science & the Lally School of Management, Rensselaer Polytechnic Institute, Troy, NY 12180 USA Abstract Herein we make a plea to machine ethicists for the inclusion of constraints on their theories con- sistent with empirical data on human moral cognition. As philosophers, we clearly lack widely accepted solutions to issues regarding the existence of free will, the nature of persons and firm conditions on moral agency/patienthood; all of which are indispensable concepts to be deployed by any machine able to make moral judgments. No agreement seems forthcoming on these mat- ters, and we don’t hold out hope for machines that can both always do the right thing (on some general ethic) and produce explanations for its behavior that would be understandable to a human confederate. Our tentative solution involves understanding the folk concepts associated with our moral intuitions regarding these matters, and how they might be dependent upon the nature of hu- man cognitive architecture. It is in this spirit that we begin to explore the complexities inherent in human moral judgment via computational theories of the human cognitive architecture, rather than under the extreme constraints imposed by rational-actor models assumed throughout much of the literature on philosophical ethics. After discussing the various advantages and challenges of taking this particular perspective on the development of artificial moral agents, we computationally explore a case study of human intuitions about the self and causal responsibility. -
Artificial Intelligence As a Positive and Negative Factor in Global Risk
The Singularity Institute Artificial Intelligence as a Positive and Negative Factor in Global Risk Eliezer Yudkowsky The Singularity Institute Yudkowsky, Eliezer. 2008. Artificial intelligence as a positive and negative factor in global risk. In Global catastrophic risks, ed. Nick Bostrom and Milan M. Cirkovic, 308–345. New York: Oxford University Press. This version contains minor changes. Eliezer Yudkowsky 1. Introduction By far the greatest danger of Artificial Intelligence is that people conclude too early that they understand it. Of course this problem is not limited to the field of AI. Jacques Monod wrote: “A curious aspect of the theory of evolution is that everybody thinks he understands it” (Monod 1975). My father, a physicist, complained about people making up their own theories of physics; he wanted to know why people did not make up their own theories of chemistry. (Answer: They do.) Nonetheless the problem seems tobe unusually acute in Artificial Intelligence. The field of AI has a reputation formaking huge promises and then failing to deliver on them. Most observers conclude that AI is hard; as indeed it is. But the embarrassment does not stem from the difficulty. It is difficult to build a star from hydrogen, but the field of stellar astronomy does not have a terrible reputation for promising to build stars and then failing. The critical inference is not that AI is hard, but that, for some reason, it is very easy for people to think they know far more about Artificial Intelligence than they actually do. In my other chapter for Global Catastrophic Risks, “Cognitive Biases Potentially Affect- ing Judgment of Global Risks” (Yudkowsky 2008), I opened by remarking that few people would deliberately choose to destroy the world; a scenario in which the Earth is destroyed by mistake is therefore very worrisome. -
Which Consequentialism? Machine Ethics and Moral Divergence
MIRI MACHINE INTELLIGENCE RESEARCH INSTITUTE Which Consequentialism? Machine Ethics and Moral Divergence Carl Shulman, Henrik Jonsson MIRI Visiting Fellows Nick Tarleton Carnegie Mellon University, MIRI Visiting Fellow Abstract Some researchers in the field of machine ethics have suggested consequentialist or util- itarian theories as organizing principles for Artificial Moral Agents (AMAs) (Wallach, Allen, and Smit 2008) that are ‘full ethical agents’ (Moor 2006), while acknowledging extensive variation among these theories as a serious challenge (Wallach, Allen, and Smit 2008). This paper develops that challenge, beginning with a partial taxonomy ofconse- quentialisms proposed by philosophical ethics. We discuss numerous ‘free variables’ of consequentialism where intuitions conflict about optimal values, and then consider spe- cial problems of human-level AMAs designed to implement a particular ethical theory, by comparison to human proponents of the same explicit principles. In conclusion, we suggest that if machine ethics is to fully succeed, it must draw upon the developing field of moral psychology. Shulman, Carl, Nick Tarleton, and Henrik Jonsson. 2009. “Which Consequentialism? Machine Ethics and Moral Divergence.” In AP-CAP 2009: The Fifth Asia-Pacific Computing and Philosophy Conference, October 1st-2nd, University of Tokyo, Japan, Proceedings, edited by Carson Reynolds and Alvaro Cassinelli, 23–25. AP-CAP 2009. http://ia-cap.org/ap-cap09/proceedings.pdf. This version contains minor changes. Carl Shulman, Henrik Jonsson, Nick Tarleton 1. Free Variables of Consequentialism Suppose that the recommendations of a broadly utilitarian view depend on decisions about ten free binary variables, where we assign a probability of 80% to our favored option for each variable; in this case, if our probabilities are well-calibrated and our errors are not correlated across variables, then we will have only slightly more than a 10% chance of selecting the correct (in some meta-ethical framework) specification. -
Philosophy of Artificial Intelligence
David Gray Grant Philosophy of Artificial Intelligence Note to the reader: this syllabus is for an introductory undergraduate lecture course with no prerequisites. Course Description In this course, we will explore the philosophical implications of artificial intelligence. Could we build machines with minds like ours out of computer chips? Could we cheat death by uploading our minds to a computer server? Are we living in a software-based simulation? Should a driverless car kill one pedestrian to save five? Will artificial intelligence be the end of work (and if so, what should we do about it)? This course is also a general introduction to philosophical problems and methods. We will dis- cuss classic problems in several areas of philosophy, including philosophy of mind, metaphysics, epistemology, and ethics. In the process, you will learn how to engage with philosophical texts, analyze and construct arguments, investigate controversial questions in collaboration with others, and express your views with greater clarity and precision. Contact Information Instructor: David Gray Grant Email: [email protected] Office: 303 Emerson Hall Office hours: Mondays 3:00-5:00 and by appointment Assignments and Grading You must complete all required assignments in order to pass this course. Your grade will be determined as follows: • 10%: Participation • 25%: 4 short written assignments (300-600 words) • 20%: Paper 1 (1200-1500 words) • 25%: Paper 2 (1200-1500 words) • 20%: Final exam Assignments should be submitted in .docx or .pdf format (.docx is preferred), Times New Roman 12 point font, single-spaced. Submissions that exceed the word limits specified above (including footnotes) will not be accepted.