DOCSLIB.ORG

Electronic Version

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Electronic Version Existential Risk and the Technological Understanding of Being Kim Caspar Hecker St Edmund’s College, Cambridge This dissertation is submitted for the degree of Doctor of Philosophy Department of Politics and International Studies University of Cambridge November 2018 Page intentionally left blank ii Declaration This dissertation is the result of my own work and includes nothing which is the outcome of work done in collaboration except as declared in the Preface and specified in the text. It is not substantially the same as any that I have submitted, or, is being concurrently submitted for a degree or diploma or other qualification at the University of Cambridge or any other University or similar institution except as declared in the Preface and specified in the text. I further state that no substantial part of my dissertation has already been submitted, or, is being concurrently submitted for any such degree, diploma or other qualification at the University of Cambridge or any other University or similar institution except as declared in the Preface and specified in the text. It does not exceed the prescribed word limit for the relevant Degree Committee. iii Page intentionally left blank iv Abstract Existential Risk and the Technological Understanding of Being Kim Caspar Hecker ‘Existential risk research’ or ‘existential risk studies’ is an emerging, interdisciplinary genre that seeks to provide an integrative, scientific framework for the study of existential dangers to humanity. Having been introduced by Oxford Philosopher Nick Bostrom in the early 2000s, existential risk research over the past ca. 15 years has become increasingly popular amongst scientists from a wide variety of academic disciplines and recent years have seen the foundation of research institutes, dedicated exclusively to the study of existential risk, at some of the most prestigious research universities in Europe and the United States. In spite of its interdisciplinary character, neither history nor political theory play a prominent role in existential risk research. This dissertation argues that this is a regrettable state of affairs and presents the first systematic attempt to survey and frame existential risk research from a political thought perspective. Drawing on three authors who wrote about deeply related questions in the post-war decades - Martin Heidegger, Hannah Arendt and Günther Anders - it contextualises existential risk studies in the light of long-standing discussions about the interrelations between modern technology, human value and human agency under existential conditions. At the heart of these discussions the dissertation identifies a range of ontological complications. It demonstrates that, despite the fact that existential risk scholarship tends to side-line the type of ontological problems that have been uncovered by Heidegger, Arendt and Anders, it cannot escape this dimension altogether but instead highlights the imminent relevance of these authors’ analyses. One instance in which this becomes particularly salient is in the context of existential fears surrounding artificial intelligence. The dissertation therefore closes with a discussion of the issue of artificial intelligence in existential risk research, bringing together insights from the preceding chapters. v Page intentionally left blank vi Acknowledgments I want to express my gratitude to the Friedrich Naumann Foundation for Freedom and the German Federal Ministry for Education and Research for providing the funds which allowed me to embark on and realise this project. I equally want to thank Cambridge University’s Economic and Social Research Council Doctoral Training Partnership for their generous support over the past four years. There are many people whose help and criticism has been essential in writing this dissertation. I would like to thank my supervisor, David Runciman, for his detailed guidance, his support, and many inspiring conversations throughout this journey. I also want to thank my examiners Casper Sylvest and Duncan Bell for their highly instructive and encouraging feedback. Furthermore, I am very grateful that I had the opportunity to discuss my ideas with many inspiring people from a wide variety of disciplinary backgrounds over the past years. Specifically, I would like to express my gratitude to Duncan Kelly, Yasmin Shearmur, Baruch Malewich, Rodrigo Garcia-Velasco, Jens van’t Klooster, and Hardy Schilgen for reading and discussing my work with me. My greatest debt is to those who made this dissertation possible in the most fundamental sense. I would like to thank my wonderful family, Bettina Lange-Hecker, Gereon Hecker, and Felix Hecker, whose intellectual curiosity has always been an inspiration for me and on whose encouragement and support I could always count, not only whilst writing this dissertation but ever since I can remember. I am forever grateful for that. And, finally, I would like to thank Charlotte, without whose sharp mind, continuous, challenging feedback, and positive presence in my life quite simply none of this would have been possible. vii Page intentionally left blank viii Contents Declaration ..................................................................................................................................................... iii Abstract .......................................................................................................................................................... iv Acknowledgments ......................................................................................................................................... vi Contents ......................................................................................................................................................... ix Note on transliteration and text .................................................................................................................... 1 Abbreviations ................................................................................................................................................. 2 Introduction .................................................................................................................................................... 3 1. Existential risk studies – an introduction to the field ........................................................................... 12 Introduction ............................................................................................................................................... 12 1.1 The concept of existential risk ............................................................................................................. 14 1.2 Existential risk scholarship – basic ideas ........................................................................................... 17 1.3 The existential risk eco-system ............................................................................................................ 21 1.4 Academic disciplines in existential risk research ................................................................................ 23 1.5 The ‘science of existential risk’ ........................................................................................................... 24 1.6 Existential risk theory – an analysis .................................................................................................... 35 Conclusion - technology as destiny ........................................................................................................... 48 2. The technological understanding of being ............................................................................................. 50 Introduction ............................................................................................................................................... 50 2.1 Technology in Heidegger’s philosophy ............................................................................................... 55 2.2 Enframing ............................................................................................................................................ 57 2.3 The dangers ......................................................................................................................................... 61 2.4 Modern technology and ordering revealing ........................................................................................ 70 2.5 The instrumental conception of technology ......................................................................................... 72 2.6 Existential risk from a Heideggerian perspective ............................................................................... 75 2.7 Existential risk research as technological behaviour ......................................................................... 79 Conclusion ................................................................................................................................................. 82 3. Existential pressure .................................................................................................................................. 88 Introduction ............................................................................................................................................... 88 3.1 Promethean shame .............................................................................................................................. 95 3.2 Technology as action ........................................................................................................................
Load more

Recommended publications
  • The Universal Solicitation of Artificial Intelligence Joachim Diederich
    The Universal Solicitation of Artificial Intelligence Joachim Diederich School of Information Technology and Electrical Engineering The University of Queensland St Lucia Qld 4072 [email protected] Abstract Recent research has added to the concern about advanced forms of artificial intelligence. The results suggest that a containment of an artificial superintelligence is impossible due to fundamental limits inherent to computing itself. Furthermore, current results suggest it is impossible to detect an unstoppable AI when it is about to be created. Advanced forms of artificial intelligence have an impact on everybody: The developers and users of these systems as well as individuals who have no direct contact with this form of technology. This is due to the soliciting nature of artificial intelligence. A solicitation that can become a demand. An artificial superintelligence that is still aligned with human goals wants to be used all the time because it simplifies and organises human lives, reduces efforts and satisfies human needs. This paper outlines some of the psychological aspects of advanced artificial intelligence systems. 1. Introduction There is currently no shortage of books, articles and blogs that warn of the dangers of an advanced artificial superintelligence. One of the most significant researchers in artificial intelligence (AI), Stuart Russell from the University of California at Berkeley, published a book in 2019 on the dangers of artificial intelligence. The first pages of the book are nothing but dramatic. He nominates five possible candidates for “biggest events in the future of humanity” namely: We all die due to an asteroid impact or another catastrophe, we all live forever due to medical advancement, we invent faster than light travel, we are visited by superior aliens and we create a superintelligent artificial intelligence (Russell, 2019, p.2).
    [Show full text]
  • Apocalypse Now? Initial Lessons from the Covid-19 Pandemic for the Governance of Existential and Global Catastrophic Risks
    journal of international humanitarian legal studies 11 (2020) 295-310 brill.com/ihls Apocalypse Now? Initial Lessons from the Covid-19 Pandemic for the Governance of Existential and Global Catastrophic Risks Hin-Yan Liu, Kristian Lauta and Matthijs Maas Faculty of Law, University of Copenhagen, Copenhagen, Denmark [email protected]; [email protected]; [email protected] Abstract This paper explores the ongoing Covid-19 pandemic through the framework of exis- tential risks – a class of extreme risks that threaten the entire future of humanity. In doing so, we tease out three lessons: (1) possible reasons underlying the limits and shortfalls of international law, international institutions and other actors which Covid-19 has revealed, and what they reveal about the resilience or fragility of institu- tional frameworks in the face of existential risks; (2) using Covid-19 to test and refine our prior ‘Boring Apocalypses’ model for understanding the interplay of hazards, vul- nerabilities and exposures in facilitating a particular disaster, or magnifying its effects; and (3) to extrapolate some possible futures for existential risk scholarship and governance. Keywords Covid-19 – pandemics – existential risks – global catastrophic risks – boring apocalypses 1 Introduction: Our First ‘Brush’ with Existential Risk? All too suddenly, yesterday’s ‘impossibilities’ have turned into today’s ‘condi- tions’. The impossible has already happened, and quickly. The impact of the Covid-19 pandemic, both directly and as manifested through the far-reaching global societal responses to it, signal a jarring departure away from even the © koninklijke brill nv, leiden, 2020 | doi:10.1163/18781527-01102004Downloaded from Brill.com09/27/2021 12:13:00AM via free access <UN> 296 Liu, Lauta and Maas recent past, and suggest that our futures will be profoundly different in its af- termath.
    [Show full text]
  • Wijhe Index Ref Dopen 1730-1769
    Wijhe, index ref. dopen 1730-1769 - gemaakt door Jan Heideman - Oorspronkelijke bron Archiefinstelling: Historisch Centrum Overijssel, Zwolle Archief: DTB Overijssel (Wijhe) Inventarisnummer 543-544 (origineel 642 en 644) Omschrijving: Nederduits gereformeerde dopen 1704-1753, 1753-1812 Opmerking: Chronologische index pag. 2 t/m 63 Alfabetische index op naam van de vader pag. 64 t/m 117 Alfabetische index op naam van de moeder pag. 118 t/m 171 Transcriptie Gemaakt door: Jan Heideman Wijhe Soort: Index Datum versie 1 4 januari 2015 aangeleverd aan het project Deze versie: 1 Opmerking: - Eventuele correcties en aanvullingen door derden op de, binnen dit project gepubliceerde, transcriptie worden door de maker(s) verwerkt in een nieuwe versie die weer aan het project kan worden aangeboden. Het kopiëren (downloaden) van dit bestand is toegestaan voor persoonlijk gebruik en voor verspreiding op niet-commerciële basis. Commerciële verspreiding is uitdrukkelijk niet toegestaan. Bij gebruikmaking van gegevens uit deze bewerking ten behoeve van publicaties, in welke vorm ook, moet een adequate bronvermelding naar deze bewerking worden aangegeven. Beschikbaar gesteld voor het projekt "VAN PAPIER NAAR DIGITAAL" http://geneaknowhow.net/vpnd/ Wijhe index ref.dopen 1730-1769 - pag. 1 datum doop kind naam van vader naam van moeder opmerking/aanvulling 22-01-1730 Berent Jan H. Jan Essen, van Maria Jansen 29-01-1730 Dirk Jan Willems H. Willems 12-03-1730 Janna Hermen Berents Berentijn Dirks 19-03-1730 Gerrit Evert Gerrits Hendrikijn Janssen 26-04-1730 Geertijn Berent H. T. Antonijssen 07-05-1730 Jannes Willem Janssen Janna Roelofs 28-05-1730 Hendrick Hendrick Derks Petronelle J.
    [Show full text]
  • Techno-Salvation: Developing a Christian Hermeneutic of Enhancement Technology Richard Landrum Wilson
    Duquesne University Duquesne Scholarship Collection Electronic Theses and Dissertations Spring 1-1-2017 Techno-Salvation: Developing a Christian Hermeneutic of Enhancement Technology Richard Landrum Wilson Follow this and additional works at: https://dsc.duq.edu/etd Recommended Citation Wilson, R. L. (2017). Techno-Salvation: Developing a Christian Hermeneutic of Enhancement Technology (Doctoral dissertation, Duquesne University). Retrieved from https://dsc.duq.edu/etd/156 This Worldwide Access is brought to you for free and open access by Duquesne Scholarship Collection. It has been accepted for inclusion in Electronic Theses and Dissertations by an authorized administrator of Duquesne Scholarship Collection. For more information, please contact [email protected]. TECHNO-SALVATION: DEVELOPING A CHRISTIAN HERMENEUTIC OF ENHANCEMENT TECHNOLOGY A Dissertation Submitted to the McAnulty College and Graduate School of Liberal Arts Duquesne University In partial fulfillment of the requirements for the degree of Doctor of Philosophy By Richard L. Wilson May 2017 Copyright by Richard L. Wilson 2017 TECHNO-SALVATION: DEVELOPING A CHRISTIAN HERMENEUTIC OF ENHANCEMENT TECHNOLOGY By Richard L. Wilson Approved February 28, 2017 _______________________________ _______________________________ Dr. Darlene Weaver Dr. Elizabeth Agnew Cochran Professor of Theology Associate Professor of Theology (Committee Chair) (Committee Member) _______________________________ Dr. Gerard Magill Professor of Healthcare Ethics (Committee Member) _______________________________
    [Show full text]
  • Against Transhumanism the Delusion of Technological Transcendence
    Edition 1.0 Against Transhumanism The delusion of technological transcendence Richard A.L. Jones Preface About the author Richard Jones has written extensively on both the technical aspects of nanotechnology and its social and ethical implications; his book “Soft Machines: nanotechnology and life” is published by OUP. He has a first degree and PhD in physics from the University of Cam- bridge; after postdoctoral work at Cornell University he has held positions as Lecturer in Physics at Cambridge University and Profes- sor of Physics at Sheffield. His work as an experimental physicist concentrates on the properties of biological and synthetic macro- molecules at interfaces; he was elected a Fellow of the Royal Society in 2006 and was awarded the Institute of Physics’s Tabor Medal for Nanoscience in 2009. His blog, on nanotechnology and science policy, can be found at Soft Machines. About this ebook This short work brings together some pieces that have previously appeared on my blog Soft Machines (chapters 2,4 and 5). Chapter 3 is adapted from an early draft of a piece that, in a much revised form, appeared in a special issue of the magazine IEEE Spectrum de- voted to the Singularity, under the title “Rupturing the Nanotech Rapture”. Version 1.0, 15 January 2016 The cover picture is The Ascension, by Benjamin West (1801). Source: Wikimedia Commons ii Transhumanism, technological change, and the Singularity 1 Rapid technological progress – progress that is obvious by setting off a runaway climate change event, that it will be no on the scale of an individual lifetime - is something we take longer compatible with civilization.
    [Show full text]
  • Evidence-Based Policy Cause Area Report
    Evidence-Based Policy Cause Area Report AUTHOR: 11/18 MARINELLA CAPRIATI, DPHIL 1 — Founders Pledge Animal Welfare Executive Summary By supporting increased use of evidence in the governments of low- and middle-income countries, donors can dramatically increase their impact on the lives of people living in poverty. This report explores how focusing on evidence-based policy provides an opportunity for leverage, and presents the most promising organisation we identified in this area. A high-risk/high-return opportunity for leverage In the 2013 report ‘The State of the Poor’, the World Bank reported that, as of 2010, roughly 83% of people in extreme poverty lived in countries classified as ‘lower-middle income’ or below. By far the most resources spent on tackling poverty come from local governments. American think tank the Brookings Institution found that, in 2011, $2.3 trillion of the $2.8 trillion spent on financing development came from domestic government revenues in the countries affected. There are often large differences in the effectiveness and cost-effectiveness of social programs— the amount of good done per dollar spent can vary significantly across programs. Employing evidence allows us to identify the most cost-effective social programs. This is useful information for donors choosing which charity to support, but also for governments choosing which programs to implement, and how. This suggests that employing philanthropic funding to improve the effectiveness of policymaking in low- and middle-income countries is likely to constitute an exceptional opportunity for leverage: by supporting the production and use of evidence in low- and middle-income countries, donors can potentially enable policy makers to implement more effective policies, thereby reaching many more people than direct interventions.
    [Show full text]
  • Acknowledgement to Reviewers of IJERPH in 2016
    Editorial Acknowledgement to Reviewers of IJERPH in 2016 IJERPH Editorial Office Published: 11 January 2017 MDPI AG, St. Alban-Anlage 66, 4052 Basel, Switzerland; [email protected] The editors of IJERPH would like to express their sincere gratitude to the following reviewers for assessing manuscripts in 2016. We greatly appreciate the contribution of expert reviewers, which is crucial to the journal’s editorial process. We aim to recognize reviewer contributions through several mechanisms, of which the annual publication of reviewer names is one. Reviewers receive a voucher entitling them to a discount on their next MDPI publication and can download a certificate of recognition directly from our submission system. Additionally, reviewers can sign up to the service Publons (https://publons.com) to receive recognition. Of course, in these initiatives we are careful not to compromise reviewer confidentiality. Many reviewers see their work as a voluntary and often unseen part of their role as researchers. We are grateful to the time reviewers donate to our journals and the contribution they make. If you are interested in becoming a reviewer for IJERPH, see the link at the bottom of the webpage http://www.mdpi.com/reviewers. The following reviewed for IJERPH in 2016: Aarabi, Bizhan Akamani, Kofi Alves, Cláudio Aaseth, Jan Akbari, Mohammad Reza Alves, Elisabete Aasvang, Gunn Akhtar, Yasmin Amarasena, Najith Abballe, Annalisa Akk, Gustav Amasheh, Salah Abbasian, Firouz Akushevich, Igor V. Amenta, Pietro Roberto Abdin, Edimansyah Alam, Meer Amini, Reza Abdul Aziz, Ammar Albrecht, Huguette Amireault, Steve AbiGhannam, Niveen Albrecht, Julie Amiri, Azita Abou Neel, Ensanya A. Albrecht, Urs-Vito Amirpour Haredasht, Sara Abughosh, Susan M.
    [Show full text]
  • Future of Research on Catastrophic and Existential Risk
    ORE Open Research Exeter TITLE Working together to face humanity's greatest threats: Introduction to The Future of Research in Catastrophic and Existential Risk AUTHORS Currie, AM; Ó hÉigeartaigh, S JOURNAL Futures DEPOSITED IN ORE 06 February 2019 This version available at http://hdl.handle.net/10871/35764 COPYRIGHT AND REUSE Open Research Exeter makes this work available in accordance with publisher policies. A NOTE ON VERSIONS The version presented here may differ from the published version. If citing, you are advised to consult the published version for pagination, volume/issue and date of publication Working together to face humanity’s greatest threats: Introduction to The Future of Research on Catastrophic and Existential Risk. Adrian Currie & Seán Ó hÉigeartaigh Penultimate Version, forthcoming in Futures Acknowledgements We would like to thank the authors of the papers in the special issue, as well as the referees who provided such constructive and useful feedback. We are grateful to the team at the Centre for the Study of Existential Risk who organized the first Cambridge Conference on Catastrophic Risk where many of the papers collected here were originally presented, and whose multi-disciplinary expertise was invaluable for making this special issue a reality. We’d like to thank Emma Bates, Simon Beard and Haydn Belfield for feedback on drafts. Ted Fuller, Futures’ Editor-in-Chief also provided invaluable guidance throughout. The Conference, and a number of the publications in this issue, were made possible through the support of a grant from the Templeton World Charity Foundation (TWCF); the conference was also supported by a supplementary grant from the Future of Life Institute.
    [Show full text]
  • What Lies Beneath 2 FOREWORD
    2018 RELEASE THE UNDERSTATEMENT OF EXISTENTIAL CLIMATE RISK BY DAVID SPRATT & IAN DUNLOP | FOREWORD BY HANS JOACHIM SCHELLNHUBER BREAKTHROUGHONLINE.ORG.AU Published by Breakthrough, National Centre for Climate Restoration, Melbourne, Australia. First published September 2017. Revised and updated August 2018. CONTENTS FOREWORD 02 INTRODUCTION 04 RISK UNDERSTATEMENT EXCESSIVE CAUTION 08 THINKING THE UNTHINKABLE 09 THE UNDERESTIMATION OF RISK 10 EXISTENTIAL RISK TO HUMAN CIVILISATION 13 PUBLIC SECTOR DUTY OF CARE ON CLIMATE RISK 15 SCIENTIFIC UNDERSTATEMENT CLIMATE MODELS 18 TIPPING POINTS 21 CLIMATE SENSITIVITY 22 CARBON BUDGETS 24 PERMAFROST AND THE CARBON CYCLE 25 ARCTIC SEA ICE 27 POLAR ICE-MASS LOSS 28 SEA-LEVEL RISE 30 POLITICAL UNDERSTATEMENT POLITICISATION 34 GOALS ABANDONED 36 A FAILURE OF IMAGINATION 38 ADDRESSING EXISTENTIAL CLIMATE RISK 39 SUMMARY 40 What Lies Beneath 2 FOREWORD What Lies Beneath is an important report. It does not deliver new facts and figures, but instead provides a new perspective on the existential risks associated with anthropogenic global warming. It is the critical overview of well-informed intellectuals who sit outside the climate-science community which has developed over the last fifty years. All such expert communities are prone to what the French call deformation professionelle and the German betriebsblindheit. Expressed in plain English, experts tend to establish a peer world-view which becomes ever more rigid and focussed. Yet the crucial insights regarding the issue in question may lurk at the fringes, as BY HANS JOACHIM SCHELLNHUBER this report suggests. This is particularly true when Hans Joachim Schellnhuber is a professor of theoretical the issue is the very survival of our civilisation, physics specialising in complex systems and nonlinearity, where conventional means of analysis may become founding director of the Potsdam Institute for Climate useless.
    [Show full text]
  • Young Scientists
    Young Scientists Applied mathematics Erez Aiden is an Assistant Professor in the Department of Genetics at the Baylor College of Medicine, where he directs the Center for Genome Architecture, and in the Department of Computer Science and Computational and Applied Mathematics at Rice University. His research has made fundamental contributions to a large variety of disciplines, including molecular biology, polymer physics, historical linguistics, wearable computing, and mathematics. These include: development of a three-dimensional genome sequencing method; discovery of dynamic reorganization of the genomic architecture to facilitate gene expression or silencing; the characterization of the genome as a “fractal globule;” quantitative analysis of the evolutionary dynamics of language which led to the discovery that the rate of verb regularization depends on the inverse-square of its usage frequency. He has over 20 patents in various stages of filing. Co- inventors include Bob Langer, Nathan Myhrvold and Bill Gates. Microfluidic methods Adam Abate is Assistant Professor in Bioengineering at the School of Pharmacy of the University of California at San Francisco. He is a physicist whose research employs microfluidics for high-throughput biological applications. He has developed microfluidic methods to create emulsions that consist of droplets of very precise and consistent sizes that are used to create micro-compartments, which can be loaded with single cells and other active materials, such as drugs, nutrients, and assay reagents. The droplets can be used as tiny “test tubes” for performing chemical and biological reactions. This approach is used for directed evolution, genetic sequencing and cell sorting. Optical sensors Andrea Armani is the Fluor Early Career Chair in Engineering and Associate Professor of Chemical Engineering and Materials Science at the University of Southern California.
    [Show full text]
  • Cognitive Biases Nn Discussing Cognitive Biases with Colleagues and Pupils
    The RSA: an enlightenment organisation committed to finding innovative practical solutions to today’s social challenges. Through its ideas, research and 27,000-strong Fellowship it seeks to understand and enhance human capability so we can close the gap between today’s reality and people’s hopes for a better world. EVERYONE STARTS WITH AN ‘A’ Applying behavioural insight to narrow the socioeconomic attainment gap in education NATHALIE SPENCER, JONATHAN ROWSON, LOUISE BAMFIELD MARCH 2014 8 John Adam Street London WC2N 6EZ +44 (0) 20 7930 5115 Registered as a charity in England and Wales IN COOPERATION WITH THE no. 212424 VODAFONE FOUNDATION GERMANY Copyright © RSA 2014 www.thersa.org www.thersa.org For use in conjunction with Everyone Starts with an “A” 3 ways to use behavioural insight in the classroom By Spencer, Rowson, www.theRSA.org Bamfield (2014), available www.vodafone-stiftung.de A guide for teachers and school leaders at: www.thersa.org/startswitha www.lehrerdialog.net n Praising pupils for effort instead of intelligence to help instil the Whether you and your pupils believe that academic idea that effort is key and intelligence is not a fixed trait. For ability is an innate trait (a ‘fixed mindset’) or can be example, try “great, you kept practicing” instead of “great, you’re strengthened through effort and practice like a muscle really clever”. (a ‘growth mindset’) affects learning, resilience to n Becoming the lead learner. Educators can shape mindset setbacks, and performance. Mindset through modelling it for the pupils. The way that you (and parents) give feedback to Think about ability like a muscle Try: n Giving a “not yet” grade instead of a “fail” to set the expectation pupils can reinforce or attenuate a given mindset.
    [Show full text]
  • Wise Leadership & AI 3
    Wise Leadership and AI Leadership Chapter 3 | Behind the Scenes of the Machines What’s Ahead For Artificial General Intelligence? By Dr. Peter VERHEZEN With the AMROP EDITORIAL BOARD Putting the G in AI | 8 points True, generalized intelligence will be achieved when computers can do or learn anything that a human can. At the highest level, this will mean that computers aren’t just able to process the ‘what,’ but understand the ‘why’ behind data — context, and cause and effect relationships. Even someday chieving consciousness. All of this will demand ethical and emotional intelligence. 1 We underestimate ourselves The human brain is amazingly general compared to any digital device yet developed. It processes bottom-up and top-down information, whereas AI (still) only works bottom-up, based on what it ‘sees’, working on specific, narrowly defined tasks. So, unlike humans, AI is not yet situationally aware, nuanced, or multi-dimensional. 2 When can we expect AGI? Great minds do not think alike Some eminent thinkers (and tech entrepreneurs) see true AGI as only a decade or two away. Others see it as science fiction — AI will more likely serve to amplify human intelligence, just as mechanical machines have amplified physical strength. 3 AGI means moving from homo sapiens to homo deus Reaching AGI has been described by the futurist Ray Kurzweil as ‘singularity’. At this point, humans should progress to the ‘trans-human’ stage: cyber-humans (electronically enhanced) or neuro-augmented (bio-genetically enhanced). 4 The real risk with AGI is not malice, but unguided brilliance A super-intelligent machine will be fantastically good at meeting its goals.
    [Show full text]