sign in sign up
<<
Home , Mind uploading, Our Final Invention

Index

affordances 241–2 apps 11, 27–33, 244–5 194, 227, 261 Ariely, Dan 28 Agar, Nicholas 15, 162, 313 Aristotle 154, 255 Age of Spiritual Machines, The 47, 54 Arkin, Ronald 64 AGI (Artificial General Intelligence) Armstrong, Stuart 12, 311 61–86, 98–9, 245, 266–7, Arp, Hans/Jean 240–2, 246 298, 311 artificial realities, see AGI Nanny 84, 311 Asimov, Isaac 45, 268, 274 aging 61, 207, 222, 225, 259, 315 avatars 73, 76, 201, 244–5, 248–9 AI () 3, 9, 12, 22, 30, 35–6, 38–44, 46–58, 72, 91, Banks, Iain M. 235 95, 99, 102, 114–15, 119, 146–7, Barabási, Albert-László 311 150, 153, 157, 198, 284, 305, Barrat, James 22 311, 315 Berger, T.W. 92 non-determinism problem 95–7 Bernal,J.D.264–5 predictions of 46–58, 311 biological naturalism 124–5, 128, 312 altruism 8 biological theories of 14, Amazon Elastic Compute Cloud 40–1 104–5, 121–6, 194, 312 Andreadis, Athena 223 Blackford, Russell 16–21, 318 androids 44, 131, 194, 197, 235, 244, Blade Runner 21 265, 268–70, 272–5, 315 Block, Ned 117, 265 animal experimentationCOPYRIGHTED 24, 279–81, Blue Brain MATERIAL Project 2, 180, 194, 196 286–8, 292 Bodington, James 16, 316 animal rights 281–2, 285–8, 316 body, attitudes to 4–5, 222–9, 314–15 Anissimov, Michael 12, 311 “Body by Design” 244, 246

Intelligence Unbound: The Future of Uploaded and Machine , First Edition. Edited by Russell Blackford and Damien Broderick. © 2014 John Wiley & Sons, Inc. Published 2014 by John Wiley & Sons, Inc. 322 Index boredom 231, 236–7, 252, 254, Coherent Extrapolated Volition 63, 78, 256–60 81–2, 86–7, 311 Borg 227, 265, 270–5 computation 13, 15, 77, 95, 122–3, Borg Queen 270–3 148, 155, 195, 199 Borsook, Paulina 223 computational environments, see virtual Bostrom, Nick 56, 58, 61, 117, 131, reality 161, 178, 190, 250, 280, 293, computational theories of consciousness 298, 317 119–25, 142, 148–9, 162 see also see also functionalist theories of Boyce, Jeanann 318 consciousness; neurocomputational brain– interface 26, 91–2, model of the 97, 244 computer hackers 4, 68, 224, 259 BRAIN Initiative 99–100, 195 13–14, 107, brain structure 12, 91–100, 105, 180, 233 195–6, 234–5, 279–80 computing power 2, 5, 35–6, 41, 149, Braund, Michael J. 245 175–6, 311 Briggman, Kevin 92–3 computer speed 2–3, 6, 35–6, 40–1, Britton, Nicholas F. 283, 286 155, 210, 214, 217, 222, 292–3, Broderick, Damien 11, 216, 318 300–1, 304 Buddhism 257, 316 conceptual blending 63, 80 Bugaj,Stephan69 93, 99, 312 conscience apps 26, 31 Callaway, Ewan 294 consciousness 2–3, 7, 9, 13–15, 18, 53, Calvin, William 3 62, 103–7, 111–13, 117, 119–26 , Carr, Nicholas 26 128–9, 139–41, 147–54, 159, Carroll, Lewis 193 162, 165, 170, 193–9, 228, causation 14, 20–1, 182–91 230–2, 245–6, 255, 257, 259, immanent causation 21, 182–8 264–9, 273–6, 290, 295, 312–16 transeunt causation 21, 182–8, of neural simulations 282–7 190 Copeland, B.J. 123 Chalmers, David 14–15, 107, 117–28, Corabi, Joseph 16, 20, 143, 312–13 132, 138–44, 147, 186–7, 283, Cotterill, Rodney 284 312–14 Crockett, M.J. 27, 30 Chiang, Ted 196 cryonic preservation 114, 187, 194, 126, 162, 266–7 243, 291 Church, G.M. 123, 125–6 CyberChild 284, 286 Clarke, Arthur C. 21 21–2, 223 Cloud, the 12, 41–2, 83, 294 21, 194, 243, 257 cloud computing 40–2 and cyborgization 3–4, 15, 21, Clynes, Manfred 264 26, 179, 194, 198–9, 226–7, cognitive enhancement 5–6, 15, 116, 263–5, 270, 310, 313–14, 318 146, 150–3, 155–9, 175–6, Cyc AGI system 82 228–9 Coherent Aggregated Volition 63, 78 Dartmouth Summer Research Project Coherent Blended Volition 63, 80–1, on Artificial Intelligence 47, 51–4, 311 57 Index 323

Data, Commander 265–74, 315 ems 298–307, 317 Davis, Erik 223 see also Dawkins, Richard 224 emulation 92–100, 103, 178–80, 182, de Garis, Hugo 62 188, 280–1, 285–96, 307, 313 death 8–9, 114, 117, 168–9, 174–5, emulation/simulation distinction 198, 205, 207, 245, 270, 281, 13–15, 107, 123–4, 191 288–91, 295, 301, 305 Encyclopedia of Ethical Failure, The 30 from destructive uploading 9, 18–19, Engines of Creation 198 108, 111–13, 122, 126–9, 131, enhancement 9, 27, 33, 78, 84, 91, 116, 137, 139, 150, 153–4, 157–9, 155–8, 175, 214, 216, 219, 244, 161–2, 196, 312–13 246, 310, 313–14 of neural emulations 288–9 Epicurus 257 whether preferable to 19, equivalency thesis 163–5 248–62, 316 see also organizational invariance see also survival eternal recurrence 260 decision theory, see prudential ethics 9, 30, 64, 67, 69–74, 78–9, rationality 82–6, 213, 246, 249, 282, demographic issues 205–7, 239 284–6, 292 Denk, Winfried 92–3 in AGI outcomes 69–5 Dennett, Daniel 117, 159, 274, 285 of AGI research 64 design options 12, 23, 36–7, 201–2, and emulation of neural structures 212, 216–17, 220, 231–2, 24, 279–96, 316–17 234–5, 314 evolution 7, 36–7, 42, 74, 96, 155, bauplans 37 218–20, 225–6, 228, 246 Dick, Philip K. 197 exascale 2 Diesmann, Markus 2 Exes (ex-humans) 12 digital distraction 27–8, 30–1 existential risks 22, 86 data-clatter 243 exocortex 26, 30–3, 310 Doctor Who 227 extended mind thesis 312 Dörner, Dietrich 76 downloading 4, 131, 243, 248–9 Facebook 6, 27–31, 79 see also mind uploading Fallows, J. 27 Drexler, Eric 58, 61, 198 Fauconnier, Giles 63, 80 Dreyfus, Hubert 47, 51, 53–4, Finley, K. 33 57–8, 255 First Contact 268–73 dualism 117, 119, 124–6, 136, 162–3, Fischer, John 251–5, 258, 260–1 194, 312 Fischhoff, B. 51 Dyson, Freeman 175 Fodor, Jerry 120, 122–5, 128 dystopia 21–2, 26–7, 226, 274 Frankenstein 193, 274 Franzen, Jonathan 6 Eagleman, David 195–6 Freaky Friday 164 economics 41–3, 62, 156, 190, Free Inquiry 227 214–18, 249, 294–5, 299–307 free will 227–8, 260, 289 Egan, Greg 117, 196 Friendly AI 3, 22–3, 43–4, 61–89, 311 embodiment 73, 194–8, 313–14 functional isomorphs 14, 18, 105–8, empathy 27–8, 61, 72–3, 162, 315 111–15, 138, 142–3, 188–90 324 Index functionalist theories of consciousness Hierarchy of Needs, Maslow’s 214, 14, 104–5, 121–5, 148–9 266–7, 274, 314 see also computational theories of see also motivational hierarchies; consciousness values future humans 23, 150, 212 Horst, S. 122 How Brains Think 3 Gamez, David 285 Hughes, James 11, 27, 310 9, 32, 265, 284 Hulme, C. 31 genotype 7–8 2, 99 Gibson, James 241–2 Humanity’s End 157 Gibson, William 21 Hume, David 134, 312 Gift of the Magi, The 257 Humpty Dumpty 193, 195 Gladwell, Malcolm 311 hyperagency 229 Glenn, Linda M. 317–18 Hyslop, A. 129 Global Brain 65, 75, 77–82, 85, 311 I, 44 Goertzel, Ben 23, 62–3, 65, 69, 71, Ihde, Don 226 77–8, 98, 311 immortality 12, 15–17, 116, 175, 179, Good, I.J. 3, 39 190, 194, 248–61, 295, 312–16 Goonan, Kathleen 15, 21, 313–14 intelligence 3–4, 9, 12–13, 18, 22–4, Governing Lethal Behavior in 27, 31–2, 36–6, 52, 57, 61–9, Autonomous 64 73–7, 82, 84, 86, 91, 98–9, 104, Grech, Victor 22, 315 119–20, 152–3, 156–60, 167, Greene, J.D. 29 187, 199, 212–13, 218, 244, Greenfield, Susan 26 263–7, 280, 298, 307, 311–13 and computation 146–9 hacking 68, 259 limits 152 see also computer hackers nature of 3, 36, 38, 98 Hamlet 16, 172–4 intelligence explosion 3, 38–44, 42, Hampton, K. 29 76–7, 82, 114, 116, 190, 313 Hanson, Robin 23, 47, 216–17, intentionality 13–14, 126, 147–8, 295, 298, 307, 317 266–70, 274 Haraway, Donna 265 Internet 11, 29, 39, 40, 43, 55, 66, hard problem of consciousness 285 77–81, 86, 97, 218, 311 hard problems 44, 285 Interplanetary Transport Network 218 hardware 7, 12, 15, 22, 24, 31, 36, Iron Man (character) 226 39–40, 55, 76, 85, 96, 175, Iron Man (motion picture) 243 178, 214, 288–9, 292–4, 299, 301, 307 Jackson, Frank 104 Hayles, N. Katherine 264, 275 Jameson, Fredric 265 Hayworth, Ken 93 Jeopardy! 2, 38, 54 He, She and It 269 Journal of Consciousness Studies 117, Heidegger, Martin 253–60, 316 119–20 Herzog, Michael H. 283 Heylighen, Francis 65, 77 Kahane, Adam 80 Hibbard, Bill 64 Kahneman, Daniel 48–9, 55 Index 325

Kandel, Eric 1, 194 Matrix trilogy 37 Kant, Immanuel 281 McCarthy, John 52 Kelly, Kevin 219 Melby-Lervåg, M. 31 Kierkegaard, S. 253–6, 316 memory, kinds of 70–1, 80 ethical sphere of existence 255 mental properties 134, 137, 181–2, religious sphere of existence 255 286, 317 Kirk, Captain James Tiberius 126–7, Metamorphosis 269 164 Metzinger, Thomas 284 knowledge argument, see Mary thought Mind Children 12 experiment mind uploading 4–10, 12, 22–4, 47, Koene, Randal 12, 91–2, 99, 312 194–6, 199, 201–9, 232, 249–50, Kubrick, Stanley 21 255, 257, 263, 312–18 Kurzweil, Ray 47–8, 51, 54–5, 131, delayed 103 146–7, 151–7, 218–19, 314 destructive 19, 102–3, 108–11, 113–16, 120, 122, 127–8, Laird, John 69 135–44, 147–59, 178, 290, 312 Ledoux, J. 228 disadvantages 155–8 Legg, Shane 63 and doubts about computer Lenat, Douglas 82 consciousness 146–60 Lewis, Clarence Irving 266 gradual 102–3, 106, 111–16, 120, Lichtman, Jeff 93 138–44, 147, 215, 222, 314 15–16, 155, 195, 198, individual options 201–4, 211, 213, 225, 243–4, 251–3, 259, 231–9 313–14, 316, 318 instant 102, 113, 135–8, 140, 143, Linus’ law 66 147, 215 Little Prince, The 241 legal rights of uploads 291–5 Locke, John 134, 165–6 nondestructive 18–19, 102–3, Loosemore, Richard 23, 232, 315 109–11, 113–16, 120, 122, Loukopoulos, L.D. 27 128, 140, 143–4, 147, 158, 178, 312 machine intelligence(s) 1, 12, 14, 18, and personal identity 5, 7–9, 15–21, 21–3, 263 102–45, 161–92, 318 see also AI (artificial intelligence); psychology of uploaded minds intelligence 299–300 Machine Intelligence Research Institute reconstructive 114–16, 122, 187 50–2, 58, 86, 120 and religion 193–4, 199 magnetic resonance imaging reverse brain engineering 178–80, (MRI/fMRI) 90, 99, 103, 179, 185 186–8, 190–1, 313 Marblestone, A.H. 98 social and cultural implications Markram, Henry 2, 194–6 204–11, 298–308 Marmarelis, V.Z. 92 structure replication and Martin, George R.R. 248, 251 reconstruction 178–80, 185–7, Mary thought experiment 104 189–91, 313 Maslow, A. 214, 266–7, 274, 314 techniques for 6, 16, 90–100, materialism 4, 117, 134–7, 144 102, 117, 161–3, 178–80, see also physicalism 183–91, 243 326 Index mind uploading (continued) non-biological substrates 212 values of uploaded minds 212–20 Noösphere 196 to virtual reality 236 Nozick, Robert visions of the future 9, 23–4, 198–9, closest-continuer theory 109, 126, 201–11, 231–9, 298–308 158 see also consciousness; personal experience machine 293 identity; survival Minority Report 243 ÓhÉigeartaigh, Seán 12, 311 Minsky, Marvin 46, 52, 57 Olson, E.T. 122, 134, 165, 314 mobile applications, see apps Olson, Nicole 23, 314 Moore’s law 2, 10, 48, 54, 94 Omega Point 196 moral enhancement 27, 32–3, 310 Omohundro, Steve 47–8, 51, 55–8, moral status 281–3, 286, 289 62, 82 morality, see ethics OpenCog AGI 65, 69–72, 75–6, morality apps, see conscience apps 82–6 morality , see conscience apps organizational invariance 13–14, 99, Moravec, Hans 12, 162 119, 107–8, 122, 125–6, 129 More, Max 5, 23, 223–4, 227–8, 244, Orkin, Jeff 78 314–15 Our Final Invention 22 223–4, Outliers 311 228–9, 244 motivational hierarchies 214–16, 220, 266–70, 274, 314 pain 19, 24, 214, 225, 233, 252–6, mythology 264, 315 273, 275, 279, 282–7, 290, 292, 300 Nagel, Thomas 317 Parfit, Derek 18, 20, 110, 117, 165–71, , regenerative 315, 318 174–5, 189 nanotechnology 39, 42, 43, 84, 103, Pascal, Blaise 150–4 164, 168, 195, 198, 232, Pascal’s Wager 150–2 315, 318 see also decision theory neural emulations, rights of, see Peirce, Charles 171 software animal rights Pennachin, C. 98 neural prostheses 91–2, 99, 146, perceptual enhancement 15, 175–6, 155, 244 203, 212, 222, 225–6, 228–9, neurocomputational model of the 232–3, 243 mind 1 personal identity 7–9, 16–21, 103, see also computational theories of 107–17, 120–2, 126–9, 132–44, consciousness; functionalist 159, 162–7, 179–91, 204, 222, theories of consciousness 290, 312–13, 318 -by-neuron replacement 15, biological (or somatic) views 109, 105–7, 111–13, 121, 138, 117, 122, 126, 165–9, 173–4, 176 142–3, 178–9, 187, 191, 313 branching problem 18, 109–10, 128, neuro-rehabilitation 318 140, 144, 158, 163, 169–75, 204 Nhát Ha⋅ nh, Thich 316 and causation 20–1, 179–91, 313 Nietzsche, Friedrich 134, 260 closest-continuer views 109–10, 116, nihilism 260, 316 122, 126, 159 Index 327

continuation of a person 112, 132–3, prosthetic impulse, see cyborgs and 136, 140, 143, 312–13 cyborgization fission and fusion of 8, 17–18, prosthetics 13, 23, 26, 91–2, 99, 229, 110–11, 114–15 240–6, 264, 275 “no self view” 134–5, 318 see also cyborgs and cyborgization numerical identity 108, 111, 132–3, prudential rationality 15, 150–9, 313 139 psychological connectedness 20, 109 qualitative identity 108 psychological continuity 20, 109, 112, psychological views 20, 109, 117, 116, 139–40, 165, 179–91 122, 126, 165, 173 Putnam, Hilary 122 temporal parts 17 threat from radical enhancement quale 266, 273–4 157, 176 23, 107, 231–9, 266–74, 315 and unity of character 254–8 fading and dancing qualia 106–7, see also survival 121–2, 129 personhood 4, 12, 108, 133–4, 165, qualia surfing 23, 231–9, 315 213, 240, 244–5, 290, 294, quality of life 67, 155, 271, 287 311–15, 318 Queen City Jazz 198 Persson, I. 27, 318 pharmaceutical enhancement Reasons and Persons 24, 117 33 Regan, Tom 282, 288 Phenomenon of Man, The 196 regenerative nanomedicine, see physical continuity 6, 136–7, nanomedicine, regenerative 169, 187 4, 137–8 physicalism 13, 134–41, 144, 181, religion 8, 193–4, 199, 225, 227 187, 265, 268 religious concepts of immortality 261 Piercy, Marge 269 religious experience 254 Pigliucci, Massimo 14–15, 18–20, robot 6, 8, 15, 19, 37–44, 68, 73, 161, 312 170, 202, 264, 268, 274, 285 Pinker, S. 123 bush robot 216 Pinocchio syndrome 263–74, 315 Robot: Mere Machine to Transcendent Pitt, Joel 23, 311 Mind 12 Plato 154 robotics 12, 24, 36–44, 65, 72–3, Platt, Charles 1 161–3, 198, 244 population growth, see demographic issues Saint-Exupéry, Antoine de 241–2, 246 post-cyberpunk 22 Sandberg, Anders 24, 47, 49, 58, 117, posthumanity 275, 296 131, 161, 176, 178, 190, 216, 280, postmodernity 253, 260 298, 316–17 Potter, Brian 50 Sandel, M. 229 predictions of artificial intelligence 12, Sandman 259 47–58, 155, 242, 311 Savulescu, J. 27, 318 Primo 223, 246, 315 Schneider, Susan 16, 20, 143, 312–13 Principle of Assuming the Most (PAM) 1, 21–2, 39, 40, 66, 131, 286, 289–91, 316–17 193–8, 226–7, 249, 263–76, 315 Problems of the Self 260 Scott, Ridley 21 328 Index

Searle, John 14, 120, 123, 125–7, Star Trek: Generations 270 148–54, 162, 194, 266, 312 Star Trek: Next Generation 268, Searle’s Wager 150–4, 159 315 self, sense of 195, 252–7 Star Trek: Voyager 271–2 Selinger, Evan 27, 30, 33 Statt, M. 30 Senge, Peter 80 Stiegler, Mark 314 219–20, 235, 282, 311, 317 Stone, Linda 27 Seven of Nine 271–2 Strout, Joe 23, 117, 314 sexuality 28, 223, 231, 254, 269, 273, substrate independence, 301 see organizational invariance Shannon, Claude 52 substratism 164–5 Shanteau, J. 49 suffering 24, 29, 155, 214, 225, 252, ship of Theseus 113, 312 257–8, 264, 281, 285, 287–8 Shoemaker, S. 180–4, 189 see also pain Simak, Clifford 267 9, 22, 56, 62, 115, simulated animals 280 146, 157 simulated environment, see virtual superintelligent machines 3, 12, 21–3, reality 38–9, 44, 61–2, 114–15 simulation hypothesis 317 survival 16–21, 96, 103, 108–17, Singer, Peter 282 122, 131–40, 144, 147–8, 155–9, Singularity 84–6, 117, 120, 144, 157, 165, 175–6, 179, 188–90, 219, 159, 180, 187–8, 190, 312–14 225–6, 228, 267, 293, 313–14 Singularity Institute, see Machine see also death; personal identity Intelligence Research Institute Singularity Is Near, The 157 Taleb, Nassim Nicholas 149 Singularity Summit 216 Techgnosis 223 Six Million Dollar Man, The 226 technological advancement 179, 217 Skevington, Suzanne M. 283, 286 technological singularity, see Singularity smartphones 12, 26, 312 Teilhard de Chardin, Pierre 196 software 13, 27, 33, 44–5, 64, 66, teleology 213, 218–20 81–6, 95, 214, 279–95, 301–2, teletransportation (teleportation) 310 108–9, 113, 117, 127–8, 165–71, software animal rights 280–96, 316–17 174–5, 189 privacy 293–4 Templeton Foundation 261 self-ownership 294–5 Thomson, Iain 16, 255–60, 316 Solving Tough Problems 80 tiny bosses 217, 301 somaticism 166–74 token identity, see type/token distinction Song of Ice and Fire, A 248 Townsend, Aubrey 19 Sotala, Kaj 58, 214 12, 22, 194, 197, souls 134–8, 141–3, 162–4, 193, 227 213, 222–4, 227, 244, 264–5, 207–11, 216, 295 314 space travel 12, 167, 203–4, 207–11, Truly 158 235, 314 Turing, Alan 43, 46–7, 123–9 Star Trek franchise 22, 263, 265 Turing machine 123 Star Trek 22, 127, 164, 227, 263–74, 42, 46, 129, 191, 266 315 Turkle, Sherry 26 Index 329

Twitter 6, 27, 79–80 Wang, Jonathan 50 2001: A Space Odyssey 21 Wang, Pei 98 type identity, see type/token distinction Ward, William Arthur 310, 318 type/token distinction 16, 20, 167, wealth distribution 40, 44, 206–7, 171–6 214, 217, 302–4 Wellington, Naomi 16, 21, 313 ultraintelligent machine 3, 38–9, 44 What Technology Wants 219 see also superintelligent machines whole brain emulation 4, 7, 12, 93–9, Unger, Peter 183–6, 188 178–91, 312 uploads and uploading, see mind see also mind uploading uploading Williams, Bernard 19, 250–60 Wittgenstein, Ludwig 128 values 23, 62–4, 71, 78, 81–2, 157, Wonderful Wizard of Oz, The 212–20, 273, 308, 314 263 virtual embodiment 236, 245 virtual reality 6–7, 19–20, 105, 196–7, xenophobia 295 209–11, 216, 220, 223–5, 236, 231–4, 244, 265, 299–303 Yampolskiy, Roman 44, 46, 57 domain 237–9, 314 Youth Without Youth 260 virtue ethics 27–33 YouTube 27 Vita-More, Natasha 23, 223, 245, 315 Yudkowsky, Eliezer 46, 57, 61–3, 81, von Neumann, John 56, 95 86, 214, 217, 293, 307, 311 Vorlons 166–9 Zarpentine, C. 27 Walker, Mark 16, 20, 164, 170, 173–4, Zimbardo, Philip 74 313 zombies 103–4, 106–7, 228, 290–1, Wallach, W. 30, 64 295