Index abnormally dangerous activities 38–9 behavioral reaction 17–18 academic expertise 112 drones 6 academic institutions/universities 222, legal protection for social 276 20–21, 214, 218, 219–20, 222, licensing 181–4 227, 231 accountability 267, 269, 376, 378, 382, movie robots 5 385, 386 anticybersquatting 17 F 189, 191, 192 appeals 249, 261, 264, 265, 266, 268 Advanced Medium-Range Air-to-Air Apple 191 Missiles (AMRAAMs) 55 Arduino 141 Aegis Combat System 53–4, 55 Arizona 271 agency capture 49 Arkin, R.C. 358 agriculture Asimov, Isaac 5, 26, 173, 357 tomato harvester 352–5, 358–9 Association for Computing Machinery Aibo dog 53, 55, 215, 218, 220, (ACM) 223 Code of Ethics and Professional Aiko 189, 191, 192 Conduct 146–7 aircraft Association for Unmanned Vehicle autopilot 26, 101 Systems International (AUVSI) 31 immunity: aviation industry 168 asymmetric element of modern warfare strict liability 364 abnormally dangerous activities asymmetry in power 49, 188, 210 38–9 Atlanta 244 Unmanned Aircraft System (U.A.S.) audit trails 265–6 38–9 augmentation, human 82 airports 10 Australia 244 Aldebaran 215 authenticity 220 Alston, P. 366 automobiles 19, 20, 31, 66, 275–6 Amazon 8, 108, 131, 132 antilock braking systems (ABS) 40, American Law Institute 29, 70 96 American National Standards Institute cruise control 26, 40, 41–2, 84, 258–9 (ANSI) 135 design defects 35 American Traffic Solutions 271 design and safety 26–7, 40, 90, 94, Anderson, C. 106 96 Anderson, K. 357, 381 driverless 12, 40, 55, 78–9, 180, 260 fallacy 4, 18–21, 22 abnormally dangerous activities animal(s) 38–9 abuse 225, 226–8, 229 control 84–5 sniffer dogs 319–20 Google (GDC) 10–11, 12, 38, 55, anthropomorphism 18–21, 22, 175, 107, 108, 110, 111–12, 118, 189, 310–311, 386 275, 298

387

Ryan Calo, A. Michael Froomkin and Ian Kerr - 9781783476732 Downloaded from Elgar Online at 10/02/2021 06:45:24AM via free access 388 Robot law

human-machine system and human-machine system and 95–101 automation 95–101 preemption 49 risk 85, 86 products liability 41–4 unreasonable risk 86–7 proposals for change 45–7, 49 speed 30, 90, 91–5, 100 electronic stability control (ESC) 38, civil disobedience 271 40, 96 experiment: coding traffic law see expert robots: delegation, coding the law relinquishment and law enforcement, automated responsibility 116, 118 235–6, 239, 245, 254, 257–9, driverless car 107, 108, 110, 260, 268, 271 111–12, 118, 120 necessity defense 268 GPS technology 15, 81, 235, 236, strict liability 242, 243, 244, 245, 254 abnormally dangerous activities errors 262–3 38–9 law enforcement and private texting-while-driving restrictions 90 sector devices 255 autonomy 53–6 malfunctions 257 consent 187, 202, 203, 205, 210 insurance 31, 43, 45–6, 180 degrees/levels of 56, 57–8, 74, 215 law enforcement, automated 250, increasing 10, 11, 18, 25, 41, 58, 260, 266–7 88–9, 174, 189 experiment: coding traffic law see low level or no 9 coding the law Wizard of Oz model 161 GPS technology 15, 81, 235, 236, environments 58–61 242, 243, 244, 245, 254, 255, ground-based teleoperated robots 8 257, 262–3 law enforcement, automated 260 legal integration of algorithms robot interrogators 319, 329 257–9 silence, right to 327, 329 license plate reader 246–7, 248–9 lethal autonomous weapons see necessity defense 268 killer robots red light cameras 247, 296, 298 machine IQ 58 social cost 271 mixed initiative or shared systems speed 235–6, 239, 245, 254, 257–9, 11, 21 260, 268 Mars Exploration Rovers 8, 53 tire pressure monitoring 248 over-ascription of 218 traffic cameras 244–5, 271, 293, Roomba 7, 9, 53, 55 299 self-taught programs 56–8 litigation 40 sexbots 187, 202, 203, 205, 210 negligence 62 silence, right to 327, 329 privacy by design 248 warehouse robots 8–9 robot language 78–9 see also driverless under automobiles control 84–5 human-machine system and bar codes 246 automation 95–101 Baraniuk, Richard 142 responsibility 88–9 bias 204 risk 85, 86 automation 264, 265, 266 safety and reasonableness 86–7 hindsight 77 speed 30, 90, 91–5, 100 law enforcement 252, 256, 264, 265, safety 266, 273, 287, 295, 296, 298, 303 design and 26–7, 40, 90, 94, 96 robot interrogators 329

Ryan Calo, A. Michael Froomkin and Ian Kerr - 9781783476732 Downloaded from Elgar Online at 10/02/2021 06:45:24AM via free access Index 389 biological weapons 342 children 219, 221, 223–4 biometrics 245, 246, 249–50, 271, autism 175, 222 293–4 child abuse 225, 230 blueprint test 36 China 333 borders 327 Christianity 189 border avatars 312–13, 315–16, 322, cinema 5–6, 7, 18, 194, 195–6, 207–8, 326, 328, 329 216–17 searches 322 Citron, D.K. 265–6, 267, 269 self-incrimination 323 civil disobedience 271 brain scans closed robots 166, 167–8, 184 electroencephalography 314, 315, closed systems 81 327–8 cluster munitions 377 functional magnetic resonance codes of conduct/ethics 136–7, 146–7, imaging (fMRI) 314–15, 316, 148, 181, 183–4, 185 325–6, 327–8, 329 coding the law 274–305 Breathalyzer test 325 background 275–8 Breazeal, C. 220 experiment: coding traffic law 275, Brooks, R.A. 157 278 burden of proof 42 instructions 304–5 Bush doctrine 359 experiment analysis 291–302 butterfly effect 82 certification 296 competition 297–9 California 61, 225, 352–3 expertise 295–6 Calo, R. 114, 164, 165, 168–70, 173, lawmaking authority 295–6 176, 180, 184, 239, 250, 267, 333 models insufficient at times Calvin, S. 334 296–7 Canada 244 new paradigms in punishment constitutional law 299–300 freedom of expression 211 problem areas 291–5 robot interrogator: right to silence second- and third-order effects 317, 323–6 299 robot interrogator searches social cost 300–302 317–22 experiment results 279–91, 292 interrogation 309 clustering 283–5 polygraph 314 concerns about creations 290–291 neuroethics 138 context 286–7 obscenity 198, 199–201 inter-ticket time 285–6 sexual violence 206 notice of speed changes 282 capabilities of robots 4, 7–11, 22, number of tickets 289–90 173–4 scalability 287–9 Čapek, Karel 5 sensor and timing error 282–3 Carpenter, J. 213, 217–18 subtle coding distinctions 288–9 cars see automobiles tolerance 279–82 causation 73, 82, 100 COGNIRON project 136 products liability cognitive fallacies 75 sophisticated robotic automobiles hindsight bias 77 42 Collins, Francis 139 chaos theory 289 Collins, Harry 109–10, 112 charities 10 common law tradition 62 chemical weapons 342 complex systems 73–4, 75–6, 81–2

Ryan Calo, A. Michael Froomkin and Ian Kerr - 9781783476732 Downloaded from Elgar Online at 10/02/2021 06:45:24AM via free access 390 Robot law

Concealed Information or Guilty crimes with scienter requirements Knowledge Test 314–16, 318–19, 252, 293 322 necessity defense 268 confessions, coerced 324, 327 crowd-sourcing 143–4, 148, 160, 249, consent 294 data use 251 cruise missiles 7–8, 174, 336 interrogators 325, 326, 328 culinary consultant 105, 106 sexbots see separate entry cultural differences 146, 162 ubicomp (ubiquitous computing) custom, industry 30 349 customary international law 350, 368, constitutional law 12, 294, 329 372–3, 379, 386 Canada cyberlaw and robolaw 3–4, 12–15, 22 freedom of expression 211 xii robot interrogator: right to silence 317, 323–6 da Vinci surgical robots 40–41 robot interrogator searches damages 317–22 statutory 170 First Amendment and freedom of Danielson, P. 143 speech 211, 268 Darling, K. 20 Fourth Amendment 252, 264, 268 data protection 348–9, 360 robot interrogator searches data-mining engines 108 317–19, 320–322 databases 75, 82, 221, 294 trespass/privacy 13–15, 17, 81, data aggregation 251 245 draft ethical robot license 180 Fifth Amendment: right to silence E-Z Pass 244 317, 323–6 identity information 245 Sixth Amendment: right to trial 264 motor vehicle records 246, 250, 294 consumer expectations test 35, 67, 70, open roboethics initiative (ORi) 147 71, 87 speed limits 245 consumer protection 12 death agency capture 49 wrongful 19 contract law 12, 61, 65 Defense Science Board (DSB) 95–6 liability and product safety 28, 32, defenses 28, 73, 168, 170 33 definitions doctrinal uncertainty 28, 29–31 12 merchantability warranty 32 automated law enforcement 239 open licensing 170 autonomous vehicle 12 control 83–5, 88–9 autonomy 55–6, 215 cookies 246 pornography 197, 198 Coordination Action for in robot xi–xii, 4, 5–7, 22, 151 Europe (CARE) 134 industrial 39 copyleft licenses 179 social 215, 228 copyright 294 surveillance 241 corporate risk management 86 dementia 222 corruption 269 Denmark 138, 244 cost–benefit test 33, 35, 36, 37, 42, 47, design 358 87 automated law enforcement 290, proposal for change 46 298 criminal justice system 264, 327 errors in design 241, 260–263 criminal law 61, 88, 203–4, 252 privacy by design 248

Ryan Calo, A. Michael Froomkin and Ian Kerr - 9781783476732 Downloaded from Elgar Online at 10/02/2021 06:45:24AM via free access Index 391

building code laws and building 277 eldercare 10, 41, 135–6, 175, 189, 219, closed and open robots 167 221 domestic robots 136 electroencephalography 314, 315, inequality: politics in 190–193 327–8 knowledge-sharing and informing electronic commerce 347, 348, 360 142–4, 145 elevator-riding robot moderating shared content open roboethics initiative (ORi) 150–151 131–62 privacy by 248 ELLEgirlBuddy 177–8 safety and 26–7, 40, 90–91, 94, 96 embodied machine intelligence and sharing and ethics implementation tort theory 51–77 140–141, 144–8, 161–2 autonomy and robots 53–6 elevator-riding robot 151–61 disembodied software 58–9 social robots 190 emergent behavior 57 speed 95 environments 58–61 workplace 74 machine IQ 58 design defects self-learning 55 tort 35, 37, 42, 46–7, 66, 68–9 self-taught programs 56–8 reasonableness 87 common sense 60, 75–6 Restatement (Third) of Torts foreseeability 34, 52, 63–4, 65, 68–9, 70–71, 87 72–4, 76 determinism, technological 210, 355, on-the-job learning 69 359, 363 Restatement (Third) of Torts disability 175, 194 70–72 robot assistants 11 future reciprocal accommodation DNA 75–7 digital identity system 249–50 negligence 62, 63–4 self-incrimination 325 Restatement (Third) of Torts, domestic robots 136, 215, 221 impact of 70–72 Roomba vacuum cleaner 7, 9, 53, 55, strict liability 62, 63, 65–70 167, 217 emergencies 92, 100, 121 domestic violence 236 emissions from motor vehicles 93–4 double effect doctrine 353–4, 363 emotional injuries 81 driverless cars see driverless under empathy 223, 224–5, 228, 301, 364 automobiles engineers, lawyers and robot language drones 180 78–101 commercial 131, 132, 177 language 83–9 domestic 177 systems 79–83 law enforcement 176–7 use 89–95 military settings 6, 8, 52, 53, 55, 174, users 95–101 176, 336, 337–8 enhancement, human 82 IHL and autonomous drones 346 errors YouTube 364 automated law enforcement 241, private 255 249–50, 260–263, 264, 265, 269 due process 238, 260, 264, 265–6, 296, analog-to-digital conversion 249 297 experiment: coding traffic law 282–3, 288–9, 293, 297, 300 E-Z Pass automated toll collection human 46, 54, 74, 301 system 243, 244, 245 ethics “Easter Eggs” 290 animal cruelty 227–8

Ryan Calo, A. Michael Froomkin and Ian Kerr - 9781783476732 Downloaded from Elgar Online at 10/02/2021 06:45:24AM via free access 392 Robot law

bottom-up approaches 133 Facebook 108 ethics discussions 138–9 failure to warn implementation 139–40 tort 35–6, 42, 46–7, 67, 69–70 closed robots 167 closed robot manufacturers 168, consent, roboticization of 186–212 184 killer robots 334–5, 358 Restatement (Third) of Torts 72, open licensing 164, 165–6, 168, 87 170–172, 184–5 false negatives 241, 244, 247, 261–2, concerns about robots 172–8 263 proposed license framework false positives 239–41, 244, 247, 261–2, 178–84 263, 264 software freedom 171 fashion 105, 106 open roboethics initiative (ORi) Federal Aviation Administration 131–62 (FAA) 101, 177 open source paradigm 132, 139, 140 Federal Communications Commission design sharing and ethics (FCC) 277 implementation 140–141 Federal Motor Vehicle Safety Standard knowledge-sharing and informing (FMVSS) 49 design 142–4 feedback loops 52, 60, 77, 80, 81 organizations and initiatives 134–5 law enforcement 236, 237–8, 239, robot–human expert disagreement 272 123 open roboethics initiative (ORi) standards and guidelines 135–7 145 see also morality Feenberg, A. 190, 210 European Union feminism 204 Commission 134 films 5–6, 7, 18, 194, 195–6, 207–8, evidence-based practice 104, 116–17, 216–17 119, 120, 121, 122–4, 126 financial risk 86 evolutionary robotics 57, 61 Food and Drug Administration (FDA) expert robots: delegation, 40, 136 relinquishment and responsibility foreseeability 34, 52, 63–4, 65, 68–9, 102–27 72–4, 76 consistent performance 112–13 closed robots 167, 168, 184 explain decisions 113 open robotics: architecture, liability human–robot disagreement and 166–8 117–20 Restatement (Third) of Torts 70–72 expert robots ‘right’ 120–122 forward-looking infrared (FLIR) expert robots ‘wrong’ 122–4 technology 319, 320–321 knowledge domains 105–7 Foster-Miller Talon 8 normative pull of evidence Foucault, M. 270–271 115–17 Fox, D. 325 philosophical gain 114–15 franchise agreements 181 responsibility 124–6 fraudulent or unfair business practices tacit knowledge 109–12 61 unpredictable by design 107–9 Free Software Foundation 171 expert witnesses freedom of expression 211, 268 emergent behavior 42 functional magnetic resonance imaging products liability 30, 43 (fMRI) 314–15, 316, 325–6, expression, freedom of 211, 268 327–8, 329 externalities 81, 87 fusion centers 267

Ryan Calo, A. Michael Froomkin and Ian Kerr - 9781783476732 Downloaded from Elgar Online at 10/02/2021 06:45:24AM via free access Index 393 gaming 298–9 Hitachi Hokusai Electric 271 Gates, Bill 163 Hitachi robo-taxi 276 gender 210 Holland, John 56 sexbots see separate entry Holmes, Oliver Wendell 63, 65 stereotypes 187, 188–93, 194, 198, household/domestic robots 136, 215, 201, 204, 206, 210 221 General Public License (GPL) 179 Roomba vacuum cleaner 7, 9, 53, 55, genetic algorithms 52, 56, 57, 61 167, 217 genetic policy 139 human dignity 375, 376, 385, 386 Geneva Conventions (1949) 342, human enhancement 82 360–361, 371 human genome 139 Additional Protocols I and II 342–6, human rights 337, 373, 375, 376, 385–6 372, 376 Human Rights Watch 137 Germany 138, 350 Gilliland, J. 351 IBM 149 Golem literature 172 Watson 102–3, 105–8, 109, 110, Google 191 111–12, 113, 114–15, 116, 287 Driverless Car (GDC) project 10–11, Idaho 177 12, 38, 55, 107, 108, 110, identity theft 247–8, 249 111–12, 118, 275, 298 ideology and technology 351–5 search engine 106–7 immigration 323 governmental standards 30, 31 see also borders Federal Motor Vehicle Safety immunity 48–9, 165, 168–9 Standard (FMVSS) 49 indemnity 32, 183 GPS technology 15, 81, 235, 236, 242, industrial robots 7, 8–9, 39, 53, 55, 108, 243–4, 245, 254 135, 173, 215, 369 errors 262–3 inequalities in society 190–193, 199, law enforcement and private sector 206, 210–211 devices 255 information collected by robots in malfunctions 257 home 177, 221 unmanned aerial vehicles 338 information, kill switch to delete 178 grounded theory 143 information sharing Guilty Knowledge Test 314–16, Codes of Ethics 147 318–19, 322 information collected by local law Gulf War 337, 338 enforcement 266–7 open source paradigm 140–144 Hague Convention II on the Laws and moderating shared content Customs of War on Land (1899) 150–151 372 open roboethics initiative (ORi) Hague Conventions (1907) 341 144–5, 146, 147–8, 150–151 Geneva Protocol (1925) 341–2 infrared (IR) or ultrasonic sensor 243 Hague Declarations (1899) 341 Ingram, B. 136–7 healthcare 221, 222 innovation 12–13, 25, 26, 27, 44–5, 50 medicine see separate entry abnormally dangerous activities 38–9 Paro therapeutic robot 135–6, 215, burden-of-proof rules 42 218–19, 221, 222 fostering 48–9 policy: public participation 138 immunity 48–9 heat scanning of homes 319, 320–321 international humanitarian law 360 Heyns, C. 366 open licensing 164, 172, 184 hindsight bias 77 preemption 30, 49

Ryan Calo, A. Michael Froomkin and Ian Kerr - 9781783476732 Downloaded from Elgar Online at 10/02/2021 06:45:24AM via free access 394 Robot law

products liability litigation: robotic case for lethal autonomous robots machines 39, 40, 41 339–40 sophisticated robotic automobiles jus nascendi in IHL 367–71 42, 43, 47 Martens Clause 371–5, 378, 380, tort: incentivizing 33 384, 385, 386 uncertainty and innovators 31 meaningful human control 375–86 Innovo Labs 215 military necessity 344, 345, 349, 351, Institute of Electrical and Electronics 356, 357, 365, 366, 384 Engineers (IEEE) 79, 134 lethal autonomous weapons as Code of Ethics 147 force multiplier of 358–64 instruction and warning defects technology and ideology 353–5 tort 35–6, 42, 46–7, 67, 69–70 norms of IHL 340–343 closed robot manufacturers 168, autonomous weapons 346 184 discrimination 343–4 Restatement (Third) of Torts 72, humanity 344–5 87 military necessity 344, 345 insurance 165 proportionality 343 automobiles 31, 43, 45–6, 180 responsible command 346, 378 draft ethical robot license 180 robotic warfare 335–9 no-fault first-party schemes 45–6, 47 superfluous injury and unnecessary products liability 31, 43, 70 suffering 383, 384 users of open robots 169–70, 180 technological neutrality 346–9, 365 workers’ compensation 46 ideology 351–5 intellectual property 105, 140, 269 normative pull of new copyright 294 technologies 349–51 open licensing: infringement of 170 International Organization for trademarks 17, 181–4 Standardization (ISO) 135 interdisciplinarity 3, 132, 133, 135 ISO 8373: definition of robot 151 International Committee for Robot ISO 13482: safety of nonmedical Arms Control (ICRAC) 137 service robots 136 International Conference on Robotics ISO 26262: road vehicles 79, 85, and Automation (ICRA) 134, 135 86–7, 96 International Court of Justice (ICJ) ISO/IEC 15288: system life cycle 345, 361, 362, 363 processes 79, 83, 84 Rome Statute 360, 379 International Robot Fair Japan 134 International Electrotechnical Internet Engineering Task Force Commission (IEC) 79 (IETF) 295 international humanitarian law: jus interrogation, robot-enhanced 306–29 nascendi, robotic weapons and aims of interrogator 308 Martens Clause 367–86 border avatars 312–13, 315–16, 322, jus nascendi and IHL 370–371 326, 328, 329 Martens Clause 371–5, 380, 384, 386 courts: limiting admissibility and use dictates of public conscience 372, 327–8 373–5, 384, 386 electroencephalography 314, 315, principles of humanity 372, 373, 327–8 378, 384, 385, 386 functional magnetic resonance nascent principle: meaningful imaging (fMRI) 314–15, 316, human control 375–86 325–6, 327–8, 329 international humanitarian law and Guilty Knowledge Test 314–16, killer robots 333–66 318–19, 322

Ryan Calo, A. Michael Froomkin and Ian Kerr - 9781783476732 Downloaded from Elgar Online at 10/02/2021 06:45:24AM via free access Index 395

polygraph 313–14, 326, 329 jus nascendi in IHL 367–71 potential legal implications 317, 329 Martens Clause 371–5, 378, 380, robot interrogator searches 384, 385, 386 317–22 meaningful human control 375–86 robots, psychology and self- military necessity 344, 345, 349, 351, incrimination 323–6 356, 357, 365, 366, 384 psychology 308–9, 328–9 lethal autonomous weapons as border avatars 312–13 force multiplier of 358–64 persuasive robots: findings from technology and ideology 353–5 HCI 309–11 norms of IHL 340–343 rapport 310, 311 autonomous weapons 346 robots, self-incrimination and discrimination 343–4 323–6 humanity 344–5 recommendations and conclusion military necessity 344, 345 327–9 proportionality 343 Reid technique 309 responsible command 346 technology 313 robotic warfare 335–9 current deception-detecting superfluous injury and unnecessary 313–15 suffering 383, 384 robot interrogators 315–16 technological neutrality 346–9, 365 Intuitive Automata 215 ideology 351–5 Intuitive Surgical, Inc. 40–41 normative pull of new iPhone 191 technologies 349–51 Iraq 338, 340 Kismet 215, 220 iRobot Kiva Systems 8–9 PackBot 8, 338, 340 Kolb, M. 217–18 Roomba 7, 9, 53, 55, 167, 217 Kurzweil, R. 357 Israel 333 iTunes 16, 108 law enforcement, automated 174, 272–3 Jasanoff, S. 138 clock synchronization 244 Jensen, R. 209 conceptualizing 239–41 Joh, E. 256 defensive strategies 247–8, 249, Joy, Bill 103–4 297–8 juries draft ethical robot license 178, 180 automobile claims 43 drones 176–7 products liability 30 experiment: coding traffic law see jus nascendi, robotic weapons and coding the law Martens clause 367–86 false negatives 241, 244, 247, 261–2, 263 Kaczynski, Theodore (Unabomber) false positives 239–41, 244, 247, 103, 104 261–2, 263, 264 Kaiser Permanente 108 information from robots 177, 266–7 Kant, I. 228, 355 interrogation, robot-enhanced Kerr, I. 173–4, 175–6, 177–8, 329 306–29 kill switch to delete information 178 multifactor authentication 246 killer robots 333–66 post-hoc enforcement 244, 260 Campaign to Stop 132, 137, 333 preemptive 243, 250, 260, 268 case for 339–40 questions necessary to confront 252 IHL and 355–64 administrative burden 263–4

Ryan Calo, A. Michael Froomkin and Ian Kerr - 9781783476732 Downloaded from Elgar Online at 10/02/2021 06:45:24AM via free access 396 Robot law

control 254–5 tort 36–7, 66, 68–9, 72 discretion 256, 259 Restatement (Third) of Torts 71 implementation 254 Marchant, G. 339 legal integration of algorithms Mars Exploration Rovers 8, 53 257–9 Martens Clause 341, 371–5, 380, 384, perfection of enforcement 256–7 386 preemptive/post hoc enforcement dictates of public conscience 372, 260 373–5, 384, 386 procedural safeguards 264–9 principles of humanity 372, 373, social cost of automation 269–72 378, 384, 385, 386 system error/malfunction 260–263 Massachusetts Institute of Technology rise of automation 235–8 (MIT) 215, 220 tamper resistance 263 Massively Open Online Courses taxonomy of capabilities 241 (MOOCs) 142 aggregation 251 medicine 105–6, 107–8, 113, 118 analysis 250–251 evidence-based 116, 126 punishment 251–2, 253 expert robot: standard of care surveillance 241–50 125–6 lawyers, engineers and robot language medical devices 136, 222 78–101 robot-human expert disagreement language 83–9 120–122 control 83–5, 88–9 surgical robots 40–41, 180 responsibility 88–9 mens rea 252 risk 85–6 mentoring 110, 111 safety, reasonableness and Meron, T. 372 efficiency 86–7 metaphors 4, 11, 13, 16–18, 22, 115 systems 79–83 Fourth Amendment and trespass/ use 89–95 privacy 13–15 actual speed 92–3, 95 shared autonomy systems 21 design speed 95 military necessity 344, 345, 349, 351, legal speed 91–2, 95 356, 357, 365, 366, 384 reasonable speed 93–5 lethal autonomous weapons as force users 95–101 multiplier of 358–64 legal anthropology 370, 379 technology and ideology 353–5 legal field: expert robots 105, 106 military settings 173–4, 175, 228 Lessig, L. 250, 355 Advanced Medium-Range Air-to- lethal autonomous weapons see killer Air Missiles (AMRAAMs) 55 robots Aegis Combat System 53–4, 55 licensing see open licensing capabilities of robots 7–8, 9, 173–4 Lin, P. 336, 357 cluster munitions 377 Linux 140–141, 149 cruise missiles 7–8, 174, 336 Lockheed Martin drones 6, 8, 52, 53, 55, 174, 176, 336, Aegis Combat System 53–4, 55 337–8 London Naval Treaty (1930) 350 IHL and autonomous 346 Second (1936) 350–351 YouTube 364 Lorenz, E. 82, 289 emotional projection 175, 217–18 ethics 137 MacKinnon, C. 197 draft ethical robot license 178, manipulation propaganda 374 179, 180 manufacturing defects killer robots 334–5

Ryan Calo, A. Michael Froomkin and Ian Kerr - 9781783476732 Downloaded from Elgar Online at 10/02/2021 06:45:24AM via free access Index 397

jus nascendi, robotic weapons and submarines 349, 351 Martens clause 367–86 technology and ideology 353–5 killer robots see separate entry negligence 19, 33, 34, 43, 51, 52, 62, nuclear weapons 360–362, 363 63–4, 169 ”smart” bombs 337 distribution chains 65–6 submarines 349–51, 358–9 expert robot: standard of care 125–6 torpedoes 336, 351 foreseeability 63–4, 71, 72–4 World War I 337 Netflix 16 World War II 342, 349, 350, 371 networks, machine-to-machine 82 Mill, J.S. 202 neuroethics 138 Miranda warning 323 neuroscience 325 misogyny 191–3, 196, 208 neutrality, technological 346–9, 365 misrepresentation 37–8 ideology 351–6 mixed initiative or shared autonomy normative pull of new technologies systems 11, 21 349–51 Mars Exploration Rovers 8, 53 Nevada 12 MOOCs (Massively Open Online New York 97, 278, 293, 298 Courses) 142 New Zealand 244 moral luck 123 no-fault first-party insurance schemes moral psychology 146 45–6, 47 moral rules 159 non governmental organizations morality 199, 228, 371, 372–3, 374–5, (NGOs) 131–2, 137, 365 383, 385, 386 nuclear weapons 360–362, 363 slave- 334 see also ethics obscenity 197, 205, 211 Morozov, E. 171–2 pornography, definitions of 197–8 movies 5–6, 7, 18, 194, 195–6, 207–8, US and Canadian jurisprudence 216–17 198–202 Mulligan, C. 268 OECD (Organisation for Economic multipurpose robots 10, 11 Co-operation and Development) music, digital 16 348 mySimon 175–6 OnStar system 236, 255 open licensing 141, 163–85 N-reasons survey platform 143 barriers to adoption of ‘sufficiently Nader, Ralph 94 open’ model 166–8 Next Generation robot 222 potential solutions 168–72 NASA 8 concerns 172 National Highway Traffic Safety physical harm 172–4 Administration (NHTSA) privacy implications 176–8 automated vehicles 79, 85, 88, social harm 175–6 94 conditions 170 national identification cards 250 covenants 170 national security 269, 314, 327, 329 proposed license framework 184–5 natural rights theory 230 analogous applications of ethics necessity 180–184 defense 268 draft text 182–3 military 344, 345, 351, 356, 357, 365, operationalizing 179–80 366, 384 scope of license 178–9 lethal autonomous weapons as ‘sufficiently and selectively open’ force multiplier of 358–64 license 170–172

Ryan Calo, A. Michael Froomkin and Ian Kerr - 9781783476732 Downloaded from Elgar Online at 10/02/2021 06:45:24AM via free access 398 Robot law open roboethics initiative (ORi) 131–3, preemption 30, 49 144–7, 161–2 printing, three-dimensional 82 background 133 privacy 12, 176, 325 bottom-up approaches 138–40 access into homes 177, 221 open source paradigm 132, 139, cars, memory of robotic 43 140–144 direct surveillance 176–7, 267 organizations and initiatives 134–5 draft ethical robot license 178 standards and guidelines 135–7 Fourth Amendment 13–15, 17, 81, building a community 149–50 245, 264 elevator-riding robot 132–3, 151–2 GPS monitoring 15, 81, 245 discussion 159–60 robot interrogator searches limitations 160–161 317–19, 320–322 policy development 154–6 law enforcement, automated 264–5, policy implementation 157–9 266–8, 269, 271 scenario 152–3 RFID tags 248 finance 148–9 reasonable expectations of 76–7, potential deliverables 147–8 318–22 practical challenges 148–51 robot interrogators 317–22, 327, 328 open robots 166–7 shared autonomy systems 21 Open Source Robotics Foundation silence, right to 325, 327, 328 141, 151 social meaning associated with open systems 80–81 robots 177–8, 267 Oregon 177 technology-neutral approach Orwell, G. 186 data protection 348–9 over-the-air updates 82 wiretapping 13–15, 17 Oxford University 276 products liability 29, 33–4, 37–9, 52, 62 closed robot manufacturers 168, 184 PackBot 8, 338, 340 defects, three types of 34–7, 65–7 Pagallo, U. 356–7, 363 design defect 35, 37, 42, 46–7, 66, Paro therapeutic robot 135–6, 215, 68–9, 70–71, 87 218–19, 221, 222 failure to warn 35–6, 42, 46–7, 67, parole hearings 327 69–70, 72, 87 patent aggregators 181 manufacturing defect 36–7, 66, Paul, Rand 174 68–9, 71, 72 Peniak, Martin 61 government standards 30, 31, 49 peremptory norms 379 immunity 48–9, 165, 168–9 Perrow, Charles 60 insurance 31, 43, 70 Persian Gulf War (1990–1991) 337 users of open robots 169–70, 180 physical harm from human-robot litigation: robotic machines 39–41 interactions 172–4 product misuse 168, 170 Picker, C. 359, 360 proposals for fundamental change Pleo robotic dinosaur 215, 216, 222–3, 44–5 228 compensating victims 45–7 polygraph 313–14, 326, 329 fostering innovation 48–9 pornography 180, 197–8, 205, 209, 294 reasonably safe 87 obscenity in US and Canadian sophisticated robotic automobiles jurisprudence 198–202 and 101 Postman, N. 352 application issues 41–3 power asymmetry 49, 188, 210 distributional impacts 43–4 prediction technology 359 property rights 229–30

Ryan Calo, A. Michael Froomkin and Ian Kerr - 9781783476732 Downloaded from Elgar Online at 10/02/2021 06:45:24AM via free access Index 399 prostitution 195 risk–utility/benefit analysis psychology 216, 219, 364 tort 35, 66, 71 of interrogation 308–13, 328–9 Robot Operating System (ROS) 141, robots, psychology and self- 148–50, 151, 157 incrimination 323–6 Romantics 172 moral 146 Roomba vacuum cleaner 7, 9, 53, 55, scenario fulfillment 339 167, 217 Public Knowledge Project 142 rules and standards 277–8 Public Library of Science (PLoS) 142 Russia 333 public opinion 374–5 Ruston, J. 149 public participation 210–211, 266 ethics: bottom-up approaches 133, SAE International 138–40, 144 SAE J3016: automated vehicles 78, healthcare 138 84–5, 88, 96, 97, 100 safety Q-learning 157–8 design and 26–7, 40, 90–91, 94, 96 Qatar 285 human-machine systems and automation 95–101 race 190, 191, 210 immunity 48, 168–9 radio-frequency identification (RFID) ISO 13482: nonmedical service tags 242–3, 246, 247, 248, 249, 297 robots 136 rape 203, 204, 205, 206, 234 law enforcement, automated 264, rapport 310, 311 270 reasonable alternative design (RAD) manual 167 35, 41, 43, 66, 68, 70–71 reasonableness, efficiency and 86–7 Receiver Operating Characteristic speed limit 93–4 (ROC) curves 262 women 206 reciprocity 219 St. Petersburg Declaration (1868) Redflex Traffic Systems 271 340–341, 383 Reid technique 309 Saudi Arabia 285 Repliee Q2 189, 191, 192 scenario fulfillment 339 reputational risk 86 science fiction 172, 189, 270 research robots 11, 22, 215 searches responsibility 11, 12–13, 88–9 Fourth Amendment 13–15, 17, 81, embodied machine intelligence and 245 tort theory 51–77 robot interrogator 317–22 expert robots: delegation, secrecy, trade 269 relinquishment and 102–27 self-defense 363 lawyers, engineers and robot capabilities 174 language 78–101 pre-emptive 359 ”sophisticated robots”, allocating self-driving cars see driverless under risk of physical injury from automobiles 25–50 self-incrimination 317, 323–6 restraining orders 236, 268, 293 Self-Organising Incremental Neural Riek, L.D. 137 Network (SOINN) 58 rights for robots 214, 229 service robots 58, 135–6, 215 risk 85–6, 184, 377, 378 ISO 13482: safety of nonmedical 136 corporate risk management 86, 168 sexbots 186–212 safety: absence of unreasonable 87 consent 187–8, 195, 197–8, 210, 211 tolerance 94–5 erosion of 202–9

Ryan Calo, A. Michael Froomkin and Ian Kerr - 9781783476732 Downloaded from Elgar Online at 10/02/2021 06:45:24AM via free access 400 Robot law

harm to society 202–5 mistreatment 229 harm to user 207–9 property rights 229–30 harm to women 205–6 when to start 230–231 draft ethical robot license 179 socially assistive robots 135–6, 175 from to 193–6 socially responsible investments (SRI) from myth to gynoid 188–9 180 furthering inequality 190–193 soft law 381 reinforcing stereotypes 189–90 Solove, D. 270 future considerations 209–11 Sony societal harms and obscenity 197, automobiles 26–7, 30, 31, 35, 40 211 abnormally dangerous activities pornography 197–8, 205 38–9 US and Canadian jurisprudence application issues 41–3 198–202 distributional impacts 43–4 sexual assault 203–4, 205, 206, 224 emergent behavior/‘learned’ 42, sexual violence and media depictions 43 of women 209 proposals for change 45–7, 49 Shakespeare, W. 186, 301 design and safety 26–7 shared autonomy systems 11, 21 innovation 27, 42, 44–5, 50 Mars Exploration Rovers 8, 53 fostering 48–9 Sharre, P. 381 immunity 48–9 shopping bots 175–6 preemption 30, 49 shopping malls 10 tort: incentivizing 33 silence, right to 317, 323–6, 329 insurance 31, 43 simulation 148 liability and product safety 27–8 Singapore 277 contract – U.C.C. 28, 29, 32 Singer, P. 340 corrective justice/market approach ”smart” bombs 337 28 smart cards 242, 246 doctrine 32–41 smart phones 242, 249, 255 innovators and uncertainty 31 sniffer dogs 319–20 litigation 39–41 social contract 230, 270 tort 28–9, 33–9, 40, 46–7 social conventions 159 uncertainty over liability 28–31 social harm from human-robot proposals for fundamental change interactions 175–6 44–9 law enforcement, automated 260, compensating victims 45–7 269–72, 297, 300–302 fostering innovation 48–9 sexbots 211 robot dog 53, 55, 215, 218, 220, 223 erosion of consent 202–9 “sophisticated robots”, allocating risk obscenity 197–202 of physical injury from 25–50 social robots 223–5 strict liability 34, 36–9, 46–7 social networks 299 abnormally dangerous activities social robots 190 38–9 legal protection 20–21, 178–9, South Korea 134, 338 213–14, 226–9 speed 91, 100 emotions: robots vs toasters actual 92–3, 95 216–20 design 95 issues around emotional law enforcement, automated 235–6, attachments to robots 239, 245, 254, 257–9, 260, 268 220–225 civil disobedience 271

Ryan Calo, A. Michael Froomkin and Ian Kerr - 9781783476732 Downloaded from Elgar Online at 10/02/2021 06:45:24AM via free access Index 401

experiment: coding traffic law see technological neutrality 346–9, 365 coding the law ideology 351–6 legal 30, 91–2, 95 normative pull of new technologies necessity defense 268 349–51 reasonable 93–5 technological somnambulism 354, 360 regulators 90 Tesla factory 82 Spotify 16 tethered robots 53, 55 standards and guidelines 30–31, 135–7, drones 6, 8, 52, 53, 55 162 Mars Exploration Rovers 8, 53 Federal Motor Vehicle Safety texting-while-driving restrictions 90 Standard (FMVSS) 49 toll collection system, E-Z Pass 243, ISO see International Organization 244, 245 for Standardization tomato harvester 352–5, 358–9 standards and rules 277–8 torpedoes 336, 351 state of the art 173 tort 12, 28–31, 33, 40, 50, 61–2, 101 tort 34, 35, 71 embodied machine intelligence and stereotypes, gender 187, 188–93, 194, tort theory see separate entry 198, 201, 204, 206, 210 emotional injuries 81 stock market 54 litigation costs 46 flash crash (2010) 59, 298 negligence 19, 33, 34, 43, 51, 52, 62, strict liability 51, 62, 63, 65–70 63–4, 169 abnormally dangerous activities 38–9 distribution chains 65–6 coding the law 293 expert robot: standard of care foreseeability 52, 65, 68–9, 71, 72–4 125–6 products liability see separate entry foreseeability 72, 73 ultrahazardous activity 65, 67–8, 72 products liability see separate entry submarines 349–51, 358–9 risk 85–6 torpedoes 336, 351 strict liability see separate entry subsidies 81 system boundaries 81 Surden, H.276-8 Torvalds, Linus 140, 150 surgical robots 40–41, 180 toymakers 215, 222 surveillance 176–7, 235–6, 238, 241–50, Toyota 275–6 267 trade organization: AUVSI 31 draft ethical robot license 178, 180 trade secrecy 269 false positives 261 trademarks 17, 181–4 location 242–3 traffic cameras 244–5, 271, 293, 299 private sector devices 255 transparency 265, 269, 296, 299, 303 social cost of automation 269–72 trespass 13, 15, 257, 260 system 82 Turiel, E. 159 time 243–4 Turing test 6 wiretapping 13–15, 17 Turkle, S. 207, 208, 219 see also drones systems 79–83 ubicomp (ubiquitous computing) 349 Ubuntu 149 tacit knowledge 109–12 ultrasonic or infrared (IR) sensor 243 Talon (Foster-Miller) 8 Uncanny Valley 190 technical capabilities of robots 4, 7–11, unfair or fraudulent business practices 22 61 technological determinism 210, 355, United Kingdom 138, 244 359, 363 United Nations 367, 371

Ryan Calo, A. Michael Froomkin and Ian Kerr - 9781783476732 Downloaded from Elgar Online at 10/02/2021 06:45:24AM via free access 402 Robot law

autonomous weapons systems 137, Restatement (Third) of Torts 72, 365–6, 367, 382 87 Declaration of Human Rights 373 websites 17 Universal Resource Locators (URLs) Weizenbaum, J. 310 17 whales 227 universities 222, 276 Wikipedia 142, 149, 150 licensing 181–4 Willow Garage 10, 141, 148–9, unmanned aerial vehicles see drones 150 Unmanned Aircraft System (U.A.S.) Winner, L. 190, 195, 334, 352, 353, 38–9 354–5, 360 USSR 361 wiretapping 13–15, 17 Wittgenstein, L. 109, 115 video games 225 Wizard of Oz model 161 Portal 216 workplace von Hippel, Eric 140 accidents 173 design 74 waiver of right to silence 324, 327 see also industrial robots Wallach, W. 122, 146 World Health Organization 361 war see military settings World Robot Declaration 134 warehouse robots 8–9 warning and instruction defects Young, J.E. 136 tort 35–6, 42, 46–7, 67, 69–70 YouTube 192, 364 closed robot manufacturers 168, 184 Zappos 8

Ryan Calo, A. Michael Froomkin and Ian Kerr - 9781783476732 Downloaded from Elgar Online at 10/02/2021 06:45:24AM via free access