1 SHAIL, 14 DECEMBER 2017 TODAY FROM: MALAGA, SPAIN ROLF PFEIFER, DR. SC. TECHN. ETH LIVING WITH ROBOTS LTD., SHANGHAI JIAO TONG UNIVERSITY, CHINA PROF. EM. UNIVERSITY OF ZURICH 2 Living with Robots Ltd. 3 Department of Automation, Shanghai Jiao Tong University, China 4 SHAIL, 14 DECEMBER 2017 HOW THE BODY SHAPES THE WAY WE THINK - 10 YEARS LATER ROLF PFEIFER, DR. SC. TECHN. ETH LIVING WITH ROBOTS LTD., SHANGHAI JIAO TONG UNIVERSITY, CHINA PROF. EM. UNIVERSITY OF ZURICH 5 SHAIL, 14 DECEMBER 2017 THE “ROBOT/AI HYPE”, EMBODIED INTELLIGENCE, SOFT ROBOTICS, AND DEEP NEURAL NETWORKS ROLF PFEIFER, DR. SC. TECHN. ETH LIVING WITH ROBOTS LTD., SHANGHAI JIAO TONG UNIVERSITY, CHINA PROF. EM. UNIVERSITY OF ZURICH EMBODIED INTELLIGENCE 6 WHY DO PLANTS NOT HAVE BRAINS? (Lewis Wolpert, British biologist) … EMBODIED INTELLIGENCE 7 WHY DO PLANTS NOT HAVE BRAINS? “The answer is actually quite simple: they don’t have to move! “ (Lewis Wolpert, British biologist) … EMBODIED INTELLIGENCE 8 THERE ARE OTHER THINGS BESIDES DEEP NEURAL NETWORKS … THE “ROBOTIC/AI HYPE” 9 ROBOTICS* 2017 HAS A PROBLEM * CONSUMER ROBOTICS, SOCIAL ROBOTS - NOT INDUSTRIAL ROBOTICS ▸ Random Interviews with consumers, 04/ 2016 EXPECTATION VS. REALITY 10 THE “ROBOTIC/AI HYPE” 11 EXPECTATION REALITY - perfect functionality - polished look - toy look - little functionality THE “ROBOTIC/AI HYPE” 12 REALITY OF „ROBOTICS-REVOLUTION“ 2016/2017 Hefei (China) THE “ROBOTIC/AI HYPE” 13 THERE IS A ROBOTIC HYPE ! THE “ROBOTIC/AI HYPE” 14 THERE IS A ROBOTIC HYPE ! THE “ROBOTIC/AI HYPE” 15 THERE IS A ROBOTIC HYPE ! THE “ROBOTIC/AI HYPE” 16 THE “ROBOTIC HYPE” CBSNEWS, December 2013 THE “ROBOTIC/AI HYPE” 17 THE “ROBOTIC HYPE” CBSNEWS, December 2013 THE “ROBOTIC/AI HYPE” 18 THE “ROBOTIC HYPE” “The dawn of the age of robotics” Frankfurter Allgemeine Zeitung 9 February 2017, p. 21 THE “ROBOTIC/AI HYPE” 2017 19 THE TABLOID PRESS What is Artificial Intelligence? Martin Vetterli, President EPFL 18 October 2017 THE “ROBOTIC/AI HYPE” 2017 20 THE TABLOID PRESS Robots take command in the garden 20min, Tabloid 19 Mai 2017 THE “ROBOTIC/AI HYPE” 21 UBS: AI TO BOOST TRADERS’ PERFORMANCE 2017 Financial Times 7 July 2017 UBS as “Pionier” THE “ROBOTIC/AI HYPE” source: AlphaGo Movie website 22 DEEPMIND - DEVELOPER OF ALPHAGO 2017 Pascal Kaufmann DER ROBOTER/AI HYPE SWISS INITIATIVE:Starmind InternationalMINDFIRE 23 THE “ROBOTIC/AI HYPE” 24 ROBOTS IN FACTORIES welding robots THE “ROBOTIC/AI HYPE” 25 ROBOTS IN FACTORIES welding robots THE “ROBOTIC/AI HYPE” 26 THE “CHAMPION”: ROBOTS LEAVING THE FACTORY HALLS HONDA ASIMO THE “ROBOTIC/AI HYPE” 27 THE “CHAMPION”: ROBOTS LEAVING THE FACTORY HALLS HONDA ASIMO THE “ROBOTIC/AI HYPE” 28 THE “CHAMPION”: ROBOTS LEAVING THE FACTORY HALLS - HONDA ASIMO MOVING INTO OUR OWN LIVING SPACE Robotics is hard !! LIVING WITH ROBOTS Service Robotics 29 29 THE “ROBOTIC HYPE” Service Robotics 30 30 Darwin-OP (Trosson) THE “ROBOTIC HYPE” “Social Robots” 31 Plen2 (Plen2 Proj.) Jibo Robohon/Robi (Robo Garage) Zenbo (Asus) Balro (Fujisoft) Kiribo (Toyota) Alpha 1s (UBTECH) Alpha 2 (UBTECH) Nao (Ald./Softbank) Buddy (Blue31 Frog Rob.) Unisrobo (UNIS Corp.) Tapia (MJI Robotics) Jibo THE “ROBOTIC HYPE” Jibo-Imitations 32 Jibo (original) ElliQ (Intuition Robotics) Jibo imitation JD.CC HowAreYou? 32 Pebble (Rokid) Olly (Emotech) “Social Robots” From: WRC Oct 2016 “Social Robots” From: WRC Oct 2016 “Social Robots” From: WRC Oct 2016 “Social Robots” From: Robot Show, Shanghai, July 2017 “Social Robots” From: Robot Show, Shanghai, July 2017 “Social Robots” From: WRC, Beijing, 2017, August 2017 “Social Robots” From: WRC, Beijing, 2017, August 2017 “Social Robots” functionality of an iPhone THE “ROBOTIC/AI HYPE” 41 SOCIAL ROBOTS 2017 - A SOBERING EXPERIENCE ? Café Nescafé Harajuku, Tokyo November 2015 Rolf with Softbank’s “Pepper” - the ‘STAR’ THE “ROBOTIC/AI HYPE” 42 SOCIAL ROBOTS 2017 - A SOBERING EXPERIENCE ? Café Nescafé Harajuku, Tokyo November 2015 Rolf with Softbank’s “Pepper” - the ‘STAR’ THE “ROBOTIC/AI HYPE” 43 SPIEGEL 43, 2016 “Hello, Pepper?” Café Nescafé Harajuku, Tokyo Why a stupid robot gets into the November 2015 headlines? Rolf with Softbank’s Spiegel 43, 2016 “Pepper” THE “ROBOTIC/AI HYPE” 44 SPIEGEL 43, 2016 “Hello, Pepper?” Café Nescafé Harajuku, Tokyo Why a stupid robot gets into the November 2015 headlines? Rolf with Softbank’s Spiegel 43, 2016 “Pepper” THE “ROBOTIC/AI HYPE” 45 CAREFUL: ANTHROPOMORPHIZATION! ANTRHOPOMORPHIZATION “… to attribute human form or personality to things not human.” Café Nescafé Merriam Webster Harajuku, Tokyo November 2015 Rolf with Softbank’s “Pepper” THE “ROBOTIC/AI HYPE” 46 ANTHROPOMORPHIZATION Café Nescafé Harajuku, Tokyo November 2015 THE “ROBOTIC/AI HYPE” 47 ANTHROPOMORPHIZATION LIVING WITH ROBOTS 48 ROBOY: GESICHTSAUSDRUCK “Hello - my name is Roboy” Photography:Credit: AdrianTEDx Baer Zurich THE “ROBOTIC/AI HYPE” 49 ROBOY: FACIAL EXPRESSION Credit: TEDx Zurich THE “ROBOTIC/AI HYPE” 50 SOCIAL ROBOTS - REALITY CHECK ▸ mostly children’s toy look ▸ social interaction but lack of manipulation skills in real world ▸ movement and locomotion limited ▸ novelty wears off quickly ▸ in essence: functionality of iPhone “Social Robots” ▸ “iPhones in tin cans” ▸ “iPhones on wheels” “Social Robots” ▸ “iPhones in tin cans” ▸ “iPhones on wheels” From: WRC 2017, August 2017 THE “ROBOTIC/AI HYPE” 53 SOCIAL ROBOTS - REALITY CHECK ▸ mostly children’s toy look ▸ social interaction but lack of manipulation skills in real world ▸ movement and locomotion limited ▸ novelty wears off quickly ▸ in essence: functionality of iPhone FULL-FEATURED HUMANOIDS NOT ANYWHERE IN SIGHT THE “ROBOTIC/AI HYPE” 54 DEEP NEURAL NETWORKS THE “ROBOTIC/AI HYPE” 55 DEEP NEURAL NETWORKS ▸ image processing ▸ AlphaGo ▸ speech and language ▸ self-driving vehicles ▸ medical diagnostics ▸ Big Data ▸ etc. THE ROBOTIC/AI HYPE 56 DEEP NEURAL NETWORKS “children playing Frisbee” THE ROBOTIC/AI HYPE 57 DEEP NEURAL NETWORKS - HUGE AMOUNTS OF DATA REQUIRED children playing “Frisbee” DER ROBOTER/AI HYPE 58 DEEP NEURAL NETWORKS ▸ image processing ▸ AlphaGo ▸ speech and language ▸ self-driving vehicles ▸ medical diagnostics ▸ Big Data ▸ etc. THE ROBOTIC/AI HYPE 59 DEEP NEURAL NETWORKS THE ROBOTIC/AI HYPE 60 DEEP NEURAL NETWORKS Gibbon THE ROBOTIC/AI HYPE 61 DEEP NEURAL NETWORKS “Statistically impressive, but individually unreliable.” John Launchbary, DARPA Gibbon THE ROBOTIC/AI HYPE THE ULTIMATE HYPE IN DNN: ALPHAGO 62 GO: AlphaGo against Lee Sedol, 2016 DER ROBOTER/AI HYPE ALPHAGO - AN ALGORITHM! 63 GO: AlphaGo against Lee Sedol, 2016 DER ROBOTER/AI HYPE ALPHAGO - AN ALGORITHM! 64 ENTIRELY “DISEMBODIED” - SOFTWARE GO: AlphaGo against Lee Sedol, 2016 THE “ROBOTIC/AI” HYPE THE “AI” 65 Internet of Things Pepper Baxter Drones Honda Asimo Industrial Robot Self-driving car Amazon Echo IBM Watson the “AI” ”machine learning” Social robots “deep neural networks” Big Data IBMs Deep Blue AlphaGo “Society 5.0” Apple Siri Industry 4.0 “Made in China 2025” THE “ROBOTIC/AI” HYPE THE “AI” 66 - complete separation of hardware and software - intelligence = software Internet of Things Pepper Baxter Drones Honda Asimo - unintelligent mechatronic structure Industrial Robot Self-driving- morphology/materials car completely ignored Amazon Echo - input-processing-output IBM- interaction Watson with environment neglected the “AI” Social robots Big Data IBMs Deep Blue AlphaGo “Society 5.0” Apple Siri Industry 4.0 “Made in China 2025” THE ROBOTIC/AI HYPE 67 PERFORMANCE VS. COMPETENCE THE ROBOTIC/AI HYPE 68 PERFORMANCE VS. COMPETENCE Performance AlphaGo AI/Deep Neural Networks human machine learning (uninteresting) “intellectual” Competence THE ROBOT/AI HYPE ALPHAGO - COMPETENCE? 69 board 19x19 —> 18x18 ?? GO: AlphaGo against Lee Sedol, 2016 THE “ROBOTIC HYPE” 70 BACK TO “SOCIAL ROBOTICS” - ROBOLOUNGE PROJECT ▸ fulfill expectations of public, deliver on promises ▸ functionality beyond speech and facial expression ▸ comfortable, engagin, exciting interaction, high “coolness factor” NOT: REPLACING HUMANS, BUT ENHANCING EXPERIENCE THE “ROBOTIC HYPE” 71 THE ROBOLOUNGE PROJECT Design and make available a space where people can experience the future (not only talk about it) The “Robolounge” … Experience a touch of tomorrow ! socialsocial experimentexperiment -- publicpublic windowwindow -- communitycommunity 72 Experience the future ! 73 VIDEO: “HOW WILL IT BE …”? THE “ROBOTIC HYPE” 75 ROBOLOUNGE ROBOTS receptionist bartender security (“bouncer”) “Drone waiters” … THE “ROBOTIC HYPE” 76 ROBOLOUNGE ROBOTS receptionist bartender security (“bouncer”) “Drone waiters” … THE “ROBOTIC HYPE” 77 WHY A “BARTENDER” ROBOT ? … THE ROBOTIC/AI HYPE 78 THE “BARTENDER” ROBOT ▸ needed for the “Robolounge” ▸ sophisticated sensory-motor and social communication skills required ▸ skills transferable to many other domains ▸ great markets ▸ it’s fun!! THE ROBOTIC/AI HYPE 79 THE ROBOT BARTENDER - CAPABILITIES ▸ customer presence recognition, visual contact ▸ voice recognition, limited speech recognition ▸ understand order, move to beer storage, fetch bottle, pour desired beer ▸ info about specials, drinks, offering humorous comments and jokes ▸ handle payment THE ROBOTIC/AI HYPE 80 THE ROBOT “BARTENDER”: WHY WILL IT WORK ? ▸ embodiment ▸ soft robotics ▸ scaffolding MUST EXPLOIT THESE FACTORS ! THE ROBOTIC/AI HYPE 81 THE ROBOT “BARTENDER”: WHY WILL IT WORK ? ▸ embodiment ▸ soft robotics ▸ scaffolding MUST EXPLOIT THESE FACTORS ! EMBODIED INTELLIGENCE 82 “I THINK — THEREFORE I AM” René Descartes Discours de la Méthode, 1637 83 Lego Mindstorms “creatures” “Crazy