AI Applications (Aibrain)

AI Applications (AIBrain)

Best 7 AI Applications Demos AI Robotics 1 AI Robot for Children Demo 1. Holistic AI - Tyche: AI Companion for Children 2 Autonomous Navigation Demo 2. Cognitive Navigation Agent Athena: AI Robot For All - at Home and Work 3 AI Assistant Demo 3. Conversational AI with Tyche: AI Companion for Children Demo 4. Joy of Driving with Language Learning, Playing Game, and Listening Music Demo 5. Multi-Lingual Support Demo 6. AI MC – Korean Version Demo 7. Tyche Chinese Live Demo 8. AI DJ 4 AI Games: Game AI vs. Academic Game AI Demo 9. AI Game “Futurable”

3 AI Business Areas • AI robots • Virtual AI • AI games

AIBrain builds Human Cognition into Holistic AI architecture, AICoRe

Sense the world (humans) Problem Discovery & Solving • Can hear AI discovers problems • Can see based on its life goals and beliefs and then solves the problems Human AICoRe Adaptive Interactive AI “Incremental” Cognitive Reasoner “Incremental” Learning Memory AI (acquiring knowledge about Respond to the world over time) Memory Graph the world • Communicative actions (AI’s Personal Memory) • Physical actions

Human Cognition Cognitive Architecture: AICoRe (Adaptive Interactive Cognitive Reasoner): - Fully Autonomous

Memory Graph as an AI’s personal memory, integrating episodic and semantic knowledge (Note that Google’s Knowledge Graph and Facebook’s Social Graph focus on semantic knowledge) Million A+I Startups Top 10 AI Applications, Sep 7, 2016

AI Application 1. Holistic AI Demo 1. Tyche AI as Holistic Intelligence

Tyche AI robot as Holistic Intelligence - All in One https://www.youtube.com/watch?v=7MqkBdHEhNY (1:14)

AI Companion for Children

Tyche.club

"This little robot is apparently the most intelligent smartphone robot in the world is capable of recognising humans, hear and talk back, learn and solve problems auto nomously." (The Guardian, 9 Jan 2014)

Tyche v1 ($199 on Amazon, Nov 2016) Demo 1. Tyche’s Holistic Intelligence - All in One

Tyche AI robot as Holistic Intelligence - All in One https://www.youtube.com/watch?v=7MqkBdHEhNY (1:14) Build your own Intelligence with iRSP + (PC, Smartphone + Sensors - Kinect)+ (Tyche, robots) Build your own with iRSP (PC, Kinect Sensor, Drone)

iRSP Robot SW w robot simulator

Tyche Controlled via Smart Watch

6 Comparison: Personal AI Robots Tyche with other Robots on Cognitive, Emotional and Social Intelligence

Pepper JIBO Buddy Tyche Price $1,931 $799 $699 $299-199 Release Date Jun 2015 in Jpn 2016 (?) July 2016 11/1/2016 Intelligence Spectrum of Intelligence Emotional Social C Family Companion AI Companion Cognitive I Total Multi-modality: Sensing O O O O NLU O Problem discovery & generation O Problem solving/Planning & CBR O Execution of physical actions O Expression in NL/Cognitive acts O Execution monitor ∆ BDI agent reasoning O? O Working Memory with active problem solving conte ∆ xts Incremental learning O O Working Memory O Incremental LTM: storing & retrieval O Social I Multi-agent recognition by face O O O ∆ Multi-agent recognition by voice ∆ Multi-agent planning O Inter-agent communication with other artificial agen ∆ ts Inter-Agent Comm and NLG O Emotional I Emotion recognition from Multimodality O ∆ Emotion recognition of humans O ∆ Emotion expression in relation to CI ∆

Legend: O Supports; ∆ Partially supports Million A+I Startups Top 10 AI Applications, Sep 7, 2016

AI Application 2. Autonomous Navigation Demo 2. Cognitive Navigation Agent with Athena: AI Robot for All

© 2016 AIBrain Inc, All rights reserved. What is Athena An intelligent robotic agent with a navigation system and cognitive planner, allo wing it to comprehend user needs and autonomously traverse its environment. Components • AIBrain’s Intelligent Agent for planning + reasoning for understanding user needs – “Show me where the bathroom is” – “Where is mom?” – “Could you ask dad to go to the living room?” • Odometry-based state tracking and sensor-based mapping and localization – Robot has map of the environment and knows its location – Able to traverse to the understood destination autonomously

• Using low-cost cameras for sensing real world coordinates (done) – Home use: dual RGB camera + software algorithm for processing – Office use: RGB-D camera, generates depth data in hardware • Mapping on ROS platform and traversing (current stage) • Integrating cognitive agent (WIP)

Creating a map with dual RGB camera Map with Kinect

Athena at Home: ACE Capabilities 1. Assistant – Physical, Information Provider, Security Highlights 2. Companion – Friend, Good Friend, Mentor • Most Affordable (SRP $299-499, Amazon, 2017) 3. Entertainer – Play Music and Games, Joy of Living • Autonomous AI at Home and Work • Customize Your Own Intelligence Athena at Work: ACE Capabilities 1. Assistant – Reception, Scheduler 2. Companion – Social Companion 3. Entertainer – Guest Entertainer

Round Base Round Base 4 Wheel Base (30-45 inches tall) www.aibrain.com Athena will come soon

(In Seoul) Athena at Robot World 2016, Seoul, Oct 12-15, 2016

(In the USA) Athena at Cuckoo’s Nest, Oct 15, 2016 Athena at Downtown Palo Alto, Nov 12, 2016 Athena at AI World & Expo, San Francisco (Nov 7-9, 2016) Athena at CES 2017, Las Vegas (Jan 2017)

Athena Demo 2. AI Visitor Guide at Work

Guest AI Guide Remark

[Athena at the entrance] V Hello? A Hello. I am Athena. Your guide at AIBrain. V Nice to meet you.

A Nice to meet you too. How can I help you?

I want to see PERSON(Eric). Sure. Follow me to the meeting room. [Move to the meeting room with visitor] A This is the meeting room. Please take a seat. V Thank you very much. No problem. I will let PERSON(Eric) know you are here A . [Move to the PERSON(Eric)’s seat alone] A PERSON(Eric), your visitor is in the meeting room. Okay. I will be there in a min Eric ute. Okay, I will inform the visitor that you will be there in A a minute. [Move to the meeting room alone] A Excuse me. PERSON(Eric) will be here in a minute. V Thank you very much. A You’re welcome. [Athena moves back to the entrance] Demo 2. Cognitive Navigation Agent with Athena: AI Robot for All

AI Application 3. AI Assistant Demo 3. Conversational AI

© 2016 AIBrain Inc, All rights reserved. Personal Robots: Artificial Friends with Limited Benefits Companies are developing appealing robot companions, but they aren’t yet capable of helping out around the house. (Will Knight on July 24, 2015, MIT Technology Review)

Pepper Jibo Buddy

Robots are repetitive. Children get bored.

Tyche What makes a human being the most advanced animal on Earth?

Eye of a golden eagle Eagles can see Dolphins can hear 4 -8 times farther than humans 7 times more than humans What makes a human being the most advanced animal on Earth?

 Language (is an innate faculty of mind which) is unique to humans (Chomsky's theory)

the faculty for language evolved by natural selection Noam Chomsky as a adaptation for communication. Demo 3. (Conversational AI) Tyche converses with two persons by differentiating them

Tyche reasons incrementally over time with its Memory Tyche AI - Demo 1. Conversational AI at Robotics Conference, CES 2016 https://www.youtube.com/watch?v=DqUZCHrsl9U (1:48) Memory Graph - AI’s Personal Memory

Organized Memory is • adaptive to changing environment talk • Incremental over time agent model sensors23 see human hear happy agent789 • 3 Types of Knowledge acquired type - Conversational episodes healthy david - Its reasoning episodes Planet1 Agent123 name (self) - Generalized abstractions Earth survive (goals, beliefs) Life-goal And- goals Object0 Agent123 prosper AICoRe TheUniverse capability

memory resources innatRe1

(Memory) aM’s And-reso urces12 Innate Reasoner Sense the world WM1 LTM1

Respond to the world

Memory Graph vs. Google’s Knowledge Graph and Facebook’s Social Graph

(Memory Graph in Jena) Memory Graph (5,974 nodes, 7,028 edges) Memory Graph 2.0 - A Human-Scale Memory

Sensing the world Respond to the world AICoRe InnatRe Organized Memory is extremely complex (Organization of 10B nodes and directed links) (Memory) - 20M conversations among people - 20M reasoning episodes + generalizations - 5M Visual episodes

Day Year 100 y Remarks

Cognitive Episodic Memory Episodes 500 200k 20 million cases Chunks, 1 page long Books 1 365 36,500 A person can read a book a day Pages 500 200k 20 million 1 thick book is 500 pages long Sentences 20K 8 Million 8 * 108 sentences Words 250K 100 Million 10B concepts 2* 1010 nodes; edges

Bytes 1m 365m 3.65*1010 1 page contains 2,000 characters Visual Episodic Memory Objects 864K 300M 30B visual objects Assume can remember 10 objects per scene Scenes 86,400 30 million 3 billion Assume one can remember a scene per sec Visual episodes 1,440 500K 5 million Assume one visual episode per min Comparison: Conversational AI Tyche converse at the Beginner Level of Cambridge English up to 93%

Performance Comparison of Tyche, Siri and Mitsuku on Cambridge English Textbook, A1 Beginner L

Cambridge English Tyche Tyche Siri Siri Mitsuku Mitsuku Interchange % Success #acceptable % Success i#acceptable % success #acceptable responses/ responses/ responses/ #total sentences #total #total sentences sentences Visual Understanding with a person 20% 2/10 0% 0/10 0% 0/10 Memory-based reasoning 96.69% 175/181 17.13% 31/181 60.77% 110/181 Deeper Reasoning 100% 4/4 0% 0/4 50% 2/4 Daily Conversation with a single person 96.15% 25/26 69.23% 18/26 92.31% 24/26 Reasoning with external information 100% 3/3 100% 3/3 66.67% 2/3 Multi-Party Conversation 92.31% 12/13 0% 0/13 7.69% 1/13 Total 93.25% 221/237 21.94% 52/237 58.65% 139/237

Note 1. The total 237 sentences of the whole 16 chapters Note 2. Reasoning with external ontologies - Tyche: WordNet, etc; Siri: Wolfram Alpha, Web Search)

(Note that these results are based on our acceptance criteria) AICoRE: 3rd Gen IPA (Intelligent Personal Agent)

1st Gen 2nd Gen 3rd Gen 2012 ~2015 2015~

Knowledge based reasoning Deep language understanding Personalization with user experiences Siri: predefined keyword & Incremental Learning matching and slot filling InformaProvider  Case-based NL Dialog Management  no deep parsing! Personalized Knowledge CBR driven problem identification Management GVA, Siri Incremental Memory-based learning Google LoLa Multi-agent cooperative problem solving Assistant

(Source: AIBrain, 2012; as part of a joint proposal of 3rd Gen IPA with Dr. Ray Perrault, Director, AIC, SRI International) Cognitive AI + Emotional AI

AI Animation Architecture (Sys Env: Unity game engine) • Emotion Intelligence and expression (ex 1. Wilfred saying “Stupid”  surprised, disgust, angry, responds accordingly – “can’t accept”) • Lip sync from text speech • Non-verbal communication and gestures - eye gaze, nodding, head shaking

Target Applications: Language Learning; AI Game Emotion expression Sample Anger Disgust Fear

Happy Sad Surprise

Sample compound expressions A) neutral, (B) happy, (C) sad, (D) fearful, (E) angry, (F) surprised, (G) disgusted, (H) happily surpr ised, (I) happily disgusted, (J) sadly fearful, (K) sadly angry, (L) sadly surprised, (M) sadly disgusted, (N) fearfully angry, (O) fearf ully surprised, (P) fearfully disgusted, (Q) angrily surprised, (R) angrily disgusted, (S) disgustedly surprised, (T) appalled, (U) hatr ed, and (V) awed..... + many others AIME Project

AIME: System for retaining memories for se lf realization/improvement and sharing with others • Conversational Agent built on AIBrain’s AICoRe tech nology • Eternal Memory saved during verbal interaction • Dynamic verbal searching for date, time and contex t • Social and Emotional 3d companion “AIME” Demo 4. Joy of Driving with Language Learning, Playing Game, and Listening Music (1:00) Demo 5. Multi-Lingual Support AI MC welcoming in English with Chinese, Japanese, and Korean Demo 6. AI MC – Korean Version Demo 7. Tyche Chinese Live Demo 8. AI DJ Million A+I Startups Top 10 AI Applications, Aug 17, 2016

AI Application 4. AI Game Demo 9. Futurable: AI Simulation Game

© 2016 AIBrain Inc, All rights reserved. Futurable 1. Summer City will showcase as one of the 30 Top Indie Games at the first Google Play Indie Games Festival, San Francisco, Sep 24, 2016 FUTURABLE by AIBrain Futurable Episode 1. Summer City [Pre-Alpha] (Aug 14, 2016)

AI Plug-in for Game Developers (GiAR Lite) http://aibrain.com/products/futurable/ Demo 8. Futurable

Futurable lets a player travel to future life in an AI-simulated enviro nment where every character is a fully autonomous AI. • The goal is survival and prosperity by improving Physical Health, Cognitiv e Intelligence, and Social Intelligence by interacting with AI characters. • The core AI technology is scalable to millions of characters.

Futurable.co Conclusion: (Best) AI Applications Youtube Video 1. How smart is today's Artificial Intelligence? https://www.youtube.com/watch?v=Dru0Ow-Vw94 (8:32) May 19, 2016, Futurewise, PBS • The biggest problem is to develop autonomous weapons (Stuart Russell, should ban such weapons. • How close are we to build truly autonomous machines?

Youtube Video 2. Singularity is Near! [Full Documentary] - Michio Kaku | Ray Kurzweil https://www.youtube.com/watch?v=8CSNmrunCnA (38:40), Published on May 3, 2016 Michio Kaku and Ray Kurzweil explains the exponential rate at which Technological Singularity is approaching and the future is far near than we c an Imagine! 2029 : Singularity Year - Neil deGrasse Tyson & Ray Kurzweil - https://www.youtube.com/watch?v=EyFYF... Life Changing Future Technologies [Full Documentary] :https://www.youtube.com/watch?v=TRSlk... The technological singularity is a hypothetical event in which artificial general intelligence (constituting, for example, intelligent computers, compu ter networks, or robots) would be capable of recursive self-improvement (progressively redesigning itself), or of autonomously building ever smart er and more powerful machines than itself, up to the point of a runaway effect—an intelligence explosion—that yields an intelligence surpassing a ll current human control or understanding. Because the capabilities of such a superintelligence may be impossible for a human to comprehend, th e technological singularity is the point beyond which events may become unpredictable or even unfathomable to human intelligence.

Ray Kurzweil: reach human level in <15 years – make ourselves smarter (Augmented Intelligence)

Still far off • “Even the smartest machines are still blind” - Fei-Fei Li, Stanford U – No where near that.

• Michio Kaku (Physics of the Impossible, Future of the Mind) • Many predictions made by worldly-renowned scientists turned out to be wrong – People love to make predictions

Youtube 3. Google's Deep Mind Explained! - Self Learning A.I. https://www.youtube.com/watch?v=TnUYcTuZJpM (13:44), May 1, 2016 • AI is the world’s greatest aim (Paul Allen) • AI could be malicious. We are cautiously optimistic (DeepMind)

AIBrain: We are Constructionists. We build Augmented Intelligence. Futurable: Future Travel – Seeing is believing!

Futurable

A+I 桃李滿天下 A+I (Augmented Intelligence) Engine Million A+I Startups Technology for All Practice for All