Rich Miner Android co-founder Man / Machine Interface Digital Ink / Stylus and other Modalities Rich Miner Co-Founder Android @richminer 35,000 years of innovative & creative output supported by “ink” 33,000 BC 1215 1488 1890 1951 2014 The interface to our best 2017 tech is an 1873 innovation 1873 1961 1981 2010 QWERTY Keyboard used at scale for only the past +/- 30 years 1873 1961 1981 2010 QWERTY With a fresh start you would not choose QWERTY on glass 1873 2016 WAIT!!!!! In 2017 Ink is still heavily used to get work done 2016 Apple has Pencil Microsoft has Surface Google has Pixelbook and Android w/Ink Confluence of Technologies Confluence of multiple technology’s enabling something new and amazing from the alignment of different technology roadmaps Confluence of multiple technology’s CPU Confluencememory of multiple technology’s UX battery tech network bandwidth display resolution real OS & development tools Voice Based Assistants Confluence of multiple technology’s Confluence of multiple technology’s SpeechConfluence accuracy of multiple technology’s AI/ML Network performance CPU/signal processing Ink latency Pen precision API’s App’s Device proliferation HWR accuracy Shape of the future Shape of the future - Dependence on Keyboard & Mouse will Decline Shape of the future - Dependence on Keyboard & Mouse will Decline Shape of the future - Dependence on Keyboard & Mouse will Decline If you do your jobs well this the future of work... The world can be your canvas What can we do? Kindergarten Letter/number/shape recognition Basic Storytelling with pictures & words Phonics Sight words Source 3rd Grade Spelling, vocab, sentence structure Addition and subtraction within 100 Multiplication and division within 100 Source 5th Grade Clear, coherent writing with logically ordered reasoning Evaluate evidence from literary or informational text Fractions, decimals Shape volume Measure and interpret data Graphing Source We got very attached to the QWERTY keyboard But remember why we started using it as an interface to computer systems.. ASCII An abstraction from 1 & 0’s paved the way for higher level programming languages Like FORTRAN FORTRAN Formula Translation 501 FORMAT(3I5) 601 FORMAT(4H A= ,I5,5H B= ,I5,5H C= ,I5,8H AREA= ,F10.2, $13H SQUARE UNITS) 602 FORMAT(10HNORMAL END) 603 FORMAT(23HINPUT ERROR, ZERO VALUE) INTEGER A,B,C 10 READ(5,501) A,B,C IF(A.EQ.0 .AND. B.EQ.0 .AND. C.EQ.0) GO TO 50 IF(A.EQ.0 .OR. B.EQ.0 .OR. C.EQ.0) GO TO 90 S = (A + B + C) / 2.0 AREA = SQRT( S * (S - A) * (S - B) * (S - C) ) WRITE(6,601) A,B,C,AREA GO TO 10 50 WRITE(6,602) STOP We can compile formula’s Directly, and in real time! Why can’t I compile this? Confluence ofMan multiple / Machine technology’s UX But these devices can…. Understand our… .. words .. writing .. facial expressions .. gestures Assistive Ink This is how we communicate facial expression Future of man / machine interaction assistive UX gesture digital ink communicating naturally as we have for voice 10’s of thousands of years recognition .