CS415 Human Computer Interaction

Lecture 12 – VR, AR, Pervasive (Ch. 20)

November 9, 2015  Sam Siewert Assignments

Assignment #5 – Explore HCI’s, Propose Group Project (Groups of 3)

Assignment #6 – Proof-of-Concept or Evaluation with Final Report

Final Oral Exam – Presentation of Project

Myself, Jim Weber, Dr. Davis, Dr. Bruder Emily and Adam Molson – Controls Lab Monitors – 9-5 on Sat, 12 noon – 9pm Sun

 Sam Siewert 2 Advanced HCI … Future

Microsoft Research HCI Vision

Interesting HCI Innovations and Experiments (Examples) – MS Hololens, – , – jibo, – sixthsense, – VR, – NVIDIA AR/VR, PX, – Intel Real Sense, – Google Project Tango, – Interactive Film, – Gear VR

 Sam Siewert 3 Ubiquitous Computing Ted Talk on Minority Report Style UI Pranav Mistry Ted Talk on Interaction David Merrill Ted Talk on Siftables MIT Media Lab – “reinvent—how humans experience, and can be aided by, technology.” - History MIT Media Lab Founder Ted Talk

Next, Week 12 … Week 13 … Advanced Avionics and UAV/UAS Week 14 – Quiz, Review for Exam #2, A#6 Help Week 15 – Exam #2

 Sam Siewert 4 Definitions Ubiquitous Computing – Merge computational artifacts smoothly with world of physical artifacts (applications integrated with things) – Superimpose relevant information over top of the object – Objects in the physical world to manipulate virtual (graspable) – Context aware applications (Who, What, Where, When, Why) – Recommendation Engines, Adware, Personal Assistants – Vannevar Bush (Memex) – Often compared to Hypertext Today

VR () – Immersive – Desktop – Simulated World

AR (Augmented Reality) – Project Onto World – See World Through Mobile Screen / Glasses With Annotation – Requires Computer Vision (Object Recognition) for True AR  Sam Siewert 5 Ubiquitous Computing Term Credited to Mark Weiser – “The Computer of the 21st Century”, Scientific American, 265(3):66-75, September 1991 – Vision Described Previously at Many HCI Research Organizations [e.g. Xerox PARC, MIT Media Lab, GIT, …]

Some Enabling Technologies – Computer Vision – Generalization of Machine Vision (for Automation) to Use Visual Perception in the Field and to Emulate Human Visual Perception – Projection, 3D, High Resolution Large Displays and Mobile Computing (Fields of View: Inches, Feet, Yards) – Head tracking Independent Display Eyeware, 3D Glasses (Polarized, Shutters) – Large Scale Interactive Surfaces (Large Touch Screens) – Data Gloves and Body Suits

 Sam Siewert 6 Playing with Concepts Cost Reduction is Key to Become Ubiquitous (Killer App) MERL DiamondTouch (2003) CU Computer Vision Chess, Automatic Duck Hunter

 Sam Siewert 7 VR, AR Killer Applications Remains to Be Seen

Today – Scientific Visualization (VR) – Digital Cinema Animation (VR, AR) – Training Systems (Surgery, AR Overlay to Identify Objects) – Games and Entertainment (VR) – First Person Viewing and Sensing (Remote Presence), E.g. UAVs (AR)

Ubiquitous Use – Not Yet? – Cost and Convenience (Pranav Mistry Pendant – Good Start - $350, Easy to Wear) – Compelling Value (Wear Computer or Build into Things – IoT)

 Sam Siewert 8 New HCI is Risky Does the HCI Define the Product? Is this the Right Place to Innovate the HCI? Catalogue of Catastrophe – Why Products Have Failed Classic Mistakes [According to One PM Consulting Firm] 1. The underestimation of complexity, cost and/or schedule – NRE Cost, Capex, Opex 2. Failure to establish appropriate control over requirements and/or scope – Creeping Featurism 3. Lack of communications – Expectations and Goals 4. Failure to engage stakeholders – Users and Evaluation 5. Failure to address culture change issues – Social Acceptance 6. Lack of oversight / poor project management – Micro-management vs. No management 7. Poor quality workmanship - SQA 8. Lack of risk management – Initial assessment and adjustment 9. Failure to understand or address system performance requirements – Interactive as well as batch systems 10. Poorly planned / managed transitions - Deployment

 Sam Siewert 9 Minute Paper

Beyond Today’s Vertical Applications Previously Enumerated…

VR, What is it Good for?

AR, What is it Good for?

Will Ubiquitous Computing Envisioned by Mark Weiser be Realized?

 Sam Siewert 10