Natural User Interfaces and Accessibility
Total Page:16
File Type:pdf, Size:1020Kb
Chapter 1 Natural User Interfaces and Accessibility he widespread adoption of mobile computing is a computers using actions related to everyday behavior, good thing for librarians who care about access such as touch, gestures, speech, and conversation.1 T for all. That’s because mobile devices make use The goal is to make it easy for humans to understand of natural user interfaces, and those interfaces are and use computers without having to learn compli- making computing easier for people of all ages and cated or abstract ways of doing things. Designers of abilities, as you’ll see in this report. these interfaces aim to create experiences that feel This trend, combined with the move toward multi- just as natural to a novice as to an expert user—and device ecosystems and the emphasis on students as for expert users it can feel like an extension of their creators with mobile apps, means that mobile learning body. is headed in a direction that is empowering for learn- ers of all abilities. There are other trends in mobile learning, but this Putting the Human before report focuses on these three: the Computer: The Move from GUI to NUI • natural user interfaces and accessibility • multi-device ecosystems NUIs are a new branch in the evolution of human- • content creation with mobile devices computer interaction, after GUIs (graphic user inter- faces). GUIs were designed to make computing easier That’s because there are synergies between these to learn than command-line interfaces, where you had trends that offer opportunities for those who care to remember specific commands and type them. By about access for all. We’ll also discuss opportunities using the metaphor of a desktop, with a trash can, ReportsLibrary Technology for libraries and librarians and suggest resources for menus, and so on, users no longer needed to memo- continuing your learning. rize commands. You could just look under each menu Many notes and links are included throughout the to find the command you needed. Now with NUIs, it’s report, so it’s recommended that you sit down with possible to move away from abstract metaphors and your computer or mobile device and prepare to follow toward interactions that feel more natural. links to view interesting photos and videos related to Some examples of natural user interfaces are the topics within. touchscreens, speech recognition, and voice com- I enjoyed gathering the research for this report, mands. There is also camera input, which allows the and I think you will find it inspiring to read about how device to recognize objects in the real world, and aug- alatechsource.org mobile computing is making life easier for so many mented reality, using the camera in a way that shows people of all ages and abilities. additional information superimposed on your view of the real world. Experts agree that NUIs won’t entirely replace Natural User Interfaces Are GUIs. Instead, they are opening up a new niche of Making Computing Easier computing that is accessible to a wider audience. 2016 April for All Ages and Abilities GUIs will continue to exist for those applications and devices where they work best.2 NUI stands for natural user interface. Natural user Mobile devices are using many kinds of natural interfaces are those where humans interact with user interfaces, and that’s good news for learners. In 5 Mobile Learning Trends: Accessibility, Ecosystems, Content Creation Nicole Hennig this section, we’ll look at several examples of how 3D Touch these interfaces work and how they make comput- www.apple.com/iphone-6s/3d-touch ing easier for all ages and abilities. And in the final chapter of this report we’ll discuss some opportunities Amazon Echo for librarians to help their communities by serving as www.amazon.com/Amazon-SK705DI-Echo/dp/ expert advisors about these mobile technologies. B00X4WHP5E The Dash smart earphones Types of NUIs https://store.bragi.com The NUIs we’ll discuss can be grouped into the follow- Scanbot ing categories: https://scanbot.io/en Touch, including the following: Layar • Touchscreens and multi-touch gestures, such as https://www.layar.com/mobile-download those used on smartphones and tablets. • Haptic interfaces, such as the Apple Watch’s abil- ity to tap your wrist as a way to notify you. • Force Touch and 3D Touch. These are Apple’s tech- Why Everyone Should Pay nologies used in the Apple Watch, the trackpad on Attention to Matters of Disability newer models of Apple’s MacBook, and the latest models of iPhones (6s and 6s Plus). With Force All of us, over time, move between times of indepen- Touch you can push down on the screen to acti- dence and dependence on others. If you’ve ever had a vate certain functions. With 3D Touch, there are broken bone or similar injury, you’ve experienced the more sensitive levels of touch based on a lighter need for assistance. or firmer push. Do you wear glasses? Contact lenses? Perhaps you Sound, including the following: have braces on your teeth? Maybe you know some- • Speech recognition, such as that used by Siri and one who has a pacemaker. Whether your need for other digital assistants. these technologies is temporary or permanent, you • Conversational interfaces, where you can talk to are using “assistive technologies.” In fact, one could your device and it can react, such as that used say that all technology is assistive technology. Even by the Amazon Echo, a device that listens for your smartphone or headphones serve to augment your commands for answering questions, playing your abilities in some way. Separating technologies music, and controlling other smart devices. into assistive technology versus “regular” technology • “Hearables”—new kinds of devices that merge no longer makes sense in a world where we all benefit the health-tracking features of smart watches and from technologies that increase our abilities. fitness bands with high-quality audio like that It’s important for all of us to think about how found in premium earbuds. An example is “The technology can help improve lives, whether you work Dash”—wireless, bio-sensing headphones. with those who have recognized disabilities or not. Sight, including the following: The idea of “normalcy,” based on a bell curve of sta- April 2016 April • Camera as seeing eye, such as that used by Google tistics about how your body or mind should perform, Translate, which allows you to point your camera is a recent one (since the nineteenth century).3 This at text in one language and see it translated to goes along with the idea that disabilities are medical another language on the fly. conditions in need of cures and the idea that disabled • Camera as scanner, such as with document-scan- bodies are somehow deficient. ning or barcode-scanning apps, especially apps These days there is talk of turning people into alatechsource.org that use OCR (optical character recognition) to cyborgs, with both utopian and dystopian visions translate what the camera sees to written text. of how that might play out.4 Exoskeletons designed Scanbot for iOS and Android is a good example. to make soldiers run faster and carry heavy loads • Augmented reality, such as the ability to show a have been developed from military research and are virtual overlay on top of what you are seeing, like now being used to help people who are paralyzed that offered by the app Layar. stand and walk.5 This is proving to be wonderful for some people and has also sparked debate. There In this report we’ll look at examples of how each are those to want to “fix” people with disabilities, of these types of interfaces can enable better access to while doing nothing to adjust infrastructure, laws, Library Technology ReportsLibrary Technology learning, for people with various types of disabilities, and social norms to make our society more accessible and for everyone. for all.6 6 Mobile Learning Trends: Accessibility, Ecosystems, Content Creation Nicole Hennig This is a significant concern particularly in the • Hearing. FaceTime, Closed Captions, Messages autism community and the deaf community. They are with iMessage, Mono Audio, Visible and Vibrating not people in need of fixing. If you haven’t had the Alerts, and Made for iPhone Hearing Aids. opportunity to think much about this issue, these two • Physical and Motor Skills. AssistiveTouch, Siri, articles will help: Switch Control, Touch Accommodations, Dicta- tion, Predictive Text, Keyboard Shortcuts, Sup- • Judy Endow, “Is Autism a Disability or a Difference?” port for Third Party Keyboards, and Hardware • Allegra Ringo, “Understanding Deafness: Not Every- Keyboard Support. one Wants to Be ‘Fixed’” • Learning and Literacy. Guided Access, Speak Screen, Dictionary, Safari Reader, and Speech Apps. For more in-depth thinking about these issues, see Carrie Wade’s “Pity Is Not Progress: Why Disabled People Don’t Need to Be ‘Fixed.’” Braille Displays for iOS https://www.apple.com/accessibility/ios/braille -display.html Is Autism a Disability or a Difference? http://ollibean.com/2014/06/20/autism-disability-difference Made for iPhone Hearing Aids https://www.apple.com/accessibility/ios/hearing-aids Understanding Deafness: Not Everyone Wants to Be “Fixed” iOS Speech Apps www.theatlantic.com/health/archive/2013/08/ https://www.apple.com/accessibility/third-party/#speech understanding-deafness-not-everyone-wants-to-be -fixed/278527 To learn more, see Apple’s iOS Accessibility site. Pity Is Not Progress: Why Disabled People Don’t For Android, which has similar features, see Google’s Need to Be “Fixed” site. Android users need to keep in mind that not https://medium.com/@wadeacar/pity-is-not-progress every device has the same set of features.