Machine Learning Is Going Mobile
Total Page:16
File Type:pdf, Size:1020Kb
Machine learning is going mobile By David Schatsky ACHINE learning—the process by which Signals Mcomputers can get better at perform- ing tasks through exposure to data, rather • Google has introduced language translation than through explicit programming—requires software, using small neural networks opti- massive computational power, the kind usu- mized for mobile phones, which can per- ally found in clusters of energy-guzzling, form well without an Internet connection.1 cloud-based computer servers outfitted with specialized processors. But an emerging trend • Lenovo announced a mobile phone that promises to bring the power of machine learn- uses multiple sensors, high-speed image ing to mobile devices that may lack or have processing hardware, and specialized only intermittent online connectivity. This will Google software to support capabili- give rise to machines that sense, perceive, learn ties such as indoor wayfinding, precision from, and respond to their environment and measuring, and augmented reality even their users, enabling the emergence of new when offline.2 product categories, reshaping how businesses engage with customers, and transforming how • NVIDIA, a maker of graphics processing work gets done across industries. technology, introduced an embeddable module for computer vision applications Machine learning is going mobile in devices such as drones and autono- systems run in the cloud on powerful serv- mous vehicles that the company says ers, processing data such as digitized voice or consumes one-tenth the power of a photos that users upload. competing offering.3 Until recently, a typical smartphone lacked the power to perform such tasks without con- • Qualcomm introduced a new processor and necting to the cloud, except in limited ways. software platform that support machine For instance, some mobile phone software can learning tasks such as image classification, recognize a single face—the owner’s—in order speech recognition, and anomaly detection to unlock the phone, or a small set of predeter- without a connection to a network.4 mined words such as “OK Google.” But offline support for increasingly powerful perception • Drone maker DJI recently introduced tasks is coming to mobile devices. a consumer-oriented drone that uses advanced computer vision hardware to Pushing machine learning enable it to follow a moving object while onto mobile devices automatically avoiding obstacles.5 Firms are starting to outfit smartphones, drones, and cars with chips based on new Machine learning is the designs that can run neural networks efficiently keystone cognitive technology while consuming 90 percent less power than 11 Emerging technologies rarely get as big a previous generations. Research efforts at MIT publicity boost as machine learning recently and IBM suggest that we will soon see more saw, when Google software defeated one of the chips on the market that excel at running neu- world’s top players of Go, one of the most com- ral networks at high speed, in small spaces and 12 plex board games ever created, in a best-of-five at low power. Because of this, mobile devices series of matches.6 The international headlines are becoming increasingly capable of perform- confirmed that machine learning—the pro- ing sophisticated feats that take advantage of cess by which fresh data can teach computers neural networks, such as computer vision and to better perform tasks—is one of the hottest speech recognition, once reserved for powerful domains within the field of artificial intel- servers running in the cloud. ligence, and that this cognitive technology is It is not only progress in hardware that is progressing rapidly.7 bringing machine learning to mobile devices. Neural networks—computer models Tech vendors are also finding ways to create designed to mimic aspects of the human compact neural networks capable of running brain’s structure and function, with elements tasks such as speech recognition and language representing neurons and their interconnec- translation on conventional mobile phones tions—are an increasingly popular way of with no connection to a server required. implementing machine learning. They are For instance, Google has introduced mobile particularly well suited for performing percep- language-translation software using small tual tasks such as computer vision and speech neural networks optimized for smartphones 13 recognition. Familiar examples of applications that can perform well even offline. And that employ neural networks for such tasks Google researchers recently published a paper include Google’s voice search,8 Facebook’s sys- describing an Internet-independent speech tem for tagging people in photos,9 and Google recognition system that performs well on a 14 Photos, which uses a neural network-based commercial mobile phone. image recognition system to automatically Mobile devices are acquiring the power to classify photos by their contents.10 All of these perform sophisticated perceptual tasks with- out dependence on connectivity to the cloud, 2 Machine learning is going mobile Perceptual interfaces bringing greater accuracy, reliability, and and interactivity responsiveness while strengthening user pri- In media and entertainment, we will likely vacy. This should greatly expand the number of see mobile devices—both general-purpose applications of perceptual computing coming ones such as mobile phones and special-pur- to market—and not only on mobile phones. pose ones such as augmented-reality head- Mobile machine learning and perceptual com- sets—offering ever more realistic and engaging puting will power a wide range of devices, from augmented and virtual reality for games and mobile sensors to phones, tablets, drones, cars, filmed entertainment. and new types of devices as yet unimagined, Ultralow power processors designed creating significant opportunities for business. for machine learning will likely help con- sumer and industrial devices and machines Many industries will see new understand and respond to the environ- and improved applications ment around them, and find their way into It’s impossible to enumerate all of the Internet-independent voice-controlled wear- applications we will see for mobile devices able devices, household appliances, and capable of performing sophisticated percep- industrial machinery. tual tasks involving vision, speech, or other Navigation and motion control sensory input. But they are likely to be found in every industry and have one or more of the Low-power chips with powerful com- following capabilities: puter vision support are bringing impressive capabilities to unmanned aerial vehicles, also • Analysis or diagnosis of sensory data known as drones, which already have applica- tions in many industries, from real estate and • Perceptual interfaces or interactivity construction to agriculture, energy, aero- space, and defense. Drone maker DJI recently • Navigation and motion control introduced a consumer-oriented aerial vehicle A few examples follow. able to follow a moving object while automati- cally avoiding obstacles.16 Analysis or diagnosis New, powerful mobile computer vision In health care, we envision a wide range of modules that use deep learning are helping diagnostic applications, including some aimed advanced driver assistance systems to “address at consumers. Imagine, for instance, a smart- the challenges of everyday driving, such as phone app that can diagnose skin conditions unexpected road debris, erratic drivers and 17 and insect bites by analyzing digital photos construction zones.” without transmitting the image data over Indoor navigation apps that use computer a network. vision to precisely locate a user, track her We imagine mobile architecture and motion, and guide her in interior spaces will design applications that use computer vision to find use in museums, train stations, airports, generate accurate 3D models of interior spaces malls, and retail stores, opening up new adver- quickly and easily. tising and commerce opportunities without the An ever more powerful and resilient need to deploy beacons or other connectivity- Internet of Things will include self-monitor- based approaches. ing industrial equipment that uses machine And on the horizon are applications not learning to predict maintenance needs and yet imagined, from wearable to pocketable to self-diagnose failures.15 portable, that can sense, analyze, and respond to sensory inputs including sound, video, 3 Machine learning is going mobile and biometrics—all enabled by low-power from household appliances to personal robots chips designed to support neural networks for to industrial equipment. machine learning. Marketing leaders should explore how a new generation of perceptive devices could Implications help cultivate closer and more responsive rela- Compact, efficient, low-power, high- tionships with customers. performance, mobile machine learning. New Operations executives should evaluate how products. New human-computer interfaces. such devices—including the evolving crop of Powerful new ways of engaging with and serv- augmented-reality tools for industry—could ing customers. The trend described here has help their people deliver an efficiency and implications for companies and professionals quality edge.18 across industries. Cyber risk professionals should explore Makers of mobile devices and mobile apps how mobile machine learning may present should begin to familiarize themselves with new ways of detecting and mitigating threats the potential of a new generation