IBM Watson eBook

Deep learning in the real world Practical applications for today’s data-driven business IBM Watson in the real world

Solving big data problems Contents with smart machines

Solving big data problems with smart machines 2 Deep learning is virtually everywhere. It’s on Amazon Big data? This is massive data 3 and Netflix making personalized recommendations. What is deep learning? 4 It’s on your smartphone helping your voice-activated “I think that these technologies can assistant understand you. It’s helping websites and Voice search / voice activated assistants 5 ultimately augment what’s possible in mobile applications transform content into precisely Recommendation engines 6 targeted advertising. It’s helping companies gain business.” Image recognition 7 meaningful insights from unstructured data. - Elliot Turner, Director of Alchemy Solutions, IBM Watson Image tagging / image search 8 Advertising 9 The vast majority of data generated from the Internet Gold added, “The vast form of data that’s proliferating Pattern recognition 10 is unstructured; it is data intended for human today that’s available to us is all unstructured. Conclusion 11 consumption and not designed for computers to process. In a session at GigaOM Structure Data 2014, It is the text, the blogs, the tweets, the articles, Elliot Turner, Director of Alchemy Solutions, IBM the photographs, and we’re just now starting to Watson (formerly CEO of AlchemyAPI) and Stephen experience this idea of a system that is readily Gold, CMO Watson, VP Partner Programs & Venture approachable that you can navigate through natural Investments, IBM Watson, spoke about unstructured language; not through speech recognition, but data and deep learning. During their session, they actually through understanding where it literally can discussed how smart machines are enabling and read and comprehend in context the data itself.” empowering today’s modern organizations.

“We’re seeing companies leverage unstructured data—things like photographs, videos, chat logs, documents—to make better, more informed business decisions to automate processes. They’re leveraging humanlike capabilities inside automated workflows with deep learning. I think that these technologies can ultimately augment what’s possible in business and humanity, but not necessarily replace it,” shared Turner.

2 IBM Watson Deep learning in the real world

Big data? This is massive data

According to an IBM study,1 approximately 2.5 quintillion bytes of data are created every day and the IDC is estimating2 that by 2020, approximately 40 zettabytes (ZB) of data will be generated every day. The Internet Live Stats site (part of the On-demand Statistics Project), provides on-demand updates showing just how quickly data is being generated on the Internet.

With numbers like these, it is clear to see how so much value can be contained, and sometimes hidden, in all the data collected by a business. Not only is it important to recognize where the data is held, but it is paramount to extract real insights to understand consumers and make better decisions.

Without the full story behind the data, organizations play an expensive guessing game as to what consumers need and want. The good news is that deep learning systems give organizations the ability to capitalize on the data at their fingertips and help ensure they stay agile, focused and knowledgeable.

3 IBM Watson Deep learning in the real world

What is deep learning?

Development teams are overwhelmed with requests to create applications that automatically gather and synthesize data so that organizations can make better “The general idea of deep learning is to content and purchasing recommendations, extract use neural networks to build multiple keywords for search engine optimization (SEO), collect layers of abstraction to solve a complex brand intelligence to develop effective messages and more. Many teams support their data analysis efforts semantic problem.” with deep learning to remain innovative, speed - Aaron Chavez, IBM Watson time-to-market, and boost revenue.

In a recent IBM Watson webinar, Aaron Chavez, IBM Watson (formerly Chief Scientist at AlchemyAPI), explains the idea of deep learning saying that “the What is Deep general idea of deep learning is to use neural networks to build multiple layers of abstraction to solve a Learning? complex semantic problem.”

In other words, deep learning is a new area of machine 5 learning that works to improve things like computer Deep Learning Resources vision and natural language processing to solve Everyone Should Bookmark unstructured data challenges. Learn More Read on to learn six practical applications for solving real-world problems with deep learning today.

4 IBM Watson Deep learning use case #1

Deep learning use case #1: Voice-activated search/voice assistants

One of the most well known and popular uses of deep learning APIs is to power voice-activated intelligent assistants, a feature found on nearly all smartphones. Today’s consumers are pretty familiar with these three major players in the smartphone OS market; Apple, , and Microsoft. Apple’s Siri is one of the most well known of the voice-activated assistants and has been around the longest (Siri was introduced in October 2011). Google Now, the voice-activated assistant for Android, was launched less than a year after Siri. The newest of the voice-activated intelligent assistants is Microsoft Cortana which was introduced in April of this year on Windows Phone 8.1.

In November 2013, Microsoft introduced a natural- language voice search on the Xbox One console. (Bing blogs). Using Xbox One’s voice navigation users can search for movies, music, and other content using natural phrases. A few months ago, Microsoft introduced Azure Media Indexer, a new Azure cloud platform service that allows users to index video Figure 1: Consumer’s assistant asking “What can I help you with? content based on the words spoken in the video. The service uses natural language processing (NLP) technology, which is based on deep learning, to make media files and content searchable and to augment the platform’s vocabulary.

APIs that allow developers to add speech recognition functionality to their applications include the AT&T Speech API and the API.AI API.

5 IBM Watson Deep learning use case #2

Deep learning use case #2: Recommendation engines

Recommendation systems have become a very recommendations. A recent Netflixblog post explains popular and common feature of web and mobile how the company is researching deep learning and applications. Major companies such as Netflix, other techniques to improve Amazon, Google, Facebook, and Twitter have access to recommendations and provide greater personalization a vast wealth of user generated data. This access to to users. A Spotify intern is currently working on a data has allowed these companies to implement deep learning approach to music recommendations complex recommendation systems that provide added called “deep content-based music recommendation,” value to both users and the companies themselves. described in this blog post.

According to a recent SlideShare presentation by The winner of 2013’s MHacks hackathon (IBM Watson Xavier Amatriain, research/engineering manager at was a sponsor) was Assimilator, a content Netflix, 2/3 of the movies users watch on Netflix are recommendation engine that “automatically finds recommended, Google News recommendations related articles and inserts them into product pages on generate 38 percent more clickthroughs, and 35 e-commerce sites.” 3 The application uses IBM® percent of Amazon’s sales are generated from AlchemyLanguage™ APIs to scan web pages for recommendations. keywords and then uses those keywords to find related content. Collaborative filtering and content-based filtering have traditionally been the two common approaches used in the design of recommendation systems. In recent years recommendation systems have become far more intelligent with companies using deep learning to predict user preferences and provide accurate

6 IBM Watson Deep learning use case #3

Deep learning use case #3: Image recognition The goal of image recognition technologies is to recognize and identify objects in images as well as understand the content and context. Google and IBM Watson have been developing image recognition technologies for quite some time. In June 2012, Google brought much attention to deep learning through the publication of a paper highlighting the company’s image recognition research.

The paper details how Google built a network and models capable of identifying cats and human faces using unsupervised learning. The network was also able to recognize cat faces and human bodies. A few months ago, IBM Watson announced the public release of the IBM® AlchemyVision™ Face Detection and Recognition API providing developers programmatic access to the company’s image recognition technology.

A leading mobile application that recognizes and identifies objects in photos taken by mobile phone users, utilizes AlchemyVision APIs which allow the app to tell users what objects are in photos and is even capable of telling users where items can be purchased. One of the key features of AlchemyVision is the ability to recognize multiple concepts within the same image. When provided an image file or URL, the AlchemyVision Face Detection and Recognition API can return the position, age, gender, and, in the case of celebrities, the identity of the people in a photo

7 IBM Watson Deep learning use case #4

Deep learning use case #4: Image Tagging/Image Search Image tagging APIs provide applications with the “As shoppers become increasingly ability to recognize and categorize many different types of objects in images including animals, comfortable making their purchases buildings, nature scenes, people, faces, etc. Many online, major brands are driving a large image tagging APIs are also able to recognize and amount of sales through eCommerce understand different concepts within the images. They also provide applications to take an image and them offerings. It’s important that we provide search for similar images based on the original. brands a way to track which campaigns resonate and drive action online. The Google uses image tagging technology to allow Google+ users to search their photos by content ability to track and measure everything without having to tag the photos beforehand. in a campaign, including the images used, Facebook is using image tagging to improve the photo gives brands a competitive advantage sharing experiences of users. when targeting customers and driving A leading social media marketing and analytics sales. With AlchemyVision, we have been company was an early tester and proponent for able to accurately tag and classify a good computer vision APIs, using them to tag, classify, track portion of images at very high rates with and measure the images used in campaigns which better targets customers and boosts sales. Another minimal human effort”, says CPO of a popular public API developer uses image tagging and leading social media marketing and other AlchemyVision APIs to tag, classify, and analyze analytics company. images pulled in from thousands of government, business, humanitarian, and other data sources.

8 IBM Watson Deep learning use case #5

Deep learning use case #5: Advertising

More and more companies are turning to deep Earlier this year, IBM Watson launched new deep Companies and technologies that are leveraging the learning when it comes to marketing and advertising learning-based taxonomy and sentiment APIs Taxonomy API include a leading real-time bidding brands, products, and services. Deep learning makes it designed to transform content into valuable digital ad (RTB) mobile advertising platform company that uses possible for ad networks and publishers to utilize their inventory. The Taxonomy API is “IAB-compliant and IBM® AlchemyLanguage™ for keyword extraction and content to create data-driven predictive advertising, includes an expanded taxonomy of over 1000 topic sentiment analysis APIs to power their predictive real-time bidding advertising, more precisely targeted categories with up to five levels of hierarchy. The modeling engine; and an industry prospecting display advertising, and more. Baidu, the Chinese self-service component of the API makes it possible to productivity tool that uses the Taxonomy API to bridge version of Google, is using deep learning to precisely create categories when given virtually any arbitrary gaps in their platform’s people suggest tool. predict advertising that is relevant to users which has phrase.” helped significantly increase the company’s revenue.

Figure 2: Online consumer responding to an add targeted toward their preferences?

9 IBM Watson Deep learning use case #6

Deep learning use case #6: Pattern recognition Pattern recognition allows companies to monitor and Disease treatment process a multitude of things, such as, comparing Doctors reviewing medical images to medical images to diagnose a treatment or using diagnose and treat complicated diseases advanced machine learning algorithms to recognize anomalies indicating potential fraudulent activity and security threats.

Fraud prevention Analyze data for anomalies indicating fraudulent activity and security threats

10 IBM Watson Get started

Conclusion

These are just some of the real-world use cases for About Janet Wagner About IBM Watson deep learning. There are many others such as speech Janet Wagner is a data journalist and full stack In January 2014, IBM launched the IBM Watson unit, a translation, speech transcription, text classification, developer based in Toledo, Ohio. Her focus revolves business dedicated to developing and commercializing content discovery, brand intelligence, and social media around APIs, data visualization, machine learning, and cloud-delivered cognitive computing technologies. The monitoring. data-driven journalism. move signified a strategic shift by IBM to deliver a new class of software, services and apps that improves by Deep learning is a disruptive technology that is being Follow her on Twitter: @webcodepro, Google+, or send learning, and discovers insights from massive amounts used by more and more companies to create new her an email. of Big Data. For more information on IBM Watson, visit: business models and to build innovative applications .com/watsonecosystem. that help solve real problems. While there may not be one industry-accepted definition of what deep learning is, there is an industry-accepted agreement as to the benefits and exciting applications deep learning has made possible, and will make possible in the future.

Get started with IBM Watson Relieve yourself of the cost and complexity of building your own system.

Learn more >

Register for a complimentary API account >

11 © Copyright IBM Corporation 2015

IBM Corporation Software Group Route 100 Somers, NY 10589

Produced in the United States of America October 2015

IBM, the IBM logo, ibm.com, and Watson are trademarks of International Business Machines Corp., registered in many jurisdictions worldwide. Other product and service names might be trademarks of IBM or other companies. A current list of IBM trademarks is available on the Web at “Copyright and trademark information” at ibm.com/­legal/­copytrade.shtml

Apple, iPhone, iPad, iPod touch, and iOS are registered trademarks or trademarks of Apple Inc., in the United States and other countries.

Microsoft, Windows, Windows NT, and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries, or both.

This document is current as of the initial date of publication and may be changed by IBM at any time. This document is current as of the initial date of publication and may be changed by IBM at any time. Not all offerings are available in every country in which IBM operates.

THE INFORMATION IN THIS DOCUMENT IS PROVIDED “AS IS” WITHOUT ANY WARRANTY, EXPRESS OR IMPLIED, INCLUDING WITHOUT ANY WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND ANY WARRANTY OR CONDITION OF NON-INFRINGEMENT.

IBM products are warranted according to the terms and conditions of the agreements under which they are provided.

Statement of Good Security Practices: IT system security involves protecting systems and information through prevention, detection and response to improper access from within and outside your enterprise. Improper access can result in information being altered, destroyed or misappropriated or can result in damage to or misuse of your systems, including to attack others. No IT system or product should be considered completely secure and no single product or security measure can be completely effective in preventing improper access. 1 IBM Study: Digital Era Transforming CMO's Agenda, Revelaing Gap IBM systems and products are designed to be part of a comprehensive security http://www-03.ibm.com/press/us/en/ in Readiness; 10/11/2011; approach, which will necessarily involve additional operational procedures, and pressrelease/35633.wss may require other systems, products or services to be most effective. IBM does 2 Webopedia Staff; How Much Data is Out There; 3/3/2014; http:// not warrant that systems and products are immune from the malicious or illegal www.webopedia.com/quick_ref/just-how-much-data-is-out-there. conduct of any party. html

3 MHacks App, Assimilator, Wins $1000 for Best Use of AlchemyAPI; Please Recycle The Alchemist Blog; IBM Watson 9/24/2013; http:// blog.alchemyapi. com/mhacks-alchemyapi-winner-assimilator

YTM03015-USEN-00