Data Science: the Big Picture Data Science with R Exploratory Data Analysis with R Data Visualization with R (3-Part)

Deep Learning: The Future of AI

@MatthewRenze #DevoxxUK

Human Cat Dog Car Job Postings for Machine Learning

Source: Indeed.com Average Salary by Job Type (USA)

$108,000

$101,000

$100,000

Source: Stack Overflow 2017

What is deep learning? What can it do for me? How do I get started? What is deep learning? Deep Learning Deep Learning

Artificial intelligence Machine learning Neural network Multiple hidden layers Hierarchical representations Makes predictions with data Deep Learning

Artificial intelligence Machine learning Neural network Multiple hidden layers Hierarchical representations Makes predictions with data Artificial Machine Deep Intelligence Learning Learning Artificial Intelligence Explicit programming Explicit programming

Encoding domain knowledge Explicit programming

Encoding domain knowledge

Statistical patterns detection Machine Learning Machine Learning

Artificial Machine Statistics Intelligence Learning 푓 푥 푓 푥

Prediction Data Function 푓 푥

Prediction Data Function

Cat Dog 푓 푥

Prediction Data Function

Cat Dog Is cat? 푓 푥

Prediction Data Function

Cat Dog Is cat? Yes

Artificial Neuron 푥1

푥2 푦

푥3 inputs neuron outputs Artificial Neuron

Σ Artificial Neuron

휔1

휔2

휔3 Artificial Neuron

휔0 Artificial Neuron

휔0

휔1

휔2

휔3 Artificial Neuron 푥 1 휔0

휔1 푥2 휑 휔2 Σ 푦

푚 휔3 푥3 푦푘 = 휑 ෍ 푤푘푗푥푗 푗=0 Artificial Neural Network Artificial Neural Network

input hidden output Artificial Neural Network

Forward propagation Artificial Neural Network

Forward propagation

Backward propagation Artificial Neural Network Artificial Neural Network Deep Neural Network

input hidden 1 hidden 2 hidden 3 output Deep Neural Network

John Jane Miko Lee input hidden 1 hidden 2 hidden 3 output Deep Neural Network

Abstractness

input hidden 1 hidden 2 hidden 3 output Deep Learning

Artificial intelligence Machine learning Neural network Multiple hidden layers Hierarchical representations Makes predictions with data Deep Learning

Artificial intelligence Machine learning Neural network Multiple hidden layers Hierarchical representations Makes predictions with data What Changed? 푓 푥

Source: http://www.asimovinstitute.org/wp-content/uploads/2016/09/neuralnetworks.png

What can deep learning do? 푓 푥 푓 푥 푓 푥

푓 푥 Technology

Sports

Entertainment 푓 푥 Article Text Predicted Headline At least 72 people died and scores more were At least 72 dead in Indian road accident hurt when a truck crowded with pilgrims plunged into a gorge in the desert state of Rajasthan on Friday, police told the press trust of India. One of the last remaining routes for Iraqis U.N. refugee agency closes last routes to Iraq trying to flee their country has effectively been closed off by new visa restrictions imposed by Syria, the U. N. refugee agency said Tuesday. Democratic presidential candidates said Democratic presidential hopefuls call for Thursday they would step up pressure on pressure on Musharraf Pakistan’s president Pervez Musharraf over democracy, and criticized White House policy towards Islamabad. 푓 푥 Gender: Female Age: 31 Gender: Male Emotion: Happy Age: 5 Emotion: Happy

Apple Source: https://blog.deepomatic.com/ai-for-everyone-d687522934af A person riding a A group of young people A herd of elephants walking motorcycle on a dirt road. playing a game of frisbee. across a dry grass field.

Courtesy of Oriol Vinyals, Alexander Toshev, Samy Bengio, and Dumitru Erha 푓 푥 Gender: Male Age: 58 Emotion: Happy Source: Microsoft Source: Nvidia

This bird has a yellow belly and This bird is white with dome black This flower has overlapping pink tarsus, grey back, wings, and on its head and wings and has a pointed petals surrounding a ring brown throat, nape with black face long orange beak of short yellow filaments

Courtesy of Han Zhang et al. 푓 푥 Hi my name is Matthew Renze 푓 푥 Source: https://cloud.google.com/text-to-speech/docs/wavenet Source: Adobe Project Voco Hello my name is Matthew Renze

Source: Lyrebird 푓 푥 Source: YOLO: Real-Time Object Detection 푓 푥

Source: Pouff - Grocery Trip ? 푓 푥 ? Courtesy of Ford Motor Company Source:Source: PouffGoogle- Grocery Deep Mind Trip Source: Boston Dynamics FUN GAME

Dog or Mop? DOG! MOP!

DOG!DOG! MOP! MOP!

DOG!

How Do I Get Started?

Option 1:

Deep Learning as a Service Deep Learning as a Service

푓 푥

They provide Deep Learning Services Pros/Cons

Pros Simple Quick Inexpensive Pros/Cons

Pros Cons Simple Narrow Quick Remote Inexpensive Pay-per-use Option 2:

Deep Learning as a Platform Deep Learning as a Platform

푓 푥

They provide You provide They host Deep Learning Platforms Pros/Cons

Pros Simple Quick Inexpensive Pros/Cons

Pros Cons Simple Training Quick Remote Inexpensive Pay-per-use Option 3

Do It Yourself Do It Yourself

푓 푥

You provide Open Source Frameworks

CNTK Pros/Cons

Pros Custom Local Private Pros/Cons

Pros Cons Custom Complex Local Labor Private Expensive Recommendation

Use traditional ML techniques first Recommendation

Use traditional ML techniques first Use Option 1 for narrow use cases Recommendations

Use traditional ML techniques first Use Option 1 for narrow use cases Use Option 2 for custom use cases Recommendations

Use traditional ML techniques first Use Option 1 for narrow use cases Use Option 2 for custom use cases Use Option 3 if option 1 or 2 fails Code Demo [TODO: ADD ETHICS SECTION?]

Note: I’m currently right at 50 minutes without the Ethics section. Where to Go Next Where to Go Next

Data Camp: https://www.datacamp.com Pluralsight: https://www.pluralsight.com Coursera: https://www.coursera.org Pluralsight Courses

Deep Learning: The Big Picture Data Science: The Big Picture Data Science with R Exploratory Data Analysis with R Data Visualization with R (3-part)

www.pluralsight.com/authors/matthewhttps://www.pluralsight.com/authors/matthew-renze-renze www.matthewrenze.com Feedback

Very important to me! What did you like? What could I improve? Conclusion What deep learning is What it can do for you How to get started

Are you prepared? Is your organization? Is our world prepared?

Thank You!

Matthew Renze Data Science Consultant Renze Consulting

Twitter: @matthewrenze Email: [email protected] Website: www.matthewrenze.com