Data Science: the Big Picture Data Science with R Exploratory Data Analysis with R Data Visualization with R (3-Part)
Total Page:16
File Type:pdf, Size:1020Kb
Deep Learning: The Future of AI @MatthewRenze #DevoxxUK Human Cat Dog Car Job Postings for Machine Learning Source: Indeed.com Average Salary by Job Type (USA) $108,000 $101,000 $100,000 Source: Stack Overflow 2017 What is deep learning? What can it do for me? How do I get started? What is deep learning? Deep Learning Deep Learning Artificial intelligence Machine learning Neural network Multiple hidden layers Hierarchical representations Makes predictions with data Deep Learning Artificial intelligence Machine learning Neural network Multiple hidden layers Hierarchical representations Makes predictions with data Artificial Machine Deep Intelligence Learning Learning Artificial Intelligence Explicit programming Explicit programming Encoding domain knowledge Explicit programming Encoding domain knowledge Statistical patterns detection Machine Learning Machine Learning Artificial Machine Statistics Intelligence Learning 푓 푥 푓 푥 Prediction Data Function 푓 푥 Prediction Data Function Cat Dog 푓 푥 Prediction Data Function Cat Dog Is cat? 푓 푥 Prediction Data Function Cat Dog Is cat? Yes Artificial Neuron 푥1 푥2 푦 푥3 inputs neuron outputs Artificial Neuron Σ Artificial Neuron Σ Artificial Neuron 휔1 휔2 휔3 Artificial Neuron 휔0 Artificial Neuron 휔0 휔1 휔2 휔3 Artificial Neuron 푥 1 휔0 휔1 푥2 휑 휔2 Σ 푦 푚 휔3 푥3 푦푘 = 휑 푤푘푗푥푗 푗=0 Artificial Neural Network Artificial Neural Network input hidden output Artificial Neural Network Forward propagation Artificial Neural Network Forward propagation Backward propagation Artificial Neural Network Artificial Neural Network Deep Neural Network input hidden 1 hidden 2 hidden 3 output Deep Neural Network input hidden 1 hidden 2 hidden 3 output Deep Neural Network input hidden 1 hidden 2 hidden 3 output Deep Neural Network input hidden 1 hidden 2 hidden 3 output Deep Neural Network input hidden 1 hidden 2 hidden 3 output Deep Neural Network John Jane Miko Lee input hidden 1 hidden 2 hidden 3 output Deep Neural Network Abstractness input hidden 1 hidden 2 hidden 3 output Deep Learning Artificial intelligence Machine learning Neural network Multiple hidden layers Hierarchical representations Makes predictions with data Deep Learning Artificial intelligence Machine learning Neural network Multiple hidden layers Hierarchical representations Makes predictions with data What Changed? 푓 푥 Source: http://www.asimovinstitute.org/wp-content/uploads/2016/09/neuralnetworks.png What can deep learning do? 푓 푥 푓 푥 푓 푥 푓 푥 Technology Sports Entertainment 푓 푥 Article Text Predicted Headline At least 72 people died and scores more were At least 72 dead in Indian road accident hurt when a truck crowded with pilgrims plunged into a gorge in the desert state of Rajasthan on Friday, police told the press trust of India. One of the last remaining routes for Iraqis U.N. refugee agency closes last routes to Iraq trying to flee their country has effectively been closed off by new visa restrictions imposed by Syria, the U. N. refugee agency said Tuesday. Democratic presidential candidates said Democratic presidential hopefuls call for Thursday they would step up pressure on pressure on Musharraf Pakistan’s president Pervez Musharraf over democracy, and criticized White House policy towards Islamabad. 푓 푥 Gender: Female Age: 31 Gender: Male Emotion: Happy Age: 5 Emotion: Happy Apple Source: https://blog.deepomatic.com/ai-for-everyone-d687522934af A person riding a A group of young people A herd of elephants walking motorcycle on a dirt road. playing a game of frisbee. across a dry grass field. Courtesy of Oriol Vinyals, Alexander Toshev, Samy Bengio, and Dumitru Erha 푓 푥 Gender: Male Age: 58 Emotion: Happy Source: Microsoft Source: Nvidia This bird has a yellow belly and This bird is white with dome black This flower has overlapping pink tarsus, grey back, wings, and on its head and wings and has a pointed petals surrounding a ring brown throat, nape with black face long orange beak of short yellow filaments Courtesy of Han Zhang et al. 푓 푥 Hi my name is Matthew Renze 푓 푥 Source: https://cloud.google.com/text-to-speech/docs/wavenet Source: Adobe Project Voco Hello my name is Matthew Renze Source: Lyrebird 푓 푥 Source: YOLO: Real-Time Object Detection 푓 푥 Source: Pouff - Grocery Trip ? 푓 푥 ? Courtesy of Ford Motor Company Source:Source: PouffGoogle- Grocery Deep Mind Trip Source: Boston Dynamics FUN GAME Dog or Mop? DOG! MOP! DOG!DOG! MOP! MOP! DOG! How Do I Get Started? Option 1: Deep Learning as a Service Deep Learning as a Service 푓 푥 They provide Deep Learning Services Pros/Cons Pros Simple Quick Inexpensive Pros/Cons Pros Cons Simple Narrow Quick Remote Inexpensive Pay-per-use Option 2: Deep Learning as a Platform Deep Learning as a Platform 푓 푥 They provide You provide They host Deep Learning Platforms Pros/Cons Pros Simple Quick Inexpensive Pros/Cons Pros Cons Simple Training Quick Remote Inexpensive Pay-per-use Option 3 Do It Yourself Do It Yourself 푓 푥 You provide Open Source Frameworks CNTK Pros/Cons Pros Custom Local Private Pros/Cons Pros Cons Custom Complex Local Labor Private Expensive Recommendation Use traditional ML techniques first Recommendation Use traditional ML techniques first Use Option 1 for narrow use cases Recommendations Use traditional ML techniques first Use Option 1 for narrow use cases Use Option 2 for custom use cases Recommendations Use traditional ML techniques first Use Option 1 for narrow use cases Use Option 2 for custom use cases Use Option 3 if option 1 or 2 fails Code Demo [TODO: ADD ETHICS SECTION?] Note: I’m currently right at 50 minutes without the Ethics section. Where to Go Next Where to Go Next Data Camp: https://www.datacamp.com Pluralsight: https://www.pluralsight.com Coursera: https://www.coursera.org Pluralsight Courses Deep Learning: The Big Picture Data Science: The Big Picture Data Science with R Exploratory Data Analysis with R Data Visualization with R (3-part) www.pluralsight.com/authors/matthewhttps://www.pluralsight.com/authors/matthew-renze-renze www.matthewrenze.com Feedback Very important to me! What did you like? What could I improve? Conclusion What deep learning is What it can do for you How to get started Are you prepared? Is your organization? Is our world prepared? Thank You! Matthew Renze Data Science Consultant Renze Consulting Twitter: @matthewrenze Email: [email protected] Website: www.matthewrenze.com.