COLIN MCDONNELL LEARNING LEARNING THE PAPERS ▸ Innate attentional biases and associated effects ▸ Thalamocortical loops for prediction learning ▸ Method of comparing human classification capability to neural networks how the brain learns and how it informs machine learning and vice versa with no pretensions of completeness LEARNING STRUCTURE OF TALK ▸ What is learning ▸ Neuroscience inspires machine learning ▸ Machine learning guides neuroscience LEARNING SOME DEFINITIONS what do I mean neuroscience? what do I mean ML? Affective neuroscience Behavioral neuroscience Cellular neuroscience Clinical neuroscience Cognitive neuroscience Computational neuroscience Cultural neuroscience Developmental neuroscience Evolutionary neuroscience Molecular neuroscience Neuroengineering Neuroethology NEURAL NETWORKS Neuroheuristics Neuroimaging Neuroinformatics Neurolinguistics Neurophysics Neurophysiology Neuropsychology Paleoneurology Social neuroscience Systems neuroscience WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO WHAT IS LEARNING ▸ pattern recognition ▸ finding an efficient encoding ▸ discovering beneficial behavior based on past observations ▸ abstraction ▸ Australian or European? WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO NEUROSCIENCE INSPIRES MACHINE LEARNING WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO Hebbian learning WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO spike timing dependent plasticity 404 WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO sort of a 404, but… sparsity synaptic re-wiring winner-take-all learning ReLU? WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO neurons that remember many excitatory synapses window of past (for temporal learning?) inputs/firings WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO layers collapse to neurons dendritic computation mathematically equivalent WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO reflection of action gradient learning potential into input dendrites WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO going smaller… molecular diffusion message-passing networks neuromodulators neuropeptides nitrous oxide WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO retrograde chemical reverse connections signaling WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO going bigger… should arise organically… attractor circuits (later: LeabraTI) WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO 404 communicating brain eventually, interacting regions networks: top-down feedback [Ullman 2015] deep reinforcement learning basal ganglia for decisions variable binding multi-sensory learning information routing WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO attention mechanisms innate biases “feature weights” WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO ‣ bias network towards “mover events” ‣ first pass: HANDS ‣ high precision, low recall ‣ second pass: ‣ tracking/continuity GAZE POSE ‣ body context ‣ third pass: ‣ gaze ‣ fourth pass ‣ mirroring ‣ own-hands ‣ comparison ‣ but was it necessary? WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO implicit labeling/ semi-supervised labeling proto-concepts basins of attraction as reward [Ullman 2012] signal generator WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO MACHINE LEARNING GUIDES NEUROSCIENCE supervised learning unsupervised learning WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO supervised learning WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO supervised learning 404? problems ‣ requires transmission of exact error-driven derivatives over distance backpropagation ‣ neurons communicate through (stochastic?) spikes ‣ temporal synchronicity ‣ what are the targets? WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO supervised learning hyper polarization of dendrites derivative backpropagation + reverse action potential WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO supervised learning hippocampus-mediated training epochs replay WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO supervised learning momentum gradient descent plasticity modulation WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO supervised learning stochastic models of dropout neural spiking WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO supervised learning developmental drop-off in layer-by-layer training cortical plasticity WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO unsupervised learning WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO unsupervised learning 404 auto-encoders layer-size bottleneck lateral inhibition WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO unsupervised learning babies understand spatiotemporal coherence predictive learning thalamocortical loops! [O’Reilly 2014] WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO unsupervised learning babies understand spatiotemporal coherence prediction learning thalamocortical loops! [O’Reilly 2014] LEARNING INTER-DISCIPLINE COMPARISONS QUESTIONS.