COLIN MCDONNELL LEARNING LEARNING

THE PAPERS

▸ Innate attentional biases and associated effects

▸ Thalamocortical loops for prediction learning

▸ Method of comparing human classification capability to neural networks

how the brain learns and how it informs machine learning and vice versa with no pretensions of completeness LEARNING

STRUCTURE OF TALK

▸ What is learning

▸ Neuroscience inspires machine learning

▸ Machine learning guides neuroscience LEARNING

SOME DEFINITIONS what do I mean neuroscience? what do I mean ML?

Affective neuroscience Behavioral neuroscience Cellular neuroscience Clinical neuroscience Cognitive neuroscience Computational neuroscience Cultural neuroscience Developmental neuroscience Evolutionary neuroscience Molecular neuroscience Neuroengineering Neuroethology NEURAL NETWORKS Neuroheuristics Neuroimaging Neuroinformatics Neurolinguistics Neurophysics Neurophysiology Neuropsychology Paleoneurology Social neuroscience Systems neuroscience WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO

WHAT IS LEARNING

▸ pattern recognition

▸ finding an efficient encoding

▸ discovering beneficial behavior based on past observations

▸ abstraction

▸ Australian or European? WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO

NEUROSCIENCE INSPIRES MACHINE LEARNING WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO

Hebbian learning WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO

spike timing dependent plasticity 404 WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO

sort of a 404, but…

sparsity synaptic re-wiring winner-take-all learning

ReLU? WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO

neurons that remember many excitatory synapses window of past (for temporal learning?) inputs/firings WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO

layers collapse to neurons dendritic computation mathematically equivalent WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO

reflection of action gradient learning potential into input dendrites WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO going smaller…

molecular diffusion message-passing networks neuromodulators neuropeptides nitrous oxide WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO

retrograde chemical reverse connections signaling WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO going bigger…

should arise organically… attractor circuits (later: LeabraTI) WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO

404 communicating brain eventually, interacting regions networks: top-down feedback [Ullman 2015] deep reinforcement learning

basal ganglia for decisions variable binding

multi-sensory learning information routing WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO

attention mechanisms innate biases “feature weights” WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO

‣ bias network towards “mover events” ‣ first pass: HANDS ‣ high precision, low recall ‣ second pass: ‣ tracking/continuity GAZE POSE ‣ body context ‣ third pass: ‣ gaze ‣ fourth pass ‣ mirroring ‣ own-hands ‣ comparison ‣ but was it necessary? WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO

implicit labeling/ semi-supervised labeling proto-concepts basins of attraction as reward [Ullman 2012] signal generator WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO

MACHINE LEARNING GUIDES NEUROSCIENCE

supervised learning unsupervised learning WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO

supervised learning WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO supervised learning 404?

problems ‣ requires transmission of exact error-driven derivatives over distance backpropagation ‣ neurons communicate through (stochastic?) spikes ‣ temporal synchronicity ‣ what are the targets? WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO supervised learning

hyper polarization of dendrites derivative backpropagation + reverse action potential WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO supervised learning

hippocampus-mediated training epochs replay WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO supervised learning

momentum gradient descent plasticity modulation WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO supervised learning

stochastic models of dropout neural spiking WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO supervised learning

developmental drop-off in layer-by-layer training cortical plasticity WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO

unsupervised learning WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO unsupervised learning

404

auto-encoders layer-size bottleneck

lateral inhibition WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO unsupervised learning

babies understand spatiotemporal coherence predictive learning thalamocortical loops! [O’Reilly 2014] WHAT IS LEARNING > NEURO INSPIRES ML > ML GUIDES NEURO unsupervised learning

babies understand spatiotemporal coherence prediction learning thalamocortical loops! [O’Reilly 2014] LEARNING

INTER-DISCIPLINE COMPARISONS QUESTIONS