Arxiv:1803.00997V3 [Q-Bio.NC] 17 Oct 2018
Total Page:16
File Type:pdf, Size:1020Kb
A computational perspective of the role of Thalamus in cognition Nima Dehghani1, 2, a) and Ralf D. Wimmer3 1)Department of Physics, Massachusetts Institute of Technology 2)Center for Brains, Minds and Machines (CBMM), Massachusetts Institute of Technology 3)Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology (Dated: October 18, 2018) Thalamus has traditionally been considered as only a relay source of cortical inputs, with hierarchically organized cortical circuits serially transforming thalamic signals to cognitively-relevant representations. Given the absence of local excitatory connections within the thalamus, the notion of thalamic `relay' seemed like a reasonable description over the last several decades. Recent advances in experimental approaches and theory provide a broader perspective on the role of the thalamus in cognitively-relevant cortical computations, and suggest that only a subset of thalamic circuit motifs fit the relay description. Here, we discuss this perspective and highlight the potential role for the thalamus { and specifically mediodorsal (MD) nucleus { in dynamic selection of cortical representations through a combination of intrinsic thalamic computations and output signals that change cortical network functional parameters. We suggest that through the contextual modulation of cortical computation, thalamus and cortex jointly optimize the information/cost trade-off in an emergent fashion. We emphasize that coordinated experimental and theoretical efforts will provide a path to understanding the role of the thalamus in cognition, along with an understanding to augment cognitive capacity in health and disease. Keywords: Thalamo-cortical system, Recurrent Neural Network, Reservoir Computing, Multi-objective Op- timization, Cognitive Computing, Artificial Intelligence CORTICO-CENTRIC VIEW OF PERCEPTUAL AND cortical area and each of such distributed optimizations COGNITIVE PROCESSING may even be solved differently.90. This view of cortical computation is also paralleled with the growing use of Until recently, cognition [in mammalian, bird and rep- recurrent neural networks (RNN) that can capture the tilian nervous system] has been viewed as a cortico- dynamics of single neurons or neural population in a va- centric process, with thalamus considered to only play riety of tasks. As such, RNNs can mimic (a) context- the mere role of a relay system. This classic view, much dependent prefrontal response89 or (b) can reproduce the driven by the visual hierarchical model of the mammalian temporal scaling of neural responses in medial frontal cortex35, puts thalamus at the beginning of a feedforward cortex and caudate nucleus151. Although it is clear that hierarchy. The transmission of information from thala- higher level cortical feedback reaches all the way down to mus to early sensory cortex (V1 in the visual system for thalamus (Wimmer et al, other refs), the main attribute example), and the gradual increasing complex represen- of perception/cognition remains cortico-centric under the tations from V2 to MT/IT and eventually prefrontal cor- umbrella of dynamic hierarchical models or RNN embod- tex (PFC), constitute the core of the perceptual repre- iment of cortical cognitive functions. Since the compu- sentation under the hierarchical model. A recent compar- tation that is carried by the system should match the ative study of biologically-plausible Convolutional Neu- computing elements at the appropriate scale25 a mis- ral Networks (CNN) and the visual ventral stream, em- match between these presumed computational systems phasizes on the feature enrichment through the network and the underlying circuitry becomes vividly apparent. of hierarchically interconnected computational modules First, associative cortex (and not just sensory cortex) (layers in the neural network and areas in the ventral receives thalamic input. Second, certain thalamic ter- stream)157. ritories receive their primary (driving) input from the arXiv:1803.00997v3 [q-bio.NC] 17 Oct 2018 The strictly static feedforward model has since mor- cortex, rather than sensory periphery, some of which are phed to a dynamic hierarchical model due to the discov- likely to be highly convergent on a single thalamic cell eries of the role of feedback from higher cortical areas level, suggesting at least a cortical modulation of sen- to lower cortical areas52. These dynamic hierarchies are sory input. Third, thalamic projections can be broad even considered to be favorable for recursive optimiza- and diffuse, suggesting a modulatory, rather than a relay tions, where the overall optimization can be achieved by function. These points are indicative that thalamus may breaking the problem into smaller ones to find the opti- play a central part in cognitive processes. But what does mum for each of these smaller problems. Such recursive including thalamus add that could not be achieved in optimization does not need to be confined to just one cortical loops? One advantage that the thalamus could bring into the cortical equation is flexibility. For exam- ple, the same sensory cue may have different meanings according to a particular context a subject is in. A re- 118 a)Electronic mail: [email protected] cent study shows that thalamus may be well suited to 2 reorganize functional connectivity in frontal cortices in sity of computing nodes (including thalamic and cortical response to such contextual changes, allowing for a more structures) and complexity of the computing architec- flexible switching of rule to action mapping. We sug- ture (Fig.1). We will start with a brief overview of the gest that the unique cognitive capability of the thalamo- thalamic architecture, followed by experimental evidence cortical system is tightly bound to parallel processing and a computational perspective of the thalamic role in and contextual modulation that are enabled by the diver- contextual cognitive computation. cortical system PhysariumP Reservoir Computing Machine y bilit CNNCNNNN pa FPGAP ca Logicgigicc GatesGateGatates ve ti i n (DiversityComputC & Genetic g o DNAA mmp Logic Gate Co CComputingtinttingtiing ut & C e nonode Complexity) o m de sing Parallel processing Figure 1. Cognitive computing morphospace: Morphospace of a few example biological and synthetic computing engines in a multidimensional layout. The thalamo-cortical system standout as a unique system with high cognitive capacity, massive parallel processing and extreme diversity of the computing nodes. Other computing systems occupy less desirable domains of this morphospace. Logic Gates: NAND, NOR; Genetic Logic Gate: Synthetic biology adaptation of logic gate; FPGA: field-programmable gate array (configurable integrated circuit); CNN : Convolutional Neural Network; Physarium Machine: programmable amorphous biological computer experimentally implemented in slime mould. Reservoir Computing: A reservoir of recurrent neurons that dynamically change their activity to nonlinearly map the input to a new space; DNA computing:A computing paradigm where many different DNA molecules are used to perform large number of logical computations in parallel; Connection Machine: the first commercial supercomputer designed for problems of Artificial Intelligence (AI) using hardware enabled parallel processing. For a multi-dimensional representation of global/local computation, serial/parallel processing and complex/simple computation, see137. For an idealized landscape of computation involving the degree of relevance of space, agent (cell) diversity and distributed computing see138. THALAMIC ARCHITECTURE: ANATOMICAL AND tures such as white matter tracts and various types of FUNCTIONAL FEATURES tissue staining procedures59. This gross anatomical clas- sification has been equated with a functional one, where Traditionally, thalamic nuclei (see Fig.2) are defined individual thalamic nuclei giving rise to a set of defined as collections of neurons that are segregated by gross fea- functions59,60. More recent fine anatomical studies chal- 3 lenge this notion, showing that within individual nuclei, 1 2 3 P single cell input/output connectivity patterns are quite variable. F O Thalamus lacks lateral excitatory connections and rather receives inputs from other subcortical structures T and/or cortex. In fact, a major feature of forebrain ex- pansion across evolution is the invasion of the thalamus 45,121 CN by cortical inputs . Most (90-95%) afferents to the AD LD relay nuclei are not from the sensory organs60,133. Re- VL TRN LD TRN AV cent anatomical studies have shown a great diversity of MD H PU cortical input type, strength and inferred degree of con- AM VPL 17 IL vergence, even within individual thalamic nuclei (see VA Fig.3 for an example view of cell and network architec- IL LGN VPM CM (D) ture diversity). (V) Excitatory inputs, mostly, arrive as feedbacks from TRN MGN layer 6 of the cortex as well as from brainstem reticular VPI formation. In addition to the diversity of excitatory in- 2 3 puts, thalamic circuits receive a diverse set of inhibitory 1 inputs (note that local GABAergic thalamic interneurons are mostly absent in non-LGN relay nuclei). The two ma- Figure 2. Schematic layout of thalamic nuclei: Three jor systems of inhibitory control are the thalamic reticu- cross sections of monkey thalamus. AD: anterodorsal nu- cleus; AM : anteromedial nucleus; AV : anteroventral nucleus; lar nucleus (TRN), a shell of inhibitory nucleus surround- CM : centromedian nucleus; CN : caudate nucleus; H : habe- ing thalamic