Active Memory Processing on Processing Memory Active Active Memory Processing
Total Page:16
File Type:pdf, Size:1020Kb
Load more
Recommended publications
-
An Abstract Model of a Cortical Hypercolumn
AN ABSTRACT MODEL OF A CORTICAL HYPERCOLUMN Baran Çürüklü1, Anders Lansner2 1Department of Computer Engineering, Mälardalen University, S-72123 Västerås, Sweden 2Department of Numerical Analysis and Computing Science, Royal Institute of Technology, S-100 44 Stockholm, Sweden ABSTRACT preferred stimulus was reported to be lower than to preferred stimulus. An abstract model of a cortical hypercolumn is presented. According to the findings by Hubel and Wiesel [16] This model could replicate experimental findings relating the primary visual cortex has a modular structure. It is to the orientation tuning mechanism in the primary visual composed of orientation minicolumns each one cortex. Properties of the orientation selective cells in the comprising some hundreds of pyramidal cells and a primary visual cortex like, contrast-invariance and smaller number of inhibitory interneurons of different response saturation were demonstrated in simulations. We kinds. Contrast edge orientation is coded such that the hypothesize that broadly tuned inhibition and local cells in each orientation minicolumn respond selectively excitatory connections are sufficient for achieving this to a quite broad interval of orientations. Further, the behavior. We have shown that the local intracortical orientation hypercolumn contains orientation minicolumns connectivity of the model is to some extent biologically with response properties distributed over all angles, and plausible. thus represents the local edge orientation pertinent to a given point in visual space. A similar modular arrangement is found in many other cortical areas, e.g. rodent whisker barrels [15]. 1. INTRODUCTION The Bayesian Confidence Propagation Neural Network model (BCPNN) has been developed in analogy Most neurons in the primary visual cortex (V1) with this possibly generic cortical structure [14]. -
Probabilistic Skeletons Endow Brain-Like Neural Networks with Innate Computing Capabilities
bioRxiv preprint doi: https://doi.org/10.1101/2021.05.18.444689; this version posted July 1, 2021. The copyright holder for this preprint (which was not certified by peer review) is the author/funder. All rights reserved. No reuse allowed without permission. Probabilistic skeletons endow brain-like neural networks with innate computing capabilities Christoph St¨ockl ∗1, Dominik Lang ∗1, and Wolfgang Maass 1 1Institute of Theoretical Computer Science, Graz University of Technology, Austria July 1, 2021 The genetic code endows neural networks of the brain with innate comput- ing capabilities. But it has remained unknown how it achieves this. Exper- imental data show that the genome encodes the architecture of neocortical circuits through pairwise connection probabilities for a fairly large set of ge- netically different types of neurons. We build a mathematical model for this style of indirect encoding, a probabilistic skeleton, and show that it suffices for programming a repertoire of quite demanding computing capabilities into neural networks. These computing capabilities emerge without learning, but are likely to provide a powerful platform for subsequent rapid learning. They are engraved into neural networks through architectural features on the sta- tistical level, rather than through synaptic weights. Hence they are specified in a much lower dimensional parameter space, thereby providing enhanced robustness and generalization capabilities as predicted by preceding work. 1 Introduction Artificial neural networks typically receive their computational capabilities through adap- tation of a very large set of parameters: through training of their synaptic weights with a very large number of examples, starting from a tabula rasa initial state. -
Spike-Based Bayesian-Hebbian Learning in Cortical and Subcortical Microcircuits
Spike-Based Bayesian-Hebbian Learning in Cortical and Subcortical Microcircuits PHILIP J. TULLY Doctoral Thesis Stockholm, Sweden 2017 TRITA-CSC-A-2017:11 ISSN 1653-5723 KTH School of Computer Science and Communication ISRN-KTH/CSC/A-17/11-SE SE-100 44 Stockholm ISBN 978-91-7729-351-4 SWEDEN Akademisk avhandling som med tillstånd av Kungl Tekniska högskolan framläg- ges till offentlig granskning för avläggande av teknologie doktorsexamen i datalogi tisdagen den 9 maj 2017 klockan 13.00 i F3, Lindstedtsvägen 26, Kungl Tekniska högskolan, Valhallavägen 79, Stockholm. © Philip J. Tully, May 2017 Tryck: Universitetsservice US AB iii Abstract Cortical and subcortical microcircuits are continuously modified throughout life. Despite ongoing changes these networks stubbornly maintain their functions, which persist although destabilizing synaptic and nonsynaptic mechanisms should osten- sibly propel them towards runaway excitation or quiescence. What dynamical phe- nomena exist to act together to balance such learning with information processing? What types of activity patterns do they underpin, and how do these patterns relate to our perceptual experiences? What enables learning and memory operations to occur despite such massive and constant neural reorganization? Progress towards answering many of these questions can be pursued through large- scale neuronal simulations. Inspiring some of the most seminal neuroscience exper- iments, theoretical models provide insights that demystify experimental measure- ments and even inform new experiments. In this thesis, a Hebbian learning rule for spiking neurons inspired by statistical inference is introduced. The spike-based version of the Bayesian Confidence Propagation Neural Network (BCPNN) learning rule involves changes in both synaptic strengths and intrinsic neuronal currents. -
A Neural Network Framework for Cognitive Bias
fpsyg-09-01561 August 31, 2018 Time: 17:34 # 1 HYPOTHESIS AND THEORY published: 03 September 2018 doi: 10.3389/fpsyg.2018.01561 A Neural Network Framework for Cognitive Bias Johan E. Korteling*, Anne-Marie Brouwer and Alexander Toet* TNO Human Factors, Soesterberg, Netherlands Human decision-making shows systematic simplifications and deviations from the tenets of rationality (‘heuristics’) that may lead to suboptimal decisional outcomes (‘cognitive biases’). There are currently three prevailing theoretical perspectives on the origin of heuristics and cognitive biases: a cognitive-psychological, an ecological and an evolutionary perspective. However, these perspectives are mainly descriptive and none of them provides an overall explanatory framework for the underlying mechanisms of cognitive biases. To enhance our understanding of cognitive heuristics and biases we propose a neural network framework for cognitive biases, which explains why our brain systematically tends to default to heuristic (‘Type 1’) decision making. We argue that many cognitive biases arise from intrinsic brain mechanisms that are fundamental for the working of biological neural networks. To substantiate our viewpoint, Edited by: we discern and explain four basic neural network principles: (1) Association, (2) Eldad Yechiam, Technion – Israel Institute Compatibility, (3) Retainment, and (4) Focus. These principles are inherent to (all) neural of Technology, Israel networks which were originally optimized to perform concrete biological, perceptual, Reviewed by: and motor functions. They form the basis for our inclinations to associate and combine Amos Schurr, (unrelated) information, to prioritize information that is compatible with our present Ben-Gurion University of the Negev, Israel state (such as knowledge, opinions, and expectations), to retain given information Edward J. -
CBC IDEAS Sales Catalog (AZ Listing by Episode Title. Prices Include
CBC IDEAS Sales Catalog (A-Z listing by episode title. Prices include taxes and shipping within Canada) Catalog is updated at the end of each month. For current month’s listings, please visit: http://www.cbc.ca/ideas/schedule/ Transcript = readable, printed transcript CD = titles are available on CD, with some exceptions due to copyright = book 104 Pall Mall (2011) CD $18 foremost public intellectuals, Jean The Academic-Industrial Ever since it was founded in 1836, Bethke Elshtain is the Laura Complex London's exclusive Reform Club Spelman Rockefeller Professor of (1982) Transcript $14.00, 2 has been a place where Social and Political Ethics, Divinity hours progressive people meet to School, The University of Chicago. Industries fund academic research discuss radical politics. There's In addition to her many award- and professors develop sideline also a considerable Canadian winning books, Professor Elshtain businesses. This blurring of the connection. IDEAS host Paul writes and lectures widely on dividing line between universities Kennedy takes a guided tour. themes of democracy, ethical and the real world has important dilemmas, religion and politics and implications. Jill Eisen, producer. 1893 and the Idea of Frontier international relations. The 2013 (1993) $14.00, 2 hours Milton K. Wong Lecture is Acadian Women One hundred years ago, the presented by the Laurier (1988) Transcript $14.00, 2 historian Frederick Jackson Turner Institution, UBC Continuing hours declared that the closing of the Studies and the Iona Pacific Inter- Acadians are among the least- frontier meant the end of an era for religious Centre in partnership with known of Canadians. -
Session 5. Learning and Memory
Picton Session 5: Learning and Memory Brain and Mind Learning and Memory … those short, plump little cakes called ‘petites madeleines,’ which look as though they had been moulded in the fluted scallop of a pilgrim’s shell. … I raised to my lips a spoonful of the tea in which I had soaked a morsel of the cake. No sooner had the warm liquid, and the crumbs with it, touched my palate than a shudder ran through my whole body, and I stopped, intent upon the extraordinary changes that were taking place. An exquisite pleasure had invaded my senses but individual, detached, with no suggestion of its origin (Marcel Proust, In Search of Lost Time, 1913) Lulu Durand, 2012 René Depasse This is the famous quotation about memory by Marcel Proust. It describes how the past can be re-experienced. How simple sensory triggers can bring forth complex memories. How these memories are at first indistinct and mysterious and only later become clear. How emotions are the glue that ties memories together. Where to get madeleines in Toronto? Try Madeleines bespoke pastry http://www.madeleines.ca/ For green-tea madeleines – Uncle Tetsu’s at Bay and Dundas. Brain and Mind: Course Outline 1. Introduction. Brain anatomy. 5. Learning and Memory. Synaptic Stroke. Neurons. Excitation. Action changes. Motor skills. Priming. potentials. Synaptic transmission.. Episodic vs semantic memory. Body sensations. Braille. Amnesia. Alzheimer’s Disease. 2. Moving to the Music. Muscles. 6. Language and Emotion. Language. Stretch reflexes. Basal ganglia. Humans vs chimps. Aphasia. Dyslexia. Cerebellum. Parkinson’s Disease. Basic emotions. Autonomic Nervous Balance. -
Injury Establishes Constitutive Μ-Opioid Receptor Activity Leading to Lasting Endogenous Analgesia and Dependence
University of Kentucky UKnowledge Theses and Dissertations--Physiology Physiology 2013 INJURY ESTABLISHES CONSTITUTIVE µ-OPIOID RECEPTOR ACTIVITY LEADING TO LASTING ENDOGENOUS ANALGESIA AND DEPENDENCE Gregory F. Corder University of Kentucky, [email protected] Right click to open a feedback form in a new tab to let us know how this document benefits ou.y Recommended Citation Corder, Gregory F., "INJURY ESTABLISHES CONSTITUTIVE µ-OPIOID RECEPTOR ACTIVITY LEADING TO LASTING ENDOGENOUS ANALGESIA AND DEPENDENCE" (2013). Theses and Dissertations--Physiology. 10. https://uknowledge.uky.edu/physiology_etds/10 This Doctoral Dissertation is brought to you for free and open access by the Physiology at UKnowledge. It has been accepted for inclusion in Theses and Dissertations--Physiology by an authorized administrator of UKnowledge. For more information, please contact [email protected]. STUDENT AGREEMENT: I represent that my thesis or dissertation and abstract are my original work. Proper attribution has been given to all outside sources. I understand that I am solely responsible for obtaining any needed copyright permissions. I have obtained and attached hereto needed written permission statements(s) from the owner(s) of each third-party copyrighted matter to be included in my work, allowing electronic distribution (if such use is not permitted by the fair use doctrine). I hereby grant to The University of Kentucky and its agents the non-exclusive license to archive and make accessible my work in whole or in part in all forms of media, now or hereafter known. I agree that the document mentioned above may be made available immediately for worldwide access unless a preapproved embargo applies. -
196296475.Pdf
SCIENCE ADVANCES | RESEARCH ARTICLE ENGINEERING Copyright © 2018 The Authors, some rights reserved; Stretchable organic optoelectronic exclusive licensee American Association sensorimotor synapse for the Advancement Yeongjun Lee1,2,3*, Jin Young Oh3,4*, Wentao Xu1,5,6, Onnuri Kim7, Taeho Roy Kim8, of Science. No claim to 3 9 3 3 7 original U.S. Government Jiheong Kang , Yeongin Kim , Donghee Son , Jeffery B.-H. Tok , Moon Jeong Park , Works. Distributed 3† 1,2,10† Zhenan Bao , Tae-Woo Lee under a Creative Commons Attribution Emulation of human sensory and motor functions becomes a core technology in bioinspired electronics for next- NonCommercial generation electronic prosthetics and neurologically inspired robotics. An electronic synapse functionalized with License 4.0 (CC BY-NC). an artificial sensory receptor and an artificial motor unit can be a fundamental element of bioinspired soft elec- tronics. Here, we report an organic optoelectronic sensorimotor synapse that uses an organic optoelectronic synapse and a neuromuscular system based on a stretchable organic nanowire synaptic transistor (s-ONWST). The voltage pulses of a self-powered photodetector triggered by optical signals drive the s-ONWST, and resultant informative synaptic outputs are used not only for optical wireless communication of human-machine interfaces but also for light-interactive actuation of an artificial muscle actuator in the same way that a biological muscle fiber contracts. Downloaded from Our organic optoelectronic sensorimotor synapse suggests a promising strategy toward developing bioinspired soft electronics, neurologically inspired robotics, and electronic prostheses. INTRODUCTION Light cognition is an important sensory function for bioinspired Our human body performs not only myriads of sensing functions electronics (12–15), for example, an artificial visualization system. -
Loss of Recent Memory After Bilateral Hippocampal
J Neurol Neurosurg Psychiatry: first published as 10.1136/jnnp.20.1.11 on 1 February 1957. Downloaded from J. Neurol. Neurosurg. Psychiat., 1957, 20, 11. LOSS OF RECENT MEMORY AFTER BILATERAL HIPPOCAMPAL LESIONS BY WILLIAM BEECHER SCOVIILLE and BRENDA MILNER From the Department of Neurosurgery, Hartford Hospital, and the Department of Neurology and Neurosurgery, McGill University, and the Montreal Neurological Institute, Canada In 1954 Scoville described a grave loss of recent found that undercutting limited to the orbital sur- memory which he had observed as a sequel to faces of both frontal lobes has an appreciable bilateral medial temporal-lobe resection in one therapeutic effect in psychosis and yet does not cause psychotic patient and one patient with intractable any new personality deficit to appear (Scoville, seizures. In both cases the operations had been Wilk, and Pepe, 1951). In view of the known close radical ones, undertaken only when more conserva- relationship between the posterior orbital and mesial tive forms of treatment had failed. The removals temporal cortices (MacLean, 1952; Pribram and extended posteriorly along the mesial surface of the Kruger, 1954), it was hoped that still greater temporal lobes for a distance of approximately 8 cm. psychiatric benefit might be obtained by extending guest. Protected by copyright. from the temporal tips and probably destroyed the the orbital undercutting so as to destroy parts of the anterior two-thirds of the hippocampus and hippo- mesial temporal cortex bilaterally. Accordingly, in campal gyrus bilaterally, as well as the uncus and 30 severely deteriorated cases, such partial temporal- amygdala. The unexpected and persistent memory lobe resections were carried out, either with or with- deficit which resulted seemed to us to merit further out orbital undercutting. -
Smutty Alchemy
University of Calgary PRISM: University of Calgary's Digital Repository Graduate Studies The Vault: Electronic Theses and Dissertations 2021-01-18 Smutty Alchemy Smith, Mallory E. Land Smith, M. E. L. (2021). Smutty Alchemy (Unpublished doctoral thesis). University of Calgary, Calgary, AB. http://hdl.handle.net/1880/113019 doctoral thesis University of Calgary graduate students retain copyright ownership and moral rights for their thesis. You may use this material in any way that is permitted by the Copyright Act or through licensing that has been assigned to the document. For uses that are not allowable under copyright legislation or licensing, you are required to seek permission. Downloaded from PRISM: https://prism.ucalgary.ca UNIVERSITY OF CALGARY Smutty Alchemy by Mallory E. Land Smith A THESIS SUBMITTED TO THE FACULTY OF GRADUATE STUDIES IN PARTIAL FULFILMENT OF THE REQUIREMENTS FOR THE DEGREE OF DOCTOR OF PHILOSOPHY GRADUATE PROGRAM IN ENGLISH CALGARY, ALBERTA JANUARY, 2021 © Mallory E. Land Smith 2021 MELS ii Abstract Sina Queyras, in the essay “Lyric Conceptualism: A Manifesto in Progress,” describes the Lyric Conceptualist as a poet capable of recognizing the effects of disparate movements and employing a variety of lyric, conceptual, and language poetry techniques to continue to innovate in poetry without dismissing the work of other schools of poetic thought. Queyras sees the lyric conceptualist as an artistic curator who collects, modifies, selects, synthesizes, and adapts, to create verse that is both conceptual and accessible, using relevant materials and techniques from the past and present. This dissertation responds to Queyras’s idea with a collection of original poems in the lyric conceptualist mode, supported by a critical exegesis of that work. -
2 the Cerebral Cortex of Mammals
Abstract This thesis presents an abstract model of the mammalian neocortex. The model was constructed by taking a top-down view on the cortex, where it is assumed that cortex to a first approximation works as a system with attractor dynamics. The model deals with the processing of static inputs from the perspectives of biological mapping, algorithmic, and physical implementation, but it does not consider the temporal aspects of these inputs. The purpose of the model is twofold: Firstly, it is an abstract model of the cortex and as such it can be used to evaluate hypotheses about cortical function and structure. Secondly, it forms the basis of a general information processing system that may be implemented in computers. The characteristics of this model are studied both analytically and by simulation experiments, and we also discuss its parallel implementation on cluster computers as well as in digital hardware. The basic design of the model is based on a thorough literature study of the mammalian cortex’s anatomy and physiology. We review both the layered and columnar structure of cortex and also the long- and short-range connectivity between neurons. Characteristics of cortex that defines its computational complexity such as the time-scales of cellular processes that transport ions in and out of neurons and give rise to electric signals are also investigated. In particular we study the size of cortex in terms of neuron and synapse numbers in five mammals; mouse, rat, cat, macaque, and human. The cortical model is implemented with a connectionist type of network where the functional units correspond to cortical minicolumns and these are in turn grouped into hypercolumn modules. -
Modeling Prediction and Pattern Recognition in the Early Visual and Olfactory Systems
Modeling prediction and pattern recognition in the early visual and olfactory systems BERNHARD A. KAPLAN Doctoral Thesis Stockholm, Sweden 2015 TRITA-CSC-A-2015:10 ISSN-1653-5723 KTH School of Computer Science and Communication ISRN KTH/CSC/A-15/10-SE SE-100 44 Stockholm ISBN 978-91-7595-532-2 SWEDEN Akademisk avhandling som med tillstånd av Kungl Tekniska högskolan fram- lägges till offentlig granskning för avläggande av Doctoral Thesis in Computer Science onsdag 27:e maj 2015 klockan 10.00 i F3, Lindstedtsvägen 26, Kungl Tekniska högskolan, Stockholm. © Bernhard A. Kaplan, April 2015 Tryck: Universitetsservice US AB iii Abstract Our senses are our mind’s window to the outside world and deter- mine how we perceive our environment. Sensory systems are complex multi-level systems that have to solve a multitude of tasks that allow us to understand our surroundings. However, questions on various lev- els and scales remain to be answered ranging from low-level neural responses to behavioral functions on the highest level. Modeling can connect different scales and contribute towards tackling these questions by giving insights into perceptual processes and interactions between processing stages. In this thesis, numerical simulations of spiking neural networks are used to deal with two essential functions that sensory systems have to solve: pattern recognition and prediction. The focus of this thesis lies on the question as to how neural network connectivity can be used in order to achieve these crucial functions. The guiding ideas of the models presented here are grounded in the probabilistic interpretation of neural signals, Hebbian learning principles and connectionist ideas.