Generalization in Data-Driven Models of Primary

Total Page:16

File Type:pdf, Size:1020Kb

Generalization in Data-Driven Models of Primary bioRxiv preprint doi: https://doi.org/10.1101/2020.10.05.326256; this version posted April 6, 2021. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is made available under aCC-BY-ND 4.0 International license. Published as a conference paper at ICLR 2021 GENERALIZATION IN DATA-DRIVEN MODELS OF PRIMARY VISUAL CORTEX Konstantin-Klemens Lurz,1-2,* Mohammad Bashiri,1-2 Konstantin Willeke,1-2 Akshay K. Jagadish,1 Eric Wang,4-5 Edgar Y. Walker,1,2,4-5 Santiago A. Cadena,2,3 Taliah Muhammad,4-5 Erick Cobos,4-5 Andreas S. Tolias,4-5 Alexander S. Ecker,6 Fabian H. Sinz1-5, ** 1 Institute for Bioinformatics and Medical Informatics, University of Tübingen, Germany 2 International Max Planck Research School for Intelligent Systems, Tübingen, Germany 3 Bernstein Center for Computational Neuroscience, University of Tübingen, Germany 4 Department for Neuroscience, Baylor College of Medicine, Houston, TX, USA 5 Center for Neuroscience and Artificial Intelligence, Baylor College of Medicine, Houston, TX, USA 6 Department of Computer Science / Campus Institute Data Science, University of Göttingen, Germany *[email protected], **[email protected] ABSTRACT Deep neural networks (DNN) have set new standards at predicting responses of neural populations to visual input. Most such DNNs consist of a convolutional network (core) shared across all neurons which learns a representation of neural computation in visual cortex and a neuron-specific readout that linearly combines the relevant features in this representation. The goal of this paper is to test whether such a representation is indeed generally characteristic for visual cortex, i.e. gener- alizes between animals of a species, and what factors contribute to obtaining such a generalizing core. To push all non-linear computations into the core where the generalizing cortical features should be learned, we devise a novel readout that reduces the number of parameters per neuron in the readout by up to two orders of magnitude compared to the previous state-of-the-art. It does so by taking advantage of retinotopy and learns a Gaussian distribution over the neuron’s receptive field po- sition. With this new readout we train our network on neural responses from mouse primary visual cortex (V1) and obtain a gain in performance of 7% compared to the previous state-of-the-art network. We then investigate whether the convolutional core indeed captures general cortical features by using the core in transfer learning to a different animal. When transferring a core trained on thousands of neurons from various animals and scans we exceed the performance of training directly on that animal by 12%, and outperform a commonly used VGG16 core pre-trained on imagenet by 33%. In addition, transfer learning with our data-driven core is more data-efficient than direct training, achieving the same performance with only 40% of the data. Our model with its novel readout thus sets a new state-of-the-art for neural response prediction in mouse visual cortex from natural images, generalizes between animals, and captures better characteristic cortical features than current task-driven pre-training approaches such as VGG16. 1 INTRODUCTION A long lasting challenge in sensory neuroscience is to understand the computations of neurons in the visual system stimulated by natural images (Carandini et al., 2005). Important milestones towards this goal are general system identification models that can predict the response of large populations of neurons to arbitrary visual inputs. In recent years, deep neural networks have set new standards in predicting responses in the visual system (Yamins et al., 2014; Vintch et al., 2015; Antolík et al., 2016; Cadena et al., 2019a; Batty et al., 2016; Kindel et al., 2017; Klindt et al., 2017; Zhang et al., 2018; Ecker et al., 2018; Sinz et al., 2018) and the ability to yield novel response characterizations (Walker et al., 2019; Bashivan et al., 2019; Ponce et al., 2019; Kindel et al., 2019; Ukita et al., 2019). 1 bioRxiv preprint doi: https://doi.org/10.1101/2020.10.05.326256; this version posted April 6, 2021. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is made available under aCC-BY-ND 4.0 International license. Published as a conference paper at ICLR 2021 Such a general system identification model is one way for neuroscientists to investigate the computa- tions of the respective brain areas in silico. Such in silico experiments exhibit the possibility to study the system at a scale and level of detail that is impossible in real experiments which have to cope with limited experimental time and adaptation effects in neurons. Moreover, all parameters, connections and weights in an in silico model can be accessed directly, opening up the opportunity to manipulate the model or determine its detailed tuning properties using numerical optimization methods. In order for the results of such analyses performed on an in silico model to be reliable, however, one needs to make sure that the model does indeed replicate the responses of its biological counterpart faithfully. This work provides an important step towards obtaining such a generalizing model of mouse V1. High performing predictive models need to account for the increasingly nonlinear response properties of neurons along the visual hierarchy. As many of the nonlinearities are currently unknown, one of the key challenges in neural system identification is to find a good set of characteristic nonlinear basis functions—so called representations. However, learning these complex nonlinearities from single neuron responses is difficult given limited experimental data. Two approaches have proven to be promising in the past: Task-driven system identification networks rely on transfer learning and use nonlinear representations pre-trained on large datasets for standard vision tasks, such as object recognition (Yamins & DiCarlo, 2016). Single neuron responses are predicted from a particular layer of a pre-trained network using a simple readout mechanism, usually an affine function followed by a static nonlinearity. Data-driven models share a common nonlinear representation among hundreds or thousands of neurons, and train the entire network end-to-end on stimulus response pairs from the experiment. Because the nonlinear representation is shared, it is trained via massive multi-task learning (one neuron–one task) and can be learned even from limited experimental data. Task-driven networks are appealing because they only need to fit the readout mechanisms on top of a given representation and thus are data-efficient in terms of the number of stimulus-response pairs needed to achieve good predictive performance (Cadena et al., 2019a). Moreover, as their representations are obtained independently of the neural data, a good predictive performance suggests that the nonlinear features are characteristic for a particular brain area. This additionally offers the interesting normative perspective that the functional representations in deep networks and biological vision could be aligned by common computational goals (Yamins & DiCarlo, 2016; Kell et al., 2018; Kubilius et al., 2018; Nayebi et al., 2018; Sinz et al., 2019; Güçlü & van Gerven, 2014; Kriegeskorte, 2015; Khaligh-Razavi & Kriegeskorte, 2014; Kietzmann et al., 2019). In order to quantify the fit of the normative hypothesis, it is important to compare a given representation to other alternatives (Schrimpf et al., 2018; Cadena et al., 2019a). However, while representations pre-trained on ImageNet are the state-of-the-art for predicting visual cortex in primates (Cadena et al., 2019a; Yamins & DiCarlo, 2016), recent work has demonstrated that pre-training on object categorization (VGG16) yields no benefits over random initialization for mouse visual cortex (Cadena et al., 2019b). Since random representation should not be characteristic for a particular brain area and other tasks that might yield more meaningful representations have not been found yet, this raises the questions whether there are better ways to obtain a generalizing nonlinear representation for mouse visual cortex. Here, we investigate whether such a generalizing representation can instead be obtained from data- driven networks. For this purpose, we develop a new data efficient readout which is designed to push non-linear computations into the core and test whether this core has learned general characteristic features of mouse visual cortex by applying the same criteria as for the task-driven approach: The ability to predict a population of unseen neurons in a new animal (transfer learning). Specifically, we make the following contributions: 1 We introduce a novel readout mechanism that keeps the number of per-neuron parameters at a minimum and learns a bivariate Gaussian distribution for the readout position from anatomical data using retinotopy. With this readout alone, we surpass the previous state-of-the-art performance in direct training by 7%. 2 We demonstrate that a representation pre-trained on thousands of neurons from various animals generalizes to neurons from an unseen animal (transfer learning). It exceeds the direct training condition by another 11%, setting the new state-of-the-art and outperforms a task-driven representation—trained on object recognition—by about 33%. 3 We then show that this generalization can be attributed to the representation and not the readout mechanism, indicating that the data-driven core indeed captures generalizing features of cortex: A representation trained on a single experiment (4.5k examples) in combination with a readout trained on anatomically matched neurons from four experiments (17.5k examples) did not achieve this performance. 4 Lastly, we find that transfer learning with our data-driven core is more data-efficient than direct training, achieving the same performance with only 40% of the data.
Recommended publications
  • Local Field Potential Decoding of the Onset and Intensity of Acute Pain In
    www.nature.com/scientificreports OPEN Local feld potential decoding of the onset and intensity of acute pain in rats Received: 25 January 2018 Qiaosheng Zhang1, Zhengdong Xiao2,3, Conan Huang1, Sile Hu2,3, Prathamesh Kulkarni1,3, Accepted: 8 May 2018 Erik Martinez1, Ai Phuong Tong1, Arpan Garg1, Haocheng Zhou1, Zhe Chen 3,4 & Jing Wang1,4 Published: xx xx xxxx Pain is a complex sensory and afective experience. The current defnition for pain relies on verbal reports in clinical settings and behavioral assays in animal models. These defnitions can be subjective and do not take into consideration signals in the neural system. Local feld potentials (LFPs) represent summed electrical currents from multiple neurons in a defned brain area. Although single neuronal spike activity has been shown to modulate the acute pain, it is not yet clear how ensemble activities in the form of LFPs can be used to decode the precise timing and intensity of pain. The anterior cingulate cortex (ACC) is known to play a role in the afective-aversive component of pain in human and animal studies. Few studies, however, have examined how neural activities in the ACC can be used to interpret or predict acute noxious inputs. Here, we recorded in vivo extracellular activity in the ACC from freely behaving rats after stimulus with non-noxious, low-intensity noxious, and high-intensity noxious stimuli, both in the absence and chronic pain. Using a supervised machine learning classifer with selected LFP features, we predicted the intensity and the onset of acute nociceptive signals with high degree of precision.
    [Show full text]
  • The Effect of Sensory Processing on the Work Performance of Call Centre Agents in a South African Context
    The effect of sensory processing on the work performance of call centre agents in a South African context Annemarie Lombard Student Number: ARCANN002 e Town ap y of C SUBMITTED TO THE UNIVERSITY OF CAPE TOWN Department of Health & Rehabilitation Sciences In fulfilmentUniversit of the requirements for the degree of Doctor of Philosophy in Occupational Therapy February 2012 Supervisor: Emeritus Associate Professor R. Watson Co-supervisor: Associate Professor M. Duncan Department of Health & Rehabilitation Sciences The copyright of this thesis vests in the author. No quotation from it or information derived from it is to be published without full acknowledgementTown of the source. The thesis is to be used for private study or non- commercial research purposes only. Cape Published by the University ofof Cape Town (UCT) in terms of the non-exclusive license granted to UCT by the author. University Declaration I, Annemarie Lombard, hereby declare that the work on which this dissertation/thesis is based is my original work (except where acknowledgements indicate otherwise), and that neither the whole work nor any part of it has been, is being, or is to be submitted for another degree at this or any other university. I empower the university to reproduce for the purpose of research either the whole or any portion of the contents in any manner whatsoever. Signature: e Town ap Date: 25th May 2012 y of C Universit Introduction Page i Acknowledgements This study was an epic journey made possible by the support of so many people to whom I am forever grateful: To God, our Heavenly Father who gave me the dream, allowed me the journey, and continues to give me the strength and courage to follow it.
    [Show full text]
  • Identification of Human Gustatory Cortex by Activation Likelihood Estimation
    r Human Brain Mapping 32:2256–2266 (2011) r Identification of Human Gustatory Cortex by Activation Likelihood Estimation Maria G. Veldhuizen,1,2 Jessica Albrecht,3 Christina Zelano,4 Sanne Boesveldt,3 Paul Breslin,3,5 and Johan N. Lundstro¨m3,6,7* 1Affective Sensory Neuroscience, John B. Pierce Laboratory, New Haven, Connecticut 2Department of Psychiatry, Yale University School of Medicine, New Haven, Connecticut 3Monell Chemical Senses Center, Philadelphia, Pennsylvania 4Department of Neurology, Northwestern University, Chicago, Illinois 5Department of Nutritional Sciences, Rutgers University School of Environmental and Biological Sciences, New Brunswick, New Jersey 6Department of Psychology, University of Pennsylvania, Philadelphia, Pennsylvania 7Department of Clinical Neuroscience, Karolinska Institutet, Stockholm, Sweden r r Abstract: Over the last two decades, neuroimaging methods have identified a variety of taste-responsive brain regions. Their precise location, however, remains in dispute. For example, taste stimulation activates areas throughout the insula and overlying operculum, but identification of subregions has been inconsistent. Furthermore, literature reviews and summaries of gustatory brain activations tend to reiterate rather than resolve this ambiguity. Here, we used a new meta-analytic method [activation likelihood estimation (ALE)] to obtain a probability map of the location of gustatory brain activation across 15 studies. The map of activa- tion likelihood values can also serve as a source of independent coordinates for future region-of-interest anal- yses. We observed significant cortical activation probabilities in: bilateral anterior insula and overlying frontal operculum, bilateral mid dorsal insula and overlying Rolandic operculum, and bilateral posterior insula/parietal operculum/postcentral gyrus, left lateral orbitofrontal cortex (OFC), right medial OFC, pre- genual anterior cingulate cortex (prACC) and right mediodorsal thalamus.
    [Show full text]
  • Cortical Feedback and Gating in Olfactory Pattern Completion and Separation
    bioRxiv preprint doi: https://doi.org/10.1101/2020.11.05.370494; this version posted November 6, 2020. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is made available under aCC-BY-NC 4.0 International license. Cortical feedback and gating in olfactory pattern completion and separation Gaia Tavonia,b,1,2, David E. Chen Kersena,c,1, and Vijay Balasubramaniana,b,c aComputational Neuroscience Initiative; bDepartment of Physics and Astronomy; cDepartment of Bioengineering, University of Pennsylvania, Philadelphia, PA 19104 A central question in neuroscience is how context changes percep- reflect coordination between the OB and cortical areas during tion of sensory stimuli. In the olfactory system, for example, exper- learning. However, the precise mechanism by which centrifu- iments show that task demands can drive merging and separation gal feedback to the OB can effect change in cortical odor of cortical odor responses, which underpin olfactory generalization representation remains unclear. and discrimination. Here, we propose a simple statistical mecha- Interestingly, the structural organization of these feedfor- nism for this effect, based on unstructured feedback from the cen- ward and feedback projections is highly disordered. MC/TCs tral brain to the olfactory bulb, representing the context associated project to the cortex in an apparently random fashion (22, 56– with an odor, and sufficiently selective cortical gating of sensory in- 58), while centrifugal feedback fibers are distributed dif- puts. Strikingly, the model predicts that both pattern separation and fusely over the OB without any discernible spatial segregation completion should increase when odors are initially more similar, an (25, 30).
    [Show full text]
  • The Olfactory Sensory Map in Drosophila Philippe P
    Chapter 7 The Olfactory Sensory Map in Drosophila Philippe P. Laissue and Leslie B. Vosshall* Abstract he fruit fly Drosophila( melanogaster) exhibits robust odor‑evoked behaviors in response to cues from diverse host plants and pheromonal cues from other flies. Understanding how the adult olfactory system supports the perception of these odorous chemicals and translates Tthem into appropriate attraction or avoidance behaviors is an important goal in contemporary sensory neuroscience. Recent advances in genomics and molecular neurobiology have provided an unprecedented level of detail into how the adult Drosophila olfactory system is organized. Volatile odorants are sensed by two bilaterally symmetric olfactory sensory appendages, the third segment of the antenna and the maxillary palps, which respectively contain approximately 1200 and 120 olfactory sensory neurons (OSNs) each. These OSNs express a divergent family of seven transmembrane domain odorant receptors (ORs) with no homology to vertebrate ORs, which determine the odor specificity of a given OSN. Drosophila was the first animal for which all OR genes were cloned, their patterns of gene expression determined and axonal projections of most OSNs elucidated. In vivo electrophysiology has been used to decode the ligand response profiles of most of the ORs, providing insight into the initial logic of olfactory coding in the fly. This chapter will review the molecular biology, neuroanatomy and function of the peripheral olfactory system of Drosophila. Introduction Sensory systems—touch, hearing, vision, taste, smell—map features of the external world into internal representations in the brain that ultimately allow all animals to navigate their environ‑ ments. The physical senses of touch and vision use topographic mapping approaches to represent discrete dimensions of the external world.
    [Show full text]
  • Exploring Sensory Neuroscience Through Experience and Experiment
    The Journal of Undergraduate Neuroscience Education (JUNE), Fall 2012, 11(1):A126-A131 ARTICLE Exploring Sensory Neuroscience Through Experience and Experiment Robert A. Wyttenbach Department of Neurobiology and Behavior, Cornell University, Ithaca, NY 14853. Many phenomena that we take for granted are illusions — attempts to connect them to neuroscience, and shows how color and motion on a TV or computer monitor, for students can explore and experiment with them. Even example, or the impression of space in a stereo music when (as is often the case) there is no agreed-upon recording. Even the stable image that we perceive when mechanistic explanation for an illusion, students can form looking directly at the real world is illusory. One of the hypotheses and test them by manipulating stimuli and important lessons from sensory neuroscience is that our measuring their effects. In effect, students can experiment perception of the world is constructed rather than received. with illusions using themselves as subjects. Sensory illusions effectively capture student interest, but how do you then move on to substantive discussion of Key words: illusion, adaptation, aftereffect, receptive field, neuroscience? This article illustrates several illusions, motion, color, pitch, size, orientation In addition to their immediate aesthetic appeal, illusions adaptation, you move your head closer to or further from have historically been used to investigate mechanisms of the white screen or look at the sky? (6) If you adapt one perception. While the success of this approach has been eye with the other eye closed and then switch eyes, is mixed — many illusions do not have accepted explanations there an afterimage? or turn out to be more complex than initially thought — Interpretations: (1) Students should be able to predict illusions are still powerful teaching tools.
    [Show full text]
  • Data-Driven Approaches to Understanding Visual Neuron Activity
    Data-driven approaches to understanding visual neuron activity Daniel A. Butts Dept. of Biology and Program in Neuroscience and Cognitive Science, University of Maryland, College Park, MD, USA **When citing this paper, please use the following: Butts DA. 2019. Data-driven approaches to understanding visual neuron function. Annual Review of Vision Science 5: 451-77. DOI: 10.1146/annurev-vision-091718-014731 With modern neurophysiological methods able to record neural activity throughout the visual pathway in the context of arbitrarily complex visual stimulation, our understanding of visual system function is becoming limited by the available models of visual neurons that can be directly related to such data. Different forms of statistical models are now being used to probe the cellular and circuit mechanisms shaping neural activity, understand how neural selectivity to complex visual features is computed, and derive the ways in which neurons contribute to systems-level visual processing. However, models that are able to more accurately reproduce observed neural activity often defy simple interpretations. As a result, rather than being used solely to connect with existing theories of visual processing, statistical modeling will increasingly drive the evolution of more sophisticated theories. 1. INTRODUCTION Visual processing is performed by billions of neurons spread across an array of visual areas. Understanding the function of such a system ultimately requires linking functional descriptions of visual processing with neural activity recorded across the visual system in appropriate visual contexts: where both the visual stimuli and neural responses are necessarily quite complex. As a result, links between function and recorded neuron activity necessarily require “statistical models”, which embody neural function in their mathematical form, and are “fit” to the data, such that their parameters correspond to specifics about each neuron’s processing (such as its “receptive field”).
    [Show full text]
  • Perception (Psych 30) Course Overview Professor Kalanit Grill-Spector
    Perception (Psych 30) Course Overview Professor Kalanit Grill-Spector Lectures: Tues,Thurs 9:30-10:45am, 200-002 Section: TBD [email protected] Office hours: Th 11-12pm, 420-414 Teaching Assistants: Course Objectives The objective of this course is to help you master the fundamental facts and concepts of perceptual psychology and sensory neuroscience. This is an interdisciplinary field of science, crossing the boundaries between psychology, biology, and engineering. My own research is on functional brain imaging, human vision and computational neuroscience. My research uses functional brain imaging magnetic resonance imaging and computational methods to study the neural basis of visual perception and link brain activations to human perception. It focuses on understanding what are the brain mechanisms underlying visual recognition and how they change over time and with learning. During lectures I will emphasize the neural bases of the perceptual phenomena that we will be studying. There are many other professors and graduate students on campus who are interested in the problems of perception. These people are scattered in several departments: in the Psychology Department, researchers study the neural and behavioral aspects of perception in humans, in the Computer Science Department they are developing software for computer vision, in the Medical School they study the biology of perception, and in the Engineering School they build systems for human use designed around our perceptual capabilities. If you should find yourself interested in some topic that matches my interests, or those of some other scientist on campus, I will be glad to introduce you and perhaps you can become involved in a research program.
    [Show full text]
  • Lecture 1 Intro
    1 Introduction Chapter 1 Introduction • Welcome to Our World • Thresholds and the Dawn of Psychophysics • Sensory Neuroscience and the Biology of Perception Introduction What do we mean by “Sensation & Perception?” • Sensation: The ability to detect a stimulus and, perhaps, to turn that detection into a private experience. • Perception: The act of giving meaning to a detected sensation. Sensation and perception are central to mental life. • Without them, how would we gain knowledge of the world? Introduction Psychologists typically study sensation and perception. • Also studied by biologists, computer scientists, medical doctors, neuroscientists, and many other fields Introduction The study of sensation and perception is a scientific pursuit and requires scientific methods. • Thresholds: Finding the limits of what can be perceived. • Scaling: Measuring private experience. • Signal detection theory: Measuring difficult decisions. • Sensory neuroscience: The biology of sensation and perception. • Neuroimaging: An image of the mind. Thresholds and the Dawn of Psychophysics Gustav Fechner (1801–1887) invented “psychophysics” and is often considered to be the true founder of experimental psychology. Fechner was an ambitious and hard- working young man who worked himself to the point of exhaustion. • Damaged his eyes by staring at the sun while performing vision experiments Figure 1.3 Gustav Fechner invented psychophysics and is thought by some to be the true founder of experimental psychology Thresholds and the Dawn of Psychophysics Fechner thought about the philosophical relationship between mind and matter. • Dualism: The mind has an existence separate from the material world of the body. • Materialism: The only thing that exists is matter, and that all things, including mind and consciousness, are the results of interactions between bits of matter.
    [Show full text]
  • Sensory Neuroscience: Four Laws of Psychophysics
    J.J. Zwislocki Sensory Neuroscience: Four Laws of Psychophysics ▶ The first book to focus on multisensory psychophysical laws ▶ Author is a leading researcher in the field of psychophysics Sensory Neuroscience:Four Laws of Psychophysics examines both psychophysics, the science of relationships between human sensations, and the stimuli that evoke them. More specifically, it defines four multisensory relationships of great generality between sensation magnitudes and the underlying stimulus magnitudes. Although, psychophysics belongs to sensory neuroscience and is strongly coupled to neurophysiology, it also has branched out to various specialized academic fields, including the sciences of vision and hearing, ophthalmology, optometry, otology, and audiology. Due to this diversification and fragmentation psychophysics has had an ad- hoc, phenomenological orientation and, besides the Weber law of differential sensitivity, has lacked a systematic grid of scientific laws. Through contributions from distinguished researchers in this field, Sensory Neuroscience:Four Laws of Psychophysics, provides valid 2009, XVIII, 174 p. 120 illus. unifying principles and systematic applications to this otherwise fragmented precursor of experimental psychology. This book will be particularly useful to auditory researchers, behavioural neuroscientists, and experimental psychologists. Printed book Dr. Jozef Zwislocki holds a Sc.D. degree from the Swiss Federal Institute of Technology and Hardcover two Dr. h. c. degrees from the Adam Mickiewicz University in Poland and Syracuse ▶ 159,99 € | £139.99 | $199.99 University respectively. He is a member of the American and Polish Academies of Sciences ▶ *171,19 € (D) | 175,99 € (A) | CHF 189.00 and the recipient of numerous research awards. Dr. Zwislocki started his research career as the director of the electroacoustic laboratory in the department of otolaryngology eBook of the University of Basel, Switzerland.
    [Show full text]
  • Interoception and Mental Health: a Roadmap
    Interoception and mental health: a roadmap Article (Published Version) Khalsa, Sahib S, Adolphs, Ralph, Cameron, Oliver G, Critchley, Hugo D, Davenport, Paul W, Feinstein, Justin S, Feusner, Jamie D, Garfinkel, Sarah N, Lane, Richard D, Mehling, Wolf E, Meuret, Alicia E, Nemeroff, Charles B, Oppenheimer, Stephen, Petzschner, Frederike H, Pollatos, Olga et al. (2018) Interoception and mental health: a roadmap. Biological Psychiatry: Cognitive Neuroscience and Neuroimaging, 3 (6). pp. 501-513. ISSN 24519022 This version is available from Sussex Research Online: http://sro.sussex.ac.uk/id/eprint/74442/ This document is made available in accordance with publisher policies and may differ from the published version or from the version of record. If you wish to cite this item you are advised to consult the publisher’s version. Please see the URL above for details on accessing the published version. Copyright and reuse: Sussex Research Online is a digital repository of the research output of the University. Copyright and all moral rights to the version of the paper presented here belong to the individual author(s) and/or other copyright owners. To the extent reasonable and practicable, the material made available in SRO has been checked for eligibility before being made available. Copies of full text items generally can be reproduced, displayed or performed and given to third parties in any format or medium for personal research or study, educational, or not-for-profit purposes without prior permission or charge, provided that the authors, title and full bibliographic details are credited, a hyperlink and/or URL is given for the original metadata page and the content is not changed in any way.
    [Show full text]
  • Lecture Materials
    NEUROSCIENCE 5. PERCEPTION, NON-HUMAN SENSES, PYRAMIDAL SYSTEMS 5.1. The Process of Perception Perception is the organization, identification, and interpretation of sensory information in order to represent and understand the environment. All perception involves signals in the nervous system, which in turn result from physical or chemical stimulation of the sense organs. For example, vision involves light striking the retina of the eye, smell is mediated by odor molecules, and hearing involves pressure waves. Perception is not the passive receipt of these signals, but is shaped by learning, memory, expectation, and attention. Perception involves these top-down effects as well as the bottom-up process of processing sensory input. The bottom-up processing transforms low level information to higher level information (e.g., extracts shapes for object recognition). The top-down processing refers to a person's concept and expectations (knowledge), and selective mechanisms (attention) that influence perception. Perception depends on complex functions of the nervous system, but subjectively seems mostly effortless because this processing happens outside conscious awareness. Since the rise of experimental psychology in the 19th century, psychology's understanding of perception has progressed by combining a variety of techniques. Psychophysics quantitatively describes the relationships between the physical qualities of the sensory input and perception. Sensory neuroscience studies the brain mechanisms underlying perception. Perceptual systems can also be studied computationally, in terms of the information they process. Perceptual issues in philosophy include the extent to which sensory qualities such as sound, smell or color exist in objective reality rather than in the mind of the perceiver. Although the senses were traditionally viewed as passive receptors, the study of illusions and ambiguous images has demonstrated that the brain's perceptual systems actively and pre-consciously attempt to make sense of their input.
    [Show full text]