Neuroimaging in Vision Science

Total Page:16

File Type:pdf, Size:1020Kb

Neuroimaging in Vision Science Journal of Vision (2008) 8(10):i, 1–1 http://journalofvision.org/8/10/i/ 1 Special Issue Introduction Neuroimaging in vision science Royal Holloway, University of London, Andy Smith London, UK New York University, David Heeger New York, USA University of Washington, Geoff Boynton Washington, USA Smith-Kettlewell Eye Research Institute, Anthony Norcia California, USA Keywords: vision, neuroimaging Citation: Smith, A., Heeger, D., Boynton, G., & Norcia, A. (2008). Neuroimaging in vision science. Journal of Vision, 8(10):i, 1–1, http://journalofvision.org/8/10/i/, doi:10.1167/8.10.i. The past decade has seen rapid growth in the use of action run in both directions: vision researchers using imaging techniques to study the human brain. In the case imaging techniques may have more to gain from mixing of vision science, the firm foundation provided by several with non-imaging vision researchers than with non-vision decades of detailed psychophysics and neurophysiology imagers. has permitted rapid progress in defining the various visual What goes for conferences also goes for journals. It is areas of the human brain, establishing the nature of the important that those conducting imaging studies of vision visual information processing that occurs within them and publish their work where it will be read by vision examining non-retinal influences such as attention, mental scientists. It is less important that their work is accessible imagery and input from the other sense systems. to fellow imagers who work on language, emotion and The imaging community, and particularly the fast- consciousness. We therefore believe that vision journals growing fMRI community, is characterized by a high are a more natural home than imaging journals for degree of independence from the mainstream neuro- imaging work on vision. The purpose of this special issue science community. The emphasis in the imaging com- is to collect together a number of high-quality imaging munity has been on developing methods of acquisition studies of visual processing and present them in a journal and analysis. Thriving new journals and conferences have used by vision researchers of varied methodological sprung up around neuroimaging, and methodology pro- persuasions. We hope that the collection serves a useful vides their core business. However, as the imaging scientific purpose in itself, but we also hope that it may approach matures and stabilizes, and its strengths and stimulate an increase in the number of imaging submis- weaknesses become clearer, it is important that imaging sions to the Journal of Vision in the future. applications addressing neuroscientific questions be inte- grated with research that uses alternative methods to address similar questions. The route to integration is the sharing of ideas and results among practitioners of Acknowledgments different approaches. Key to sharing ideas and results is the existence of conferences and journals that embrace wide-ranging methodologies within a restricted sub- discipline of neuroscience, in our case vision science. Commercial relationships: none. There has been a gratifying surge in imaging presentations Corresponding author: Andrew T. Smith. at recent annual meetings and a consequent increase in Email: [email protected]. awareness of imaging work among visual psychophysi- Address: Department of Psychology, Royal Holloway, cists and computational theorists. The benefits of inter- University of London, Egham, Surrey, TW20 OEX UK. doi: 10.1167/8.10.i Published August 1, 2008 ISSN 1534-7362 * ARVO Downloaded from jov.arvojournals.org on 10/01/2021.
Recommended publications
  • Motion Processing in Human Visual Cortex
    1 Motion Processing in Human Visual Cortex Randolph Blake*, Robert Sekuler# and Emily Grossman* *Vanderbilt Vision Research Center, Nashville TN 37203 #Volen Center for Complex Systems, Brandeis University, Waltham MA 02454 Acknowledgments. The authors thank David Heeger, Alex Huk, Nestor Matthews and Mark Nawrot for comments on sections of this chapter. David Bloom helped greatly with manuscript formatting and references. During preparation of this chapter RB and EG were supported by research grants from the National Institutes of Health (EY07760) and the National Science Foundation (BCS0121962) and by a Core Grant from the National Institutes of Health (EY01826) awarded to the Vanderbilt Vision Research Center. [email protected] 2 During the past few decades our understanding of the neural bases of visual perception and visually guided actions has advanced greatly; the chapters in this volume amply document these advances. It is fair to say, however, that no area of visual neuroscience has enjoyed greater progress than the physiology of visual motion perception. Publications dealing with visual motion perception and its neural bases would fill volumes, and the topic remains central within the visual neuroscience literature even today. This chapter aims to provide an overview of brain mechanisms underlying human motion perception. The chapter comprises four sections. We begin with a short review of the motion pathways in the primate visual system, emphasizing work from single-cell recordings in Old World monkeys; more extensive reviews of this literature appear elsewhere.1,2 With this backdrop in place, the next three sections concentrate on striate and extra-striate areas in the human brain that are implicated in the perception of motion.
    [Show full text]
  • Neuroimaging and the "Complexity" of Capital Punishment O
    Notre Dame Law School NDLScholarship Journal Articles Publications 2007 Neuroimaging and the "Complexity" of Capital Punishment O. Carter Snead Notre Dame Law School, [email protected] Follow this and additional works at: https://scholarship.law.nd.edu/law_faculty_scholarship Part of the Criminal Law Commons, Criminal Procedure Commons, and the Legal Ethics and Professional Responsibility Commons Recommended Citation O. C. Snead, Neuroimaging and the "Complexity" of Capital Punishment, 82 N.Y.U. L. Rev. 1265 (2007). Available at: https://scholarship.law.nd.edu/law_faculty_scholarship/542 This Article is brought to you for free and open access by the Publications at NDLScholarship. It has been accepted for inclusion in Journal Articles by an authorized administrator of NDLScholarship. For more information, please contact [email protected]. ARTICLES NEUROIMAGING AND THE "COMPLEXITY" OF CAPITAL PUNISHMENT 0. CARTER SNEAD* The growing use of brain imaging technology to explore the causes of morally, socially, and legally relevant behavior is the subject of much discussion and contro- versy in both scholarly and popular circles. From the efforts of cognitive neuros- cientists in the courtroom and the public square, the contours of a project to transform capital sentencing both in principle and in practice have emerged. In the short term, these scientists seek to play a role in the process of capitalsentencing by serving as mitigation experts for defendants, invoking neuroimaging research on the roots of criminal violence to support their arguments. Over the long term, these same experts (and their like-minded colleagues) hope to appeal to the recent find- ings of their discipline to embarrass, discredit, and ultimately overthrow retributive justice as a principle of punishment.
    [Show full text]
  • The Standard Model of Computer Vision
    The Embedded Neuron, the Enactive Field? Mazviita Chirimuuta* & Ian Gold*† *School of Philosophy & Bioethics, Monash University, Clayton VIC 3800, Australia; [email protected] †Departments of Philosophy & Psychiatry, McGill University, Montreal, Quebec H3A 2T7, Canada; [email protected] Abstract The concept of the receptive field, first articulated by Hartline, is central to visual neuroscience. The receptive field of a neuron encompasses the spatial and temporal properties of stimuli that activate the neuron, and, as Hubel and Wiesel conceived of it, a neuron’s receptive field is static. This makes it possible to build models of neural circuits and to build up more complex receptive fields out of simpler ones. Recent work in visual neurophysiology is providing evidence that the classical receptive field is an inaccurate picture. The receptive field seems to be a dynamic feature of the neuron. In particular, the receptive field of neurons in V1 seems to be dependent on the properties of the stimulus. In this paper, we review the history of the concept of the receptive field and the problematic data. We then consider a number of possible theoretical responses to these data. 1. Introduction One role for the philosopher of neuroscience is to examine issues raised by the central concepts of neuroscience (Gold & Roskies forthcoming) just as philosophy of biology does for biology and philosophy of physics for physics. In this paper we make an attempt to explore one issue around the concept of the receptive field (RF) of visual neurons. Fundamentally, the RF of a neuron represents “how a cell responds when a point of light falls in a position of space (or time)” (Rapela, Mendel & Grzywacz 2006, p.
    [Show full text]
  • Supplemental Information: a Recurrent Circuit Implements Normalization, Simulating the Dynamics of V1 Activity David J
    SI Appendix: Heeger & Zemlianova, PNAS, 2020 Supplemental Information: A Recurrent Circuit Implements Normalization, Simulating the Dynamics of V1 Activity David J. Heeger and Klavdia O. Zemlianova Corresponding author: David J. Heeger Email: [email protected] Table of contents Introduction (with additional references) 2 Extended Discussion (with additional references) 2 Failures and extensions 2 Gamma oscillations 3 Mechanisms 3 Detailed Methods 5 Input drive: temporal prefilter 5 Input drive: spatial RFs 5 Input drive: RF size 7 Recurrent drive 7 Normalization weights 8 Derivations 9 Notation conventions 9 Fixed point 9 Effective gain 11 Effective time constant 12 Variants 13 Bifurcation Analysis 18 Stochastic resonance 20 References 22 www.pnas.org/cgi/doi/10.1073/pnas.2005417117 1 SI Appendix: Heeger & Zemlianova, PNAS, 2020 Introduction (with additional references) The normalization model was initially developed to explain stimulus-evoked responses of neurons in primary visual cortex (V1) (1-7), but has since been applied to explain neural activity and behavior in diverse cognitive processes and neural systems (7-62). The model mimics many well-documented physiological phenomena in V1 including response saturation, cross-orientation suppression, and sur- round suppression (9-11, 16, 17, 19, 22, 38, 63-66), and their perceptual analogues (67-71). Different stimuli suppress responses by different amounts, suggesting the normalization is “tuned” or “weighted” (9, 16, 17, 21, 72-75). Normalization has been shown to serve a number of functions in a variety of neural systems (7) including automatic gain control (needed because of limited dynamic range) (4, 8, 12), simplifying read-out (12, 76, 77), conferring invariance with respect to one or more stimulus dimensions (e.g., contrast, odorant concentration) (4, 8, 12, 37, 78), switching between aver- aging vs.
    [Show full text]
  • Vision As a Beachhead
    Biological Review Psychiatry Vision as a Beachhead David J. Heeger, Marlene Behrmann, and Ilan Dinstein ABSTRACT When neural circuits develop abnormally due to different genetic deficits and/or environmental insults, neural computations and the behaviors that rely on them are altered. Computational theories that relate neural circuits with specific quantifiable behavioral and physiological phenomena, therefore, serve as extremely useful tools for elucidating the neuropathological mechanisms that underlie different disorders. The visual system is particularly well suited for characterizing differences in neural computations; computational theories of vision are well established, and empirical protocols for measuring the parameters of those theories are well developed. In this article, we examine how psychophysical and neuroimaging measurements from human subjects are being used to test hypotheses about abnormal neural computations in autism, with an emphasis on hypotheses regarding potential excitation/inhibition imbalances. We discuss the complexity of relating specific computational abnormalities to particular underlying mechanisms given the diversity of neural circuits that can generate the same computation, and we discuss areas of research in which computational theories need to be further developed to provide useful frameworks for interpreting existing results. A final emphasis is placed on the need to extend existing ideas into developmental frameworks that take into account the dramatic developmental changes in neurophysiology (e.g., changes in excitation/inhibition balance) that take place during the first years of life, when autism initially emerges. Keywords: Autism, Computational theory, E/I balance, Neuroimaging, Psychophysics, Sensory, Vision, Visual cortex http://dx.doi.org/10.1016/j.biopsych.2016.09.019 The excitation/inhibition (E/I) imbalance hypothesis posits that (GABA) is an excitatory neurotransmitter during this period autism is caused by abnormally high E/I ratios throughout the (25).
    [Show full text]
  • HIPS-2 Software for Image Processing: Goals and Directions
    The HIPS-2 Software for Image Processing: Goals and Directions Michael S. Landy Sharplmage Software, P.O. Box 373, Prince St. Sta., NY, NY 10012-0007 Department of Psychology and Center for Neural Science, NYU, NY, NY 10003 ABSTRACT HIPS-2 is a set of image processing modules which provides a powerful suite of tools for those interested in research, system development and teaching. In this paper we first review the design con- siderations used to develop HIPS-2 from its predecessor (HIPS'). Then, a number of further developments are outlined which are under consideration. These include the development of a graphical user interface, more general approaches to color from the standpoint of color reproduction and linear models of color, and extensions to the software and data format to deal with production-oriented tasks. 1. THE HIPS SOFTWARE HJPS* is an image processing package for the UNIX environment.78 It was originally developed at New York University to support a research project on low bandwidth coding of images of American Sign Language14, and was completed in 1983. In 1991, the software was completely rewritten in a design which involved a collaboration between Sharplmage Software in New York and The Turing Institute in Glasgow, resulting in the HIPS-2 software. The HIPS and HIPS-2 packages are now in use at over 200 sites worldwide in a wide variety of application areas including research in computer vision and robotics, visual perception, satellite imaging, medical imaging, mechanical engineering, oil exploration, etc. In this section the design of HIPS is reviewed briefly. In later sections the new features of HIPS-2 as well as possible future directions will be discussed.
    [Show full text]
  • Curriculum Vitae Uri Hasson Contact Information Address: Department Of
    Curriculum Vitae Uri Hasson Contact Information Address: Department of Psychology and the Neuroscience Institute Peretsman-Scully Hall Princeton University Princeton, NJ, 08544 Phone: (609) 258 3884 Fax: (609) 258 1113 Email: [email protected] Web: http://www.hassonlab.com/ Academic Employment 2017- Professor, Department of Psychology and the Neuroscience Institute, Princeton University 2014-2017 Associate Professor, Department of Psychology and the Neuroscience Institute, Princeton University 2008-2014 Assistant Professor, Department of Psychology and the Neuroscience Institute, Princeton University 2004-2008 Postdoctoral Fellow, Center for Neural Science, New York University (advisors: David Heeger and Nava Rubin) Education 1999-2004 Ph.D. Neurobiology Department, Weizmann Institute of Science (advisor: Rafael Malach) 1995-1998 M.Sc. Cognitive Science, the Hebrew University of Jerusalem 1991-1994 B.Sc. Philosophy and Cognitive Science, the Hebrew University of Jerusalem Honors and Awards 2016- NIH’s directors Pioneer Award 2004-2007 Human Frontier Science Program (HFSP) Long-Term Fellowship 2004/2005 Rothschild Fellowship 2000-2004 Feinberg Fellowship for doctoral degree in Neurobiology 2003 Human Brain Mapping Travel Award 1997 Winner of the 'New Voices, New Visions' multimedia competition Hasson, Uri page | 2 Research Support Currently funded grants 2017- DOD Applications “Capturing Dynamic Brain-to-Brain Coupling using Temporal Representation Learning” 2017- NIH, 1R01MH112566-01 “Brain-to-brain dynamical coupling: a new framework
    [Show full text]
  • Differential Impact of Endogenous and Exogenous Attention on Activity In
    bioRxiv preprint doi: https://doi.org/10.1101/414508; this version posted November 4, 2020. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is made available under aCC-BY-NC-ND 4.0 International license. 1 Differential impact of endogenous and exogenous attention 2 on activity in human visual cortex 3 4 Laura Dugué1,2,3,4, Elisha P. Merriam1,2,5, David J. Heeger1,2 & Marisa Carrasco1,2 5 6 7 8 9 10 1 Department of Psychology, New York University 11 2 Center for Neural Science, New York University 12 3 Université de Paris, CNRS, Integrative Neuroscience and Cognition Center, F-75006 Paris, 13 France 14 4 Institut Universitaire de France, Paris, France 15 5 Laboratory of Brain and Cognition, NIMH/NIH, Bethesda, MD 16 17 18 Running title: endogenous and exogenous attention 19 20 21 Corresponding author: 22 Laura Dugué 23 Current address: 45 rue des Saints-Pères 75006 Paris, FRANCE 24 [email protected] 1 bioRxiv preprint doi: https://doi.org/10.1101/414508; this version posted November 4, 2020. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is made available under aCC-BY-NC-ND 4.0 International license. 25 ABSTRACT (150 words) 26 How do endogenous (voluntary) and exogenous (involuntary) attention modulate activity in vis- 27 ual cortex? Using ROI-based fMRI analysis, we measured fMRI activity for valid and invalid 28 trials (target at cued/un-cued location, respectively), pre- or post-cueing endogenous or exoge- 29 nous attention, while participants performed the same orientation discrimination task.
    [Show full text]
  • Download Various Parameter Settings (E.G., the Weight Matrices and Offsets), Computed Separately Offline
    ORGaNICs arXiv:1803.06288 May 24, 2018 ORGaNICs: A Theory of Working Memory in Brains and Machines David J. Heeger and Wayne E. Mackey Department of Psychology and Center for Neural Science New York University 4 Washington Place, room 809 New York, NY 10003 Email: [email protected] Keywords: working memory, LSTM, neural integrator !1 ORGaNICs arXiv:1803.06288 May 24, 2018 Abstract Working memory is a cognitive process that is responsible for temporarily holding and ma- nipulating information. Most of the empirical neuroscience research on working memory has focused on measuring sustained activity and sequential activity in prefrontal cortex and/or parietal cortex during delayed-response tasks, and most of the models of working memory have been based on neural integrators. But working memory means much more than just hold- ing a piece of information online. We describe a new theory of working memory, based on a recurrent neural circuit that we call ORGaNICs (Oscillatory Recurrent GAted Neural Integrator Circuits). ORGaNICs are a variety of Long Short Term Memory units (LSTMs), imported from machine learning and artificial intelligence, that can be used to explain the complex dynamics of delay-period activity during a working memory task. The theory is analytically tractable so that we can characterize the dynamics, and the theory provides a means for reading out infor- mation from the dynamically varying responses at any point in time, in spite of the complex dy- namics. ORGaNICs can be implemented with a biophysical (electrical circuit) model of pyrami- dal cells, combined with shunting inhibition via a thalamocortical loop.
    [Show full text]
  • Profile of David Heeger PROFILE Brian Doctrow, Science Writer
    PROFILE Profile of David Heeger PROFILE Brian Doctrow, Science Writer “Interdisciplinary” has become a buzzword in science research project, a collaboration in recent years. According to David Heeger, a profes- between computer scientist sor of psychology and neural science at New York Ruzena Bajcsy and psychol- University (NYU), “You don’t do interdisciplinary sci- ogist Jacob Nachmias. ence by putting a physicist and a biologist in the same After graduating with a office. Nor do you make interdisciplinary science hap- bachelor’s degree in mathe- pen by taking a grant proposal and assigning it for matics in 1983, Heeger de- review to people from a different field who know nothing cided to continue studying about it. You have to be willing to learn the other field’s with Bajcsy, earning his master’s language...techniques...and literature.” Heeger, who degree in 1985 and his PhD in was elected to the National Academy of Sciences in 1987, both in computer sci- 2013, understands interdisciplinary science more than ence. As a thesis advisor, Bajcsy most. For decades, Heeger’s research has straddled the was generous, encouraging boundaries between psychology, neuroscience, and Heeger to publish his disserta- computer science, with lasting impacts on all three fields. tion work as sole author and providing him with valuable David Heeger. Image courtesy of the Na- Early Opportunities professional contacts, including tional Academy of Sciences. David Heeger was born into science. His father, Alan Alexander Pentland, who coad- Heeger, is a physicist whose discovery of conductive vised Heeger on some of his dissertation work, and polymers earned him the Nobel Prize for Chemistry in Edward Adelson, who would later become Heeger’s 2000.
    [Show full text]
  • Motion Opponency in Visual Cortex
    The Journal of Neuroscience, August 15, 1999, 19(16):7162–7174 Motion Opponency in Visual Cortex David J. Heeger,1 Geoffrey M. Boynton,1 Jonathan B. Demb,1 Eyal Seidemann,2 and William T. Newsome2 1Department of Psychology, and 2Howard Hughes Medical Institute and Department of Neurobiology, Stanford University, Stanford, California 94305-2130 Perceptual studies suggest that visual motion perception is MT and MST of the macaque monkey brain. Although there was mediated by opponent mechanisms that correspond to mutu- substantial variability in the degree of opponency between ally suppressive populations of neurons sensitive to motions in recording sites, the monkey and human data were qualitatively opposite directions. We tested for a neuronal correlate of mo- similar on average. These results provide further evidence that: tion opponency using functional magnetic resonance imaging (1) direction-selective signals underly human MT1 responses, (fMRI) to measure brain activity in human visual cortex. There (2) neuronal signals in human MT1 support visual motion per- was strong motion opponency in a secondary visual cortical ception, (3) human MT1 is homologous to macaque monkey area known as the human MT complex (MT1), but there was MT and adjacent motion sensitive brain areas, and (4) that fMRI little evidence of motion opponency in primary visual cortex. To measurements are correlated with average spiking activity. determine whether the level of opponency in human and mon- key are comparable, a variant of these experiments was per- Key words: MT; V1; neuroimaging; fMRI; motion; visual mo- formed using multiunit electrophysiological recording in areas tion perception; motion opponency; vision; visual cortex Computational theories of visual motion perception typically nency (Levinson and Sekuler, 1975b; Watson et al., 1980; Ray- include a motion opponent stage in which, for example, the mond and Braddick, 1996).
    [Show full text]
  • Deconstructing Interocular Suppression: Attention and Divisive Normalization
    RESEARCH ARTICLE Deconstructing Interocular Suppression: Attention and Divisive Normalization Hsin-Hung Li1, Marisa Carrasco1,2, David J. Heeger1,2* 1 Department of Psychology, New York University, New York, New York, United States of America, 2 Center for Neural Science, New York University, New York, New York, United States of America * [email protected] Abstract In interocular suppression, a suprathreshold monocular target can be rendered invisible by a salient competitor stimulus presented in the other eye. Despite decades of research on interocular suppression and related phenomena (e.g., binocular rivalry, flash suppression, continuous flash suppression), the neural processing underlying interocular suppression is still unknown. We developed and tested a computational model of interocular suppression. The model included two processes that contributed to the strength of interocular suppres- OPEN ACCESS sion: divisive normalization and attentional modulation. According to the model, the salient Citation: Li H-H, Carrasco M, Heeger DJ (2015) competitor induced a stimulus-driven attentional modulation selective for the location and Deconstructing Interocular Suppression: Attention orientation of the competitor, thereby increasing the gain of neural responses to the compet- and Divisive Normalization. PLoS Comput Biol itor and reducing the gain of neural responses to the target. Additional suppression was 11(10): e1004510. doi:10.1371/journal.pcbi.1004510 induced by divisive normalization in the model, similar to other forms of visual masking. To Editor: Matthias Bethge, University of Tübingen and test the model, we conducted psychophysics experiments in which both the size and the Max Planck Institute for Biologial Cybernetics, GERMANY eye-of-origin of the competitor were manipulated.
    [Show full text]