Equiluminance Cells in Visual Cortical Area V4

Total Page:16

File Type:pdf, Size:1020Kb

Equiluminance Cells in Visual Cortical Area V4 12398 • The Journal of Neuroscience, August 31, 2011 • 31(35):12398–12412 Behavioral/Systems/Cognitive Equiluminance Cells in Visual Cortical Area V4 Brittany N. Bushnell,1 Philip J. Harding,1 Yoshito Kosai,1 Wyeth Bair,1,2 and Anitha Pasupathy1 1Department of Biological Structure and Washington National Primate Research Center, University of Washington, Seattle, Washington 98195, and 2Department of Physiology, Anatomy, and Genetics, University of Oxford, Oxford OX1 3PT, United Kingdom We report a novel class of V4 neuron in the macaque monkey that responds selectively to equiluminant colored form. These “equilumi- nance” cells stand apart because they violate the well established trend throughout the visual system that responses are minimal at low luminance contrast and grow and saturate as contrast increases. Equiluminance cells, which compose ϳ22% of V4, exhibit the opposite behavior: responses are greatest near zero contrast and decrease as contrast increases. While equiluminance cells respond preferentially to equiluminant colored stimuli, strong hue tuning is not their distinguishing feature—some equiluminance cells do exhibit strong unimodal hue tuning, but many show little or no tuning for hue. We find that equiluminance cells are color and shape selective to a degree comparable with other classes of V4 cells with more conventional contrast response functions. Those more conventional cells respond equally well to achromatic luminance and equiluminant color stimuli, analogous to color luminance cells described in V1. The existence of equiluminance cells, which have not been reported in V1 or V2, suggests that chromatically defined boundaries and shapes are given special status in V4 and raises the possibility that form at equiluminance and form at higher contrasts are processed in separate channels in V4. Introduction nance contrast on chromatic responses is typically facilitatory. Responses of neurons in primate area V4, an intermediate Most neurons in V1, V2, and V3 are sensitive to both luminance stage along the ventral visual pathway, are sensitive to the and color (Gouras and Kruger, 1979; Thorell et al., 1984; Hubel color (Zeki, 1973; Schein and Desimone, 1990) and the ach- and Livingstone, 1990; Lennie et al., 1990; Johnson et al., 2001; romatic luminance of visual stimuli (Schein and Desimone, Hansen and Gegenfurtner, 2007), and the contrast response 1990). But, because studies seldom vary chromaticity and lu- functions in these areas show a characteristic V-shaped pattern minance simultaneously, we do not yet know how luminance (i.e., responses increase, and saturate, with increasing luminance and chromatic signals are multiplexed in area V4. This is an contrasts) (Sclar et al., 1990; Albrecht, 1995; Gegenfurtner et al., important question to address because (1) V4 is known to play an 1997; Kiper et al., 1997). A small fraction of V1 neurons respond important role in form processing (Desimone and Schein, 1987; more strongly to equiluminant stimuli than to luminance stim- Kobatake and Tanaka, 1994); (2) in natural vision, form can be uli, but because these neurons are typically low pass and unori- defined by chromatic contrast, luminance contrast, or both ented (Lennie et al., 1990; Johnson et al., 2001), they are unlikely (Hansen and Gegenfurtner, 2009); and (3) psychophysical stud- to contribute to form encoding. The V1 and V2 neurons ies suggest that both chromatic and luminance contrasts contrib- equipped to encode object boundaries multiplex luminance and ute to form perception (Cavanagh, 1991). Deciphering how color signals (Lennie et al., 1990; Johnson et al., 2001; Shapley and luminance and chrominance signals are combined across the V4 Hawken, 2002; Hansen and Gegenfurtner, 2007). population will advance our understanding of how cortex pro- To discover how luminance contrast modulates the responses duces a unified, invariant perception of form. of V4 neurons to colored stimuli, we studied the responses of Evidence from early stages of visual processing suggests that single neurons in awake monkeys to a set of 25 chromaticities chrominance-defined and luminance-defined form information presented at four different luminance contrasts. As in V1, a ma- is carried by the same neurons and that the influence of lumi- jority of V4 neurons responded to both chromatic and achro- matic stimuli, and luminance contrast had a facilitatory influence on chromatic responses. For a sizable minority, however, equilu- Received April 14, 2011; revised June 25, 2011; accepted July 8, 2011. minant color stimuli evoked the strongest responses, which de- Author contributions: P.J.H., W.B., and A.P. designed research; B.N.B., P.J.H., Y.K., and A.P. performed research; creased when luminance contrasts were added to the chromatic A.P. analyzed data; W.B. and A.P. wrote the paper. stimuli. These equiluminance cells do not fall into previously This work was supported by National Eye Institute Grant R01 EY018839, The Whitehall Foundation, University of Washington Vision Core Grant P30 EY01730, and National Center for Research Resources Grant RR00166. W.B. is established cell classes in V1 or V2, and their shape-selective supportedbytheWellcomeTrustandSt.John’sCollege,Oxford(Oxford,UK).WethankYasmineEl-Shamayleh,Greg properties suggest that these neurons can contribute to the en- Horwitz, and Raghu Pasupathy for helpful discussions and comments. Jalal Baruni and National Primate Research coding of equiluminant colored form. Center Bioengineering provided technical support. Correspondence should be addressed to Anitha Pasupathy, Department of Biological Structure and Washington NationalPrimateResearchCenter,UniversityofWashington,1959PacificStreetNortheast,HSBG-520,Universityof Materials and Methods Washington Mailbox 357420, Seattle, WA 98195. E-mail: [email protected]. Surgery and animal behavior DOI:10.1523/JNEUROSCI.1890-11.2011 Two rhesus monkeys (Macaca mulatta; one male and one female) were Copyright © 2011 the authors 0270-6474/11/3112398-15$15.00/0 surgically implanted with custom-built head posts attached to the skull Bushnell et al. • Equiluminance Cells in V4 J. Neurosci., August 31, 2011 • 31(35):12398–12412 • 12399 with orthopedic screws. After fixation training (see below), a recording chamber was implanted based on structural MRI scans. A craniotomy was performed in a subsequent surgery. For detailed surgical procedures, see Bushnell et al. (2011). All animal procedures conformed to NIH guidelines and were approved by the Institutional Animal Care and Use Committee at the University of Washington. Animals were seated in front of a computer monitor at a distance of 57 cm and were trained to fixate a 0.1° white dot within 0.5–0.75° of visual angle. Eye position was monitored using a 1 kHz infrared eye-tracking system (Eyelink 1000; SR Research). Stimulus presentation and animal behavior were controlled by Linux-based custom software (PYPE; orig- inally developed in the Gallant Laboratory, University of California, Berkeley, Berkeley, CA). Each trial began with the presentation of a fix- ation spot at the center of the screen. Once fixation was acquired, four to six stimuli were presented in succession, each for 300 ms (500 ms for 22 cells), separated by interstimulus intervals of 200 ms. Stimulus onset and offset times were based on photodiode detection of synchronized pulses in the lower left corner of the monitor. Data collection During each recording session, a single dura-puncturing microelectrode (FHC), 250 ␮m in diameter, was lowered into the cortex using an eight- channel acute microdrive system (Gray Matter Research). Signals from the electrode were amplified and filtered and single-neuron activity was isolated using a spike sorting system (Plexon Systems). We targeted dorsal V4 and our electrode penetrations were largely in the prelunate gyrus and occasionally in the adjoining bank of the lunate Figure1. Colorandshapestimuli.A,The25chromaticitiesusedinthestudyareshownintheCIE sulcus. Previous studies suggest that color selective units are clustered in chromaticitydiagram.Thecolorsoccupiedthreetrianglesatincreasingdistancesfromtheachromatic patches, recently termed “globs” (Conway et al., 2007). While the precise point(no.1)andrepresentedthreelevelsofcolorcontrast:colors2–7composedthelowcolorcontrast location of globs varies across animals, combining fMRI and physiology, band; 8–13, the mid color contrast band; and 14–25, the high color contrast band. Each of the 25 Conway and colleagues suggested that globs were less prevalent in dorsal chromaticities was presented at four different luminance contrasts relative to the achromatic V4. We do not know the precise location of globs in our animals, but background labeled 1. B, Shape stimuli used to characterize the shape preferences of neurons. 15–20% of our recorded neurons had hue tuning (see Results) that was A subset (10–29) of these shapes was presented in eight orientations at 45° intervals to study roughly consistent with that attributed to glob regions. shape selectivity. Some shapes that show rotational symmetry were presented at fewer rota- tions. For example, shapes labeled 1 and 2 were presented at two and four rotations, respec- Visual stimuli tively. Shape labeled 1 was used to characterize color and luminance preferences of example Visual stimuli were presented on a CRT monitor (40.6 ϫ 30.5 cm; 97 Hz ϫ neuronswhosedataareshowninFigure2,A,B,andD;shapelabeled2wasusedtocharacterize frame rate; 1600 1200 pixels) calibrated with a spectrophotoradiom-
Recommended publications
  • Arxiv:1907.02116V1 [Q-Bio.NC] 3 Jul 2019
    Multiplicative modulations in hue-selective cells enhance unique hue representation Paria Mehrani1, 2, *, Andrei Mouraviev1, 2, and John K. Tsotsos1, 2 1Department of Electrical Engineering and Computer Science, York University, Toronto, Canada 2The Center for Vision Research, York University, Toronto, Canada [email protected], [email protected], [email protected] There is still much to understand about the color processing mechanisms in the brain and the transformation from cone-opponent representations to perceptual hues. Moreover, it is unclear which areas(s) in the brain represent unique hues. We propose a hierarchical model inspired by the neuronal mechanisms in the brain for local hue representation, which reveals the contributions of each visual cortical area in hue representation. Local hue encoding is achieved through incrementally increasing processing nonlinearities beginning with cone input. Besides employing nonlinear rectifications, we propose multiplicative modulations as a form of nonlinearity. Our simulation results indicate that multiplicative modulations have significant contributions in encoding of hues along intermediate directions in the MacLeod-Boynton diagram and that model V4 neurons have the capacity to encode unique hues. Additionally, responses of our model neurons resemble those of biological color cells, suggesting that our model provides a novel formulation of the brain's color processing pathway. The color processing mechanisms in the primary visual Beyond LGN, studies on multiple regions in the ventral cortex and later processing stages are a target of debate stream show an increase in nonlinearity with respect to among color vision researchers. What is also unclear is the three cone types from LGN to higher brain areas [7] which brain area represents unique hues, those pure col- and also a shift of selectivity toward intermediate hues ors unmixed with other colors.
    [Show full text]
  • Representation of Perceptual Color Space in Macaque Posterior Inferior Temporal Cortex (The V4 Complex)
    New Research Sensory and Motor Systems Representation of Perceptual Color Space in Macaque Posterior Inferior Temporal Cortex (the V4 Complex) †,Thorsten Hansen,3 and Bevil R. Conway1,2 ء,Katherine L. Hermann,1,2 ء,Kaitlin S. Bohon,1,2 DOI:http://dx.doi.org/10.1523/ENEURO.0039-16.2016 1Program in Neuroscience, Wellesley College, Wellesley, Massachusetts 02481, 2Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, Massachusetts 02139, and 3Department of Psychology, Justus Liebig University Giessen, 35396 Giessen, Germany Abstract The lateral geniculate nucleus is thought to represent color using two populations of cone-opponent neurons [L vs M; Svs(Lϩ M)], which establish the cardinal directions in color space (reddish vs cyan; lavender vs lime). How is this representation transformed to bring about color perception? Prior work implicates populations of glob cells in posterior inferior temporal cortex (PIT; the V4 complex), but the correspondence between the neural representation of color in PIT/V4 complex and the organization of perceptual color space is unclear. We compared color-tuning data for populations of glob cells and interglob cells to predictions obtained using models that varied in the color-tuning narrowness of the cells, and the color preference distribution across the populations. Glob cells were best accounted for by simulated neurons that have nonlinear (narrow) tuning and, as a population, represent a color space designed to be perceptually uniform (CIELUV). Multidimensional scaling and representational similarity analyses showed that the color space representations in both glob and interglob populations were correlated with the organization of CIELUV space, but glob cells showed a stronger correlation.
    [Show full text]
  • Color-Opponent Mechanisms for Local Hue Encoding in a Hierarchical Framework
    Color-opponent mechanisms for local hue encoding in a hierarchical framework Paria Mehrani,∗ Andrei Mouraviev,∗ Oscar J. Avella Gonzalez, John K. Tsotsos [email protected], [email protected], [email protected] , [email protected] Abstract L cone A biologically plausible computational model for color rep- M cone resentation is introduced. We present a mechanistic hier- archical model of neurons that not only successfully en- codes local hue, but also explicitly reveals how the con- tributions of each visual cortical layer participating in the process can lead to a hue representation. Our proposed model benefits from studies on the visual cortex and builds a network of single-opponent and hue-selective neurons. Local hue encoding is achieved through gradually increas- ing nonlinearity in terms of cone inputs to single-opponent cells. We demonstrate that our model's single-opponent neurons have wide tuning curves, while the hue-selective neurons in our model V4 layer exhibit narrower tunings, Cone responses as a function of x -4 -2 0 2 4 resembling those in V4 of the primate visual system. Our x simulation experiments suggest that neurons in V4 or later layers have the capacity of encoding unique hues. More- Figure 1: Spatial profile of a single-opponent L+M- cell. over, with a few examples, we present the possibility of The receptive field of this cells receives positive contri- spanning the infinite space of physical hues by combining butions from L cones and negative ones from M cones. the hue-selective neurons in our model. The spatial extent of these cone cells are different and Keywords| Single-opponent, Hue, Hierarchy, Visual determines the mechanism for this cell.
    [Show full text]
  • Multiplicative Modulations Enhance Diversity of Hue-Selective Cells Paria Mehrani✉, Andrei Mouraviev & John K
    www.nature.com/scientificreports OPEN Multiplicative modulations enhance diversity of hue-selective cells Paria Mehrani✉, Andrei Mouraviev & John K. Tsotsos There is still much to understand about the brain’s colour processing mechanisms and the transformation from cone-opponent representations to perceptual hues. Moreover, it is unclear which area(s) in the brain represent unique hues. We propose a hierarchical model inspired by the neuronal mechanisms in the brain for local hue representation, which reveals the contributions of each visual cortical area in hue representation. Hue encoding is achieved through incrementally increasing processing nonlinearities beginning with cone input. Besides employing nonlinear rectifcations, we propose multiplicative modulations as a form of nonlinearity. Our simulation results indicate that multiplicative modulations have signifcant contributions in encoding of hues along intermediate directions in the MacLeod-Boynton diagram and that our model V2 neurons have the capacity to encode unique hues. Additionally, responses of our model neurons resemble those of biological colour cells, suggesting that our model provides a novel formulation of the brain’s colour processing pathway. Te colour processing mechanisms in the primary visual cortex and later processing stages are a target of debate among colour vision researchers. What is also unclear is which brain area represents unique hues, those pure colours unmixed with other colours. In spite of a lack of agreement on colour mechanisms in higher visual areas, human visual system studies confrm that colour encoding starts with three types of cones sensitive to long (L), medium (M) and short (S) wavelengths, forming the LMS colour space. Cones send opponent feedforward sig- nals to LGN cells with single-opponent receptive felds1–3.
    [Show full text]
  • Color-Tuned Neurons Are Spatially Clustered According to Color Preference Within Alert Macaque Posterior Inferior Temporal Cortex
    Color-tuned neurons are spatially clustered according to color preference within alert macaque posterior inferior temporal cortex Bevil R. Conwaya,1 and Doris Y. Tsaob aNeuroscience Program, Wellesley College, Wellesley, MA 02481; and bDivision of Biology, Caltech, Pasadena, CA 91125 Edited by David H. Hubel, Harvard Medical School, Boston, MA, and approved August 21, 2009 (received for review October 29, 2008) Large islands of extrastriate cortex that are enriched for color- referred to as the V4 complex (9). The scale of the globs is similar tuned neurons have recently been described in alert macaque to the size of the patches of labeled cells found in the posterior using a combination of functional magnetic resonance imaging inferior temporal cortex (PIT) following anterograde injections (fMRI) and single-unit recording. These millimeter-sized islands, of tracer into the subcompartments of V2 (cytochrome-oxidase dubbed ‘‘globs,’’ are scattered throughout the posterior inferior thin stripes) that are especially concerned with encoding color temporal cortex (PIT), a swath of brain anterior to area V3, (10–12). fMRI-guided single-unit recording targeting the globs including areas V4, PITd, and posterior TEO. We investigated the reveals that the vast majority of glob cells are color-tuned (7). micro-organization of neurons within the globs. We used fMRI to The color tuning of this population strongly suggests its involve- identify the globs and then used MRI-guided microelectrodes to ment in color perception (13, 14), but it remains unknown if the test the color properties of single glob cells. We used color stimuli cells are organized within the globs, as might be expected that sample the CIELUV perceptual color space at regular intervals following Barlow’s hypothesis.
    [Show full text]
  • A Tour of Contemporary Color Vision Research 2 3 Bevil R
    1 1 A tour of contemporary color vision research 2 3 Bevil R. Conway1, Rhea T. Eskew Jr2, Paul R. Martin3 and Andrew Stockman4 4 5 1National Eye Institute and National Institute of Mental Health, National Institutes of Health, 6 Bethesda, MD 20892 7 2Department of Psychology, 125 Nightingale Hall, Northeastern University, Boston MA 02115, 8 USA 9 3Save Sight Institute and School of Medical Sciences, The University of Sydney, Sydney, New 10 South Wales, Australia 11 4UCL Institute of Ophthalmology, University College London, 11-43 Bath Street, London EC1V 12 9EL, England 13 14 15 16 Abstract 17 The study of color vision encompasses many disciplines, including art, biochemistry, 18 biophysics, brain imaging, cognitive neuroscience, color preferences, colorimetry, computer 19 modelling, design, electrophysiology, language and cognition, molecular genetics, neuroscience, 20 physiological optics, psychophysics and physiological optics. Coupled with the elusive nature 21 of the subjective experience of color, this wide range of disciplines makes the study of color as 22 challenging as it is fascinating. This overview of the special issue Color: Cone Opponency and 23 Beyond outlines the state of the science of color, and points to some of the many questions that 24 remain to be answered in this exciting field. 25 26 2 1 2 The study of color is perhaps the oldest discipline of psychology. For the ancient Greeks, 3 colors took fifth place after the classical elements of fire, air, water, and earth (see page 28 of 4 Kuehni & Schwarz, 2008). Helmholtz’s observation that colors can be created by superposing 5 three primaries (von Helmholtz, 1867), and Maxwell’s measurements of the proportions of 6 primary lights (positive and negative) required to make the match (Maxwell, 1860), paved the 7 way to our first scientific understanding of the psychological representation of color (Maxwell, 8 1860).
    [Show full text]
  • Hue Tuning Curves in V4 Change with Visual Context
    bioRxiv preprint doi: https://doi.org/10.1101/780478; this version posted September 4, 2020. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is made available under aCC-BY-NC-ND 4.0 International license. 1 Hue tuning curves in V4 change with visual context 2 Ari S. Benjamin!*, Pavan Ramkumar#, , Hugo Fernandes#, Matthew Smith',(,), Konrad P. Kording, 3 . Department of Bioengineering, University of Pennsylvania, Philadelphia, PA 4 . Department of Physical Medicine and Rehabilitation, Northwestern University and Shirley Ryan Ability Lab, 5 Chicago, IL 6 . System> Biosciences, San Francisco, CA 7 . Department of Biomedical Engineering, Carnegie Mellon University, Pittsburgh, PA 8 . Carnegie Mellon Neuroscience Institute, Pittsburgh, PA 9 6. Department of Ophthalmology, University of Pittsburgh, Pittsburgh, PA 10 7. *Correspondence: [email protected] 1 bioRxiv preprint doi: https://doi.org/10.1101/780478; this version posted September 4, 2020. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is made available under aCC-BY-NC-ND 4.0 International license. 11 Summary 12 To understand activity in the higher visual cortex, researchers typically investigate how parametric changes 13 in stimuli affect neural activity. These experiments reveal neurons’ general response properties only when 14 the effect of a parameter in synthetic stimuli is representative of its effect in other visual contexts. However, 15 in higher visual cortex it is rarely verified how well tuning to parameters of simplified experimental stimuli 16 represents tuning to those parameters in complex or naturalistic stimuli.
    [Show full text]
  • Neurophysiological Correlates of Color Vision: a Model
    Psychology & Neuroscience, 2013, 6, 2, 213 - 218 DOI: 10.3922/j.psns.2013.2.09 Neurophysiological correlates of color vision: a model Arne Valberg1 and Thorstein Seim2 1- Norwegian University of Science and Technology, Trondheim, ST, Norway 2- MikroSens, Slependen, AK, Norway Abstract The tree-receptor theory of human color vision accounts for color matching. A bottom-up, non-linear model combining cone signals in six types of cone-opponent cells in the lateral geniculate nucleus (LGN) of primates describes the phenomenological dimensions hue, color strength, and lightness/brightness. Hue shifts with light intensity (the Bezold-Brücke phenomenon), and saturation (the Abney effect) are also accounted for by the opponent model. At the threshold level, sensitivities of the more sensitive primate cells correspond well with human psychophysical thresholds. Conventional Fourier analysis serves well in dealing with the discrimination data, but here we want to take a look at non-linearity, i.e., the neural correlates to perception of color phenomena for small and large fields that span several decades of relative light intensity. We are particularly interested in the mathematical description of spectral opponency, receptive fields, the balance of excitation and inhibition when stimulus size changes, and retina-to-LGN thresholds. Keywords: human color vision, opponent theory, three-color theory, three-receptor theory, perception, neuroscience. Received 1 February 2012; received in revised form 2 July 2012; accepted 16 July 2012. Available online 18 November 2013. Introduction and Russell De Valois (1965) in the U.S. started Current neuroscience has a good understanding of the recording the activity of single neurons in the primate three-receptor theory of color vision, but the opponent- visual pathway.
    [Show full text]
  • Color-Tuned Neurons Are Spatially Clustered According to Color Preference Within Alert Macaque Posterior Inferior Temporal Cortex
    Color-tuned neurons are spatially clustered according to color preference within alert macaque posterior inferior temporal cortex Bevil R. Conwaya,1 and Doris Y. Tsaob aNeuroscience Program, Wellesley College, Wellesley, MA 02481; and bDivision of Biology, Caltech, Pasadena, CA 91125 Edited by David H. Hubel, Harvard Medical School, Boston, MA, and approved August 21, 2009 (received for review October 29, 2008) Large islands of extrastriate cortex that are enriched for color- referred to as the V4 complex (9). The scale of the globs is similar tuned neurons have recently been described in alert macaque to the size of the patches of labeled cells found in the posterior using a combination of functional magnetic resonance imaging inferior temporal cortex (PIT) following anterograde injections (fMRI) and single-unit recording. These millimeter-sized islands, of tracer into the subcompartments of V2 (cytochrome-oxidase dubbed ‘‘globs,’’ are scattered throughout the posterior inferior thin stripes) that are especially concerned with encoding color temporal cortex (PIT), a swath of brain anterior to area V3, (10–12). fMRI-guided single-unit recording targeting the globs including areas V4, PITd, and posterior TEO. We investigated the reveals that the vast majority of glob cells are color-tuned (7). micro-organization of neurons within the globs. We used fMRI to The color tuning of this population strongly suggests its involve- identify the globs and then used MRI-guided microelectrodes to ment in color perception (13, 14), but it remains unknown if the test the color properties of single glob cells. We used color stimuli cells are organized within the globs, as might be expected that sample the CIELUV perceptual color space at regular intervals following Barlow’s hypothesis.
    [Show full text]