Vision: From Eye to Brain (Chap 3, Part B)
Lecture 7
Jonathan Pillow Sensation & Perception (PSY 345 / NEU 325) Princeton University, Spring 2015
1 more “channels”: spatial frequency channels spatial frequency: the number of cycles of a grating per unit of visual angle (usually specified in degrees) • think of it as: # of bars per unit length
low frequency intermediate high frequency
2 Why sine gratings? • Provide useful decomposition of images
Technical term: Fourier decomposition
3 Fourier decomposition • mathematical decomposition of an image (or sound) into sine waves. reconstruction: “image” 1 sine wave
2 sine waves
3 sine waves
4 sine waves
4 “Fourier Decomposition” theory of V1 claim: role of V1 is to do “Fourier decomposition”, i.e., break images down into a sum of sine waves
• Summation of two spatial sine waves • any pattern can be broken down into a sum of sine waves
5 Fourier decomposition • mathematical decomposition of an image (or sound) into sine waves.
Original image High Frequencies Low Frequencies
6 original
low medium high
7 Retinal Ganglion Cells: tuned to spatial frequency
Response of a ganglion cell to sine gratings of different frequencies
8 The contrast sensitivity function
Human contrast sensitivity illustration of this sensitivity
9 Image Illustrating Spatial Frequency Channels
10 Image Illustrating Spatial Frequency Channels
11 If it is hard to tell who this famous person is, try squinting or defocusing
“Lincoln illusion” Harmon & Jules 1973
12 “Gala Contemplating the Mediterranean Sea, which at 30 meters becomes the portrait of Abraham Lincoln (Homage to Rothko)”
- Salvador Dali (1976)
13 “Gala Contemplating the Mediterranean Sea, which at 30 meters becomes the portrait of Abraham Lincoln (Homage to Rothko)”
- Salvador Dali (1976)
14 lateral geniculate nucleus (LGN): one on each side of the brain • this is where axons of retinal ganglion cells synapse
Organization: • represents contralateral visual field • segregated into eye- specific layers • segregated into M and P layers
Ipsilateral: Referring to the same side of the body Contralateral: Referring to the opposite side of the body
15 Primary Visual Cortex
• Striate cortex: known as primary visual cortex, or V1 • “Primary visual cortex” = first place in cortex where visual information is processed
(Previous two stages: retina and LGN are pre-cortical)
16 Receptive Fields: monocular vs. binocular
- LGN cells: responds to one eye or the other, never both
LGN
V1 - V1 cells: can respond to input from both eyes • By the time information gets to V1, inputs from both eyes have been combined (but V1 neurons still tend to have a preferred eye - they spike more to input from one eye)
17 Topography: mapping of objects in space onto the visual cortex
• contralateral representation - each visual field (L/R) represented in opposite hemisphere
• cortical magnification - unequal representation of fovea vs. periphery in cortex - a misnomer, because “magnification” already present in retina
(that is, the amount of space in cortex for each part of the visual field is given by the number of fibers coming in from LGN)
18 Acuity in V1
Visual acuity declines in an orderly fashion with eccentricity—distance from the fovea (in deg)
19 V1 receptive fields: elongated regions of space
Major change in representation: • Circular receptive fields (retina & LGN) replaced by elongated “stripe” receptive fields in cortex • Has ~ 200 million cells! • (vs. 1 million Retinal Ganglion Cells)
20 Orientation tuning: • neurons in V1 respond more to bars of certain orientations • response rate falls off with difference from preferred orientation “preferred orientation” “preferred
21 Receptive Fields in V1
Many cortical cells respond especially well to: • Moving lines • Bars • Edges • Gratings • Direction of motion
Ocular dominance: • Cells in V1 tend to have a “preferred eye” (i.e., respond better to inputs from one eye than the other)
22 Simple vs. Complex Cells
23 Receptive Fields in V1
Cells in V1 respond best to bars of light rather than to spots of light • “simple” cells: prefer bars of light, or prefer bars of dark • “complex” cells: respond to both bars of light and dark
[Hubel & Weisel movie]
24 Column: a vertical arrangement of neurons
• ocular dominance • orientation column: column: for particular for a particular location in location in cortex, neurons cortex, neurons have same have same preferred eye preferred orientation
25 Hypercolumn - contains all possible columns
• Hypercolumn: 1-mm block of V1 containing “all the machinery necessary to look after everything the visual cortex is responsible for, in a certain small part of the visual world” (Hubel, 1982
• Each hypercolumn contains a full set of columns - has cells responding to every possible orientation, and inputs from left right eyes
26 web demos receptive fields http://sites.sinauer.com/wolfe4e/wa03.04.html columns http://sites.sinauer.com/wolfe4e/wa03.05.html
27 Adaptation
28 Adaptation: the Psychologist’s Electrode
“tilt after-effect”
29 Adaptation: the Psychologist’s Electrode
“tilt after-effect”
• perceptual illusion of tilt, provided by adapting to a pattern of a given orientation
• supports idea that the human visual system contains individual neurons selective for different orientations
30 Adaptation: the Psychologist’s Electrode
Adaptation: the diminishing response of a sense organ to a sustained stimulus
• An important method for deactivating groups of neurons without surgery
• Allows selective temporary “knock out” of group of neurons by activating them strongly
31 Effects of adaptation on population response and perception
Before Adaptation 0 degree stimulus
unadapted population resp to 0 deg
Stimulus presented =
32 Effects of adaptation on population response and perception
Then adapt to 20º Before Adaptation
unadapted population resp to 0 deg
Stimulus presented =
33 Selective adaptation alters neural responses and perception
After Adaptation perceptual effect of adaptation is repulsion away from the adapter
Stimulus presented =
34 Selective Adaptation: The Psychologist’s Electrode
Selective adaptation for spatial frequency: Evidence that human visual system contains neurons selective for spatial frequency
35 Adaptation that is specific to spatial frequency (SF)
1. adapt 2. test
3. percept
36 Adaptation that is specific to spatial frequency (SF)
1. adapt 2. test
3. percept
37 Adaptation that is specific to spatial frequency (SF)
1. adapt 2. test
3. percept
38 Adaptation that is specific to spatial frequency AND orientation
1. adapt 2. test
3. No adaptive percept
39 Adaptation that is specific to spatial frequency AND orientation
1. adapt 2. test
3. No adaptive percept
40 Adaptation that is specific to spatial frequency AND orientation
1. adapt 2. test
3. No adaptive percept
41 Selective Adaptation: The Psychologist’s Electrode
Orthodox viewpoint: • If you can observe a particular type of adaptive after-effect, there is a certain neuron in the brain that is selective (or tuned) for that property
THUS (for example):
There are no neurons tuned for spatial frequency across all orientations, because adaptation is orientation specific.
42 Selective Adaptation: The Psychologist’s Electrode
adapting spatial freq
contrast sensitivity after threshold increases near width of “channels” adaptation to a sine the adapted frequency that contribute to wave with a frequency contrast sensitivity of 7 cycles/degree.
43 Selective Adaptation: The Psychologist’s Electrode
adapting spatial freq
Therefore: • adaptation reveals separate channels devoted to orientation and spatial frequencies • width of adaptive effect reveals the width of the channel
44 The Development of Spatial Vision • how can you study the vision of infants who can’t yet speak?
1. preferential-looking paradigm - infants prefer to look at more complex stimuli
45 The Development of Spatial Vision • how can you study the vision of infants who can’t yet speak?
2. visually evoked potentials (VEP) - measure brain’s electrical activity directly
46 The Development of Spatial Vision
young children: not very sensitive to high spatial frequencies
• Visual system is still developing ! Cones and rods are still developing and taking final shape ! Retinal ganglion cells are still migrating and growing connections with the fovea ! The fovea itself has not fully developed until about 4 years of age
47 Summary • early visual pathway: retina -> LGN -> V1 • “contralateral” representations in visual pathway • visual acuity (vs. sensitivity) • spatial frequency channels • Fourier analysis • spatial frequency sensitivity & tuning • V1 receptive fields, orientation tuning • Hubel & Weisel experiments • simple vs. complex cells • cortical magnification • cortical columns, hypercolumns • adaptation
48