Perception of Visual Motion
Total Page:16
File Type:pdf, Size:1020Kb
Load more
Recommended publications
-
The Hodgkin-Huxley Neuron Model for Motion Detection in Image Sequences Hayat Yedjour, Boudjelal Meftah, Dounia Yedjour, Olivier Lézoray
The Hodgkin-Huxley neuron model for motion detection in image sequences Hayat Yedjour, Boudjelal Meftah, Dounia Yedjour, Olivier Lézoray To cite this version: Hayat Yedjour, Boudjelal Meftah, Dounia Yedjour, Olivier Lézoray. The Hodgkin-Huxley neuron model for motion detection in image sequences. Neural Computing and Applications, Springer Verlag, In press, 10.1007/s00521-021-06446-0. hal-03331961 HAL Id: hal-03331961 https://hal.archives-ouvertes.fr/hal-03331961 Submitted on 2 Sep 2021 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. Noname manuscript No. (will be inserted by the editor) The Hodgkin{Huxley neuron model for motion detection in image sequences Hayat Yedjour · Boudjelal Meftah · Dounia Yedjour · Olivier L´ezoray Received: date / Accepted: date Abstract In this paper, we consider a biologically-inspired spiking neural network model for motion detection. The proposed model simulates the neu- rons' behavior in the cortical area MT to detect different kinds of motion in image sequences. We choose the conductance-based neuron model of the Hodgkin-Huxley to define MT cell responses. Based on the center-surround antagonism of MT receptive fields, we model the area MT by its great pro- portion of cells with directional selective responses. -
Table of Contents and Index
CONTENTS 1. Thinking about Space 1 2. The Ways of Light 7 3. Sensing Our Own Shape 51 4. Brain Maps and Polka Dots 69 5. Sherlock Ears 107 6. Moving with Maps and Meters 143 7. Your Sunglasses Are in the Milky Way 161 8. Going Places 177 9. Space and Memory 189 10. Thinking about Thinking 203 Notes 219 Acknowledgments 225 Credits 231 Index 237 Color illustrations follow page 86 Groh Corrected Pages.indd 7 7/15/14 9:09 AM INDEX Italicized page numbers refer to figures and their captions acalculia, 214 aqueous humor, 22, 30, 31 action potentials, 56–59, 57, 60, 61, 71–72, 74, Aristotle, 24, 180 94–96, 140, 146; electrically stimulating, astronomy, and discoveries regarding optics, 102; and memory, 191; in MT, 99; in 26–32. See also Brahe, Tycho; Kepler, superior colliculus, 154. See also spikes, Johannes electrical in neurons axon: conduction speed along, 95; as part of active sites, of proteins, 17 neuron, 71–73; paths traveled by, 77–78, adjusting to new glasses, 192–193 86, 91, 93 akinetopsia, 100 alcohol, effects on vestibular system, 183–184 balance, sense of, 175, 180–185. See also Alhazen, 8, 11–12 vestibular system aliasing, of sound, 123–125 barn owls, and hearing, 122, 137–138, 157, analog coding, in the brain, 146–147. See also Plate 7 digital coding, in the brain; maps, as form basilar membrane, resonance gradient of, of brain code; meters, as form of brain 139–140; and sound transduction, 109, 110 code bats, and echolocation, 131–132, 132 anechoic, 127 Bergen, Edgar, 135 ants, and navigation, 185–187, Plate 9 biased random walk, and navigation, 178. -
Capture of Stereopsis and Apparent Motion by Illusory Contours
Perception & Psychophysics 1986, 39 (5), 361-373 Capture of stereopsis and apparent motion by illusory contours V. S. RAMACHANDRAN University of California, San Diego, La Jolla, California The removal of right-angle sectors from four circular black disks created the impression of a white "subjective" square with its four corners occluding the disks ("illusory contours"). The dis play in one eye was identical to that in the other except that for one eye a horizontal disparity was introduced between the edges of the cut sectors so that an illusory white square floated out in front of the paper. When a "template" ofthis stereogram was superimposed on a vertical square wave grating (6 cycles/deg) the illusory square pulled the corresponding lines of grating forward even though the grating was at zero disparity. (Capture was not observed if the template was superimposed on horizontal gratings; the grating remained flush with the background). Analo gous effects were observed in apparent motion ("motion capture"). Removal of sectors from disks in an appropriately timed sequence generated apparent motion of an illusory square. When a template of this display was superimposed on a grating, the lines appeared to move vividly with the square even though they were physically stationary. It was concluded that segmentation of the visual scene into surfaces and objects can profoundly influence the early visual processing of stereopsis and apparent motion. However, there are interesting differences between stereo cap ture and motion capture, which probably reflect differences in natural constraints. The implica tions of these findings for computational models of vision are discussed. -
Unsupervised Learning of a Hierarchical Spiking Neural Network for Optical Flow Estimation: from Events to Global Motion Perception
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2019 1 Unsupervised Learning of a Hierarchical Spiking Neural Network for Optical Flow Estimation: From Events to Global Motion Perception Federico Paredes-Valles´ , Kirk Y. W. Scheper , and Guido C. H. E. de Croon , Member, IEEE Abstract—The combination of spiking neural networks and event-based vision sensors holds the potential of highly efficient and high-bandwidth optical flow estimation. This paper presents the first hierarchical spiking architecture in which motion (direction and speed) selectivity emerges in an unsupervised fashion from the raw stimuli generated with an event-based camera. A novel adaptive neuron model and stable spike-timing-dependent plasticity formulation are at the core of this neural network governing its spike-based processing and learning, respectively. After convergence, the neural architecture exhibits the main properties of biological visual motion systems, namely feature extraction and local and global motion perception. Convolutional layers with input synapses characterized by single and multiple transmission delays are employed for feature and local motion perception, respectively; while global motion selectivity emerges in a final fully-connected layer. The proposed solution is validated using synthetic and real event sequences. Along with this paper, we provide the cuSNN library, a framework that enables GPU-accelerated simulations of large-scale spiking neural networks. Source code and samples are available at https://github.com/tudelft/cuSNN. Index Terms—Event-based vision, feature extraction, motion detection, neural nets, neuromorphic computing, unsupervised learning F 1 INTRODUCTION HENEVER an animal endowed with a visual system interconnected cells for motion estimation, among other W navigates through an environment, turns its gaze, or tasks. -
The Role of Selective Attention in Perceptual Switching By
The Role of Selective Attention in Perceptual Switching By Brenda Marie Stoesz A Thesis Submitted to the Faculty of Graduate Studies In Partial Fulfillment of the Requirements For the Degree of Master of Arts Department of Psychology University of Manitoba Winnipeg, Manitoba © Stoesz, Brenda M.; 2008 Perceptual Switching ii Abstract When viewing ambiguous figures, individuals can exert selective attentional control over their perceptual reversibility behaviour (e.g., Strüber & Stadler, 1999). In the current study, we replicated this finding but we also found that ambiguous figures containing faces are processed quite differently from those containing objects. Furthermore, inverting an ambiguous figure containing faces (i.e., Rubin’s vase-face) resulted in an “inversion effect”. These findings highlight the importance of considering how we attend to faces in addition to how we perceive and process faces. Describing the perceptual reversal patterns of individuals in the general population allowed us to draw comparisons to behaviours exhibited by individuals with Asperger Syndrome (AS). The group data suggested that these individuals were less affected by figure type or stimulus inversion. Examination of individual scores, moreover, revealed that the majority of participants with AS showed an atypical reversal pattern, particularly with ambiguous figures containing faces, and an atypical inversion effect. Together, our results show that ambiguous figures can be a very valuable tool for examining face processing mechanisms in the general population and other distinct groups of individuals, particularly those diagnosed with AS. Perceptual Switching iii Acknowledgements I would like to deeply thank my mentor, Dr. Lorna S. Jakobson, who, over the year that I have worked on this particular research project, provided me with much support and guidance. -
Human Visual Motion Perception Shows Hallmarks of Bayesian Structural Inference Sichao Yang1,2,6*, Johannes Bill3,4,6*, Jan Drugowitsch3,5,7 & Samuel J
www.nature.com/scientificreports OPEN Human visual motion perception shows hallmarks of Bayesian structural inference Sichao Yang1,2,6*, Johannes Bill3,4,6*, Jan Drugowitsch3,5,7 & Samuel J. Gershman4,5,7 Motion relations in visual scenes carry an abundance of behaviorally relevant information, but little is known about how humans identify the structure underlying a scene’s motion in the frst place. We studied the computations governing human motion structure identifcation in two psychophysics experiments and found that perception of motion relations showed hallmarks of Bayesian structural inference. At the heart of our research lies a tractable task design that enabled us to reveal the signatures of probabilistic reasoning about latent structure. We found that a choice model based on the task’s Bayesian ideal observer accurately matched many facets of human structural inference, including task performance, perceptual error patterns, single-trial responses, participant-specifc diferences, and subjective decision confdence—especially, when motion scenes were ambiguous and when object motion was hierarchically nested within other moving reference frames. Our work can guide future neuroscience experiments to reveal the neural mechanisms underlying higher-level visual motion perception. Motion relations in visual scenes are a rich source of information for our brains to make sense of our environ- ment. We group coherently fying birds together to form a fock, predict the future trajectory of cars from the trafc fow, and infer our own velocity from a high-dimensional stream of retinal input by decomposing self- motion and object motion in the scene. We refer to these relations between velocities as motion structure. -
In This Research Report We Will Explore the Gestalt Principles and Their Implications and How Human’S Perception Can Be Tricked
The Gestalt Principles and there role in the effectiveness of Optical Illusions. By Brendan Mc Kinney Abstract Illusion are created in human perception in relation to how the mind process information, in this regard on to speculate that the Gestalt Principles are a key process in the success of optical illusions. To understand this principle the research paper will examine several optical illusions in the hopes that they exhibit similar traits used in the Gestalt Principles. In this research report we will explore the Gestalt Principles and their implications and how human’s perception can be tricked. The Gestalt Principles are the guiding principles of perception developed from testing on perception and how human beings perceive their surroundings. Human perception can however be tricked by understanding the Gestalt principles and using them to fool the human perception. The goal of this paper is to ask how illusions can be created to fool human’s perception using the gestalt principles as a basis for human’s perception. To examine the supposed, effect the Gestalt Principles in illusions we will look at three, the first being Rubin’s Vase, followed by the Penrose Stairs and the Kanizsa Triangle to understand the Gestalt Principles in play. In this context we will be looking at Optical Illusion rather than illusions using sound to understand the Gestalt Principles influence on human’s perception of reality. Illusions are described as a perception of something that is inconsistent with the actual reality (dictionary.com, 2015). How the human mind examines the world around them can be different from the actuality before them, this is due to the Gestalt principles influencing people’s perception. -
Springer Science+Business Media, LLC, Part of Springer Nature 2019 D
F Figure-Ground Segregation, Once figure-ground segmentation is achieved, Computational Neural the figure region often delineates a zone of addi- Models of tional attentive visual processing. Arash Yazdanbakhsh1 and Ennio Mingolla2 1 Computational Neuroscience and Vision Lab, Detailed Description Department of Psychological and Brain Sciences, Graduate Program for Neuroscience (GPN), The Importance of Figure-Ground Center for Systems Neuroscience (CSN), Center Segregation for Research in Sensory Communications and Visual function in animals has broadly increased Neural Technology (CReSCNT), Boston in complexity and competence across eons of University, Boston, MA, USA fi 2 evolution, with gure-ground perception being Department of Communication Sciences and among the later and more intriguing achieve- Disorders, Bouvé College of Health Sciences, ments of relatively sophisticated visual species. Northeastern University, Boston, MA, USA The importance of figure-ground perception can be seen by considering its advantages to animals that have the capability, as compared to the visual Definition limitations of animals whose visual systems do not support figure-ground perception (Land and Figure-ground segregation refers to the capacity Nilsson 2002). For example, the single-celled of a visual system to rapidly and reliably pick out euglena can use its eyespot and flagellum to orient for greater visual analysis, attention, or awareness, its locomotion in a light field, but it cannot take or preparation for motor action, a region of the account of the edges of individual objects in the visual field (figure) that is distinct from the com- sense of figure-ground for purposes of steering. bined areas of all the rest of the visual field Arrays of visual receptors that sample different (ground). -
Motion-In-Depth Perception and Prey Capture in the Praying Mantis Sphodromantis Lineola
© 2019. Published by The Company of Biologists Ltd | Journal of Experimental Biology (2019) 222, jeb198614. doi:10.1242/jeb.198614 RESEARCH ARTICLE Motion-in-depth perception and prey capture in the praying mantis Sphodromantis lineola Vivek Nityananda1,*, Coline Joubier1,2, Jerry Tan1, Ghaith Tarawneh1 and Jenny C. A. Read1 ABSTRACT prey as they come near. Just as with depth perception, several cues Perceiving motion-in-depth is essential to detecting approaching could contribute to the perception of motion-in-depth. or receding objects, predators and prey. This can be achieved Two of the motion-in-depth cues that have received the most using several cues, including binocular stereoscopic cues such attention in humans are binocular: changing disparity and as changing disparity and interocular velocity differences, and interocular velocity differences (IOVDs) (Cormack et al., 2017). monocular cues such as looming. Although these have been Stereoscopic disparity refers to the difference in the position of an studied in detail in humans, only looming responses have been well object as seen by the two eyes. This disparity reflects the distance to characterized in insects and we know nothing about the role of an object. Thus as an object approaches, the disparity between the stereoscopic cues and how they might interact with looming cues. We two views changes. This changing disparity cue suffices to create a used our 3D insect cinema in a series of experiments to investigate perception of motion-in-depth for human observers, even in the the role of the stereoscopic cues mentioned above, as well as absence of other cues (Cumming and Parker, 1994). -
The Figure Is in the Brain of the Beholder: Neural Correlates of Individual Percepts in The
The Figure is in the Brain of the Beholder: Neural Correlates of Individual Percepts in the Bistable Face-Vase Image A Thesis Presented to The Division of Philosophy, Religion, Psychology, and Linguistics Reed College In Partial Fulfillment of the Requirements for the Degree Bachelor of Arts Phoebe Bauer May 2015 Approved for the Division (Psychology) Michael Pitts Acknowledgments I think some people experience a degree of unease when being taken care of, so they only let certain people do it, or they feel guilty when it happens. I don’t really have that. I love being taken care of. Here is a list of people who need to be explicitly thanked because they have done it so frequently and are so good at it: Chris: thank you for being my support system across so many contexts, for spinning with me, for constantly reminding me what I’m capable of both in and out of the lab. Thank you for validating and often mirroring my emotions, and for never leaving a conflict unresolved. Rennie: thank you for being totally different from me and yet somehow understanding the depths of my opinions and thought experiments. Thank you for being able to talk about magic. Thank you for being my biggest ego boost and accepting when I internalize it. Ben: thank you for taking the most important classes with me so that I could get even more out of them by sharing. Thank you for keeping track of priorities (quality dining: yes, emotional explanations: yes, fretting about appearances: nu-uh). #AshHatchtag & Stella & Master Tran: thank you for being a ceaseless source of cheer and laughter and color and love this year. -
Do 3D Visual Illusions Work for Immersive Virtual Environments?
Do 3D Visual Illusions Work for Immersive Virtual Environments? Filip Skolaˇ Roman Gluszny Fotis Liarokapis CYENS – Centre of Excellence Solarwinds CYENS – Centre of Excellence Nicosia, Cyprus Brno, Czech Republic Nicosia, Cyprus [email protected] [email protected] [email protected] Abstract—Visual illusions are fascinating because visual per- The majority of visual illusions are generated by two- ception misjudges the actual physical properties of an image or dimensional pictures and their motions [9], [10]. But there are a scene. This paper examines the perception of visual illusions not a lot of visual illusions that make use of three-dimensional in three-dimensional space. Six diverse visual illusions were im- plemented for both immersive virtual reality and monitor based (3D) shapes [11]. Visual illusions are now slowly making their environments. A user-study with 30 healthy participants took appearance in serious games and are unexplored in virtual place in laboratory conditions comparing the perceptual effects reality. Currently, they are usually applied in the fields of brain of the two different mediums. Experimental data were collected games, puzzles and mini games. from both a simple ordering method and electrical activity of the However, a lot of issues regarding the perceptual effects brain. Results showed unexpected outcomes indicating that only some of the illusions have a stronger effect in immersive virtual are not fully understood in the context of digital games. reality, others in monitor based environments while the rest with An overview of electroencephalography (EEG) based brain- no significant effects. computer interfaces (BCIs) and their present and potential Index Terms—virtual reality, visual illusions, perception, hu- uses in virtual environments and games has been recently man factors, games documented [12]. -
Motion Processing in Human Visual Cortex
1 Motion Processing in Human Visual Cortex Randolph Blake*, Robert Sekuler# and Emily Grossman* *Vanderbilt Vision Research Center, Nashville TN 37203 #Volen Center for Complex Systems, Brandeis University, Waltham MA 02454 Acknowledgments. The authors thank David Heeger, Alex Huk, Nestor Matthews and Mark Nawrot for comments on sections of this chapter. David Bloom helped greatly with manuscript formatting and references. During preparation of this chapter RB and EG were supported by research grants from the National Institutes of Health (EY07760) and the National Science Foundation (BCS0121962) and by a Core Grant from the National Institutes of Health (EY01826) awarded to the Vanderbilt Vision Research Center. [email protected] 2 During the past few decades our understanding of the neural bases of visual perception and visually guided actions has advanced greatly; the chapters in this volume amply document these advances. It is fair to say, however, that no area of visual neuroscience has enjoyed greater progress than the physiology of visual motion perception. Publications dealing with visual motion perception and its neural bases would fill volumes, and the topic remains central within the visual neuroscience literature even today. This chapter aims to provide an overview of brain mechanisms underlying human motion perception. The chapter comprises four sections. We begin with a short review of the motion pathways in the primate visual system, emphasizing work from single-cell recordings in Old World monkeys; more extensive reviews of this literature appear elsewhere.1,2 With this backdrop in place, the next three sections concentrate on striate and extra-striate areas in the human brain that are implicated in the perception of motion.