VISUAL PERCEPTION an Information-Based Approach to Understanding Biological and Artificial Vision

Total Page:16

File Type:pdf, Size:1020Kb

VISUAL PERCEPTION an Information-Based Approach to Understanding Biological and Artificial Vision VISUAL PERCEPTION An Information-based Approach to Understanding Biological and Artificial Vision by Noel A. Murphy B.A.(Mod) Submitted in fulfilment of the requirements for the degree of DOCTOR OF PHILOSOPHY Supervised by Prof. Charles McCorkell School of Electronic Engineering Dublin City University Dublin 9 Ireland September 1992 I hereby certify that this material, which I now submit for assessment on the programme of study leading to the award of Doctor of Philosophy is entirely my own work, and has not been taken from the work of others save and to the extent that such work has been cited and acknowledged within the text of my work Dedication To Karina, for all her love, support, patience and understanding, especially over the last three years. To Mum and Dad, Brigid and Michael Murphy, who have given me enormous support right through my education and who have never seen me lacking for anything. Acknowledgements I would like to thank my supervisor, Prof. Charles McCorkell, a man of great patience and forbearance for giving me the opportunity to cany out this work at a critical stage of my career, for giving me the opportunity to discover that lecturing (in moderate quantities) and research (in immoderate quantities) were two things that I would find enormously fulfilling, and for the constant help, support and guidance throughout the long road to this dissertation. I have had contact with many fellow students, and students of my own, in my years in the NIHE and now DCU. Particular names that spring to mind are Brian Buggy who started the same week as me and was a great friend and colleague throughout, Gearoid Mooney, Mark McDonnell, Jim Gunning and the many fourth-year B.Eng project students and who helped in various aspects of the project. For their interest, support and encouragement I am very greatful. The staff in the School of Electronic Engineering, DCU have been very supportive and cooperative in all the time I have worked with them, and for this I would like to heartily thank them. In particular I owe an enormous debt to Barry McMullin who introduced me to much of the literature which I have found most valuable, who kept me in touch with the outside world, who was always available to discuss and debate ideas which at the time seemed to have little place in an engineering department, and for the effort he put into organising the workshop on Autopoiesis & Perception held in DCU, August 1992, while he was preparing his own Ph.D. thesis. Also I am very greatful for the support and encouragement of Paul Whelan and Niall Byrne — Paul for his organisational contributions to the Advanced Vision Systems Group and the vision lab in DCU over the last two years, Niall for assisting in the preparation of various papers and presentations and for proofreading parts of this dissertation. John Whelan and his cohort of merry technicians were always there to sort out our problems, even the equipment ones, and their work and assistance is much appreciated. I would like to thank Dr Eugene Kennedy, and Dr Michael Clancy who supported the initial setting up of this project, and the National Board of Science and Technology (NBST), now called EOLAS, who provided funding for the first two years work. Table of Contents Acknowledgements ............................................................................................... iii Abstract ....................... vii List of Tables & Figures ..................................................................................... ix Preface .................................................................................................................x List of Publications .................................................... xxiii 1 Introduction ......................................................................................................... 1 1.1 Biology and Vision Engineering ............, ........................................... 1 1.2 Objectives................................................................................................ 6 1.2.1 Understanding the nature of perceptual processes ................ 8 1.2.2 Understanding the nature and role of information ................ 10 1.3 Cognitive Science .................................................................................. 11 1.3.1 Representational view of reality ............................................. 13 16 1.4 The Control/Autonomy D uality............................................................ 18 1.5 Descriptions and Explanations...............................................................20 1.6 Summary of Chapters of Dissertation................................................... 22 2 The Philosophy of Perception ...................................................... 30 2.1 Introduction.......................................................................................... 30 2.2 The Controversy of Universals............................................................... 31 2.2.1 R ealism .................................................................................... 32 2.2.2 Aristotelian duality ................................................................. 35 2.2.3 Aristotelian causality and complex systems ........................ 36 2.2.4 Anti-realism .......................................................................... 40 2.3 Similarity and Radical Nominalism ..................................................... 45 2.3.1 Theorem of the ugly duckling ................ 46 2.3.2 Axiology and radical nominalism ............................................47 2.4 Induction and Deduction ...................................................................... 48 2.4.1 Induction and evidence .......................................................... 49 2.4.2 Probabilistic interpretation of induction ............................... 51 2.4.3 The necessary view of probability......................................... 54 2.4.4 Abduction ............................................................................... 55 2.5 The Purpose of Perception ................................................................... 55 2.5.1 The eye/camera analogy.......................................................... 57 2.5.2 The status of functional explanations of perception 58 2.5.3 An approach to understanding perception............................. 60 2.6 Summary ................................................................................................ 62 3 Natural Visual Perception: The Retina ............................................................ 63 3.1 Introduction............................................................................................. 63 3.2 Retinal Structure .................................................................................... 64 3.3 Fovea .................................................................................................... 66 3.3.1 Foveal acuity ................ 66 3.3.2 Information processing implications of acuity....................... 68 3.3.3 Colour transduction....................................................................70 3.4 Extrafovea................................................. 72 v 3.4.1 Extrafoveal sampling..............................................................72 3.4.2 Extrafoveal function ...............................................................74 3.5 Receptive Fields and Point Images ..................................................... 75 3.5.1 Receptive fields and feature-detection theories .......................75 3.5.2 Point image and retinotopic m a p s ......................................... 77 3.6 Retinal Neurons — Processing, Function and Structure...................... 81 3.6.1 An overview of the cat re tin a ................................. 81 3.6.2 More retinas, more functions, more complexity.................... 85 3.6.3 The ganglion cells — a biological film ? ............................... 89 3.7 Neural Coding ...................................................................................... 93 3.7.1 Noise in the compound retina of the f l y ............................... 93 3.7.2 Neural predictive coding ........................................................ 96 3.7.3 Matched gain ..................... 98 3.7.4 Alternative theories of neural function................................ 100 3.7.5 Edges or artifacts: the Mach band phenomenon ....... 103 3.8 Summary ............................................................................................. 103 4 Information in Perception ............................................................................... 105 4.1 Introduction........................................................................................... 106 4.1.1 Information in physics.......................................................... 108 4.2 The Mathematical Theory of Information ......................................... I l l 4.3 Gabor’s Theory of information .......................................................... 115 4.4 Sampling and Quantization.................................................... 122 4.4.1 Isopreference curves ................................................... 122 4.4.2 The human spatial M T F ....................................................... 124 4.5 Entropy and Structure ........................................................................ 128 4.6 Linsker’s Neural Information-processing Principle........................... 130 4.7 Statistical and Form Redundancy ....................................................
Recommended publications
  • The Effects of Cognition on Pain Perception (Prepared for Anonymous Review.)
    I think it’s going to hurt: the effects of cognition on pain perception (Prepared for anonymous review.) Abstract. The aim of this paper is to investigate whether, or to what extent, cognitive states (such as beliefs or intentions) influence pain perception. We begin with an examination of the notion of cognitive penetration, followed by a detailed description of the neurophysiological underpinnings of pain perception. We then argue that some studies on placebo effects suggest that there are cases in which our beliefs can penetrate our experience of pain. Keywords: pain, music therapy, gate-control theory, cognitive penetration, top-down modularity, perceptual learning, placebo effect 1. Introduction Consider the experience of eating wasabi. When you put wasabi on your food because you believe that spicy foods are tasty, the stimulation of pain receptors in your mouth can result in a pleasant experience. In this case, your belief seems to influence your perceptual experience. However, when you put wasabi on your food because you incorrectly believe that the green paste is mint, the stimulation of pain receptors in your mouth can result in a painful experience rather than a pleasant one. In this case, your belief that the green paste is mint does not seem to influence your perceptual experience. The aim of this paper is to investigate whether, or to what extent, cognitive states (such as beliefs) influence pain perception. We begin with an examination of the notion of cognitive penetration and its theoretical implications using studies in visual perception. We then turn our attention to the perception of pain by considering its neurophysiological underpinnings.
    [Show full text]
  • Visual Perception in Migraine: a Narrative Review
    vision Review Visual Perception in Migraine: A Narrative Review Nouchine Hadjikhani 1,2,* and Maurice Vincent 3 1 Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Harvard Medical School, Boston, MA 02129, USA 2 Gillberg Neuropsychiatry Centre, Sahlgrenska Academy, University of Gothenburg, 41119 Gothenburg, Sweden 3 Eli Lilly and Company, Indianapolis, IN 46285, USA; [email protected] * Correspondence: [email protected]; Tel.: +1-617-724-5625 Abstract: Migraine, the most frequent neurological ailment, affects visual processing during and between attacks. Most visual disturbances associated with migraine can be explained by increased neural hyperexcitability, as suggested by clinical, physiological and neuroimaging evidence. Here, we review how simple (e.g., patterns, color) visual functions can be affected in patients with migraine, describe the different complex manifestations of the so-called Alice in Wonderland Syndrome, and discuss how visual stimuli can trigger migraine attacks. We also reinforce the importance of a thorough, proactive examination of visual function in people with migraine. Keywords: migraine aura; vision; Alice in Wonderland Syndrome 1. Introduction Vision consumes a substantial portion of brain processing in humans. Migraine, the most frequent neurological ailment, affects vision more than any other cerebral function, both during and between attacks. Visual experiences in patients with migraine vary vastly in nature, extent and intensity, suggesting that migraine affects the central nervous system (CNS) anatomically and functionally in many different ways, thereby disrupting Citation: Hadjikhani, N.; Vincent, M. several components of visual processing. Migraine visual symptoms are simple (positive or Visual Perception in Migraine: A Narrative Review. Vision 2021, 5, 20. negative), or complex, which involve larger and more elaborate vision disturbances, such https://doi.org/10.3390/vision5020020 as the perception of fortification spectra and other illusions [1].
    [Show full text]
  • Visual Perceptual Skills
    Super Duper® Handy Handouts!® Number 168 Guidelines for Identifying Visual Perceptual Problems in School-Age Children by Ann Stensaas, M.S., OTR/L We use our sense of sight to help us function in the world around us. It helps us figure out if something is near or far away, safe or threatening. Eyesight, also know as visual perception, refers to our ability to accurately identify and locate objects in our environment. Visual perception is an important component of vision that contributes to the way we see and interpret the world. What Is Visual Perception? Visual perception is our ability to process and organize visual information from the environment. This requires the integration of all of the body’s sensory experiences including sight, sound, touch, smell, balance, and movement. Most children are able to integrate these senses by the time they start school. This is important because approximately 75% of all classroom learning is visual. A child with even mild visual-perceptual difficulties will struggle with learning in the classroom and often in other areas of life. How Are Visual Perceptual Problems Diagnosed? A child with visual perceptual problems may be diagnosed with a visual processing disorder. He/she may be able to easily read an eye chart (acuity) but have difficulty organizing and making sense of visual information. In fact, many children with visual processing disorders have good acuity (i.e., 20/20 vision). A child with a visual-processing disorder may demonstrate difficulty discriminating between certain letters or numbers, putting together age-appropriate puzzles, or finding matching socks in a drawer.
    [Show full text]
  • AN OT's Toolbox : Making the Most out of Visual Processing and Motor Processing Skills
    AN OT’s Toolbox : Making the Most out of Visual Processing and Motor Processing Skills Presented by Beth Kelley, OTR/L, MIMC FOTA 2012 By Definition Visual Processing Motor Processing is is the sequence of steps synonymous with Motor that information takes as Skills Disorder which is it flows from visual any disorder characterized sensors to cognitive by inadequate development processing.1 of motor coordination severe enough to restrict locomotion or the ability to perform tasks, schoolwork, or other activities.2 1. http://en.wikipedia.org/wiki/Visual_ processing 2. http://medical-dictionary.thefreedictionary.com/Motor+skills+disorder Visual Processing What is Visual Processing? What are systems involved with Visual Processing? Is Visual Processing the same thing as vision? Review general anatomy of the eye. Review general functions of the eye. -Visual perception and the OT’s role. -Visual-Motor skills and why they are needed in OT treatment. What is Visual Processing “Visual processing is the sequence of steps that information takes as it flows from visual sensors to cognitive processing1” 1. http://en.wikipedia.org/wiki/Visual_Processing What are the systems involved with Visual Processing? 12 Basic Processes are as follows: 1. Vision 2. Visual Motor Processing 3. Visual Discrimination 4. Visual Memory 5. Visual Sequential Memory 6. Visual Spatial Processing 7. Visual Figure Ground 8. Visual Form Constancy 9. Visual Closure 10. Binocularity 11.Visual Accommodation 12.Visual Saccades 12 Basic Processes are: 1. Vision The faculty or state of being able to see. The act or power of sensing with the eyes; sight. The Anatomy of Vision 6 stages in Development of the Vision system Birth to 4 months 4-6 months 6-8 months 8-12 months 1-2 years 2-3 years At birth babies can see patterns of light and dark.
    [Show full text]
  • Olfaction Modulates Ambiguous Visual Motion Perception
    OPEN Smelling directions: Olfaction modulates SUBJECT AREAS: ambiguous visual motion perception HUMAN BEHAVIOUR Shenbing Kuang & Tao Zhang PERCEPTION MOTION State Key Laboratory of Brain and Cognitive Science, Institute of Psychology, Chinese Academy of Sciences, Beijing 100101, China. OLFACTORY CORTEX Senses of smells are often accompanied by simultaneous visual sensations. Previous studies have Received documented enhanced olfactory performance with concurrent presence of congruent color- or shape- 27 February 2014 related visual cues, and facilitated visual object perception when congruent smells are simultaneously present. These visual object-olfaction interactions suggest the existences of couplings between the olfactory Accepted pathway and the visual ventral processing stream. However, it is not known if olfaction can modulate visual 3 July 2014 motion perception, a function that is related to the visual dorsal stream. We tested this possibility by examining the influence of olfactory cues on the perceptions of ambiguous visual motion signals. We Published showed that, after introducing an association between motion directions and olfactory cues, olfaction could 23 July 2014 indeed bias ambiguous visual motion perceptions. Our result that olfaction modulates visual motion processing adds to the current knowledge of cross-modal interactions and implies a possible functional linkage between the olfactory system and the visual dorsal pathway. Correspondence and requests for materials n our daily life, we are constantly exposed to multiple sensory inputs from different sensory modalities of should be addressed to varying reliability. Yet we could effortless integrate these parallel sensory signals and maintain a unified T.Z. (taozhang@psych. I perception that allows us to interact with the external world.
    [Show full text]
  • Visual Perceptual Skills Required for Handwriting
    VISUAL PERCEPTUAL SKILLS REQUIRED FOR HANDWRITING Handwriting is a complex skill. Handwriting involves the ability to form letters with consistent letter size, proportions and spacing, so that others can read words and sentences. Producing legible handwriting requires complex visual perceptual skills as well as an integration of motor skills with these visual perceptual skills. A deficiency in visual-motor integration may be evident when observing poor quality handwriting (Volman, van Schendel, & Jongmans, 2006). Visual perception is the process where the brain extracts and organises information, giving meaning to what we see. Visual-motor integration is the degree to which visual perception and finger-hand movements are well coordinated (Beery & Beery, 2010). There are many components of visual processing which work together to assign meaning to what we see and include eye-hand coordination, figure ground, visual discrimination, form constancy, visual memory and visual- sequential memory. Eye –hand coordination is the ability to coordinate eye movement with hand movements and includes the ability to process visual information to guide hand function. When children are learning to control a pencil for handwriting, they will rely on visual information as they look at their hand and what the pencil is producing as they write. The ability to copy a vertical line, circle, horizontal line, right oblique line, square, left oblique line and an oblique cross have been recognised by therapists as an indication of a child’s readiness to integrate visual-motor skills to begin handwriting instruction. Beery & Beery (2010) recommend that formal pencil-paper instruction is postponed until a child can easily execute an oblique cross as it requires crossing the midline, which is the source of many reversal problems.
    [Show full text]
  • Effects of Language on Visual Perception
    Effects of Language on Visual Perception Gary Lupyan1a, Rasha Abdel Rahmanb, Lera Boroditskyc, Andy Clarkd aUniversity of Wisconsin-Madison bHumboldt-Universität zu Berlin cUniversity of California San Diego dUniversity of Sussex Abstract Does language change what we perceive? Does speaking different languages cause us to perceive things differently? We review the behavioral and elec- trophysiological evidence for the influence of language on perception, with an emphasis on the visual modality. Effects of language on perception can be observed both in higher-level processes such as recognition, and in lower-level processes such as discrimination and detection. A consistent finding is that language causes us to perceive in a more categorical way. Rather than being fringe or exotic, as they are sometimes portrayed, we discuss how effects of language on perception naturally arise from the interactive and predictive nature of perception. Keywords: language; perception; vision; categorization; top-down effects; prediction “Even comparatively simple acts of perception are very much more at the mercy of the social patterns called words than we might suppose.” [1]. “No matter how influential language might be, it would seem preposter- ous to a physiologist that it could reach down into the retina and rewire the ganglion cells” [2]. 1Correspondence: [email protected] Preprint submitted to Trends in Cognitive Sciences August 22, 2020 Language as a form of experience that affects perception What factors influence how we perceive the world? For example, what makes it possible to recognize the object in Fig. 1a? Or to locate the ‘target’ in Fig. 1b? Where is the head of the bird in Fig.
    [Show full text]
  • Visual Perception Is the Ability to Give Meaning to What Is Seen
    What is visual perception? Visual perception is the ability to give meaning to what is seen. It is not the actual ability to see, but instead, it is the person’s ability to comprehend what the eyes see. Visual perceptual skills include: figure-ground, form constancy, spatial relations, visual closure, visual discrimination, visual memory, and visualization. Figure ground: the ability to locate an object, word, letter, number, etc. from their background. Example: Locating a pencil in a messy desk or finding a requested object on an iSpy page. Form constancy: the ability to identify two similar objects even when one is smaller, larger, darker, lighter, upside down, side-ways, backwards, etc. Example: Being able to tell the difference between “d” and “b”, “p” and “q”, “m” and “w.” A deficit in this area of visual perception can cause a child to display letter and number reversals. Spatial relations: the ability to know where an object is in relation to oneself; Knowing and understanding how to use directional terms to describe an objects position in space. Example: Knowing right versus left, front versus back, up versus down (directional terms). Visual closure: the ability to identify an object even when part of it is missing and/or hidden/covered up. Example: Recognizing a shape as a square even when a portion of the line is covered. Visual discrimination: the ability to differentiate objects (i.e. can be letters, words, numbers, etc.) by size, color, shape, orientation, position in space, forms, patterns, etc. in order to identify similarities and/or differences. Example: Knowing that a triangle is a triangle even if it is turned upside down or larger/smaller in size than the model triangle.
    [Show full text]
  • Assessment and Intervention of Visual Perception and Cognition Following Brain Injury and the Impact on Everyday Functioning
    Assessment and Intervention of Visual Perception and Cognition Following Brain Injury and the Impact on Everyday Functioning. Kara Christy, MS, OTRL, CBIS Natasha Huffine, MS, OTRL, CBIS Vision and the Brain •Occipital Lobe • Temporal Lobe • Primary visual cortex • Combines sensory information • Visual association cortex associated with the recognition and identification of objects such • Analyzing orientation, position, and as people, places, and things. movement. • Initiation of Smooth Pursuit Movements • Parietal Lobe • Visual Field Loss • Locating objects • Eye movements • Drawing/construction of objects •Frontal Lobe • Neglect • Saccades and Attention • Movement through space 2 Definitions Visual Perception is the ability to interpret, understand, and define incoming visual information. Form Constancy is the ability to identify objects despite their variation of size, color, shape, position, or texture. Figure ground Perception is the ability to distinguish foreground from background. Visual Closure is the ability to accurately identify objects that are partially covered or missing. Spatial Orientation is the ability to recognize personal position in relation to opposing positions, directions, movement of objects, and environmental locations. Unilateral Inattention is phenomenon that causes one to experience an inability to orient and respond to contralateral visual information. Depth Perception is the ability to perceive relative distance in environmental objects. Visual Memory is the ability to take in a visual stimulus, retain its details, and store for later retrieval. Visual Motor Integration is accurate and quick communication between the eyes and hands. Visuocognition is the ability to use visual information to solve problems, make decisions, and complete planning and organizational tasks through mental manipulation. Executive Functioning is the ability to reason, plan, problem solve, make inferences, and/or evaluate results of actions and decisions.
    [Show full text]
  • Sensation and Perception
    CHAPTER6 Sensation and Perception Chapter Preview Sensation is the process by which we detect stimulus energy from our environment and transmit it to our brain. Perception is the process of organizing and interpreting sensory information, enabling us to recognize meaningful objects and events. Clear evidence that perception is influenced by our experience comes from the many demonstrations of perceptual set and context effects. The task of each sense is to receive stimulus energy, transform it into neural signals, and send those neural messages to the brain. In vision, light waves are converted into neural impulses by the retina; after being coded, these impulses travel up the optic nerve to the brain’s cortex, where they are interpreted. In organizing sensory data into whole perceptions, our first task is to discriminate figure from ground. We then organize the figure into meaningful form by following certain rules for group- ing stimuli. We transform two-dimensional retinal images into three-dimensional perceptions by using binocular cues, such as retinal disparity, and monocular cues, such as the relative sizes of objects. The perceptual constancies enable us to perceive objects as enduring in color, shape, and size regardless of viewing angle, distance, and illumination. The constancies explain several well- known illusions. Both nature and nurture shape our perceptions. For example, when cataracts are removed from adults who have been blind from birth, these persons can distinguish figure and ground and can perceive color but are unable to distinguish shapes and forms. At the same time, human vision is remarkably adaptable. Given glasses that turn the world upside down, people manage to adapt and move about with ease.
    [Show full text]
  • 7 Senses Street Day Bringing the Common Sense Back to Our Neighbourhoods
    7 Senses Street Day Bringing the common sense back to our neighbourhoods Saturday, 16 November 2013 What are the 7 Senses? Most of us are familiar with the traditional five senses – sight, smell, taste, hearing, and touch. The two lesser known senses refer to our movement and balance (Vestibular) and our body position (Proprioception). This article gives an overview of each of the senses and how the sensory processing that occurs for us to interpret the world around us. Quick Definitions Sensory integration is the neurological process that organizes sensations from one's body and from the environment, and makes it possible to use the body to make adaptive responses within the environment. To do this, the brain must register, select, interpret, compare, and associate sensory information in a flexible, constantly-changing pattern. (A Jean Ayres, 1989) Sensory Integration is the adequate and processing of sensory stimuli in the central nervous system – the brain. It enables us interact with our environment appropriately. Sensory processing is the brain receiving, interpreting, and organizing input from all of the active senses at any given moment. For every single activity in daily life we need an optimal organization of incoming sensory information. If the incoming sensory information remains unorganized – e.g. the processing in the central nervous system is incorrect - an appropriate, goal orientated and planned reaction (behavior) relating to the stimuli is not possible. Sight Sight or vision is the capability of the eyes to focus and detect images of visible light and generate electrical nerve impulses for varying colours, hues, and brightness.
    [Show full text]
  • 1 What Do Models of Visual Perception Tell Us About Visual Phenomenology?
    What do models of visual perception tell us about visual phenomenology? Rachel N. Denison1, Ned Block2, Jason Samaha3 1 Department of Psychology and Center for Neural Science, New York University 2 Department of Philosophy, New York University 3 Department of Psychology, University of California, Santa Cruz 1 Abstract Computational models of visual processing aim to provide a compact, explanatory account of the complex neural processes that underlie visual perception and behavior. But what, if anything, do current modeling approaches say about how conscious visual experience arises from neural processing? Here, we introduce the reader to four commonly used models for understanding visual computations, neural activity, and behavior: signal detection theory, drift diffusion, probabilistic population codes, and sampling. In an attempt to bridge these modeling approaches with experimental and philosophical work on the neural basis of conscious visual perception, we lay out possible relationships between the components of the models and the contents of phenomenal visual experience. We find no unique relation between model components and phenomenal experience in any model; rather, there are multiple logically possible mappings from models to experience. Going forward, we suggest that there are scientific opportunities to develop models that predict and explain a variety of subjective reports and philosophical opportunities to consider what aspects of phenomenal experience are promising scientific targets. Keywords: vision, perception, consciousness, subjective report, computational model 2 1 Introduction The science of visual perception has a long history of developing quantitative, computational models to explain and predict visual performance on a variety of tasks. These models have typically been developed to account for objective visual performance—like observer’s accuracy, reaction time, or perceptual sensitivity in discriminating different visual stimuli.
    [Show full text]