Recovery of Stereopsis Through Perceptual Learning in PNAS PLUS Human Adults with Abnormal Binocular Vision

Total Page:16

File Type:pdf, Size:1020Kb

Load more

Recovery of stereopsis through perceptual learning in PNAS PLUS human adults with abnormal binocular vision Jian Dinga,b,1 and Dennis M. Levia,b aSchool of Optometry and bThe Helen Wills Neuroscience Institute, University of California, Berkeley, CA 94720 AUTHOR SUMMARY Stereopsis, the perception of therefore, the monocular and depth based on the binocular binocular cues are consistent disparity of the images projected and reinforce each other in the to the retinas of the two eyes, perception of depth (4). adds richness to our perception Stereo training began by first of our 3D world. However, 3– establishing binocular fusion 5% of the population is stereo- and alignment—through which blind and is unable to use bin- the brain sees a single, unified ocular disparity to perceive image for both eyes—by re- depth or has a condition called ducing the contrast of the DE’s “stereoanomaly” that results in frame (Fig. P1A, Left) until both seriously impaired stereovision. frames were visible through Stereoblindness and stereo- a stereoscope (Fig. P1A, Left anomaly often result from and Center) and adjusting the a “turned eye” or “lazy eye” vertical and horizontal positions during early childhood. If not of the two frames separately. treated early enough, these Once fusion and alignment were COGNITIVE SCIENCES PSYCHOLOGICAL AND conditions could lead to reduced achieved (Fig. P1A, Right), two or no stereopsis. Although pairs of vertical gratings (Fig. treatment is seldom undertaken P1B, Left and Center) were pre- Fig. P1. Stimuli. (A) Each training trial began with frames that assist in adults, we show here that fi sented to the two eyes stereo- — an observer with fusing images from two eyes into a single uni ed ’ perceptual learning the re- image in the brain. (B) Once fusion was achieved, vertically aligned scopically. The observer s task petitive practice of a demanding target gratings (Upper) and reference gratings (Lower) were presented was to indicate the relative visual task—can induce the re- to the two eyes stereoscopically until a response was given. RE, right depth of the top grating (i.e., covery of stereopsis in adults eye; LE, left eye. whether it was closer or farther with abnormal binocular vision. away than the bottom grating) Under everyday viewing con- (Fig. P1B, Right). For training, ditions, individuals with abnormal binocular vision typically feedback was provided after each trial, and the stimuli contained view the world through their dominant eye (DE); signals from monocular position cues that were correlated perfectly with the other eye, the nondominant eye (NDE), are suppressed binocular disparity cues. To rule out monocular artifacts and strongly in the brain. In the laboratory, however, it is possible to ensure that our observers achieved stereopsis, we applied stereo present separate images to each eye through a stereoscope (Fig. tests with stimuli that contained no monocular cues (pure dis- P1A). By reducing the contrast of the DE’sframe(Fig.P1A, parity test) before and after training. Left) and carefully aligning the images, it is possible for an After more than 10,000 trials of training, observers with ab- abnormal observer to perceive both eyes’ images simulta- normal binocular vision improved their stereo performance neously (Fig. P1A, Right). In the present study we used a ste- substantially and significantly. Indeed, three observers who were reoscope to aid eye alignment and perceptual learning to train stereoblind before training achieved measurable stereopsis stereopsis in five adults who were stereoblind or stereo- through stereo training. The training effect was very limited for anomalous. Recent studies suggest that perceptual learning normal observers with comparable training. may provide an important method for recovery of vision in Before training, all stereoblind observers failed the clinical adults with lazy eye (1). In a few instances, improvement of stereo test (>400 arc seconds); however, after training, they stereopsis appears to be a side benefitofimprovingmonocular displayed stereoacuities of 40–140 arc seconds on this test. Some vision through perceptual learning in juveniles with lazy eye (2). consider the appreciation of depth in random dot stereograms Recently, Nakatsuka et al. (3) reported that adult monkeys with to be the gold standard for stereopsis, because the stereograms mild stereo deficiencies (i.e., that required a larger depth cue contain no monocular information that might be used in depth than normal) improved their stereoacuity—the ability to detect perception. We developed a psychophysical stereo test with the smallest depths—through perceptual learning. However, high-contrast dynamic random-dot stereograms (DRS) that perceptual learning has not been applied directly to the treat- ment of stereoblindness in human observers. The purpose of the present study was to test whether the recovery of stereopsis Author contributions: J.D. and D.M.L. designed research; J.D. performed research; J.D. can be induced through perceptual learning in human observers analyzed data; and J.D. and D.M.L. wrote the paper. who have suffered long-standing stereoblindness, and, if so, The authors declare no conflict of interest. what the nature of the recovered stereopsis is. To induce ste- This article is a PNAS Direct Submission. reopsis, we used a perceptual learning paradigm that combined 1To whom correspondence should be addressed. E-mail: [email protected]. monocular cues—the relative positions of images in one eye— See full research article on page E733 of www.pnas.org. that were correlated perfectly with the binocular disparity cues; Cite this Author Summary as: PNAS 10.1073/pnas.1105183108. www.pnas.org/cgi/doi/10.1073/pnas.1105183108 PNAS | September 13, 2011 | vol. 108 | no. 37 | 15035–15036 Downloaded by guest on September 26, 2021 eliminate any possible monocular cues. With the exception of tual learning may provide a useful method for treating stereo- one abnormal observer, all observers were able to detect depth in blindness and stereoanomalies and that the recovered our DRS test. A demonstration DRS is available online in stereopsis may improve the quality of life in persons with Supporting Information. We also examined the properties of the stereo deficiencies. recovered stereopsis and found that it has reduced resolution and precision relative to normal, although it is based on per- 1. Levi DM, Li RW (2009) Perceptual learning as a potential treatment for amblyopia: A ceiving depth by detecting binocular disparity. mini-review. Vision Res 49:2535–2549. Stereoblind or stereodeficient individuals who recover ste- 2. Li RW, Provost A, Levi DM (2007) Extended perceptual learning results in substantial reopsis may gain substantial benefitineverydaylife(5).After recovery of positional acuity and visual acuity in juvenile amblyopia. Invest Ophthalmol achieving stereopsis, our observers reported that depth “pop- Vis Sci 48:5046–5051. ped out” in daily life. They feel more confident in daily tasks 3. Nakatsuka C, et al. (2007) Effects of perceptual learning on local stereopsis and neuronal – that are related to depth perception and are able, for the responses of V1 and V2 in prism-reared monkeys. J Neurophysiol 97:2612 2626. fi 4. Wilcox LM, Harris JM, McKee SP (2007) The role of binocular stereopsis in monoptic rst time, to enjoy 3D movies. Here we have documented the depth perception. Vision Res 47:2367–2377. recovery of stereopsis in human adults with abnormal binocular 5. Barry SR (2009) Fixing My Gaze: A Scientist’s Journey into Seeing in Three Dimensions vision through perceptual learning. We conclude that percep- (Basic Books, New York). 15036 | www.pnas.org/cgi/doi/10.1073/pnas.1105183108 Ding and Levi Downloaded by guest on September 26, 2021.
Recommended publications
  • Qt6hb7321d.Pdf

    Qt6hb7321d.Pdf

    UC Berkeley UC Berkeley Previously Published Works Title Recovering stereo vision by squashing virtual bugs in a virtual reality environment. Permalink https://escholarship.org/uc/item/6hb7321d Journal Philosophical transactions of the Royal Society of London. Series B, Biological sciences, 371(1697) ISSN 0962-8436 Authors Vedamurthy, Indu Knill, David C Huang, Samuel J et al. Publication Date 2016-06-01 DOI 10.1098/rstb.2015.0264 Peer reviewed eScholarship.org Powered by the California Digital Library University of California Submitted to Phil. Trans. R. Soc. B - Issue Recovering stereo vision by squashing virtual bugs in a virtual reality environment. For ReviewJournal: Philosophical Only Transactions B Manuscript ID RSTB-2015-0264.R2 Article Type: Research Date Submitted by the Author: n/a Complete List of Authors: Vedamurthy, Indu; University of Rochester, Brain & Cognitive Sciences Knill, David; University of Rochester, Brain & Cognitive Sciences Huang, Sam; University of Rochester, Brain & Cognitive Sciences Yung, Amanda; University of Rochester, Brain & Cognitive Sciences Ding, Jian; University of California, Berkeley, Optometry Kwon, Oh-Sang; Ulsan National Institute of Science and Technology, School of Design & Human Engineering Bavelier, Daphne; University of Geneva, Faculty of Psychology and Education Sciences; University of Rochester, Brain & Cognitive Sciences Levi, Dennis; University of California, Berkeley, Optometry; Issue Code: Click <a href=http://rstb.royalsocietypublishing.org/site/misc/issue- 3DVIS codes.xhtml target=_new>here</a> to find the code for your issue.: Subject: Neuroscience < BIOLOGY Stereopsis, Strabismus, Amblyopia, Virtual Keywords: Reality, Perceptual learning, stereoblindness http://mc.manuscriptcentral.com/issue-ptrsb Page 1 of 29 Submitted to Phil. Trans. R. Soc. B - Issue Phil.
  • 3D Computational Modeling and Perceptual Analysis of Kinetic Depth Effects

    3D Computational Modeling and Perceptual Analysis of Kinetic Depth Effects

    Computational Visual Media DOI 10.1007/s41095-xxx-xxxx-x Vol. x, No. x, month year, xx–xx Research Article 3D Computational Modeling and Perceptual Analysis of Kinetic Depth Effects Meng-Yao Cui1, Shao-Ping Lu1( ), Miao Wang2, Yong-Liang Yang3, Yu-Kun Lai4, and Paul L. Rosin4 c The Author(s) 2020. This article is published with open access at Springerlink.com Abstract Humans have the ability to perceive 3D shapes from 2D projections of rotating 3D objects, which is called Kinetic Depth Effects. This process is based on a variety of visual cues such as lighting and shading effects. However, when such cues are weakened or missing, perception can become faulty, as demonstrated by the famous silhouette illusion example – the Spinning Dancer. Inspired by this, we establish objective and subjective evaluation models of rotated 3D objects by taking their projected 2D images as input. We investigate five different cues: ambient Fig. 1 The Spinning Dancer. Due to the lack of visual cues, it confuses humans luminance, shading, rotation speed, perspective, and color as to whether rotation is clockwise or counterclockwise. Here we show 3 of 34 difference between the objects and background. In the frames from the original animation [21]. Image courtesy of Nobuyuki Kayahara. objective evaluation model, we first apply 3D reconstruction algorithms to obtain an objective reconstruction quality 1 Introduction metric, and then use a quadratic stepwise regression analysis method to determine the weights among depth cues to The human perception mechanism of the 3D world has represent the reconstruction quality. In the subjective long been studied.
  • Daily Mixed Visual Experience That Prevents Amblyopia in Cats Does Not Always Allow the Development of Good Binocular Depth Perception

    Daily Mixed Visual Experience That Prevents Amblyopia in Cats Does Not Always Allow the Development of Good Binocular Depth Perception

    Journal of Vision (2009) 9(5):22, 1–7 http://journalofvision.org/9/5/22/ 1 Daily mixed visual experience that prevents amblyopia in cats does not always allow the development of good binocular depth perception Department of Psychology, Dalhousie University, Donald E. Mitchell Halifax, NS, Canada Department of Psychology, Dalhousie University, Jan Kennie Halifax, NS, Canada WT Centre for Neuroimaging, UCL Institute of Neurology, D. Samuel Schwarzkopf London, UK School of Biosciences, Cardiff University, Frank Sengpiel Cardiff, Wales, UK Kittens reared with mixed daily visual input that consists of episodes of normal (binocular) exposure followed by abnormal (monocular) exposure can develop normal visual acuity in both eyes if the length of the former exposure exceeds a critical amount. However, later studies of the tuning of cells in primary visual cortex of animals reared in this manner revealed that their responses to interocular differences in phase were not reliable suggesting that their binocular depth perception may not be normal. We examined this possibility in 3 kittens reared with mixed daily visual exposure (2 hrs binocular vision followed by 5 hrs monocular exposure) that allowed development of normal visual acuity in both eyes. Measurements made of the threshold differences in depth that could be perceived under monocular and binocular viewing revealed a 10-fold superiority of binocular over monocular depth thresholds in one animal while the depth thresholds of the other two animals were poor and there was no binocular superiority. Thus, there was evidence that only one animal possessed stereopsis while the other two were likely stereoblind. While 2 hrs of daily binocular vision protected against the development of amblyopia, the poor outcome with respect to stereopsis points to the need for additional measures to promote binocular vision.
  • CS 534: Computer Vision Stereo Imaging Outlines

    CS 534: Computer Vision Stereo Imaging Outlines

    CS 534 A. Elgammal Rutgers University CS 534: Computer Vision Stereo Imaging Ahmed Elgammal Dept of Computer Science Rutgers University CS 534 – Stereo Imaging - 1 Outlines • Depth Cues • Simple Stereo Geometry • Epipolar Geometry • Stereo correspondence problem • Algorithms CS 534 – Stereo Imaging - 2 1 CS 534 A. Elgammal Rutgers University Recovering the World From Images We know: • 2D Images are projections of 3D world. • A given image point is the projection of any world point on the line of sight • So how can we recover depth information CS 534 – Stereo Imaging - 3 Why to recover depth ? • Recover 3D structure, reconstruct 3D scene model, many computer graphics applications • Visual Robot Navigation • Aerial reconnaissance • Medical applications The Stanford Cart, H. Moravec, 1979. The INRIA Mobile Robot, 1990. CS 534 – Stereo Imaging - 4 2 CS 534 A. Elgammal Rutgers University CS 534 – Stereo Imaging - 5 CS 534 – Stereo Imaging - 6 3 CS 534 A. Elgammal Rutgers University Motion parallax CS 534 – Stereo Imaging - 7 Depth Cues • Monocular Cues – Occlusion – Interposition – Relative height: the object closer to the horizon is perceived as farther away, and the object further from the horizon is perceived as closer. – Familiar size: when an object is familiar to us, our brain compares the perceived size of the object to this expected size and thus acquires information about the distance of the object. – Texture Gradient: all surfaces have a texture, and as the surface goes into the distance, it becomes smoother and finer. – Shadows – Perspective – Focus • Motion Parallax (also Monocular) • Binocular Cues • In computer vision: large research on shape-from-X (should be called depth from X) CS 534 – Stereo Imaging - 8 4 CS 534 A.
  • Teacher Guide

    Teacher Guide

    Neuroscience for Kids http://faculty.washington.edu/chudler/neurok.html. Our Sense of Sight: Part 2. Perceiving motion, form, and depth Visual Puzzles Featuring a “Class Experiment” and “Try Your Own Experiment” Teacher Guide WHAT STUDENTS WILL DO · TEST their depth perception using one eye and then two · CALCULATE the class averages for the test perception tests · DISCUSS the functions of depth perception · DEFINE binocular vision · IDENTIFY monocular cues for depth · DESIGN and CONDUCT further experiments on visual perception, for example: · TEST people’s ability to interpret visual illusions · CONSTRUCT and test new visual illusions · DEVISE a “minimum difference test” for visual attention 1 SETTING UP THE LAB Supplies For the Introductory Activity Two pencils or pens for each student For the Class Experiment For each group of four (or other number) students: Measuring tools (cloth tape or meter sticks) Plastic cups, beakers or other sturdy containers Small objects such as clothespins, small legos, paper clips For “Try Your Own Experiment!” Visual illusion figures, found at the end of this Teacher Guide Paper and markers or pens Rulers Other Preparations · For the Class Experiment and Do Your Own Experiment, students can write results on a plain sheet of paper. · Construct a chart on the board where data can be entered for class discussion. · Decide the size of the student groups; three is a convenient number for these experiments—a Subject, a Tester, and a Recorder. Depending on materials available, four or five students can comprise a group. · For “Try Your Own Experiment!,” prepare materials in the Supply list and put them out on an “Explore” table.
  • Interacting with Autostereograms

    Interacting with Autostereograms

    See discussions, stats, and author profiles for this publication at: https://www.researchgate.net/publication/336204498 Interacting with Autostereograms Conference Paper · October 2019 DOI: 10.1145/3338286.3340141 CITATIONS READS 0 39 5 authors, including: William Delamare Pourang Irani Kochi University of Technology University of Manitoba 14 PUBLICATIONS 55 CITATIONS 184 PUBLICATIONS 2,641 CITATIONS SEE PROFILE SEE PROFILE Xiangshi Ren Kochi University of Technology 182 PUBLICATIONS 1,280 CITATIONS SEE PROFILE Some of the authors of this publication are also working on these related projects: Color Perception in Augmented Reality HMDs View project Collaboration Meets Interactive Spaces: A Springer Book View project All content following this page was uploaded by William Delamare on 21 October 2019. The user has requested enhancement of the downloaded file. Interacting with Autostereograms William Delamare∗ Junhyeok Kim Kochi University of Technology University of Waterloo Kochi, Japan Ontario, Canada University of Manitoba University of Manitoba Winnipeg, Canada Winnipeg, Canada [email protected] [email protected] Daichi Harada Pourang Irani Xiangshi Ren Kochi University of Technology University of Manitoba Kochi University of Technology Kochi, Japan Winnipeg, Canada Kochi, Japan [email protected] [email protected] [email protected] Figure 1: Illustrative examples using autostereograms. a) Password input. b) Wearable e-mail notification. c) Private space in collaborative conditions. d) 3D video game. e) Bar gamified special menu. Black elements represent the hidden 3D scene content. ABSTRACT practice. This learning effect transfers across display devices Autostereograms are 2D images that can reveal 3D content (smartphone to desktop screen). when viewed with a specific eye convergence, without using CCS CONCEPTS extra-apparatus.
  • Stereopsis and Stereoblindness

    Stereopsis and Stereoblindness

    Exp. Brain Res. 10, 380-388 (1970) Stereopsis and Stereoblindness WHITMAN RICHARDS Department of Psychology, Massachusetts Institute of Technology, Cambridge (USA) Received December 20, 1969 Summary. Psychophysical tests reveal three classes of wide-field disparity detectors in man, responding respectively to crossed (near), uncrossed (far), and zero disparities. The probability of lacking one of these classes of detectors is about 30% which means that 2.7% of the population possess no wide-field stereopsis in one hemisphere. This small percentage corresponds to the probability of squint among adults, suggesting that fusional mechanisms might be disrupted when stereopsis is absent in one hemisphere. Key Words: Stereopsis -- Squint -- Depth perception -- Visual perception Stereopsis was discovered in 1838, when Wheatstone invented the stereoscope. By presenting separate images to each eye, a three dimensional impression could be obtained from two pictures that differed only in the relative horizontal disparities of the components of the picture. Because the impression of depth from the two combined disparate images is unique and clearly not present when viewing each picture alone, the disparity cue to distance is presumably processed and interpreted by the visual system (Ogle, 1962). This conjecture by the psychophysicists has received recent support from microelectrode recordings, which show that a sizeable portion of the binocular units in the visual cortex of the cat are sensitive to horizontal disparities (Barlow et al., 1967; Pettigrew et al., 1968a). Thus, as expected, there in fact appears to be a physiological basis for stereopsis that involves the analysis of spatially disparate retinal signals from each eye. Without such an analysing mechanism, man would be unable to detect horizontal binocular disparities and would be "stereoblind".
  • Algorithms for Single Image Random Dot Stereograms

    Algorithms for Single Image Random Dot Stereograms

    Displaying 3D Images: Algorithms for Single Image Random Dot Stereograms Harold W. Thimbleby,† Stuart Inglis,‡ and Ian H. Witten§* Abstract This paper describes how to generate a single image which, when viewed in the appropriate way, appears to the brain as a 3D scene. The image is a stereogram composed of seemingly random dots. A new, simple and symmetric algorithm for generating such images from a solid model is given, along with the design parameters and their influence on the display. The algorithm improves on previously-described ones in several ways: it is symmetric and hence free from directional (right-to-left or left-to-right) bias, it corrects a slight distortion in the rendering of depth, it removes hidden parts of surfaces, and it also eliminates a type of artifact that we call an “echo”. Random dot stereograms have one remaining problem: difficulty of initial viewing. If a computer screen rather than paper is used for output, the problem can be ameliorated by shimmering, or time-multiplexing of pixel values. We also describe a simple computational technique for determining what is present in a stereogram so that, if viewing is difficult, one can ascertain what to look for. Keywords: Single image random dot stereograms, SIRDS, autostereograms, stereoscopic pictures, optical illusions † Department of Psychology, University of Stirling, Stirling, Scotland. Phone (+44) 786–467679; fax 786–467641; email [email protected] ‡ Department of Computer Science, University of Waikato, Hamilton, New Zealand. Phone (+64 7) 856–2889; fax 838–4155; email [email protected]. § Department of Computer Science, University of Waikato, Hamilton, New Zealand.
  • Visual Secret Sharing Scheme with Autostereogram*

    Visual Secret Sharing Scheme with Autostereogram*

    Visual Secret Sharing Scheme with Autostereogram* Feng Yi, Daoshun Wang** and Yiqi Dai Department of Computer Science and Technology, Tsinghua University, Beijing, 100084, China Abstract. Visual secret sharing scheme (VSSS) is a secret sharing method which decodes the secret by using the contrast ability of the human visual system. Autostereogram is a single two dimensional (2D) image which becomes a virtual three dimensional (3D) image when viewed with proper eye convergence or divergence. Combing the two technologies via human vision, this paper presents a new visual secret sharing scheme called (k, n)-VSSS with autostereogram. In the scheme, each of the shares is an autostereogram. Stacking any k shares, the secret image is recovered visually without any equipment, but no secret information is obtained with less than k shares. Keywords: visual secret sharing scheme; visual cryptography; autostereogram 1. Introduction In 1979, Blakely and Shamir[1-2] independently invented a secret sharing scheme to construct robust key management scheme. A secret sharing scheme is a method of sharing a secret among a group of participants. In 1994, Naor and Shamir[3] firstly introduced visual secret sharing * Supported by National Natural Science Foundation of China (No. 90304014) ** E-mail address: [email protected] (D.S.Wang) 1 scheme in Eurocrypt’94’’ and constructed (k, n)-threshold visual secret sharing scheme which conceals the original data in n images called shares. The original data can be recovered from the overlap of any at least k shares through the human vision without any knowledge of cryptography or cryptographic computations. With the development of the field, Droste[4] provided a new (k, n)-VSSS algorithm and introduced a model to construct the (n, n)-combinational threshold scheme.
  • Stereoscopic Therapy: Fun Or Remedy?

    Stereoscopic Therapy: Fun Or Remedy?

    STEREOSCOPIC THERAPY: FUN OR REMEDY? SARA RAPOSO Abstract (INDEPENDENT SCHOLAR , PORTUGAL ) Once the material of playful gatherings, stereoscop­ ic photographs of cities, the moon, landscapes and fashion scenes are now cherished collectors’ items that keep on inspiring new generations of enthusiasts. Nevertheless, for a stereoblind observer, a stereoscopic photograph will merely be two similar images placed side by side. The perspective created by stereoscop­ ic fusion can only be experienced by those who have binocular vision, or stereopsis. There are several caus­ es of a lack of stereopsis. They include eye disorders such as strabismus with double vision. Interestingly, stereoscopy can be used as a therapy for that con­ dition. This paper approaches this kind of therapy through the exploration of North American collections of stereoscopic charts that were used for diagnosis and training purposes until recently. Keywords. binocular vision; strabismus; amblyopia; ste- reoscopic therapy; optometry. 48 1. Binocular vision and stone (1802­1875), which “seem to have access to the visual system at the same stereopsis escaped the attention of every philos­ time and form a unitary visual impres­ opher and artist” allowed the invention sion. According to the suppression the­ Vision and the process of forming im­ of a “simple instrument” (Wheatstone, ory, both similar and dissimilar images ages, is an issue that has challenged 1838): the stereoscope. Using pictures from the two eyes engage in alternat­ the most curious minds from the time of as a tool for his study (Figure 1) and in­ ing suppression at a low level of visual Aristotle and Euclid to the present day.
  • Neural Correlates of Convergence Eye Movements in Convergence Insufficiency Patients Vs

    Neural Correlates of Convergence Eye Movements in Convergence Insufficiency Patients Vs

    Neural Correlates of Convergence Eye Movements in Convergence Insufficiency Patients vs. Normal Binocular Vision Controls: An fMRI Study A thesis submitted in partial fulfillment of the requirements for the degree of Master of Science in Biomedical Engineering by Chirag B. Limbachia B.S.B.M.E., Wright State University, 2014 2015 Wright State University Wright State University GRADUATE SCHOOL January 18, 2016 I HEREBY RECOMMEND THAT THE THESIS PREPARED UNDER MY SUPER- VISION BY Chirag B. Limbachia ENTITLED Neural Correlates of Convergence Eye Movements in Convergence Insufficiency Patients vs. Normal Binocular Vision Controls: An fMRI Study BE ACCEPTED IN PARTIAL FULFILLMENT OF THE REQUIRE- MENTS FOR THE DEGREE OF Master of Science in Biomedical Engineering. Nasser H. Kashou Thesis Director Jaime E. Ramirez-Vick, Ph.D., Chair, Department of Biomedical, Industrial, and Human Factors Engineering Committee on Final Examination Nasser H. Kashou, Ph.D. Marjean T. Kulp, O.D., M.S., F.A.A.O. Subhashini Ganapathy, Ph.D. Robert E.W. Fyffe, Ph.D. Vice President for Research and Dean of the Graduate School ABSTRACT Limbachia, Chirag. M.S.B.M.E., Department of Biomedical, Industrial, and Human Factor En- gineering, Wright State University, 2015. Neural Correlates of Convergence Eye Movements in Convergence Insufficiency Patients vs. Normal Binocular Vision Controls: An fMRI Study. Convergence Insufficiency is a binocular vision disorder, characterized by reduced abil- ity of performing convergence eye movements. Absence of convergence causes, eye strain, blurred vision, doubled vision, headaches, and difficulty reading due frequent loss of place. These symptoms commonly occur during near work. The purpose of this study was to quantify neural correlates associated with convergence eye movements in convergence in- sufficient (CI) patients vs.
  • Relative Importance of Binocular Disparity and Motion Parallax for Depth Estimation: a Computer Vision Approach

    Relative Importance of Binocular Disparity and Motion Parallax for Depth Estimation: a Computer Vision Approach

    remote sensing Article Relative Importance of Binocular Disparity and Motion Parallax for Depth Estimation: A Computer Vision Approach Mostafa Mansour 1,2 , Pavel Davidson 1,* , Oleg Stepanov 2 and Robert Piché 1 1 Faculty of Information Technology and Communication Sciences, Tampere University, 33720 Tampere, Finland 2 Department of Information and Navigation Systems, ITMO University, 197101 St. Petersburg, Russia * Correspondence: pavel.davidson@tuni.fi Received: 4 July 2019; Accepted: 20 August 2019; Published: 23 August 2019 Abstract: Binocular disparity and motion parallax are the most important cues for depth estimation in human and computer vision. Here, we present an experimental study to evaluate the accuracy of these two cues in depth estimation to stationary objects in a static environment. Depth estimation via binocular disparity is most commonly implemented using stereo vision, which uses images from two or more cameras to triangulate and estimate distances. We use a commercial stereo camera mounted on a wheeled robot to create a depth map of the environment. The sequence of images obtained by one of these two cameras as well as the camera motion parameters serve as the input to our motion parallax-based depth estimation algorithm. The measured camera motion parameters include translational and angular velocities. Reference distance to the tracked features is provided by a LiDAR. Overall, our results show that at short distances stereo vision is more accurate, but at large distances the combination of parallax and camera motion provide better depth estimation. Therefore, by combining the two cues, one obtains depth estimation with greater range than is possible using either cue individually.