Download 3D TV and 3D Cinema: Tools and Processes For
Total Page:16
File Type:pdf, Size:1020Kb
Load more
Recommended publications
-
Qt6hb7321d.Pdf
UC Berkeley UC Berkeley Previously Published Works Title Recovering stereo vision by squashing virtual bugs in a virtual reality environment. Permalink https://escholarship.org/uc/item/6hb7321d Journal Philosophical transactions of the Royal Society of London. Series B, Biological sciences, 371(1697) ISSN 0962-8436 Authors Vedamurthy, Indu Knill, David C Huang, Samuel J et al. Publication Date 2016-06-01 DOI 10.1098/rstb.2015.0264 Peer reviewed eScholarship.org Powered by the California Digital Library University of California Submitted to Phil. Trans. R. Soc. B - Issue Recovering stereo vision by squashing virtual bugs in a virtual reality environment. For ReviewJournal: Philosophical Only Transactions B Manuscript ID RSTB-2015-0264.R2 Article Type: Research Date Submitted by the Author: n/a Complete List of Authors: Vedamurthy, Indu; University of Rochester, Brain & Cognitive Sciences Knill, David; University of Rochester, Brain & Cognitive Sciences Huang, Sam; University of Rochester, Brain & Cognitive Sciences Yung, Amanda; University of Rochester, Brain & Cognitive Sciences Ding, Jian; University of California, Berkeley, Optometry Kwon, Oh-Sang; Ulsan National Institute of Science and Technology, School of Design & Human Engineering Bavelier, Daphne; University of Geneva, Faculty of Psychology and Education Sciences; University of Rochester, Brain & Cognitive Sciences Levi, Dennis; University of California, Berkeley, Optometry; Issue Code: Click <a href=http://rstb.royalsocietypublishing.org/site/misc/issue- 3DVIS codes.xhtml target=_new>here</a> to find the code for your issue.: Subject: Neuroscience < BIOLOGY Stereopsis, Strabismus, Amblyopia, Virtual Keywords: Reality, Perceptual learning, stereoblindness http://mc.manuscriptcentral.com/issue-ptrsb Page 1 of 29 Submitted to Phil. Trans. R. Soc. B - Issue Phil. -
Daily Mixed Visual Experience That Prevents Amblyopia in Cats Does Not Always Allow the Development of Good Binocular Depth Perception
Journal of Vision (2009) 9(5):22, 1–7 http://journalofvision.org/9/5/22/ 1 Daily mixed visual experience that prevents amblyopia in cats does not always allow the development of good binocular depth perception Department of Psychology, Dalhousie University, Donald E. Mitchell Halifax, NS, Canada Department of Psychology, Dalhousie University, Jan Kennie Halifax, NS, Canada WT Centre for Neuroimaging, UCL Institute of Neurology, D. Samuel Schwarzkopf London, UK School of Biosciences, Cardiff University, Frank Sengpiel Cardiff, Wales, UK Kittens reared with mixed daily visual input that consists of episodes of normal (binocular) exposure followed by abnormal (monocular) exposure can develop normal visual acuity in both eyes if the length of the former exposure exceeds a critical amount. However, later studies of the tuning of cells in primary visual cortex of animals reared in this manner revealed that their responses to interocular differences in phase were not reliable suggesting that their binocular depth perception may not be normal. We examined this possibility in 3 kittens reared with mixed daily visual exposure (2 hrs binocular vision followed by 5 hrs monocular exposure) that allowed development of normal visual acuity in both eyes. Measurements made of the threshold differences in depth that could be perceived under monocular and binocular viewing revealed a 10-fold superiority of binocular over monocular depth thresholds in one animal while the depth thresholds of the other two animals were poor and there was no binocular superiority. Thus, there was evidence that only one animal possessed stereopsis while the other two were likely stereoblind. While 2 hrs of daily binocular vision protected against the development of amblyopia, the poor outcome with respect to stereopsis points to the need for additional measures to promote binocular vision. -
Recovery of 3-D Shape from Binocular Disparity and Structure from Motion
Perception & Psychophysics /993. 54 (2). /57-J(B Recovery of 3-D shape from binocular disparity and structure from motion JAMES S. TI'ITLE The Ohio State University, Columbus, Ohio and MYRON L. BRAUNSTEIN University of California, Irvine, California Four experiments were conducted to examine the integration of depth information from binocular stereopsis and structure from motion (SFM), using stereograms simulating transparent cylindri cal objects. We found that the judged depth increased when either rotational or translational motion was added to a display, but the increase was greater for rotating (SFM) displays. Judged depth decreased as texture element density increased for static and translating stereo displays, but it stayed relatively constant for rotating displays. This result indicates that SFM may facili tate stereo processing by helping to resolve the stereo correspondence problem. Overall, the re sults from these experiments provide evidence for a cooperative relationship betweel\..SFM and binocular disparity in the recovery of 3-D relationships from 2-D images. These findings indicate that the processing of depth information from SFM and binocular disparity is not strictly modu lar, and thus theories of combining visual information that assume strong modularity or indepen dence cannot accurately characterize all instances of depth perception from multiple sources. Human observers can perceive the 3-D shape and orien tion, both sources of information (along with many others) tation in depth of objects in a natural environment with im occur together in the natural environment. Thus, it is im pressive accuracy. Prior work demonstrates that informa portant to understand what interaction (if any) exists in the tion about shape and orientation can be recovered from visual processing of binocular disparity and SFM. -
Stereopsis and Stereoblindness
Exp. Brain Res. 10, 380-388 (1970) Stereopsis and Stereoblindness WHITMAN RICHARDS Department of Psychology, Massachusetts Institute of Technology, Cambridge (USA) Received December 20, 1969 Summary. Psychophysical tests reveal three classes of wide-field disparity detectors in man, responding respectively to crossed (near), uncrossed (far), and zero disparities. The probability of lacking one of these classes of detectors is about 30% which means that 2.7% of the population possess no wide-field stereopsis in one hemisphere. This small percentage corresponds to the probability of squint among adults, suggesting that fusional mechanisms might be disrupted when stereopsis is absent in one hemisphere. Key Words: Stereopsis -- Squint -- Depth perception -- Visual perception Stereopsis was discovered in 1838, when Wheatstone invented the stereoscope. By presenting separate images to each eye, a three dimensional impression could be obtained from two pictures that differed only in the relative horizontal disparities of the components of the picture. Because the impression of depth from the two combined disparate images is unique and clearly not present when viewing each picture alone, the disparity cue to distance is presumably processed and interpreted by the visual system (Ogle, 1962). This conjecture by the psychophysicists has received recent support from microelectrode recordings, which show that a sizeable portion of the binocular units in the visual cortex of the cat are sensitive to horizontal disparities (Barlow et al., 1967; Pettigrew et al., 1968a). Thus, as expected, there in fact appears to be a physiological basis for stereopsis that involves the analysis of spatially disparate retinal signals from each eye. Without such an analysing mechanism, man would be unable to detect horizontal binocular disparities and would be "stereoblind". -
Stereoscopic Therapy: Fun Or Remedy?
STEREOSCOPIC THERAPY: FUN OR REMEDY? SARA RAPOSO Abstract (INDEPENDENT SCHOLAR , PORTUGAL ) Once the material of playful gatherings, stereoscop ic photographs of cities, the moon, landscapes and fashion scenes are now cherished collectors’ items that keep on inspiring new generations of enthusiasts. Nevertheless, for a stereoblind observer, a stereoscopic photograph will merely be two similar images placed side by side. The perspective created by stereoscop ic fusion can only be experienced by those who have binocular vision, or stereopsis. There are several caus es of a lack of stereopsis. They include eye disorders such as strabismus with double vision. Interestingly, stereoscopy can be used as a therapy for that con dition. This paper approaches this kind of therapy through the exploration of North American collections of stereoscopic charts that were used for diagnosis and training purposes until recently. Keywords. binocular vision; strabismus; amblyopia; ste- reoscopic therapy; optometry. 48 1. Binocular vision and stone (18021875), which “seem to have access to the visual system at the same stereopsis escaped the attention of every philos time and form a unitary visual impres opher and artist” allowed the invention sion. According to the suppression the Vision and the process of forming im of a “simple instrument” (Wheatstone, ory, both similar and dissimilar images ages, is an issue that has challenged 1838): the stereoscope. Using pictures from the two eyes engage in alternat the most curious minds from the time of as a tool for his study (Figure 1) and in ing suppression at a low level of visual Aristotle and Euclid to the present day. -
Abstract Computer Vision in the Space of Light Rays
ABSTRACT Title of dissertation: COMPUTER VISION IN THE SPACE OF LIGHT RAYS: PLENOPTIC VIDEOGEOMETRY AND POLYDIOPTRIC CAMERA DESIGN Jan Neumann, Doctor of Philosophy, 2004 Dissertation directed by: Professor Yiannis Aloimonos Department of Computer Science Most of the cameras used in computer vision, computer graphics, and image process- ing applications are designed to capture images that are similar to the images we see with our eyes. This enables an easy interpretation of the visual information by a human ob- server. Nowadays though, more and more processing of visual information is done by computers. Thus, it is worth questioning if these human inspired “eyes” are the optimal choice for processing visual information using a machine. In this thesis I will describe how one can study problems in computer vision with- out reference to a specific camera model by studying the geometry and statistics of the space of light rays that surrounds us. The study of the geometry will allow us to deter- mine all the possible constraints that exist in the visual input and could be utilized if we had a perfect sensor. Since no perfect sensor exists we use signal processing techniques to examine how well the constraints between different sets of light rays can be exploited given a specific camera model. A camera is modeled as a spatio-temporal filter in the space of light rays which lets us express the image formation process in a function ap- proximation framework. This framework then allows us to relate the geometry of the imaging camera to the performance of the vision system with regard to the given task. -
Investigating Intermittent Stereoscopy: Its Effects on Perception and Visual Fatigue
©2016 Society for Imaging Science and Technology DOI: 10.2352/ISSN.2470-1173.2016.5.SDA-041 INVESTIGATING INTERMITTENT STEREOSCOPY: ITS EFFECTS ON PERCEPTION AND VISUAL FATIGUE Ari A. Bouaniche, Laure Leroy; Laboratoire Paragraphe, Université Paris 8; Saint-Denis; France Abstract distance in virtual environments does not clearly indicate that the In a context in which virtual reality making use of S3D is use of binocular disparity yields a better performance, and a ubiquitous in certain industries, as well as the substantial amount cursory look at the literature concerning the viewing of of literature about the visual fatigue S3D causes, we wondered stereoscopic 3D (henceforth abbreviated S3D) content leaves little whether the presentation of intermittent S3D stimuli would lead to doubt as to some negative consequences on the visual system, at improved depth perception (over monoscopic) while reducing least for a certain part of the population. subjects’ visual asthenopia. In a between-subjects design, 60 While we do not question the utility of S3D and its use in individuals under 40 years old were tested in four different immersive environments in this paper, we aim to position conditions, with head-tracking enabled: two intermittent S3D ourselves from the point of view of user safety: if, for example, the conditions (Stereo @ beginning, Stereo @ end) and two control use of S3D is a given in a company setting, can an implementation conditions (Mono, Stereo). Several optometric variables were of intermittent horizontal disparities aid in depth perception (and measured pre- and post-experiment, and a subjective questionnaire therefore in task completion) while impacting the visual system assessing discomfort was administered. -
Audiovisual Spatial Congruence, and Applications to 3D Sound and Stereoscopic Video
Audiovisual spatial congruence, and applications to 3D sound and stereoscopic video. C´edricR. Andr´e Department of Electrical Engineering and Computer Science Faculty of Applied Sciences University of Li`ege,Belgium Thesis submitted in partial fulfilment of the requirements for the degree of Doctor of Philosophy (PhD) in Engineering Sciences December 2013 This page intentionally left blank. ©University of Li`ege,Belgium This page intentionally left blank. Abstract While 3D cinema is becoming increasingly established, little effort has fo- cused on the general problem of producing a 3D sound scene spatially coher- ent with the visual content of a stereoscopic-3D (s-3D) movie. The percep- tual relevance of such spatial audiovisual coherence is of significant interest. In this thesis, we investigate the possibility of adding spatially accurate sound rendering to regular s-3D cinema. Our goal is to provide a perceptually matched sound source at the position of every object producing sound in the visual scene. We examine and contribute to the understanding of the usefulness and the feasibility of this combination. By usefulness, we mean that the technology should positively contribute to the experience, and in particular to the storytelling. In order to carry out experiments proving the usefulness, it is necessary to have an appropriate s-3D movie and its corresponding 3D audio soundtrack. We first present the procedure followed to obtain this joint 3D video and audio content from an existing animated s-3D movie, problems encountered, and some of the solutions employed. Second, as s-3D cinema aims at providing the spectator with a strong impression of being part of the movie (sense of presence), we investigate the impact of the spatial rendering quality of the soundtrack on the reported sense of presence. -
Download (6MB)
This work is protected by copyright and other intellectual property rights and duplication or sale of all or part is not permitted, except that material may be duplicated by you for research, private study, criticism/review or educational purposes. Electronic or print copies are for your own personal, non- commercial use and shall not be passed to any other individual. No quotation may be published without proper acknowledgement. For any other use, or to quote extensively from the work, permission must be obtained from the copyright holder/s. AN INVESTIGATION OF SOME FACTORS AFFECTING THE VARIABILITY OF THE MCCOLLOUGH EFFECT 1 by N.J. Lund, B.Sc., Wales Thesis submitted for the degree of Doctor of Philosophy to the University of Keele Department of Communication and Neuroscience 1982 Dedication: To my parents, John and Cynthia Lund ABSTRACT A series of experiments are reported which have attempted to isolate some factors causing inter and intrasubject variability of the McCollough effect.* A number of such factors were found. 1. The initial strength of the OCCA is strongly influenced by sleep duration. Reduction of up to one third of a normal nights sleep caused a marked decrease in the aftereffect strength. Sleep periods of under a third of normal were found to have no further effect. Decay rates were not affected by prior sleep duration. 2. Both the strength and decay of the McCollough effect undergo diurnal changes late in the evening. These changes were linked with the sleep cycle and evidence is presented indicating that the effect of the time of day upon the initial strength may be linked with the effect of sleep duration. -
Near and Distance Stereopsis Restoration in Amblyopia with 3D Computer Treatment
Stereopsis restoration with 3D computer treatment ·Original Article· Near and distance stereopsis restoration in amblyopia with 3D computer treatment Hong-Wei Deng1, Ping Huang2, Hua-hong Zhong1, Nyankerh Cyril Nii Amankwah3, Jun Zhao1 1 Shenzhen Eye Hospital; Shenzhen Key Laboratory of ● KEYWORDS: stereopsis; amblyopia; fusion; ametropic Ophthalmology; Joint College of Optometry of Shenzhen amblyopia; anisometropic amblyopia University; Affiliated Shenzhen Eye Hospital of Jinan DOI:10.18240/ier.2020.02.12 University, Shenzhen 518040, Guangdong Province, China 2Beijing Jiachengshixin Digital Medical Technology Co. Ltd., Citation: Deng HW, Huang P, Zhong HH, Nyankerh CNA, Zhao Beijing 100089, China J. Near and distance stereopsis restoration in amblyopia with 3D 3Schepens Eye Research Institute, Mass. Eye and Ear hospital, computer treatment. Int Eye Res 2020;1(2):128-132 Harvard Medical School, MA, USA. Correspondence to: Hong-Wei Deng. Shenzhen Eye Hospital; INTRODUCTION Shenzhen Key Laboratory of Ophthalmology; Joint College of bout 5%-10% of the American population are totally Optometry of Shenzhen University; Affiliated Shenzhen Eye A stereo blind or have impaired stereovision, which Hospital of Jinan University, Shenzhen 518040, Guangdong means these people do not perceive depth as normal and Province, China. [email protected] the 3-dimensional (3D) structure of the natural world. Furthermore, they have heightened difficulty specific tasks, Received: 2018-11-22 Accepted: 2020-01-05 such as driving and playing badminton, and other cognitive activities requiring both speed and accuracy[1-2]. One of the Abstract main causes of stereo blindness is believed to be juvenile ● AIM: To evaluate the effect of stereoscopic 3D (S3D) strabismus or amblyopia[3]. -
Active Efficient Coding Explains the Development of Binocular Vision
Active efficient coding explains the development of binocular vision and its failure in amblyopia Samuel Eckmanna,b,c,1 , Lukas Klimmascha,b, Bertram E. Shid, and Jochen Triescha,b,1 aFrankfurt Institute for Advanced Studies, 60438 Frankfurt am Main, Germany; bDepartment of Computer Science and Mathematics, Goethe University, 60629 Frankfurt am Main, Germany; cMax Planck Institute for Brain Research, 60438 Frankfurt am Main, Germany; and dDepartment of Electronic and Computer Engineering, Hong Kong University of Science and Technology, Clear Water Bay, Hong Kong Edited by Martin S. Banks, University of California, Berkeley, CA, and approved January 29, 2020 (received for review May 13, 2019) The development of vision during the first months of life is an In our formulation of active efficient coding, we maximize active process that comprises the learning of appropriate neu- coding efficiency as measured by the Shannon mutual informa- ral representations and the learning of accurate eye movements. tion I (R, C ) between the retinal stimulus represented by retinal While it has long been suspected that the two learning processes ganglion cell activity R and its cortical representation C under are coupled, there is still no widely accepted theoretical frame- a limited resource constraint. The mutual information can be work describing this joint development. Here, we propose a com- decomposed as putational model of the development of active binocular vision to fill this gap. The model is based on a formulation of the active I (R, C ) = H(R) − H(R j C ), [1] efficient coding theory, which proposes that eye movements as well as stimulus encoding are jointly adapted to maximize the where H(R) is the entropy of the retinal response and H(R j C ) overall coding efficiency. -
Stereopsis by a Neural Network Which Learns the Constraints
Stereopsis by a Neural Network Which Learns the Constraints Alireza Khotanzad and Ying-Wung Lee Image Processing and Analysis Laboratory Electrical Engineering Department Southern Methodist University Dallas, Texas 75275 Abstract This paper presents a neural network (NN) approach to the problem of stereopsis. The correspondence problem (finding the correct matches between the pixels of the epipolar lines of the stereo pair from amongst all the possible matches) is posed as a non-iterative many-to-one mapping. A two-layer feed forward NN architecture is developed to learn and code this nonlinear and complex mapping using the back-propagation learning rule and a training set. The important aspect of this technique is that none of the typical constraints such as uniqueness and continuity are explicitly imposed. All the applicable constraints are learned and internally coded by the NN enabling it to be more flexible and more accurate than the existing methods. The approach is successfully tested on several random dot stereograms. It is shown that the net can generalize its learned map ping to cases outside its training set. Advantages over the Marr-Poggio Algorithm are discussed and it is shown that the NN performance is supe rIOr. 1 INTRODUCTION Three-dimensional image processing is an indispensable property for any advanced computer vision system. Depth perception is an integral part of 3-d processing. It involves computation of the relative distances of the points seen in the 2-d images to the imaging device. There are several methods to obtain depth information. A common technique is stereo imaging. It uses two cameras displaced by a known distance to generate two images of the same scene taken from these two different viewpoints.