Avoiding Monocular Artifacts in Clinical Stereotests Presented on Column
Total Page:16
File Type:pdf, Size:1020Kb
Journal of Vision (2016) 16(14):13, 1–14 1 Avoiding monocular artifacts in clinical stereotests presented on column-interleaved digital stereoscopic displays Faculty of Psychology, Universidad Complutense de Madrid, Madrid, Spain Institute of Neuroscience, Newcastle University, # Ignacio Serrano-Pedraza Newcastle upon Tyne, UK $ Institute of Neuroscience, Newcastle University, Kathleen Vancleef Newcastle upon Tyne, UK $ Institute of Neuroscience, Newcastle University, # Jenny C. A. Read Newcastle upon Tyne, UK $ New forms of stereoscopic 3-D technology offer vision scientists new opportunities for research, but also Introduction come with distinct problems. Here we consider autostereo displays where the two eyes’ images are Technical advances are offering vision scientists new spatially interleaved in alternating columns of pixels ways of displaying stereo images. One example is the and no glasses or special optics are required. Column- development of autostereoscopic 3-D displays, which interleaved displays produce an excellent stereoscopic do not require the use of eyeglasses or mirrors to view effect, but subtle changes in the angle of view can them. The two most common multiplexing techniques increase cross talk or even interchange the left and used in autostereo displays are the parallax barrier right eyes’ images. This creates several challenges to (using opaque layers) and the microlens technique the presentation of cyclopean stereograms (containing (using cylindrical lenslets; Dodgson, 2005; Holliman, structure which is only detectable by binocular vision). Dodgson, Favalora, & Pockett, 2011; Konrad & Halle, We discuss the potential artifacts, including one that is 2007; Peterka et al., 2008; Sexton & Surman, 1999). In unique to column-interleaved displays, whereby scene this work we will focus on the parallax-barrier elements such as dots in a random-dot stereogram technique, which produces a column-interleaved stereo appear wider or narrower depending on the sign of display. The parallax barrier is in fact one of the oldest their disparity. We derive an algorithm for creating autostereoscopic techniques (Sexton & Surman, 1999): stimuliwhicharefreefromthisartifact.Weshowthat In 1838, Wheatstone proposed a simple version of this this and other artifacts can be avoided by (a) using a task which is robust to disparity-sign inversion—for technique (see his figure 6) in order to help fuse two example, a disparity-detection rather than disparate images when the naked eyes are used. discrimination task—(b) using our proposed algorithm As generally implemented today, digital parallax- to ensure that parallax is applied symmetrically on the barrier stereoscopic displays consist of two LCD panels column-interleaved display, and (c) using a dynamic overlaid on one another with a precise geometric stimulus to avoid monocular artifacts from motion relationship (Konrad & Halle, 2007). The back panel is parallax. In order to test our recommendations, we used as normal to display the images, and the front is performed two experiments using a stereoacuity task transparent when the device is used in 2-D mode. When implemented with a parallax-barrier tablet. Our the 3-D display is activated, the front LCD panel results confirm that these recommendations eliminate generates opaque vertical grid lines (Figure 1). When the artifacts. We believe that these recommendations the viewer is in the right position, odd columns of pixels will be useful to vision scientists interested in running are visible only to one eye, while even columns are stereo psychophysics experiments using parallax- visible only to the other. Thus this technique allows two barrier and other column-interleaved digital displays. disparate images to be presented in column-interleaved Citation: Serrano-Pedraza, I., Vancleef, K., & Read, J. C. A. (2016). Avoiding monocular artifacts in clinical stereotests presented on column-interleaved digital stereoscopic displays. Journal of Vision, 16(14):13, 1–14, doi:10.1167/16.14.13. doi: 10.1167/16.14.13 Received August 10, 2016; published November 16, 2016 ISSN 1534-7362 This work is licensed under a Creative Commons Attribution 4.0 International License. Downloaded From: http://jov.arvojournals.org/pdfaccess.ashx?url=/data/Journals/JOV/935848/ on 11/18/2016 Journal of Vision (2016) 16(14):13, 1–14 Serrano-Pedraza, Vancleef, & Read 2 Figure 1. Basic idea behind the parallax-barrier technology. (a) A perspective example. (b) A top view. format on a single screen, one image to each eye, so it is available on handheld mobile devices, making it they can be fused without using 3-D glasses. portable and convenient. One limitation of these parallax-barrier displays is The fundamental requirement of a stereoacuity test is that the spatial resolution of the image in the horizontal that it must not have monocular cues (e.g., occlusion, dimension is halved. A further limitation is that the texture gradient, relative size, motion parallax) that occlusion geometry only holds over a limited range of enable observers to perform correctly without using their viewing distances and only if the display is frontopar- stereovision. Many current clinical stereotests, such as allel, so that the interocular axis is parallel to the screen the Randot (Figure 2), Frisby (Figure 3), TNO, Lang, plane. If the display is rotated even slightly away from and Random-Dot E tests, try to avoid the presence of frontoparallel (e.g., viewed from the side), both images monocular depth cues by using random-element stereo- will become visible to both eyes. This can also occur if grams (Julesz, 1960). The subject has to detect a target the observer views the display from the wrong distance, which—ideally—is perfectly camouflaged in the monoc- or with more extreme rotations about the interocular ular images and can be detected only by stereopsis (in axis (e.g., if the display is viewed from above or below; Julesz’s terminology, the target is cyclopean). In all of see Figure 11A). With more extreme rotations away these tests, monocular artifacts are a potential issue if from frontoparallel (more oblique viewing, e.g., if the care is not taken in the administration of the test. display is viewed from the left or right side), the images Most current stereotests use 3-D glasses, either can become inverted so that the image intended for the polarized (Randot, Random-Dot E) or anaglyph right eye will be visible only to the left, and vice versa. (TNO), to separate the images presented to each eye. In this article, we consider the use of column- The use of 3-D glasses often allows significant cross interleaved autostereo digital technology for clinical talk between the two eyes—that is, some fraction of the tests of stereoacuity, or stereotests. This technology has image that is presented to one eye also passes through three main advantages that make it particularly the filter that covers the other eye. Cross talk is attractive for clinical applications: (a) It does not undesirable because it reduces stereoacuity and depth require special glasses or other optics, which is perception (Cormack, Stevenson, & Landers, 1997; especially useful with children; (b) it offers very low Schor & Heckmann, 1989). Potentially, cross talk can interocular cross talk when correctly positioned; and (c) also ‘‘de-camouflage’’ a cyclopean object, enabling a Figure 2. Possible cross-talk artifacts in the Randot stereotest. (A) Random-dot component, in which the task is to recognize the disparate symbol (the letter E). (B) Animals component, in which the task is to identify the nearest animal (the cat, fourth from the left). If the viewer removes his or her 3-D glasses or tilts his or her head 458, so that both eyes view the merged binocular image instead of each eye seeing its intended image, the correct answer is visible monocularly in both cases. Downloaded From: http://jov.arvojournals.org/pdfaccess.ashx?url=/data/Journals/JOV/935848/ on 11/18/2016 Journal of Vision (2016) 16(14):13, 1–14 Serrano-Pedraza, Vancleef, & Read 3 Figure 3. (A) Frisby stereotest. (B) Schematic idea of a disparity-detection test. Four textured patches are presented, all at the same background parallax except one, which contains a target at a different parallax. The task is to identify the patch containing the target. stereoblind user to detect a target which was intended element cyclopean content generated for a non-column- to be visible only to stereopsis. For example, in the interleaved display is displayed in column-interleaved Randot stereotest, subjects are asked to identify format, the elements appear wider or narrower on the cyclopean shapes in a random-dot pattern. When the screen depending on the sign of their disparity (near or test is viewed without glasses, the disparate dots appear far relative to the screen). When combined with cross- twice, meaning that the shapes are clearly visible talk artifacts, this could also allow observers to detect monocularly (Figure 2A). The same problem also the stimulus using monocular cues. We will show applies even with glasses if the subject tilts his or her examples of this artifact and a procedure to get rid of it. head. The Randot stereotest uses linear polarization to However, the critical advantage of digital displays separate left and right images, so a head tilt of 458 over the paper and plastic used for current clinical results in 100% cross talk. stereotests is that it is possible to design a stereotest to The Lang and Frisby stereotests both avoid the need be robust to all these artifacts. We will explain how to for 3-D glasses. The Lang stereotest uses column- achieve this, and will show data indicating that after interleaved autostereo lenticular technology, in which our strategies are applied, viewers cannot achieve lenses are used to direct each image to the appropriate artificially good results through the use of monocular eye. If the subject is allowed to tilt the test card back and cues. With these strategies, digital column-interleaved forth, he or she can identify the disparate shape from the 3-D displays are far more robust to monocular-cue monocular motion (i.e., motion parallax) as the left and artifacts than are current clinical stereotests.