DOCSLIB.ORG

Developing Gameplay Mechanics for Head-Tracked Stereoscopy: a Feasibility Study B.Sc

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Developing Gameplay Mechanics for Head-Tracked Stereoscopy: a Feasibility Study B.Sc UNIVERSITY CAMPUS SUFFOLK Developing Gameplay Mechanics for Head-Tracked Stereoscopy: A Feasibility Study B.Sc. (Hons) Computer Games Programming Roger Creyke (s110431) 14th May 2010 This text investigates the feasibility and limitations of developing gameplay mechanics for modern three dimensional game environments, specifically with tracked stereoscopic imaging via the use of a virtual reality head mounted display. Developing Gameplay Mechanics for Head-Tracked Stereoscopy Roger Creyke (s110431) Acknowledgements I would very much like to thank: My wife Rachel for her support, patience, love and everything in between. My parents for their love, support, and tolerance of my academic procrastination. My programming tutor Dr Andrew Revitt for his enthusiasm and encouragement. My dissertation tutors Chris Janes and Robert Kurta for their guidance. My colleagues Alex Webb, Matt David and Daniel Stamp for their help with proof reading. 14th May 2010 Page 2 Developing Gameplay Mechanics for Head-Tracked Stereoscopy Roger Creyke (s110431) Contents 1 Introduction .......................................................................................................................................... 4 1.1 Central Problematic .............................................................................................................................. 4 1.2 Aims and Objectives .............................................................................................................................. 4 2 Literature Review .................................................................................................................................. 5 2.1 Stereoscopy ........................................................................................................................................... 5 2.2 Tracking ................................................................................................................................................. 7 2.3 Head Mounted Displays ........................................................................................................................ 9 3 Research .............................................................................................................................................. 11 3.1 Principle Research Objectives ............................................................................................................. 11 3.2 Research Method ................................................................................................................................ 11 3.2.1 Installation ...................................................................................................................................... 11 3.2.2 Interfacing ....................................................................................................................................... 11 3.2.3 Testbed ........................................................................................................................................... 12 3.2.4 Gameplay Mechanics ...................................................................................................................... 13 4 Conclusion ........................................................................................................................................... 16 4.1 Findings ............................................................................................................................................... 16 4.2 Summary & Recommendations .......................................................................................................... 16 4.3 Further Development .......................................................................................................................... 16 5 Bibliography ........................................................................................................................................ 17 6 Table of Figures ................................................................................................................................... 19 7 Glossary of Terms ................................................................................................................................ 20 8 Table of Software ................................................................................................................................ 21 9 Appendices .......................................................................................................................................... 22 9.1 Project Plan ......................................................................................................................................... 22 9.2 Headset Interface Code ....................................................................................................................... 23 9.2.1 Headset.cs ....................................................................................................................................... 23 9.2.2 HeadsetEye.cs ................................................................................................................................. 29 9.2.3 HeadsetMeasurement.cs ................................................................................................................ 30 14th May 2010 Page 3 Developing Gameplay Mechanics for Head-Tracked Stereoscopy Roger Creyke (s110431) 1 Introduction Virtual reality head mounted displays are head mounted devices which usually project a three dimensional image to the user via the use of stereoscopic visual displays and monitor the user’s movements via the use of tracking devices. A stereoscopic visual display is a device which displays two images, usually taken from offset angles, to give the illusion of depth. A tracking device is a piece of hardware which monitors the movement of its user. The application of virtual reality head mounted displays (HMDs) within the field of interactive entertainment is not a new proposition, but while such systems have been trialled commercially for over 20 years, they have yet to be adopted by the mainstream consumer market. This paper documents an investigation into the history of head mounted stereoscopy and attempts to clarify why the games industry has been hesitant to embrace the technology by understanding the limitations of, and difficulties with, developing tracked stereoscopic gameplay mechanics. Specifically, the development processes required to create a modern interactive application are investigated for such systems. Finally, presented are a number of new potential gameplay mechanics designed for stereoscopic HMDs. This paper outlines a number of methods available for implementing head mounted virtual reality. Firstly, the science of stereoscopy is investigated with the intention of understanding how users perceive depth, and what methods can be used to create an artificial sense of perspective. Secondly, the science of tracking is explored in detail, with the intention of understanding the optimum method available for delivering a convincing yet practical interactive experience. Research into the practical creation of two gameplay mechanics is discussed in detail along with both initial and retrospective observations of notable difficulties during development. Development of a custom headset interface library is also documented. Source code for the library is included, fully annotated and available for use in similar projects. Finally, a conclusion is presented, with recommendations for those who may be considering pursuing stereoscopic tracked gameplay development. This outlines limitations of the concept, workarounds for potential issues and an overall assessment of the feasibility of such an undertaking. 1.1 Central Problematic To understand the practicalities, difficulties and limitations of developing gameplay mechanics for head tracked stereoscopic vision, with the intention of deciding whether this technology is widely suitable to the field of interactive entertainment. 1.2 Aims and Objectives This research project was chosen with the intention of achieving the following goals: To understand the science behind stereoscopy and head tracking. To develop a custom process for prototyping gameplay mechanics with an HMD. To apply knowledge garnered from the undergraduate degree course. To satisfy a personal interest in the subject matter. 14th May 2010 Page 4 Developing Gameplay Mechanics for Head-Tracked Stereoscopy Roger Creyke (s110431) 2 Literature Review 2.1 Stereoscopy “A visual display channel is a presentation of visual information displayed for one eye. Two visual display channels with separate views are required to achieve stereopsis.” (Sherman, 2003, p. 124) Stereoscopy is a broad term which defines any technique capable of recording three-dimensional visual information of an object or scene from dual observation points (see Figure 1). The ability to judge distance from the point of the observer through the use of this binocular vision is known as stereopsis. Kim argues that humans are 3D-orientated creatures, and operate daily using the depth perception capability in the immediate space around them. Consequently, providing depth information is important in realising 3D and natural interaction in the virtual environment (Kim, 2005, p. 81). Figure 1 - Stereoscopy Human beings exist or at least perceive to exist in a three dimensional environment and can perceive depth relative to their point of observation by using natural stereoscopic
Load more

Recommended publications
  • Stereoscopic Vision, Stereoscope, Selection of Stereo Pair and Its Orientation
    International Journal of Science and Research (IJSR) ISSN (Online): 2319-7064 Impact Factor (2012): 3.358 Stereoscopic Vision, Stereoscope, Selection of Stereo Pair and Its Orientation Sunita Devi Research Associate, Haryana Space Application Centre (HARSAC), Department of Science & Technology, Government of Haryana, CCS HAU Campus, Hisar – 125 004, India , Abstract: Stereoscope is to deflect normally converging lines of sight, so that each eye views a different image. For deriving maximum benefit from photographs they are normally studied stereoscopically. Instruments in use today for three dimensional studies of aerial photographs. If instead of looking at the original scene, we observe photos of that scene taken from two different viewpoints, we can under suitable conditions, obtain a three dimensional impression from the two dimensional photos. This impression may be very similar to the impression given by the original scene, but in practice this is rarely so. A pair of photograph taken from two cameras station but covering some common area constitutes and stereoscopic pair which when viewed in a certain manner gives an impression as if a three dimensional model of the common area is being seen. Keywords: Remote Sensing (RS), Aerial Photograph, Pocket or Lens Stereoscope, Mirror Stereoscope. Stereopair, Stere. pair’s orientation 1. Introduction characteristics. Two eyes must see two images, which are only slightly different in angle of view, orientation, colour, A stereoscope is a device for viewing a stereoscopic pair of brightness, shape and size. (Figure: 1) Human eyes, fixed on separate images, depicting left-eye and right-eye views of same object provide two points of observation which are the same scene, as a single three-dimensional image.
    [Show full text]
  • Interacting with Autostereograms
    See discussions, stats, and author profiles for this publication at: https://www.researchgate.net/publication/336204498 Interacting with Autostereograms Conference Paper · October 2019 DOI: 10.1145/3338286.3340141 CITATIONS READS 0 39 5 authors, including: William Delamare Pourang Irani Kochi University of Technology University of Manitoba 14 PUBLICATIONS 55 CITATIONS 184 PUBLICATIONS 2,641 CITATIONS SEE PROFILE SEE PROFILE Xiangshi Ren Kochi University of Technology 182 PUBLICATIONS 1,280 CITATIONS SEE PROFILE Some of the authors of this publication are also working on these related projects: Color Perception in Augmented Reality HMDs View project Collaboration Meets Interactive Spaces: A Springer Book View project All content following this page was uploaded by William Delamare on 21 October 2019. The user has requested enhancement of the downloaded file. Interacting with Autostereograms William Delamare∗ Junhyeok Kim Kochi University of Technology University of Waterloo Kochi, Japan Ontario, Canada University of Manitoba University of Manitoba Winnipeg, Canada Winnipeg, Canada [email protected] [email protected] Daichi Harada Pourang Irani Xiangshi Ren Kochi University of Technology University of Manitoba Kochi University of Technology Kochi, Japan Winnipeg, Canada Kochi, Japan [email protected] [email protected] [email protected] Figure 1: Illustrative examples using autostereograms. a) Password input. b) Wearable e-mail notification. c) Private space in collaborative conditions. d) 3D video game. e) Bar gamified special menu. Black elements represent the hidden 3D scene content. ABSTRACT practice. This learning effect transfers across display devices Autostereograms are 2D images that can reveal 3D content (smartphone to desktop screen). when viewed with a specific eye convergence, without using CCS CONCEPTS extra-apparatus.
    [Show full text]
  • Multi-Perspective Stereoscopy from Light Fields
    Multi-Perspective stereoscopy from light fields The MIT Faculty has made this article openly available. Please share how this access benefits you. Your story matters. Citation Changil Kim, Alexander Hornung, Simon Heinzle, Wojciech Matusik, and Markus Gross. 2011. Multi-perspective stereoscopy from light fields. ACM Trans. Graph. 30, 6, Article 190 (December 2011), 10 pages. As Published http://dx.doi.org/10.1145/2070781.2024224 Publisher Association for Computing Machinery (ACM) Version Author's final manuscript Citable link http://hdl.handle.net/1721.1/73503 Terms of Use Creative Commons Attribution-Noncommercial-Share Alike 3.0 Detailed Terms http://creativecommons.org/licenses/by-nc-sa/3.0/ Multi-Perspective Stereoscopy from Light Fields Changil Kim1,2 Alexander Hornung2 Simon Heinzle2 Wojciech Matusik2,3 Markus Gross1,2 1ETH Zurich 2Disney Research Zurich 3MIT CSAIL v u s c Disney Enterprises, Inc. Input Images 3D Light Field Multi-perspective Cuts Stereoscopic Output Figure 1: We propose a framework for flexible stereoscopic disparity manipulation and content post-production. Our method computes multi-perspective stereoscopic output images from a 3D light field that satisfy arbitrary prescribed disparity constraints. We achieve this by computing piecewise continuous cuts (shown in red) through the light field that enable per-pixel disparity control. In this particular example we employed gradient domain processing to emphasize the depth of the airplane while suppressing disparities in the rest of the scene. Abstract tions of autostereoscopic and multi-view autostereoscopic displays even glasses-free solutions become available to the consumer. This paper addresses stereoscopic view generation from a light field. We present a framework that allows for the generation However, the task of creating convincing yet perceptually pleasing of stereoscopic image pairs with per-pixel control over disparity, stereoscopic content remains difficult.
    [Show full text]
  • STAR 1200 & 1200XL User Guide
    STAR 1200 & 1200XL Augmented Reality Systems User Guide VUZIX CORPORATION VUZIX CORPORATION STAR 1200 & 1200XL – User Guide © 2012 Vuzix Corporation 2166 Brighton Henrietta Town Line Road Rochester, New York 14623 Phone: 585.359.5900 ! Fax: 585.359.4172 www.vuzix.com 2 1. STAR 1200 & 1200XL OVERVIEW ................................... 7! System Requirements & Compatibility .................................. 7! 2. INSTALLATION & SETUP .................................................. 14! Step 1: Accessory Installation .................................... 14! Step 2: Hardware Connections .................................. 15! Step 3: Adjustment ..................................................... 19! Step 4: Software Installation ...................................... 21! Step 5: Tracker Calibration ........................................ 24! 3. CONTROL BUTTON & ON SCREEN DISPLAY ..................... 27! VGA Controller .................................................................... 27! PowerPak+ Controller ......................................................... 29! OSD Display Options ........................................................... 30! 4. STAR HARDWARE ......................................................... 34! STAR Display ...................................................................... 34! Nose Bridge ......................................................................... 36! Focus Adjustment ................................................................ 37! Eye Separation ...................................................................
    [Show full text]
  • A Novel Walk-Through 3D Display
    A Novel Walk-through 3D Display Stephen DiVerdia, Ismo Rakkolainena & b, Tobias Höllerera, Alex Olwala & c a University of California at Santa Barbara, Santa Barbara, CA 93106, USA b FogScreen Inc., Tekniikantie 12, 02150 Espoo, Finland c Kungliga Tekniska Högskolan, 100 44 Stockholm, Sweden ABSTRACT We present a novel walk-through 3D display based on the patented FogScreen, an “immaterial” indoor 2D projection screen, which enables high-quality projected images in free space. We extend the basic 2D FogScreen setup in three ma- jor ways. First, we use head tracking to provide correct perspective rendering for a single user. Second, we add support for multiple types of stereoscopic imagery. Third, we present the front and back views of the graphics content on the two sides of the FogScreen, so that the viewer can cross the screen to see the content from the back. The result is a wall- sized, immaterial display that creates an engaging 3D visual. Keywords: Fog screen, display technology, walk-through, two-sided, 3D, stereoscopic, volumetric, tracking 1. INTRODUCTION Stereoscopic images have captivated a wide scientific, media and public interest for well over 100 years. The principle of stereoscopic images was invented by Wheatstone in 1838 [1]. The general public has been excited about 3D imagery since the 19th century – 3D movies and View-Master images in the 1950's, holograms in the 1960's, and 3D computer graphics and virtual reality today. Science fiction movies and books have also featured many 3D displays, including the popular Star Wars and Star Trek series. In addition to entertainment opportunities, 3D displays also have numerous ap- plications in scientific visualization, medical imaging, and telepresence.
    [Show full text]
  • Investigating Intermittent Stereoscopy: Its Effects on Perception and Visual Fatigue
    ©2016 Society for Imaging Science and Technology DOI: 10.2352/ISSN.2470-1173.2016.5.SDA-041 INVESTIGATING INTERMITTENT STEREOSCOPY: ITS EFFECTS ON PERCEPTION AND VISUAL FATIGUE Ari A. Bouaniche, Laure Leroy; Laboratoire Paragraphe, Université Paris 8; Saint-Denis; France Abstract distance in virtual environments does not clearly indicate that the In a context in which virtual reality making use of S3D is use of binocular disparity yields a better performance, and a ubiquitous in certain industries, as well as the substantial amount cursory look at the literature concerning the viewing of of literature about the visual fatigue S3D causes, we wondered stereoscopic 3D (henceforth abbreviated S3D) content leaves little whether the presentation of intermittent S3D stimuli would lead to doubt as to some negative consequences on the visual system, at improved depth perception (over monoscopic) while reducing least for a certain part of the population. subjects’ visual asthenopia. In a between-subjects design, 60 While we do not question the utility of S3D and its use in individuals under 40 years old were tested in four different immersive environments in this paper, we aim to position conditions, with head-tracking enabled: two intermittent S3D ourselves from the point of view of user safety: if, for example, the conditions (Stereo @ beginning, Stereo @ end) and two control use of S3D is a given in a company setting, can an implementation conditions (Mono, Stereo). Several optometric variables were of intermittent horizontal disparities aid in depth perception (and measured pre- and post-experiment, and a subjective questionnaire therefore in task completion) while impacting the visual system assessing discomfort was administered.
    [Show full text]
  • THE INFLUENCES of STEREOSCOPY on VISUAL ARTS Its History, Technique and Presence in the Artistic World
    University of Art and Design Cluj-Napoca PhD THESIS SUMMARY THE INFLUENCES OF STEREOSCOPY ON VISUAL ARTS Its history, technique and presence in the artistic world PhD Student: Scientific coordinator: Nyiri Dalma Dorottya Prof. Univ. Dr. Ioan Sbârciu Cluj-Napoca 2019 1 CONTENTS General introduction ........................................................................................................................3 Chapter 1: HISTORY OF STEREOSCOPY ..............................................................................4 1.1 The theories of Euclid and the experiments of Baptista Porta .........................................5 1.2 Leonardo da Vinci and Francois Aguillon (Aguilonius) .................................................8 1.3 The Inventions of Sir Charles Wheatstone and Elliot ...................................................18 1.4 Sir David Brewster's contributions to the perfection of the stereoscope .......................21 1.5 Oliver Wendell Holmes, the poet of stereoscopy ..........................................................23 1.6 Apex of stereoscopy .......................................................................................................26 1.7 Underwood & Keystone .................................................................................................29 1.8 Favorite topics in stereoscopy ........................................................................................32 1.8.1 Genre Scenes33 .........................................................................................................33
    [Show full text]
  • 2018 First Call for Papers4 2013+First+Call+For+Papers+V4.Qxd
    FIRST CALL FOR PAPERS Display Week 2018 Society for Information Display INTERNATIONAL SYMPOSIUM, SEMINAR & EXHIBITION May 20 – 25, 2018 LOS ANGELES CONVENTION CENTER LOS ANGELES, CALIFORNIA, USA www.displayweek.org • Photoluminescence and Applications – Using quantum Special Topics for 2018 nanomaterials for color-conversion applications in display components and in pixel-integrated configurations. Optimizing performance and stability for integration on- The Display Week 2018 Technical Symposium will chip (inside LED package) and in remote phosphor be placing special emphasis on four Special Topics configurations for backlight units. of Interest to address the rapid growth of the field of • Micro Inorganic LEDs and Applications – Emerging information display in the following areas: Augmented technologies based on scaling down inorganic LEDs for Reality, Virtual Reality, and Artificial Intelligence; use as arrayed emitters in display applications, with Quantum Dots and Micro-LEDs; and Wearable opportunities from large video displays down to high Displays, Sensors, and Devices. Submissions relating resolution microdisplays. Science and technology of to these special topics are highly encouraged. micro LED devices, materials, and processes for the fabrication and integration with electronic drive back- 1. AUGMENTED REALITY, VIRTUAL REALITY, AND planes. Color generation, performance, and stability. ARTIFICIAL INTELLIGENCE (AR, VR, AND AI) Packaging and module assembly solutions for emerging This special topic will cover the technologies and
    [Show full text]
  • Construction of Autostereograms Taking Into Account Object Colors and Its Applications for Steganography
    Construction of Autostereograms Taking into Account Object Colors and its Applications for Steganography Yusuke Tsuda Yonghao Yue Tomoyuki Nishita The University of Tokyo ftsuday,yonghao,[email protected] Abstract Information on appearances of three-dimensional ob- jects are transmitted via the Internet, and displaying objects q plays an important role in a lot of areas such as movies and video games. An autostereogram is one of the ways to represent three- dimensional objects taking advantage of binocular paral- (a) SS-relation (b) OS-relation lax, by which depths of objects are perceived. In previous Figure 1. Relations on an autostereogram. methods, the colors of objects were ignored when construct- E and E indicate left and right eyes, re- ing autostereogram images. In this paper, we propose a L R spectively. (a): A pair of points on the screen method to construct autostereogram images taking into ac- and a single point on the object correspond count color variation of objects, such as shading. with each other. (b): A pair of points on the We also propose a technique to embed color informa- object and a single point on the screen cor- tion in autostereogram images. Using our technique, au- respond with each other. tostereogram images shown on a display change, and view- ers can enjoy perceiving three-dimensional object and its colors in two stages. Color information is embedded in we propose an approach to take into account color variation a monochrome autostereogram image, and colors appear of objects, such as shading. Our approach assign slightly when the correct color table is used.
    [Show full text]
  • The Varriertm Autostereoscopic Virtual Reality Display
    submission id papers_0427 The VarrierTM Autostereoscopic Virtual Reality Display Daniel J. Sandin, Todd Margolis, Jinghua Ge, Javier Girado, Tom Peterka, Thomas A. DeFanti Electronic Visualization Laboratory University of Illinois at Chicago [email protected] Abstract In most other lenticular and barrier strip implementations, stereo is achieved by sorting image slices in integer (image) coordinates. Virtual reality (VR) has long been hampered by the gear Moreover, many autostereo systems compress scene depth in the z needed to make the experience possible; specifically, stereo direction to improve image quality but Varrier is orthoscopic, glasses and tracking devices. Autostereoscopic display devices are which means that all 3 dimensions are displayed in the same gaining popularity by freeing the user from stereo glasses, scale. Besides head-tracked perspective interaction, the user can however few qualify as VR displays. The Electronic Visualization further interact with VR applications through hand-held devices Laboratory (EVL) at the University of Illinois at Chicago (UIC) such as a 3d wand, for example to control navigation through has designed and produced a large scale, high resolution head- virtual worlds. tracked barrier-strip autostereoscopic display system that There are four main contributions of this paper. New virtual produces a VR immersive experience without requiring the user to barrier algorithms are presented that enhance image quality and wear any encumbrances. The resulting system, called Varrier, is a lower color shifts by operating at sub-pixel resolution. Automated passive parallax barrier 35-panel tiled display that produces a camera-based registration of the physical and virtual barrier strip wide field of view, head-tracked VR experience.
    [Show full text]
  • Stereogram Design for Testing Local Stereopsis
    Stereogram design for testing local stereopsis Gerald Westheimer and Suzanne P. McKee The basic ability to utilize disparity as a depth cue, local stereopsis, does not suffice to respond to random dot stereograms. They also demand complex perceptual processing to resolve the depth ambiguities which help mask their pattern from monocular recognition. This requirement may cause response failure in otherwise good stereo subjects and seems to account for the long durations of exposure required for target disparities which are still much larger than the best stereo thresholds. We have evaluated spatial stimuli that test local stereopsis and have found that targets need to be separated by at least 10 min arc to obtain good stereo thresholds. For targets with optimal separation of components and brief exposure duration (250 msec), thresh- olds fall in the range of 5 to 15 sec arc. Intertrial randomization of target lateral placement can effectively eliminate monocular cues and yet allow excellent stereoacuity. Stereoscopic acuity is less seriously affected by a small amount of optical defocus when target elements are widely, separated than when they are crowded, though in either case the performance decrement is higher than for ordinary visual acuity. Key words: stereoscopic acuity, local stereopsis, global stereopsis, optical defocus A subject is said to have stereopsis if he can are very low indeed, certainly under 10 sec detect binocular disparity of retinal images arc in a good observer, and such low values and associate the quality of depth with it. In can be attained with exposures of half a sec- its purest form this would manifest itself by ond or even less.
    [Show full text]
  • Evaluating Relative Impact of Vr Components Screen Size, Stereoscopy and Field of View on Spatial Comprehension and Presence in Architecture
    EVALUATING RELATIVE IMPACT OF VR COMPONENTS SCREEN SIZE, STEREOSCOPY AND FIELD OF VIEW ON SPATIAL COMPREHENSION AND PRESENCE IN ARCHITECTURE by Nevena Zikic Technical Report No.53 May 2007 Computer Integrated Construction Research Program The Pennsylvania State University ©Copyright University Park, PA, 16802 USA ABSTRACT In the last couple of years, computing technology has brought new approaches to higher education, particularly in architecture. They include simulations, multimedia presentations, and more recently, Virtual Reality. Virtual Reality (also referred to as Virtual Environment) is a computer generated three-dimensional environment which responds in real time to the activities of its users. Studies have been performed to examine Virtual Reality’s potential in education. Although the results point to the usefulness of Virtual Reality, recognition of what is essential and how it can be further adapted to educational purposes is still in need of research. The purpose of this study is to examine Virtual Reality components and assess their potential and importance in an undergraduate architectural design studio setting. The goal is to evaluate the relative contribution of Virtual Reality components: display and content variables, (screen size, stereoscopy and field of view; level of detail and level of realism, respectively) on spatial comprehension and sense of presence using a variable- centered approach in an educational environment. Examining the effects of these independent variables on spatial comprehension and sense of presence will demonstrate the potential strength of Virtual Reality as an instructional medium. This thesis is structured as follows; first, the architectural design process and Virtual Reality are defined and their connection is established.
    [Show full text]