Developing a Cinematic Language for Virtual Reality Filmmaking Author Zhang, Yu Published 2020-11-16 Thesis Type Thesis (PhD Doctorate) School Griffith Film School DOI https://doi.org/10.25904/1912/4021 Copyright Statement The author owns the copyright in this thesis, unless stated otherwise. Downloaded from http://hdl.handle.net/10072/399975 Griffith Research Online https://research-repository.griffith.edu.au Developing a Cinematic Language for Virtual Reality Filmmaking Yu Zhang BA, Art Design BE, Computer Science and Technology MA, Drama and Film & TV Science Griffith Film School Arts, Education and Law Griffith University Submitted in fulfillment of the requirements of the degree of Doctor of Philosophy March 2020 ABSTRACT Many international film festivals, such as those held in Venice, Cannes and Melbourne, have recently established award categories for Cinematic Virtual Reality (CVR) films. However, short videos and animation works still dominate the global CVR film industry and full-length CVR feature films remain largely unsupported. This study aims to contribute to the promotion of the CVR feature film as a viable narrative format. As the focus of this investigation, CVR film represents not only an exciting nexus between computer technology and filmic creativity but also a transformation in the way films are produced and consumed. Filmmakers aspiring to engage with this medium are faced with its significant innovative potential and consequently, with negotiating a new CVR language, production methods and techniques. The main purpose of this research is to contribute to the development of a cinematic language that can be applied to CVR filmmaking. The present study has made much progress to that end, focusing on three aspects of CVR filmmaking: CVR cinematography, cutting and editing and composition and spatial narrative. The outcomes of this study can be applied in the form of a toolbox to assist would-be CVR film directors in mastering the shooting and associated production techniques specific to CVR film production. Employing a Practice-Based Research (PBR) methodology, I have documented the progress of this research from conception to completion via a reflective journal. The main components of the PBR include a study of traditional film techniques, from which a series of CVR previsualisation (previs) experiments were conducted utilising key scenes from selected well-known films for CVR simulation. The results of these experiments were in turn used as the foundation for the second component of this research – the production of an original experimental CVR feature-length film that I directed, titled Calling. The final component of this research is a suite of new creative methods garnered from the previs experiments, culminating in a glossary of 23 new CVR-specific terms and production techniques. i As research on CVR film language and techniques is still emerging, traditional filmmakers are especially motivated to better understand the potential of this novel genre and production mode. Unlike conventional filmmaking cameras, CVR cameras have multiple lenses, which demand different shooting and production methods. Additionally, the CVR space that this form of filmmaking captures breaks the flat picture frame of conventional film. Therefore, traditional filmmakers must transcend their reliance on long- standing principles of “flat film” if they are to leverage the new and innovative storytelling potentials of the CVR medium. One of the major findings of this study is that although traditional film language is able to be partially applied to the production of CVR film, traditional filmmakers need to be strategically mindful of the differences, both large and small, between “flat film” and CVR film. In particular, CVR film directors must be willing to reconceptualise their own roles in the overall filmmaking process as the CVR film is much less director-centered than traditional film and thus more audience-centered. From this reconceptualisation, CVR filmmakers need to shift their narrative-centric mode of thinking to a spatial thinking mode if they are to embrace the full creative possibilities of this emerging filmic medium. ii STATEMENT OF ORIGINALITY This work has not previously been submitted for a degree or diploma in any university. To the best of my knowledge and belief, the thesis contains no material previously published or written by another person except where due reference is made in the thesis itself. __ Yu Zhang March 2020 iii TABLE OF CONTENTS ABSTRACT ................................................................................................................ i STATEMENT OF ORIGINALITY .............................................................................. iii LIST OF FIGURES ................................................................................................... vi LIST OF TABLES ................................................................................................... viii ACKNOWLEDGEMENTS......................................................................................... ix CHAPTER 1: INTRODUCTION & BACKGROUND ................................................... 1 Statement of the Problem ............................................................................................. 1 Motivations for Research .............................................................................................. 1 Scope of the Study........................................................................................................ 2 Defining Cinematic Virtual Reality ................................................................................. 3 Cinematic Virtual Reality as a New Audio-visual Medium.............................................. 4 Cinematic Virtual Reality (CVR) as an Emerging Cinematic Language ......................... 5 Evolution of Virtual Reality in Brief ................................................................................ 6 Differences between Conventional 2D and CVR Film Production ................................. 8 Screen differences ........................................................................................................ 8 Significance of the Study............................................................................................. 13 Research Outcomes ................................................................................................... 16 Conclusion .................................................................................................................. 16 CHAPTER 2: CONTEXTUAL REVIEW ................................................................... 17 Introduction ................................................................................................................. 17 Section One: Review of Virtual Reality Films .............................................................. 17 Section Two: Creating the Cinematic Shot .................................................................. 30 Section Three: Editing ................................................................................................. 38 Section Four: Composition and Narrative .................................................................... 44 Conclusion .................................................................................................................. 52 CHAPTER 3: METHODOLOGY - PRACTICE-BASED RESEARCH ....................... 53 Introduction ................................................................................................................. 53 PBR as an Emerging Research Paradigm in Art and Design ...................................... 53 The Research Framework........................................................................................... 56 A Research Methodology Embedded in Cinema Theory and Practice ........................ 57 iv Practical and Analytical Tools ..................................................................................... 59 The Creative Artefact – Making of Calling, Research Questions, Evaluations & Reflections .................................................................................................................. 64 Conclusion .................................................................................................................. 66 CHAPTER 4: FOUNDATION WORK – 3D CVR PREVIsualisation ........................ 67 Introduction ................................................................................................................. 67 Findings & Discussion of CVR Previsualisation Experiments ...................................... 67 Conclusion .................................................................................................................. 96 CHAPTER 5: CALLING, A CASE STUDY – THE MAKING OF A CVR FEATURE- LENGTH FILM ......................................................................................................... 99 Introduction ................................................................................................................. 99 Applied Production Technique 1: CVR Cinematography ............................................. 99 Applied Production Technique 2: Editing in Calling ................................................... 110 Applied Production Technique 3: CVR Long Take .................................................... 118 Applied Production Technique 4: Spatial Composition .............................................. 121 Applied Production Technique