DOCSLIB.ORG

An Analysis of the Current and Future State of 3D Facial Animation Techniques and Systems

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text

Load more

AN ANALYSIS OF THE CURRENT AND FUTURE STATE OF 3D FACIAL ANIMATION TECHNIQUES AND SYSTEMS by Chen Liu B.A., Communication University of China 2006 A THESIS SUBMITTED IN PARTIAL FULFILLMENT OF THE REQUIREMENTS FOR THE DEGREE OF MASTER OF SCIENCE In the School of Interactive Arts and Technology © Chen Liu 2009 SIMON FRASER UNIVERSITY Fall 2009 All rights reserved. However, in accordance with the Copyright Act of Canada, this work may be reproduced, without authorization, under the conditions for Fair Dealing. Therefore, limited reproduction of this work for the purposes of private study, research, criticism, review and news reporting is likely to be in accordance with the law, particularly if cited appropriately. APPROVAL Name: Chen Liu Degree: Master of Science Title of Essays: An analysis of the current and future state of 3D facial animation techniques and systems Examining Committee: Chair: ______________________________________ Dr. Bernhard Riecke Assistant Professor, Interactive Arts and Technology ______________________________________ Prof. Steve DiPaola Senior Supervisor Associate Professor, Interactive Arts and Technology ______________________________________ Dr. Chris Shaw Supervisor Associate Professor, Interactive Arts and Technology ______________________________________ Dr. Tom Calvert Internal Examiner Professor, Interactive Arts and Technology Date Defended/Approved: December-02-2009 ii Declaration of Partial Copyright Licence The author, whose copyright is declared on the title page of this work, has granted to Simon Fraser University the right to lend this thesis, project or extended essay to users of the Simon Fraser University Library, and to make partial or single copies only for such users or in response to a request from the library of any other university, or other educational institution, on its own behalf or for one of its users. The author has further granted permission to Simon Fraser University to keep or make a digital copy for use in its circulating collection (currently available to the public at the “Institutional Repository” link of the SFU Library website <www.lib.sfu.ca> at: <http://ir.lib.sfu.ca/handle/1892/112>) and, without changing the content, to translate the thesis/project or extended essays, if technically possible, to any medium or format for the purpose of preservation of the digital work. The author has further agreed that permission for multiple copying of this work for scholarly purposes may be granted by either the author or the Dean of Graduate Studies. It is understood that copying or publication of this work for financial gain shall not be allowed without the author’s written permission. Permission for public performance, or limited permission for private scholarly use, of any multimedia materials forming part of this work, may have been granted by the author. This information may be found on the separately catalogued multimedia material and in the signed Partial Copyright Licence. While licensing SFU to permit the above uses, the author retains copyright in the thesis, project or extended essays, including the right to change the work for subsequent purposes, including editing and publishing the work in whole or in part, and licensing other parties, as the author may desire. The original Partial Copyright Licence attesting to these terms, and signed by this author, may be found in the original bound copy of this work, retained in the Simon Fraser University Archive. Simon Fraser University Library Burnaby, BC, Canada Last revision: Spring 09 STATEMENT OF ETHICS APPROVAL The author, whose name appears on the title page of this work, has obtained, for the research described in this work, either: (a) Human research ethics approval from the Simon Fraser University Office of Research Ethics, or (b) Advance approval of the animal care protocol from the University Animal Care Committee of Simon Fraser University; or has conducted the research (c) as a co-investigator, collaborator or research assistant in a research project approved in advance, or (d) as a member of a course approved in advance for minimal risk human research, by the Office of Research Ethics. A copy of the approval letter has been filed at the Theses Office of the University Library at the time of submission of this thesis or project. The original application for approval and letter of approval are filed with the relevant offices. Inquiries may be directed to those authorities. Simon Fraser University Library Simon Fraser University Burnaby, BC, Canada Last update: Spring 2010 ABSTRACT Computer facial animation is now being used in a multitude of important fields. It brings a more human, social and dramatic reality to computer games, films and interactive multimedia, and is growing in use and importance. Authoring computer facial animation with complex and subtle expressions is still difficult and fraught with problems. It is currently mostly authored using generalized computer animation techniques, which often limit the quality and quantity of facial animation production. Given additional computer power, facial understanding and software sophistication, new face-centric methods are emerging but typically are immature in nature. This research attempts to define and organizationally categorize current and emerging methods, including surveying facial animation experts to define the current state of the field, perceived bottlenecks and emerging techniques. The thesis culminates in documenting this shared knowledge and making recommendations based on the data gathered, on possible new techniques for next generation, face-centric, computer animation systems. Keywords: facial animation; animation systems; animation techniques; user survey; motion capture iii DEDICATION To my loving husband Lei Chen, who has supported me throughout this entire venture. iv ACKNOWLEDGEMENTS I would like to thank my senior supervisor, Steve DiPaola. His guidance has helped me complete this study as well as complete my entire graduate career. Thank you for your great help with the whole process from constructing a viable survey to finding professional subjects in animation. Thanks also to the members of my committee and Tom Loughin who has assisted me through statistical analysis. I also want to thank my parents who have raised me and have taught me from a baby. If it were not because of your teaching and moral example, I would not have pursued a Master degree. All my success in the future will also be your success. In the end, I want to thank my husband Lei Chen for his support and love during my graduate studies. He gave me both economic and emotional support throughout these years. v TABLE OF CONTENTS Approval ............................................................................................................................ ii Abstract .............................................................................................................................iii Dedication ........................................................................................................................ iv Acknowledgements ........................................................................................................... v Table of contents .............................................................................................................. vi List of Figures .................................................................................................................. viii List of Tables ..................................................................................................................... x 1: Survey of 3D Facial Animation .................................................................................. 1 1.1 State of Facial Animation .......................................................................................... 1 1.1.1 Introduction.................................................................................................... 1 1.1.2 Computer Facial Animation History ............................................................... 3 1.2 Application Areas ...................................................................................................... 5 1.2.1 The Film and Advertisement industry ............................................................ 6 1.2.2 Game Industry ............................................................................................... 6 1.2.3 Medicine ........................................................................................................ 8 1.2.4 Social Agents and Avatars ............................................................................ 9 1.3 Thesis Summary ....................................................................................................... 9 2: Facial Animation Techniques .................................................................................. 11 2.1 Shape interpolation or Blend Shapes ..................................................................... 12 2.2 Parameterization ..................................................................................................... 15 2.3 Bone-based Rigging Methods ................................................................................. 17 2.4 Deformation-based Approaches ............................................................................. 19 2.4.1 Free-form deformation (FFD) ...................................................................... 19 2.4.2 Extended free-form deformation (EFFD) ....................................................
Recommended publications
  • Easy Facial Rigging and Animation Approaches

    Easy Facial Rigging and Animation Approaches

    Pedro Tavares Barata Bastos EASY FACIAL RIGGING AND ANIMATION APPROACHES A dissertation in Computer Graphics and Human-Computer Interaction Presented to the Faculty of Engineering of the University of Porto in Partial Fulfillment of the Requirements for the Degree of Doctor of Philosophy in Digital Media Supervisor: Prof. Verónica Costa Orvalho April 2015 ii This work is financially supported by Fundação para a Ciência e a Tecnologia (FCT) via grant SFRH/BD/69878/2010, by Fundo Social Europeu (FSE), by Ministério da Educação e Ciência (MEC), by Programa Operacional Potencial Humano (POPH), by the European Union (EU) and partially by the UT Austin | Portugal program. Abstract Digital artists working in character production pipelines need optimized facial animation solutions to more easily create appealing character facial expressions for off-line and real- time applications (e.g. films and videogames). But the complexity of facial animation has grown exponentially since it first emerged during the production of Toy Story (Pixar, 1995), due to the increasing demand of audiences for better quality character facial animation. Over the last 15 to 20 years, companies and artists developed various character facial animation techniques in terms of deformation and control, which represent a fragmented state of the art in character facial rigging. Facial rigging is the act of planning and building the mechanical and control structures to animate a character's face. These structures are the articulations built by riggers and used by animators to bring life to a character. Due to the increasing demand of audiences for better quality facial animation in films and videogames, rigging faces became a complex field of expertise within character production pipelines.
  • Digital Production Pipelines: Examining Structures And

    Digital Production Pipelines: Examining Structures And

    DIGITAL PRODUCTION PIPELINES: EXAMINING STRUCTURES AND METHODS IN THE COMPUTER EFFECTS INDUSTRY A Thesis by DANE EDWARD BETTIS Submitted to the Office of Graduate Studies of Texas A&M University in partial fulfillment of the requirements for the degree of MASTER OF SCIENCE May 2005 Major Subject: Visualization Sciences DIGITAL PRODUCTION PIPELINES: EXAMINING STRUCTURES AND METHODS IN THE COMPUTER EFFECTS INDUSTRY A Thesis by DANE EDWARD BETTIS Submitted to Texas A&M University in partial fulfillment of the requirements for the degree of MASTER OF SCIENCE Approved as to style and content by: ___________________________________ ______________________________________ Karen Hillier Frederic Parke (Chair of Committee) (Member) __________________ ___________________ Joyce Juntune Phillip Tabb (Member) (Head of Department) May 2005 Major Subject: Visualization Sciences iii ABSTRACT Digital Production Pipelines: Examining Structures and Methods in the Computer Effects Industry. (May 2005) Dane Edward Bettis, B.E.D., Texas A&M University Chair of Advisory Committee: Prof. Karen Hillier Computer animated films require collaboration: blending artistic concept with technical skill, meeting budget constraints and adhering to deadlines. The path which production follows from initial idea to finished product is known as the pipeline. The purpose of this thesis is to collect, study and share information regarding production pipeline practices and to derive a conceptual definition. Research focused on selected companies in the United States which have produced at least one feature-length computer generated film and continue to produce them. The key finding of this thesis is a conceptual definition of digital production pipelines: A digital production pipeline must, by definition, utilize digital computing hardware and software to facilitate human work and collaboration for the overarching purpose of producing content for film.
  • 3D Animation Overview

    3D Animation Overview

    CHAPTER 1 3D Animation Overview 3D animation has become a mainstay in film, television, and video games, and is becoming an integral part of other industries that may not have found it all that useful at first. Fields such as medicine, architecture, law, and even forensics now use 3D animation. To really understand 3D animation, you must look at its short history, which is tied directly to the history of the com- puter. Computer graphics, one of the fastest growing industries today, drives the technology and determines what computers are going to be able to do tomorrow. In this chapter, you will look at present-day 3D animation and then look back at how the past has shaped what we do today. Defining 3D animation Exploring the 3D animation industry Delving into the history of 3D animation Defining 3D Animation 3D animation, which falls into the larger field of 3D computer graphics, is a general term describing an entire industry that utilizes 3D animation computer software and hardware in many types of productions. This book uses the term 3D animation to refer to a wide range of 3D graphics, including static images or evenCOPYRIGHTED real solid models printed with aMATERIAL 3D printer called a rapid prototyper. But animation and movement is the primary function of the 3D animation indus- try. 3D animation is used in three primary industries: Entertainment Scientific Other 147481c01.indd 1 1/11/12 4:20:32 PM 2 Chapter 1 • 3D Animation Overview Each of these industries uses 3D animation in completely different ways and for different final output, including film, video, visualizations, rapid prototyping, and many others.
  • A Facial Model and Animation Techniques for Animated Speech

    A Facial Model and Animation Techniques for Animated Speech

    A Facial Model and Animation Techniques for Animated Speech DISSERTATION Presented in Partial Fulfillment of the Requirements for the Degree Doctor of Philosophy in the Graduate School of The Ohio State University By Scott Alan King, B.S., M.S. * * * * * The Ohio State University 2001 Dissertation Committee: Approved by Richard E. Parent, Adviser Wayne E. Carlson Adviser Han-Wei Shen Department of Computer and Information Science c Copyright by Scott Alan King 2001 ABSTRACT Creating animated speech requires a facial model capable of representing the myr- iad shapes the human face experiences during speech and a method to produce the correct shape at the correct time. We present a facial model designed to support animated speech. Our model has a highly deformable lip model that is grafted onto the input facial geometry providing the necessary geometric complexity for creating lip shapes and high-quality lip renderings. We provide a highly deformable tongue model that can represent the shapes the tongue experiences during speech. We add teeth, gums, and upper palate geometry to complete the inner mouth. For more realistic movement of the skin we consider the underlying soft and hard tissue. To decrease the processing time we hierarchically deform the facial surface. We also present a method to animate the facial model over time to create animated speech. We use a track-based animation system that has one facial model parameter per track with possibly more than one track per parameter. The tracks contain control points for a curve that describes the value of the parameter over time. We allow many different types and orders of curves that can be combined in different manners.