DOCSLIB.ORG

Towards a Filmic Look and Feel in Real Time Computer Graphics Sherief Farouk

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Towards a Filmic Look and Feel in Real Time Computer Graphics Sherief Farouk The University of Maine DigitalCommons@UMaine Electronic Theses and Dissertations Fogler Library 5-2013 Towards a filmic look and feel in real time computer graphics Sherief Farouk Follow this and additional works at: http://digitalcommons.library.umaine.edu/etd Part of the Computer and Systems Architecture Commons, Hardware Systems Commons, and the Other Film and Media Studies Commons Recommended Citation Farouk, Sherief, "Towards a filmic look and feel in real time computer graphics" (2013). Electronic Theses and Dissertations. 1898. http://digitalcommons.library.umaine.edu/etd/1898 This Open-Access Thesis is brought to you for free and open access by DigitalCommons@UMaine. It has been accepted for inclusion in Electronic Theses and Dissertations by an authorized administrator of DigitalCommons@UMaine. TOWARDS A FILMIC LOOK AND FEEL IN REAL TIME COMPUTER GRAPHICS By Sherief Farouk B.S. Arab Academy for Science and Technology, 2009 A THESIS Submitted in Partial Fulfillment of the Requirements for the Degree of Master of Science (in Computer Science) The Graduate School The University of Maine May 2013 Advisory Committee: James Fastook, Professor of Computer Science, Advisor Phillip Dickens, Associate Professor of Computer Science Larry Latour, Associate Professor of Computer Science TOWARDS A FILMIC LOOK AND FEEL IN REAL TIME COMPUTER GRAPHICS By Sherief Farouk Thesis Advisor: Dr. James Fastook An Abstract of the Thesis Presented in Partial Fulfillment of the Requirements for the Degree of Master of Science (in Computer Science) May 2013 Film footage has a distinct look and feel that audience can instantly recognize, making its replication desirable for computer generated graphics. This thesis pre­ sents methods capable of replicating significant portions of the film look and feel while being able to fit within the constraints imposed by real-time computer gen­ erated graphics on consumer hardware. TABLE OF CONTENTS LIST OF FIGURES....................................................................................... vi LIST OF EQUATIONS..................................................................................xi CHAPTER ONE: INTRODUCTION.............................................................. 1 Problem Statement...................................................................................1 Objectives.................................................................................................2 Review of Previous Work........................................................................ 4 CHAPTER TWO: RENDERING OVERVIEW ............................................ 6 High Dynamic Range.............................................................................. 7 Conservation of Energy.......................................................................... 8 The Graphics Pipeline............................................................................ 11 Anti-Aliasing........................................................................................... 25 Pixels versus fragments........................................................................30 CHAPTER THREE: DEPTH OF FIELD..................................................... 31 Introduction.............................................................................................31 Previous Work........................................................................................37 Proposed Technique............................................................................. 44 Algorithm................................................................................................ 49 Results....................................................................................................50 CHAPTER FOUR: LENS FLARE...............................................................52 Introduction............................................................................................ 52 Previous Work........................................................................................ 54 Breakdown..............................................................................................55 Bright Region Detection...................................................................55 Bloom ................................................................................................56 Light Streaks..................................................................................... 57 Ghosting............................................................................................59 Proposed Technique..............................................................................63 Algorithm.................................................................................................66 Results....................................................................................................67 CHAPTER FIVE: TONEMAPPING........................................................... 70 Introduction............................................................................................ 70 Previous Work........................................................................................ 77 Proposed Approach.............................................................................. 82 Results....................................................................................................85 CHAPTER SIX: FRAME RATE..................................................................88 CHAPTER SEVEN: MOTION BLUR......................................................... 92 Introduction............................................................................................ 92 Used Technique.....................................................................................95 CHAPTER EIGHT: PROJECTOR COLOR CONVERGENCE................97 Introduction.............................................................................................97 Previous Work...................................................................................... 100 Proposed Technique............................................................................ 101 Algorithm................................... ...........................................................104 Results.................................................................................................. 105 CONCLUSIONS........................................................................................ 109 BIBLIOGRAPHY........................................................................................ 110 APPENDIX A: BRANCH-FREE ERROR FUNCTION........................... 114 BIOGRAPHY OF THE AUTHOR..............................................................115 v LIST OF FIGURES Figure 1. IEEE 16-bit Floating Point Binary Layout................................. 7 Figure 2. High Dynamic Range Blur......................................................... 10 Figure 3. The Hardware Graphics Pipeline..............................................11 Figure 4. Rasterization Rendering Vertices............................................ 13 Figure 5. Rasterization Rendering Polygon............................................ 14 Figure 6. Texture and Associated Mipmap Chain...................................15 Figure 7. Trilinear and Anisotropic Texture Filtering............................... 17 Figure 8. Cubemap Texture Composition............................................... 18 Figure 9. Cubemap Texture Addressing..................................................19 Figure 10. Texture and Rasterized Polygon.............................................. 20 Figure 11. Scene Rendered Using Render To Texture.............................21 Figure 12. Complex Render To Texture Pipeline......................................22 Figure 13. Texture and Screen Aligned Polygon.......................................23 Figure 14. Texture and Post Processed Polygon..................................... 24 Figure 15. Computer Generated Scene with Aliasing.............................. 25 Figure 16. Computer Generated Scene with Anti-Aliasing......................26 Figure 17. Anti-Aliased Pixel Sample Layout............................................27 vi Figure 18. Subsampled Pixel Color Values............................................... 28 Figure 19. Subsampled Pixel Color Resolution.........................................28 Figure 20. High Frequency Polygon with Anti-Aliasing............................ 29 Figure 21. Lens Imaging Model.................................................................. 32 Figure 22. Chromatic Aberration Lens Model............................................ 33 Figure 23. Chromatic Aberration Photograph............................................34 Figure 24. Purple Fringing..........................................................................35 Figure 25. Depth of Field in Film................................................................ 36 Figure 26. Depth of Field Sampling Pattern.............................................. 38 Figure 27. Depth of Field in Uncharted 2 .................................................. 39 Figure 28. Depth of Field in Good Samaritan.............................................41 Figure 29. Depth of Field Layers in Good Samaritan................................41 Figure 30. Depth of Field Aperture Sampling Patterns............................ 45 Figure 31. Scene and Depth of Field Rejected Samples.........................47 Figure 32. Chromatic Aberration in Mythbusters....................................
Load more

Recommended publications
  • Tonal Artifactualizations: Light-To-Dark in Still Imagery and Effects on Perception
    TONAL ARTIFACTUALIZATIONS: LIGHT-TO-DARK IN STILL IMAGERY AND EFFECTS ON PERCEPTION By GREGORY BERNARD POINDEXTER Bachelor of Science in Communication Oral Roberts University Tulsa, Oklahoma. 1985 Submitted to the Faculty of the Graduate College of the Oklahoma State University in partial fulfillment of the requirements for the Degree of MASTER OF SCIENCE May, 2012 TONAL ARTIFACTUALIZATIONS: LIGHT-TO-DARK IN STILL IN STILL IMAGERY AND EFFECTS ON PERCEPTION Thesis Approved: Lori K. McKinnon, Ph.D. Thesis Adviser Cynthia Nichols, Ph.D. Todd Arnold, Ph.D. Sheryl A. Tucker, Ph.D. Dean of the Graduate College ii TABLE OF CONTENTS Chapter Page I. INTRODUCTION......................................................................................................1 Cognitive Framework (Background of the Problem) ..............................................2 Statement of the Problem.........................................................................................5 Rationale ..................................................................................................................6 Theoretical Framework............................................................................................7 Assumptions.............................................................................................................8 Outline of the Following Chapters...........................................................................9 II. REVIEW OF LITERATURE..................................................................................10 A
    [Show full text]
  • Shadow Telecinetelecine
    ShadowShadow TelecineTelecine HighHigh performanceperformance SolidSolid StateState DigitalDigital FilmFilm ImagingImaging TechnologyTechnology Table of contents • Introduction • Simplicity • New Scanner Design • All Digital Platform • The Film Look • Graphical Control Panel • Film Handling • Main Features • Six Sector Color Processor • Cost of ownership • Summary SHADOWSHADOTelecine W Telecine Introduction The Film Transfer market is changing const- lantly. There are a host of new DTV formats required for the North American Market and a growing trend towards data scanning as opposed to video transfer for high end compositing work. Most content today will see some form of downstream compression, so quiet, stable images are still of paramount importance. With the demand growing there is a requirement for a reliable, cost effective solution to address these applications. The Shadow Telecine uses the signal proce- sing concept of the Spirit DataCine and leve- rages technology and feature of this flagship product. This is combined with a CCD scan- ner witch fulfils the requirements for both economical as well as picture fidelity. The The Film Transfer market is evolving rapidly. There are a result is a very high performance producthost allof new DTV formats required for the North American the features required for today’s digital Marketappli- and a growing trend towards data scanning as cation but at a greatly reduced cost. opposed to video transfer for high end compositing work. Most content today will see some form of downstream Unlike other Telecine solutions availablecompression, in so quiet, stable images are still of paramount importance. With the demand growing there is a this class, the Shadow Telecine is requirementnot a for a reliable, cost effective solution to re-manufactured older analog Telecine,address nor these applications.
    [Show full text]
  • Flexibility for Alternative Content
    ALTERNATIVE CONTENT DMS SCALERS More flexibility for Alternative Content Kinoton’s Markus Näther explains the technology behind the company’s DMS Scalers -Cinema projectors using Series analog component, composite, S-Video and why high-quality cinema scalers employ very II 2K DLP Cinema® technology VGA inputs for connecting PCs or laptops, DVD complex mathematical algorithms to achieve support not only true 2K content, players, satellite receivers, digital encoders, smooth transitions. Pixels to be added are but also different video formats. cable receivers and many other sources, up to interpolated from the interim values of their If it comes to alternative content, HDMI inputs for Blu-Ray players etc. Premium neighbouring pixels, and if pixels have to be D scalers even offer SDI and HD-SDI inputs for though, they quickly reach their limits – the deleted, the same principle is used to smooth range of different picture resolutions, video professional sources. the transitions between the residual pixels. rendering techniques, frame rates and refresh Perfect Image Adjustment How well a scaler accomplishes this demanding rates used on the video market is simply too The different video sources – like classic TV, task basically depends on its processing power. large. Professional media scalers can convert HDTV, DVD or Blu-Ray, just to name the most Kinoton’s premium scaler model DMS DC2 incompatible video signals into the ideal input common ones – work with different image PRO realises image format changes without signal for D-Cinema projectors, and in addition resolutions. The ideal screen resolution for any loss of sharpness, the base model HD DMS enhance the projector’s capabilities of connect- the projection of alternative content with 2K still provides an acceptable image quality for ing alternate content sources.
    [Show full text]
  • Real-Time Rendering Techniques with Hardware Tessellation
    Volume 34 (2015), Number x pp. 0–24 COMPUTER GRAPHICS forum Real-time Rendering Techniques with Hardware Tessellation M. Nießner1 and B. Keinert2 and M. Fisher1 and M. Stamminger2 and C. Loop3 and H. Schäfer2 1Stanford University 2University of Erlangen-Nuremberg 3Microsoft Research Abstract Graphics hardware has been progressively optimized to render more triangles with increasingly flexible shading. For highly detailed geometry, interactive applications restricted themselves to performing transforms on fixed geometry, since they could not incur the cost required to generate and transfer smooth or displaced geometry to the GPU at render time. As a result of recent advances in graphics hardware, in particular the GPU tessellation unit, complex geometry can now be generated on-the-fly within the GPU’s rendering pipeline. This has enabled the generation and displacement of smooth parametric surfaces in real-time applications. However, many well- established approaches in offline rendering are not directly transferable due to the limited tessellation patterns or the parallel execution model of the tessellation stage. In this survey, we provide an overview of recent work and challenges in this topic by summarizing, discussing, and comparing methods for the rendering of smooth and highly-detailed surfaces in real-time. 1. Introduction Hardware tessellation has attained widespread use in computer games for displaying highly-detailed, possibly an- Graphics hardware originated with the goal of efficiently imated, objects. In the animation industry, where displaced rendering geometric surfaces. GPUs achieve high perfor- subdivision surfaces are the typical modeling and rendering mance by using a pipeline where large components are per- primitive, hardware tessellation has also been identified as a formed independently and in parallel.
    [Show full text]
  • 24P and Panasonic AG-DVX100 and AJ-SDX900 Camcorder Support in Vegas and DVD Architect Software
    ® 24p and Panasonic AG-DVX100 and AJ-SDX900 camcorder support in Vegas and DVD Architect Software Revision 3, Updated 05.27.04 The information contained in this document is subject to change without notice and does not represent a commitment on the part of Sony Pictures Digital Media Software and Services. The software described in this manual is provided under the terms of a license agreement or nondisclosure agreement. The software license agreement specifies the terms and conditions for its lawful use. Sound Forge, ACID, Vegas, DVD Architect, Vegas+DVD, Acoustic Mirror, Wave Hammer, XFX, and Perfect Clarity Audio are trademarks or registered trademarks of Sony Pictures Digital Inc. or its affiliates in the United States and other countries. All other trademarks or registered trademarks are the property of their respective owners in the United States and other countries. Copyright © 2004 Sony Pictures Digital Inc. This document can be reproduced for noncommercial reference or personal/private use only and may not be resold. Any reproduction in excess of 15 copies or electronic transmission requires the written permission of Sony Pictures Digital Inc. Table of Contents What is covered in this document? Background ................................................................................................................................................................. 3 Vegas ..........................................................................................................................................................................
    [Show full text]
  • Avid DS - Your Future Is Now
    DSWiki DSWiki Table Of Contents 1998 DS SALES BROCHURE ............................................. 4 2005 DS Wish List ..................................................... 8 2007 Unfiltered DS Wish List ............................................. 13 2007 Wish Lists ....................................................... 22 2007DSWishListFinalistsRound2 ........................................... 28 2010 Wish List ........................................................ 30 A ................................................................. 33 About .............................................................. 53 AchieveMoreWithThe3DDVE ............................................. 54 AmazonStore ......................................................... 55 antler .............................................................. 56 Arri Alexa ........................................................... 58 Avid DS - Your Future Is Now ............................................. 59 Avid DS for Colorists ................................................... 60 B ................................................................. 62 BetweenBlue&Green ................................................... 66 Blu-ray Copy ......................................................... 67 C ................................................................. 68 ColorItCorrected ...................................................... 79 Commercial Specifications ............................................... 80 Custom MC Color Surface Layouts ........................................
    [Show full text]
  • NVIDIA Quadro Technical Specifications
    NVIDIA Quadro Technical Specifications NVIDIA Quadro Workstation GPU High-resolution Antialiasing ° Dassault CATIA • Full 128-bit floating point precision • Up to 16x full-scene antialiasing (FSAA), ° ESRI ArcGIS pipeline at resolutions up to 1920 x 1200 ° ICEM Surf • 12-bit subpixel precision • 12-bit subpixel sampling precision ° MSC.Nastran, MSC.Patran • Hardware-accelerated antialiased enhances AA quality ° PTC Pro/ENGINEER Wildfire, points and lines • Rotated-grid FSAA significantly 3Dpaint, CDRS The NVIDIA Quadro® family of In addition to a full line up of 2D and • Hardware OpenGL overlay planes increases color accuracy and visual ° SolidWorks • Hardware-accelerated two-sided quality for edges, while maintaining ° UDS NX Series, I-deas, SolidEdge, professional solutions for workstations 3D workstation graphics solutions, the lighting performance3 Unigraphics, SDRC delivers the fastest application NVIDIA Quadro professional products • Hardware-accelerated clipping planes and many more… Memory performance and the highest quality include a set of specialty solutions that • Third-generation occlusion culling • Digital Content Creation (DCC) graphics. have been architected to meet the • 16 textures per pixel • High-speed memory (up to 512MB Alias Maya, MOTIONBUILDER needs of a wide range of industry • OpenGL quad-buffered stereo (3-pin GDDR3) ° NewTek Lightwave 3D Raw performance and quality are only sync connector) • Advanced lossless compression ° professionals. These specialty Autodesk Media and Entertainment the beginning. The NVIDIA
    [Show full text]
  • Extending the Graphics Pipeline with Adaptive, Multi-Rate Shading
    Extending the Graphics Pipeline with Adaptive, Multi-Rate Shading Yong He Yan Gu Kayvon Fatahalian Carnegie Mellon University Abstract compute capability as a primary mechanism for improving the qual- ity of real-time graphics. Simply put, to scale to more advanced Due to complex shaders and high-resolution displays (particularly rendering effects and to high-resolution outputs, future GPUs must on mobile graphics platforms), fragment shading often dominates adopt techniques that perform shading calculations more efficiently the cost of rendering in games. To improve the efficiency of shad- than the brute-force approaches used today. ing on GPUs, we extend the graphics pipeline to natively support techniques that adaptively sample components of the shading func- In this paper, we enable high-quality shading at reduced cost on tion more sparsely than per-pixel rates. We perform an extensive GPUs by extending the graphics pipeline’s fragment shading stage study of the challenges of integrating adaptive, multi-rate shading to natively support techniques that adaptively sample aspects of the into the graphics pipeline, and evaluate two- and three-rate imple- shading function more sparsely than per-pixel rates. Specifically, mentations that we believe are practical evolutions of modern GPU our extensions allow different components of the pipeline’s shad- designs. We design new shading language abstractions that sim- ing function to be evaluated at different screen-space rates and pro- plify development of shaders for this system, and design adaptive vide mechanisms for shader programs to dynamically determine (at techniques that use these mechanisms to reduce the number of in- fine screen granularity) which computations to perform at which structions performed during shading by more than a factor of three rates.
    [Show full text]
  • Graphics Pipeline and Rasterization
    Graphics Pipeline & Rasterization Image removed due to copyright restrictions. MIT EECS 6.837 – Matusik 1 How Do We Render Interactively? • Use graphics hardware, via OpenGL or DirectX – OpenGL is multi-platform, DirectX is MS only OpenGL rendering Our ray tracer © Khronos Group. All rights reserved. This content is excluded from our Creative Commons license. For more information, see http://ocw.mit.edu/help/faq-fair-use/. 2 How Do We Render Interactively? • Use graphics hardware, via OpenGL or DirectX – OpenGL is multi-platform, DirectX is MS only OpenGL rendering Our ray tracer © Khronos Group. All rights reserved. This content is excluded from our Creative Commons license. For more information, see http://ocw.mit.edu/help/faq-fair-use/. • Most global effects available in ray tracing will be sacrificed for speed, but some can be approximated 3 Ray Casting vs. GPUs for Triangles Ray Casting For each pixel (ray) For each triangle Does ray hit triangle? Keep closest hit Scene primitives Pixel raster 4 Ray Casting vs. GPUs for Triangles Ray Casting GPU For each pixel (ray) For each triangle For each triangle For each pixel Does ray hit triangle? Does triangle cover pixel? Keep closest hit Keep closest hit Scene primitives Pixel raster Scene primitives Pixel raster 5 Ray Casting vs. GPUs for Triangles Ray Casting GPU For each pixel (ray) For each triangle For each triangle For each pixel Does ray hit triangle? Does triangle cover pixel? Keep closest hit Keep closest hit Scene primitives It’s just a different orderPixel raster of the loops!
    [Show full text]
  • From Point to Pixel: a Genealogy of Digital Aesthetics by Meredith Anne Hoy
    From Point to Pixel: A Genealogy of Digital Aesthetics by Meredith Anne Hoy A dissertation submitted in partial satisfaction of the requirements for the degree of Doctor of Philosophy in Rhetoric and the Designated Emphasis in Film Studies in the Graduate Division of the University of California, Berkeley Committee in charge: Professor Whitney Davis, co-chair Professor Jeffrey Skoller, co-chair Professor Warren Sack Professor Abigail DeKosnik Professor Kristen Whissel Spring 2010 Copyright 2010 by Hoy, Meredith All rights reserved. Abstract From Point to Pixel: A Genealogy of Digital Aesthetics by Meredith Anne Hoy Doctor of Philosophy in Rhetoric University of California, Berkeley Professor Whitney Davis, Co-chair Professor Jeffrey Skoller, Co-chair When we say, in response to a still or moving picture, that it has a digital “look” about it, what exactly do we mean? How can the slick, color-saturated photographs of Jeff Wall and Andreas Gursky signal digitality, while the flattened, pixelated landscapes of video games such as Super Mario Brothers convey ostensibly the same characteristic of “being digital,” but in a completely different manner? In my dissertation, From Point to Pixel: A Genealogy of Digital Aesthetics, I argue for a definition of a "digital method" that can be articulated without reference to the technicalities of contemporary hardware and software. I allow, however, the possibility that this digital method can acquire new characteristics when it is performed by computational technology. I therefore treat the artworks covered in my dissertation as sensuous artifacts that are subject to change based on the constraints and affordances of the tools used in their making.
    [Show full text]
  • Graphics Pipeline
    Graphics Pipeline What is graphics API ? • A low-level interface to graphics hardware • OpenGL About 120 commands to specify 2D and 3D graphics Graphics API and Graphics Pipeline OS independent Efficient Rendering and Data transfer Event Driven Programming OpenGL What it isn’t: A windowing program or input driver because How many of you have programmed in OpenGL? How extensively? OpenGL GLUT: window management, keyboard, mouse, menue GLU: higher level library, complex objects How does it work? Primitives: drawing a polygon From the implementor’s perspective: geometric objects properties: color… pixels move camera and objects around graphics pipeline Primitives Build models in appropriate units (microns, meters, etc.). Primitives Rotate From simple shapes: triangles, polygons,… Is it Convert to + material Translate 3D to 2D visible? pixels properties Scale Primitives 1 Primitives: drawing a polygon Primitives: drawing a polygon • Put GL into draw-polygon state glBegin(GL_POLYGON); • Send it the points making up the polygon glVertex2f(x0, y0); glVertex2f(x1, y1); glVertex2f(x2, y2) ... • Tell it we’re finished glEnd(); Primitives Primitives Triangle Strips Polygon Restrictions Minimize number of vertices to be processed • OpenGL Polygons must be simple • OpenGL Polygons must be convex (a) simple, but not convex TR1 = p0, p1, p2 convex TR2 = p1, p2, p3 Strip = p0, p1, p2, p3, p4,… (b) non-simple 9 10 Material Properties: Color Primitives: Material Properties • glColor3f (r, g, b); Red, green & blue color model color, transparency, reflection
    [Show full text]
  • Improved Television Systems: NTSC and Beyond
    • Improved Television Systems: NTSC and Beyond By William F. Schreiber After a discussion ofthe limits to received image quality in NTSC and a excellent results. Demonstrations review of various proposals for improvement, it is concluded that the have been made showing good motion current system is capable ofsignificant increase in spatial and temporal rendition with very few frames per resolution. and that most of these improvements can be made in a second,2 elimination of interline flick­ er by up-conversion, 3 and improved compatible manner. Newly designed systems,for the sake ofmaximum separation of luminance and chromi­ utilization of channel capacity. should use many of the techniques nance by means of comb tilters. ~ proposedfor improving NTSC. such as high-rate cameras and displays, No doubt the most important ele­ but should use the component. rather than composite, technique for ment in creating interest in this sub­ color multiplexing. A preference is expressed for noncompatible new ject was the demonstration of the Jap­ systems, both for increased design flexibility and on the basis oflikely anese high-definition television consumer behaL'ior. Some sample systems are described that achieve system in 1981, a development that very high quality in the present 6-MHz channels, full "HDTV" at the took more than ten years.5 Orches­ CCIR rate of 216 Mbits/sec, or "better-than-35mm" at about 500 trated by NHK, with contributions Mbits/sec. Possibilities for even higher efficiency using motion compen­ from many Japanese companies, im­ sation are described. ages have been produced that are comparable to 35mm theater quality.
    [Show full text]