DOCSLIB.ORG

GPU-Enabled Rapid Image Processing Framework

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
GPU-Enabled Rapid Image Processing Framework A GPU-Enabled Rapid Image Processing Framework Mark Davey Lead HPC Engineer www.thefoundry.co.uk Visual Effects Software The Foundry We develop, market and sell Visual Efects Software NUKE - Compositing MARI - 3D Texture Painting HIERO - Shot Management KATANA - Look-Development and Lighting MODO - 3D Modelling and Rendering www.thefoundry.co.uk Visual Effects Software Aardman Animations BaseFX Studios BlueBolt Who uses our software? Blue Sky Studios Brainstorm Digital CoSA VFX Digital Domain Digital Fusion Double Negative Well established global client base: Dreamworks The Embassy Fido Framestore Igloo VFX Industrial Light and Magic Jellyfish Look Efects Film Lucasfilm Entertainment March Entertainment Method Studios Mikros Image The Moving Picture Animation Company Mr. X Passion Pictures Pixomondo Prime Focus Rushes Commercial advertising Smoke and Mirrors Sony Pictures Imageworks Sony Pictures Animation The Mill Township Broadcast Unexpected Union VFX Walt Disney Animation Warner Bros. Animation Weta Digital ZOIC Studios www.thefoundry.co.uk Visual Effects Software At the heart - 2D Image Processing A fundamental component of our products Used in efects such as: • Noise reduction • Keying • Motion and disparity estimation • Colour correction • 3D texture creation We need to make it as fast as possible! www.thefoundry.co.uk Visual Effects Software Moving to GPUs • Traditionally used the CPU for image processing • Lots of legacy code • GPUs are great at image processing • Our customers often have GPUs, but not always (e.g. on render farms) • So need a CPU path • Do not want to write same code multiple times (debugging, maintenance, new hardware, etc) www.thefoundry.co.uk Visual Effects Software Solution: A Rapid Image Processing Framework (RIP) •Image processing algorithms expressed as kernels •Kernels written in a C++ like, domain-specific language •Kernels run over an iteration space •Metadata expresses access patterns, image formats, bounday conditions, etc •Kernels are converted to an Abstract Syntax Tree (AST) •The AST is translated into diferent languages www.thefoundry.co.uk Visual Effects Software Example Kernel class GainImage : Kernel<eComponentWise> { param: Image<eRead, ePoint> src; Image<eWrite, ePoint> dst; float gain; local: void define() { defineParam(gain, "gain", 1.0f); } void kernel() { dst() = src() * gain; } }; www.thefoundry.co.uk Visual Effects Software Example Kernel class GainImage : Kernel<eComponentWise> { param: Image<eRead, ePoint> src; Image<eWrite, ePoint> dst; float gain; local: void define() { defineParam(gain, "gain", 1.0f); } void kernel() { dst() = src() * gain; } }; www.thefoundry.co.uk Visual Effects Software Example Kernel class GainImage : Kernel<eComponentWise> { param: Image<eRead, ePoint> src; Image<eWrite, ePoint> dst; float gain; local: void define() { defineParam(gain, "gain", 1.0f); } void kernel() { dst() = src() * gain; } }; www.thefoundry.co.uk Visual Effects Software Kernel Types •Iteration Independently run at every point in an iteration space. Example: Gain •Rolling Run over iteration space in order, providing access to results from the previous point along an axis Example: Box blur •Reduction Image data is reduced down to a single ‘value’ example: Maximum pixel value www.thefoundry.co.uk Visual Effects Software Kernel Metadata •Granularity - Component | Pixel •Image access - Read | Write •Memory Access - Point | Ranged | Random •Edge Methods - None | Clamped | Constant www.thefoundry.co.uk Visual Effects Software Current Language Support CUDA OpenCL C++ Scalar C++ SIMD (SSE2, SSE4.1, AVX) www.thefoundry.co.uk Visual Effects Software Current RIP-Based Efects • Denoise • Video Retimer • Convolution • Depth-Based Blur • Motion Blur • Vector Generator www.thefoundry.co.uk Visual Effects Software Run-time RIP • Generate kernels at run time (JIT) for specific image formats and data types • Profile machine to determine best language options to use • CPU kernels compiled using LLVM • GPU kernels currently translated to OpenCL www.thefoundry.co.uk Visual Effects Software Example - Denoise • Proprietary Wavelet-Based Algorithm • Requires 20+ Kernels • Tunable parameters for best results • Must run at interactive speeds • Legacy CPU plug-in too slow www.thefoundry.co.uk Visual Effects Software Denoise - Tests GPUs CPUs Quadro FX 3800M 4 SM Core i7M 2 Core + HT Quadro K600 1 SMX Core i7-3667U 2 Core + HT Quadro 4000 8 SM Xeon E5504 4 Core Quadro 6000 14 SM Xeon X5550 4 Core + HT Quadro K5000 8 SMX Xeon E5620 8 Core + HT Geforce GTX 580 16 SM Xeon E5-2640 12 Core + HT Tesla K20 13 SMX Image: 1920x1080 (1080p) RGB, 32-bit float www.thefoundry.co.uk Visual Effects Software www.thefoundry.co.uk Visual Effects Software www.thefoundry.co.uk Visual Effects Software The RIP Node - Fast R&D • Develop kernels at run-time within our software using the RIP language • No other development tools required • Automatically creates parameter sliders via kernel introspection • Use graph of nodes to create complex algorithms • Great for rapid research and development www.thefoundry.co.uk Visual Effects Software Example - Directional Blur CPU: Xeon X5550 GPU: Quadro 6000 Legacy CPU: 227s GPU RIP: 5.6s (40 times faster) GPU RIP Pixel: 3.0s (75 times faster) www.thefoundry.co.uk Visual Effects Software GPU Image Processing - Issues • Memory is finite and limited • Our software supports very large images • Not always possible to process a whole image on a GPU • Point, and ranged access processing is tiled • Relatively long transfer times • Try to keep intermediate data on GPU as long as possible • We are working on better caching www.thefoundry.co.uk Visual Effects Software The Future - Highlights •Beyond 2D image processing • 3D data • Deep data • Arrays of structures •Heterogeneous computing • Use all available devices • Efcient scheduling • Minimise data transfers • Unified kernel results •Greater GPU optimisation • Better caching • Better use of Kepler architecture www.thefoundry.co.uk Visual Effects Software Questions? www.thefoundry.co.uk Visual Effects Software.
Load more

Recommended publications
  • Final Website Delegate List 2017
    Delegate List Updated 27th August 2017 First Name Surname Company Lucy Acfield Guinness World Records Sara Acworth Zeamu Music Patrick Adam The Eggleys Lindsey Adams Daily Madness Productions Rick Adams Rick Adams Productions Folake Adigun Nickelodeon Ivan Agenjo Peekaboo Animation Metsamarja Aittokoski Sun In the Eye Productions Lisa Akhurst DNA Creative Ltd waed al ghabra Sheffield Hallam University Madawi Alahmad University of Sheffield Margret Albers Association for the Promotion of German Milly Ali Timeline Television Shazia Ali Mint Research Ltd Foz Allan Bryncoed Productions Ltd Jo Allen CBBC Ollie Alsop Serious Lunch/Eye Present Vanessa Amberleigh CBeebies Val Ames Kindle Entertainment Xiaomei An The University of Sheffiled Steven Andrew Zodiak Kids Nicola Andrews Keshet International UK Ltd Chris Andrews CA Dev Valentina Andries University of Edinburgh Tom Angell Tom Angell Ltd Laura Annis Blue Zoo Productions Laverne Antrobus Tavistock and Portman NHS Trust Rhodri ap Dyfrig S4C Will Appiah Digital Shoguns Thomas Archibald BT Ben Armstrong BBC Finn Arnesen Hasbro Studios Helen Arntsen Blue Zoo Keith Arrowsmith The Children's Media Conference Nihal Arthanayake BBC Abhi Arya Sandbox Corrina Askin Corrina Askin Films Leigh Aspin BBC Sarah Aspinall Virgin Media Martin Athanasiou I'm Hungry Studios Isabella Atkin Volunteer Tessa Atkins Small Fry Animation Lucy Atkinson BBC Jonathan Attenborough Lost My Name Ros Attille BBC Ami Aubrey The Children's Media Conference Jake Aubrey-Bentley Freelance Lauren Auty Finger Industries Tristan
    [Show full text]
  • The Uses of Animation 1
    The Uses of Animation 1 1 The Uses of Animation ANIMATION Animation is the process of making the illusion of motion and change by means of the rapid display of a sequence of static images that minimally differ from each other. The illusion—as in motion pictures in general—is thought to rely on the phi phenomenon. Animators are artists who specialize in the creation of animation. Animation can be recorded with either analogue media, a flip book, motion picture film, video tape,digital media, including formats with animated GIF, Flash animation and digital video. To display animation, a digital camera, computer, or projector are used along with new technologies that are produced. Animation creation methods include the traditional animation creation method and those involving stop motion animation of two and three-dimensional objects, paper cutouts, puppets and clay figures. Images are displayed in a rapid succession, usually 24, 25, 30, or 60 frames per second. THE MOST COMMON USES OF ANIMATION Cartoons The most common use of animation, and perhaps the origin of it, is cartoons. Cartoons appear all the time on television and the cinema and can be used for entertainment, advertising, 2 Aspects of Animation: Steps to Learn Animated Cartoons presentations and many more applications that are only limited by the imagination of the designer. The most important factor about making cartoons on a computer is reusability and flexibility. The system that will actually do the animation needs to be such that all the actions that are going to be performed can be repeated easily, without much fuss from the side of the animator.
    [Show full text]
  • Top Questions About Character Animation
    Top Questions About Character Animation What are some of the exciting aspects of character animation, and how is it different than other computer animation forms? The phrase computer animation is often used as a catch-all for many computer generated effects including spinning logos, Flash programming on the Web or special effects in movies. These are not character animation. Character animation is the process of giving life to a character, whether it is a dog that can talk, a drawn person or an animated object. Character animation creates personality. How long does it take one person to create one minute of animation? This is difficult to pinpoint, but it can take one animator about 16 – 20 weeks of full-time work to produce 60 seconds of animation.1 At Pixar Animation Studios, due to their high level of quality control, animators have been known to work on two minutes of film for a year or more. How many animators typically work on an animated feature film? It depends on the studio and its needs, so anywhere from 20 – 80 animators could be working on an animated feature film. What is the biggest myth about character animation? A lot of people believe that the computer does all of the work for the animator, but the reality is that the animator is only using the computer as a tool to create detailed animation frame by frame. What are some of the most challenging aspects of character animation? Character animators work in fun, collaborative, exciting and detailed environments. They need to have a high level of patience while working with the tiny movements of a character frame by frame.
    [Show full text]
  • PB Paddington 2
    presenta ! diretto da PAUL KING con HUGH GRANT BRENDAN GLEESON JIM BROADBENT PETER CAPALDI JULIE WALTERS SALLY HAWKINS HUGH BONNEVILLE e con la voce di FRANCESCO MANDELLI distribuito da EAGLE PICTURES durata 95' AL CINEMA DAL 9 NOVEMBRE 2017 www.eaglepictures.com UFFICIO STAMPA Pierluigi Manzo e Alessio Piccirillo +39.347.0133173 +39.393.9328580 [email protected] - www.manzopiccirillo.com CAST ARTISTICO BRENDAN GLEESON Nocche McGinty SALLY HAWKINS Mary Brown FRANCESCO MANDELLI Paddington HUGH GRANT Phoenix Buchanan JIM BROADBENT Samuel Gruber JULIE WALTERS Miss Bird HUGH BONNEVILLE Henry Brown PETER CAPALDI Reginald Curry SAMUEL JOSLIN Jonathan Brown MADELEINE HARRIS Judy Brown TOM DAVIS T-Bone !2 CAST TECNICO Diretto da PAUL KING Scritto da PAUL KING SIMON FARNABY Prodotto da DAVID HEYMAN Produttori esecutivi ROSIE ALISON ALEXANDRA FERGUSON RON HAPERN Case di produzione HEYDAY FILMS MARMALADE FILMS LTD. STUDIO CANAL Fotografia ERIK WILSON Scenografie GARY WILLIAMSON Montaggio JONATHAN AMOS MARK EVERSON Costumi LINDY HEMMING !3 Musiche DARIO MARIANELLI Casting NINA GOLD Direttore delle animazioni PABLO GRILLO Supervisore VFX GLEN PRATT Distribuito da EAGLE PICTURES Ufficio Stampa MANZOPICCIRILLO SINOSSI Paddington è ormai un celebre membro di Windsor Gardens, la comunità in cui vive con la famiglia Brown. A caccia del regalo perfetto per il centenario di zia Lucy, il nostro simpatico e buffo amico trova un raro libro pop-up in un negozietto di antiquariato. Dopo avere svolto una serie di lavoretti per tentare di comprarlo, il libro
    [Show full text]
  • Free-Digital-Preview.Pdf
    THE BUSINESS, TECHNOLOGY & ART OF ANIMATION AND VFX January 2013 ™ $7.95 U.S. 01> 0 74470 82258 5 www.animationmagazine.net THE BUSINESS, TECHNOLOGY & ART OF ANIMATION AND VFX January 2013 ™ The Return of The Snowman and The Littlest Pet Shop + From Up on The Visual Wonders Poppy Hill: of Life of Pi Goro Miyazaki’s $7.95 U.S. 01> Valentine to a Gone-by Era 0 74470 82258 5 www.animationmagazine.net 4 www.animationmagazine.net january 13 Volume 27, Issue 1, Number 226, January 2013 Content 12 22 44 Frame-by-Frame Oscars ‘13 Games 8 January Planner...Books We Love 26 10 Things We Loved About 2012! 46 Oswald and Mickey Together Again! 27 The Winning Scores Game designer Warren Spector spills the beans on the new The composers of some of the best animated soundtracks Epic Mickey 2 release and tells us how much he loved Features of the year discuss their craft and inspirations. [by Ramin playing with older Disney characters and long-forgotten 12 A Valentine to a Vanished Era Zahed] park attractions. Goro Miyazaki’s delicate, coming-of-age movie From Up on Poppy Hill offers a welcome respite from the loud, CG world of most American movies. [by Charles Solomon] Television Visual FX 48 Building a Beguiling Bengal Tiger 30 The Next Little Big Thing? VFX supervisor Bill Westenhofer discusses some of the The Hub launches its latest franchise revamp with fashion- mind-blowing visual effects of Ang Lee’s Life of Pi. [by Events forward The Littlest Pet Shop.
    [Show full text]
  • M Asterclass
    The Sixth Annual CG, Animation & Gaming Forum John Anthony Theatre June 9, 2007 Collin College 9:00 a.m. – 5:30 p.m. 2800 E. Spring Creek Pkwy, Plano, TX Masterclass 10 a.m. – 3:30 p.m. June 8, 2007 Room C-104, Collin College www.industrygiants.org From the drawing board to the movie theater - and all points in-between – the sixth annual Industry Giants 2007 computer graphics, animation and gaming forum investigates what it takes to cultivate and keep an animation and gaming industry in Texas. Bryan Engram – Reel FX Creative Studios 9:00 a.m. Rita Street – Radar Cartoons 1:30 p.m. Animation Supervisor Managing Director, Producer, and Author Currently, Bryan is finishing commercial spots for Rita is managing director of Radar Cartoons, Dreamworks’ Shrek the Third. His credits include coproducer of The Nicktoons Film Festival, and feature films The Wild, Everyone’s Hero, and Teenage vp of development for Mike Young Productions, Mutant Ninja Turtles; shorts such as Blue Sky’s Aunt Her current animated series, Ruby Gloom, has been Fanny’s Tour of Booty; and game cinematics for Halo 2 nominated in the Annecy (France) and Cartoons on and Transformers :The Game. the Bay (Italy) Festivals. Elizabeth Hitt – Digital Domain 10:00 a.m. Steve Gaconnier – Janimation 2:30 p.m. Visual Effects CEO and Chief Creative Director Elizabeth works for Academy Award winning visual Janimation is nationally recognized as a talented effects house Digital Domain and has credits on and industrious company through their work for Stealth, Zoom, Texas Chainsaw Massacre: The Beginning, such clients as Fox Sports, Nokia, Pennzoil, Miller The Hitcher, and the upcoming Transformers.
    [Show full text]
  • In Re Digital Domain Media Group, Inc. Securities Litigation 12-CV
    Case 2:12-cv-14333-JEM Document 57 Entered on FLSD Docket 07/31/2013 Page 1 of 99 UNITED STATES DISTRICT COURT SOUTHERN DISTRICT OF FLORIDA Ft. Pierce Division Case No. 12-14333-CIV-MARTINEZ-LYNCH CLASS ACTION In re Digital Domain Media Group Securities Litigation / JURY TRIAL DEMANDED CONSOLIDATED AMENDED CLASS ACTION COMPLAINT Case 2:12-cv-14333-JEM Document 57 Entered on FLSD Docket 07/31/2013 Page 2 of 99 TABLE OF CONTENTS I. NATURE OF THE ACTION ............................................................................................. 2 II. JURISDICTION AND VENUE ......................................................................................... 5 III. THE PARTIES.................................................................................................................... 6 A. Lead Plaintiffs ......................................................................................................... 6 B. The Individual Defendants ...................................................................................... 7 C. The Director Nominee Defendants ......................................................................... 8 D. The Underwriter Defendants ................................................................................. 10 E. Palm Beach Capital Defendants ............................................................................ 11 F. SingerLewak ......................................................................................................... 12 G. Non-Party DDMG ................................................................................................
    [Show full text]
  • The New Digital Domain
    THE NEW DIGITAL DOMAIN How the Pandemic Reshaped Geopolitics, the Social Contract and Technological Sovereignty POLICY REPORT SEPTEMBER 2020 CONTENTS 03 EXECUTIVE SUMMARY 04 DIGITALIZED AND PRIVATIZED: GEOPOLITICS IN THE PANDEMIC 09 DRIVERS AND IMPLICATIONS OF THE DIGITAL ECONOMY 13 A FRACTURING SOCIAL CONTRACT 18 CONTACT TRACING AND TECHNOLOGICAL SOVEREIGNTY 22 RECOMMENDATIONS AND TOPICS FOR EXPLORATION cgc.ie.edu THE NEW DIGITAL DOMAIN 3 EXECUTIVE SUMMARY The COVID-19 pandemic, besides triggering the most Today’s biggest winners are the big tech companies, who severe economic crisis since the Great Depression, is represent the lion’s share of the most valuable companies accelerating technological trends that were well in the that run on data, algorithms and apps rather than making before its outbreak. The Great Lockdown physical labor, but have also managed to utilize the exposed the digital divide between frontier and under-governed nature of the digital domain to non-frontier firms, with the former group being able avoid paying tax and social security. The societal to provide services and goods no longer available within flipside of the growing digital gaps between winners traditional markets. The growing concentration of and losers has been skyrocketing inequality and the power and wealth in the hands of a few global hollowing-out of the middle class—something that digital companies will shape global and domestic in the short term the pandemic is likely to exacerbate. politics in the immediate future. Globally, the pandemic has increased geopolitical THIS REPORT ANALYSES THESE SHIFTS, rivalry and underlined the decline of the US as a PROPOSES A SERIES OF RECOMMENDATIONS superpower.
    [Show full text]
  • Written Evidence Submitted by UK Screen Alliance/Animation UK to the Treasury Select Committee
    Written evidence submitted by UK Screen Alliance/Animation UK to the Treasury Select Committee 23/03/2020 1. About UK Screen Alliance/Animation UK 1.1. UK Screen Alliance in partnership with Animation UK is the trade association that represents Visual Effects (VFX), TV & Film Studios, Post-Production and Animation in the UK. It is the membership organisation for over 100 leading employers in the film, TV and advertising sectors and its primary purpose is advocacy for its member companies and the wider screen industries. 2. The impact of Covid-19 on the Film, TV and advertising supply chain 2.1. Our members rely on an inflow of business from film, TV and advertising productions, but as a result of the Covid-19 virus virtually all global filming has stopped. Film crews utilise large numbers of people working in close proximity, so social distancing measures have made them impossible to operate and insurers will not cover disruption from Covid-19. 2.2. This means that there is no raw unedited material flowing into post-production and VFX for them to work on. This has had an immediate effect on some companies and for others the effect will become apparent over the next few weeks as the projects that they already have in their systems come to completion and are not replaced by new work. Their business interruption insurance will not cover them in these circumstances. 2.3. This sector, which was vibrant until just two weeks ago, is about to come to a dead stop. VFX alone contributes more than £1 billion GVA to the economy and attracts considerable inward investment from the USA.
    [Show full text]
  • DVD MAGAZINE Outstanding Animation, VFX and Motion Graphics for Design and Advertising 15 ��������������������
    DVD MAGAZINE Outstanding animation, VFX and motion graphics for design and advertising 15 �������������������� ������������������������������������������������������������������������������� ��������������������������������������������������������������������������������� ������������������������������������������������������������������������������ �������� ������� �������� ������������ ������� ��������������� ������� ��� �������� ������������������������������������������������������������������������������ ������������������������������������������������ �������������������������������������������������������������������������������� ��������������������������������������������������������������������������������� ������������������� ������������������������������������������������������������������������������� ������������������������������������������������������������������������������������ ���������������������������������������������������������������������������������� �������������������������������������������������������������������������������� ������������������������������������������������������������������������������ �������������������������������������������������������������������������������������� ������������������������ ��������������������������������������������������������������������� �������������������������� ���������������������������������� �������������������� ����������������������������������������� ���������������������������������������� �������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������������
    [Show full text]
  • Falcon's Digital Media​,А​Look Development & Senior Lighting Artist ​ ​Scream House Games LLC,А​Art
    My career spans over 20 years working in the vfx, animation and video game industries. I was fortunate to have been employed at such innovative companies as Walt Disney Animation Studios, Blue Sky Studios, Digital Domain, and Sony Pictures Imageworks. Using both proprietary and mainstream software, I have gained valuable production knowledge and experience working on a variety of pipelines. Responsibilities in Project Management, Art Direction, Game Design, Texture Painting, ​ Environments, Lighting and Look Development have all elevated my creative skills while complementing my technical expertise. Currently, I create & develop immersive interactive 3D content for industries that require Virtual Reality and Augmented Reality experiences using the latest game engine technology. 2015 ­ Present Haskell 3D, Art Director, Lead Artist, Game Designer, Hallandale Beach, FL ​ ​ ​ ​ Previous Clients: Falcon’s Digital Media, Look Development & Senior Lighting Artist, Orlando, FL ​ ​ ​ ​ “The Avengers: Battle of Ultron ­ Dark Ride” (2016) ­ Ilyas & Mustafa Galadari Group ​ “The Lost Valley ­ Theme park attraction” (2016) ­ IMG Worlds of Adventure “Other high profile guest experiences” (2016) ­ IMG Worlds of Adventure 2012 ­ Present Scream House Games LLC, Art Director, Game Developer, Game Designer, Hallandale Beach, FL ​ ​ ​ ​ Scream House Games is a startup independent video game company focusing on the development of survival adventure horror games. “Murder Castle” (2017) ­ Pre­production phase 2007­2012 LightHouse Animation, Art Director, Lead
    [Show full text]
  • Crestview Partners and Aleph Capital Back Framestore's Acquisition Of
    Crestview Partners and Aleph Capital Back Framestore’s Acquisition of Company 3 / Method New York, NY (Nov 6, 2020) – Crestview Partners (“Crestview”), and Aleph Capital Partners LLP (“Aleph”), have today announced a partnership with Framestore, the UK-headquartered, Oscar- winning visual-effects and production services company, to acquire Company 3 / Method, one of the world’s leading post-production and visual effects companies. Following completion of the acquisition, Crestview and Aleph will become the majority shareholders of the enlarged company. The combination of Framestore and Company 3 / Method will create an industry-leading player in a fast-growing market driven by the explosion of content production, and the growth of streaming platforms, bringing together two of the world’s top creative businesses in film, television and advertising. Following the investment from Crestview and Aleph, the merged business will represent the next phase of the industry, uniquely uniting all aspects that support the making of entertainment and communications content – from concept, through to digital and post-production. It will create the only global studio working across every part of the creative and production process and represent a partnership that has together won every major creative award in the film, television, advertising, mixed reality, stereo conversion and experiential sectors. Framestore is headquartered in London with creative studios in Los Angeles, New York, Chicago, Montréal and Mumbai. The company has been a powerhouse in leading entertainment, from its work on box office hits such as Avengers End Game, Blade Runner 2049 and Gravity as well as original series for streaming services such as Amazon, Netflix and Disney+, to immersive theme park experiences for the likes of Wanda and Lionsgate Entertainment World.
    [Show full text]