sign in sign up
<<
Home , Dave Filoni, Jon Favreau, Rick Famuyiwa, Skywalker Sound, The Mandalorian, Virtual actor

The Art & Science of : StageCraft

VIEWING GUIDE

DISCUSSION ACTIVITIES » VFX GLOSSARY » LEARNING QUESTIONS » STANDARDS »

Industrial Light & Magic, industry leaders multimedia presentation that demonstrates presentation in the world of visual effects, have done it the intersection of art, science, and again by creating a start-to-finish virtual technology in the entertainment industry, all production solution called ILM StageCraft. while making connections to current STEAM The groundbreaking technology provides a curriculum topics. Attendees will be able to overview continuous pipeline from initial exploration, send in questions for our guests during the scouting, and art direction, traditional and Q&A portion of the program via the website. technical previsualization, lighting, and of course, real-time production filming This study guide is intended to complement itself, with the innovative StageCraft LED The Art & Science of Lucasfilm: StageCraft volumes. Utilizing their own career path presentation, but feel free to adapt and stories and current examples of work on The abridge the content as necessary to Mandalorian, experienced professionals from meet your unique learning objectives and ILM’s Virtual Production Team will share their circumstances. expertise in a behind-the-scenes, interactive

Recommended Grades 6-12

Content written by Maddy Leonard. Designed by Paola Rojas, Amy Matthews, and Maddy Leonard. All SFFILM Education materials are developed in alignment with educational standards for media literacy. SFFILM Education welcomes feedback and questions on all printed study materials.

More info at sffilm.org/education PRESENTATION OVERVIEW » PRESENTER BIOS » DISCUSSION QUESTIONS » ACTIVITIES »

The Mandalorian made its world debut with the release of Disney+ in November of 2019. about As the first ever live action series, opened a new realm of The Mandalorian was written and executive storytelling in the Star Wars galaxy. Set produced by Emmy-nominated producer the between the fall of the Empire and the rise of and actor . Lucasfilm veteran the First Order, a lone mysterious gunfighter (Star Wars: The , Star plies his trade deep in the galaxy’s outer Wars Rebels) directed the series premiere. reaches far from the activity of the New Additional episodic directors include Deborah series Republic. Chow (Jessica Jones), (Dope), (Solemates), With a starring cast including , and (Thor: Ragnarok). , , Emily Swallow, , Omid Abtahi, and , the unprecedented series subject Arts/Media English Language Arts Career Path Training STEAM areas Computer Science Peer/Youth Issues

More info at sffilm.org/education ABOUT THE SERIES » DISCUSSION QUESTIONS » ACTIVITES » ESSAY CONTEST » presenter bios

Ian Milham joined Industrial Light & Magic in Ciku Karanja is a technology project Eoghan Cunneen is a Virtual Production

2018 as a Virtual Production Supervisor, after a manager for Lucasfilm’s virtual production Computer Graphics Supervisor and Content teams. For the past eight years, she 24 year career in real time computer graphics. He Pipeline Engineering Manager at Lucasfilm’s has worked with filmmakers, actors, leads the on stage team of artists operating the Advanced Development Group, a research creatives, and engineers across the Bay Stagecraft system in its first major deployment and development group within Lucasfilm that Area. She has a Master’s in media history, on Season One of The Mandalorian. Ian got his focuses on real-time computer graphics that enjoys exploring narrative as it relates start as an environment artist in video games, drive ILM’s virtual production and ILMxLAB’s to audience, society, and power, and is becoming an Art Director and Creative Director on intrigued by cinematic innovations as immersive experiences. He focuses on software several titles. He was nominated for Best Real- definitive and disruptive milestones in our development and infrastructure to optimize the

Time visuals by the Visual Effects Society and a future histories. production process.

BAFTA for Outstanding Visual Achievement for

Dead Space.

More info at sffilm.org/education PRESENTER BIOS » ACTIVITIES » ESSAY CONTEST» VFX GLOSSARY »

discussion questions John Favreau’s innovative approach to The Mandalorian Did you enjoy this presentation? What How do you think the drove the advancement of ILM were your favorite moments? and LED Screen technology can StageCraft to great success. An change the film industry? What end-to-end virtual production Before this presentation, did you know are your predictions on how these solution, ILM StageCraft is what goes into making a heavily VFX technologies will be used in the future? a methodology that allows focused show like The Mandalorian? filmmakers unparalleled What did you learn about The Unreal Engine technology was created creative control and Mandalorian’s VFX process that you by — an American video did not know before? game and software developer and collaboration during prep and publisher — to be used in its video shoot, which is a game-changer If you previously watched The games. Now that the technology on a huge visual effects driven Mandalorian before this presentation, is being used to improve VFX in series like The Mandalorian. did you know it was shot with new filmmaking, do you see a future where Instead of the traditional green LED screen technology instead of video games and film become more screen and post visual effects traditional green screens? Do you think intertwined? Why or why not? What do paradigm, ILM StageCraft the show would have looked different if you think that future will look like? it was shot using mostly green screen enables principle photography technology? What do you think would Are you interested in working on VFX in on photo-real, virtual sets have been different? films? Why? that rendered in real-time and indistinguishable from Do some research on other new VFX What new skills and competencies will their physical counterparts. technologies that Lucasfilm has used filmmakers of the future need that are This provides an immersive in its productions over the course of different from what they needed in the experience for actors and its existence. What other technologies past? did Lucasfilm and its partners help filmmakers, seamless popularize? How do those past Compare the skills and experiences of interactive light on the physical technologies compare to current day the presenters from their bios. What elements on set, and literally VFX technology? patterns do you see in their career thousands of in-camera VFX paths? What surprised you? What finals. It’s had a profoundly Why do you think it’s important for VFX questions do you have for them? positive impact on every aspect artists to continuously be trying new of our production.” things and exploring new technology? How did the presenters explain how STEAM plays into their jobs? What kind Compare and contrast the Unreal of math and science training would you - Janet Lewin, Co-Producer, The Engine and LED Screen technology need to prepare for work in this field? Mandalorian with Green Screen technology. What are the pros and cons to each kind of technology?

More info at sffilm.org/education DISCUSSION QUESTIONS » ESSAY CONTEST » VFX GLOSSARY » LUCASFILM OVERVIEW »

VFX Storyboarding (from a computer, laptop, or TV). Create a miniature character or several characters, activities Watch this short video titled “Intro to and find a video or photo that you want Storyboarding”. Pay attention to the to use as your set background. Pull that explanation of how storyboarding has photo or video on your monitor, and changed as VFX have evolved over time. set up your characters in front of it. Take How do you think the Unreal Engine and your recording device and create a shot LED Screen Technology will change how where the character seamlessly blends in filmmakers plan their storytelling? with your digital background. Play around with the lighting from the monitor and the Green Screen Technology lighting in your environment and make Try out green screen technology for your own scene with your character(s). yourself! Green Screen by Do Ink is a cheap, easy, beginner app for testing out a Unreal Engine green screen. Did you know Unreal Engine is free to use? If you are interested in VFX design or video LED Screen Technology game design you can give it a try here. Try to re-create the new LED screen There are even free tutorials created by technology used in the Mandalorian. Epic Games that can help you learn to use You can create a mini version of this the platform. technology using a recording device (a camera or smartphone) and a monitor additional Unreal Engine

The Virtual Production of The resources Mandalorian, Season One

Why ‘The Mandalorian’ Uses Virtual Sets Over Green Screen

Understanding ‘The Volume,’ The Technology That’s Changing VFX Production

More info at sffilm.org/education ACTIVITIES » VFX GLOSSARY » LUCASFILM OVERVIEW » LEARNING STANDARDS »

This contest is made possible by the generous world of your own. Introduce us to your story nellie support of the Nellie Wong Magic of Movies world and then explain how you would bring Education Fund, endowed by Tim Kochis and your world to life on screen using new VFX SFFILM board member Penelope Wong to honor technology. If you had an unlimited budget, the memory of her mother, Nellie Wong (1917- would you use LED Screen Technology, wong 2007), who was an avid film-goer and cinephile. Unreal Engine, Green Screens, or something Developed to support the year-round outreach completely different? efforts of SFFILM Education, the Fund aims to 4. Watch an episode of The Mandalorian cultivate students’ imaginations, enhance their through the lens of a film critic. Think back to magic of critical thinking and creative writing skills and what you learned about the technical process instill a greater appreciation for the magic of that went into creating the series. How do movies in young audiences of the Bay Area. these new technological advancements movies change the viewing experience for the Winning essays will be determined based on audience? Pay attention to things like lighting, creativity, depth, enthusiasm, clarity, mood, emotion, acting, pacing, and editing, grammar and relevance to the essay prompts. and analyze how new technology made these essay Essays must be written in response to one of aspects of the episode different than other the following questions about the The Art & Star Wars films. Science of Lucasfilm: StageCraft presentation. 5. Write about your experience on this digital There is no minimum word or page count for this field trip. Did you enjoy this presentation? contest contest, instead students should focus on crafting What were your favorite moments? Was there a thoughtful and complete response to their a subject that one or more of the presenters selected prompt. Essays should be no longer than touched on that was extra interesting to you? 3 pages. Do some more research on that subject and tell us what you learn. Prompts Submissions 1. Did this presentation make you think differently about your own career trajectory? Please email all submissions to Did it make you think differently about [email protected] with “Lucasfilm Essay how you might use your skills in either Contest” in the subject line. To be eligible for math, science, or art in your future career? consideration, all essays must include the Think about the experiences that led these following information: presenters toward working for Lucasfilm. Have you had an experience in your own life • Student name that inspired you toward a particular kind of • Grade work? Imagine and describe a future in which • School that experience leads you into the career of • Teacher name your dreams. • Teacher email address 2. The speakers from Lucasfilm presented about the new technology that was used to make Deadline for entry is Jan 5th 2021 at 11:59 PM . The Mandalorian, and how it has the ability to shape the future of VFX within the filmmaking industry. Is there a new, emerging technology Prizes that you think will redefine an industry or way of life (i.e. new tech in transportation, • Elementary School, Grades 1-5 environmental science, storytelling, sports, $150 cash prize medicine, etc)? Write about this new • Middle School Grades 6-8 technology and how you think it will reshape $300 cash prize our world. • High School Grades 9-12 3. Use your imagination to create a new story $500 cash prize

More info at sffilm.org/education ESSAY CONTEST » LUCASFILM OVERVIEW » LEARNING STANDARDS » MEDIA LITERACY RESOURCES » vfx glossary CHARACTER ANIMATION shots that involve camera movement, as it eliminates the many A specialized area of the animation process, which involves variables of human camera operation. bringing animated characters to life. Character Animators must create the illusion of thoughtfulness, emotion and personality PHOTOGRAMMETRY by developing every character’s appearance, body language The age-old practice of determining the geometric properties of and facial expressions from scratch. While an actor generally objects based on photographic images. provides the vocals in an animated film performance, the character animator provides all else. ROTOSCOPING An animation technique in which live- action video is traced and COMPOSITING “painted” to create 2-D animation that mimics the live-action. The combining of visual elements from separate sources into single images, often to create the illusion that all those UNREAL ENGINE elements are parts of the same scene or space. The Unreal Engine is a game engine developed by Epic Games, first showcased in the 1998 first-person shooter game Unreal. CREATURE ANIMATION Today Unreal Engine is the world’s most open and advanced Not unlike character animation, creature animation is the real-time 3D creation tool. Continuously evolving to serve not process of bringing animated beasts, aliens and animals to life. only its original purpose as a state-of-the-art game engine, today it gives creators across industries the freedom and control to deliver cutting-edge content, interactive experiences, FACIAL ANIMATION and immersive virtual worlds. The detailed process of animating characters’ facial features to convey particular appearances, emotions, reactions, etc. The process of creating the illusion of camera movement by GREEN SCREEN digitally compositing and sequencing background images that A special effects film technique involving filming actors against change position relative to live action footage. a green screen on which effects such as computerized graphics can be added later and integrated into a single sequence.. VIRTUAL SET A 3D software module that collates and arranges a massive series of images according to the spatial organization and A process by which patterns of movement are captured via geometry of a given scene setting such that live action green a series of sensory nodes applied to various body/face parts screen footage of actors can be dynamically combined with the of a live actor; these nodes record data about the spatial virtual space. In the case of The Mandalorian, the virtual set configuration of these nodes over time; simulation software consisted of an immersive and massive 20’ high by 270-degree then processes these data and applies them to a semicircular LED video wall and ceiling with a 75’-diameter on a computer. performance space, where the practical set pieces were combined with digital extensions on the screens. Digital 3D MOTION CONTROL environments created by ILM played back interactively on the A process that generally utilizes robotic camera mounts, LED walls, edited in real-time during the shoot, which allowed enabling identically configured and timed camera movement for pixel-accurate tracking and perspective-correct 3D imagery on every take. This process facilitates digital compositing on rendered at high resolution.

More info at sffilm.org/education VFX GLOSSARY » LEARNING STANDARDS » MEDIA LITERACY RESOURCES » PRESENTATION OVERVIEW » lucasfilm overview Lucasfilm seven of the top 10 worldwide box-office hits of all time and has Lucasfilm Is Among The World’s Leading Entertainment Service contributed to 25 of the top 50. Companies, A Pioneer In Visual Effects And Sound Across Multiple Mediums, And Is Home To The Legendary Star Wars ILM has set the standard for visual effects, creating some of And Franchises. the most stunning images in the history of film. At the forefront of the digital revolution, the company continues to break new Founded by visionary filmmaker in 1971, ground in visual effects, VR, AR, and Immersive Cinema. The Lucasfilm established itself as a “rebel base” of sorts in San company has been awarded 15 for Best Francisco’s Bay Area, a place the filmmaker chose to “shake Visual Effects and received 31 Academy Awards for Scientific up the status quo…of how movies were made and what they and Technical Achievement. were about.” It was a defiant departure from the Hollywood mainstream and a more conducive atmosphere to cultivate his independent spirit of filmmaking. The pulsating hum of a . The thunderous footsteps of a stalking Tyrannosaurus Rex. The awesome roar of Star-Lord’s Basing his Skywalker Sound facility at the Ranch, Lucas moved Milano. For more than a generation, Skywalker Sound has Industrial Light & Magic, his special effects company based created soundscapes that have redefined aural immersion. in , to nearby San Rafael, allowing him to keep his production facilities and special effects house in close With origins based in ’s landmark work on 1977’s Star proximity to each other. Wars, Skywalker Sound specializes in , mixing, and audio post-production across multiple mediums. From In 2005, Lucas brought Lucasfilm and Industrial Light & Magic the gathering of real-life, organic sounds to developing new together at the Letterman Digital Arts Center at the Presidio in techniques in sound presentation, Skywalker Sound remains San Francisco. Six years later in 2012, he handed the company one of the world’s most innovative facilities — eager to explore, reigns over to renowned producer Kathleen Kennedy, who has create, and venture into the unknown. since opened up an exciting new era for Lucasfilm by returning it to its production studio roots. ILMxLAB Lucasfilm’s award-winning immersive entertainment studio, When Lucasfilm was acquired by Disney that same year, pioneering a new era of interactive storytelling through virtual Kennedy worked to enhance the company’s collaborative spirit, and mixed reality experiences. Working with acclaimed creators building a creative community of writers, directors, artists and and designers, we create living worlds, inviting you to step filmmakers. Lucasfilm draws on the vast pool of skilled, world- inside and become the hero of your own personal adventure. class talent found in San Francisco and around the world, allowing it to create the top-notch entertainment experiences it has come to be known for.

Industrial Light and Magic Founded in 1975 by George Lucas, ILM is the leading effects facility in the world, serving the motion picture, commercial production, and attraction industries. ILM has created visual effects for over 325 feature films and has played a key role in

More info at sffilm.org/education LUCASFILM OVERVIEW » MEDIA LITERACY RESOURCES » PRESENTATION OVERVIEW » ABOUT THE SERIES »

Science and Technical Subjects including the narration of historical events, scientific procedures/ CCSS.ELA-LITERACY.RST.6-8.4 common experiments, or technical processes. Determine the meaning of symbols, CCSS.ELA-LITERACY.WHST.6-12.6 key terms, and other domain-specific words and phrases as they are used in Use technology, including the Internet, to core a specific scientific or technical context produce and publish writing and present relevant to grades 6-8 texts and topics. the relationships between information and ideas clearly and efficiently. CCSS.ELA-LITERACY.RST.6-8.9 standards CCSS.ELA-LITERACY.WHST.6-12.7 Compare and contrast the information gained from experiments, simulations, Conduct short research projects to video, or multimedia sources with that answer a question (including a self- gained from reading a text on the same generated question), drawing on several topic. sources and generating additional related, focused questions that allow for CCSS.ELA-LITERACY.RST.9-10.4 multiple avenues of exploration. Determine the meaning of symbols, CCSS.ELA-LITERACY.WHST.6-12.8 key terms, and other domain-specific words and phrases as they are used in Gather relevant information from a specific scientific or technical context multiple print and digital sources, using relevant to grades 9-10 texts and topics. search terms effectively; assess the credibility and accuracy of each source; CCSS.ELA-LITERACY.RST.11-12.4 and quote or paraphrase the data and Determine the meaning of symbols, conclusions of others while avoiding key terms, and other domain-specific plagiarism and following a standard words and phrases as they are used in format for citation. a specific scientific or technical context CCSS.ELA-LITERACY.WHST.6-12.9 relevant to grades 11-12 texts and topics. Draw evidence from informational texts CCSS.ELA-LITERACY.RST.11-12.9 to support analysis, reflection, and Synthesize information from research. a range of sources (e.g., texts, experiments, simulations) into a coherent understanding of a process, phenomenon, or concept, resolving conflicting information when possible.

Writing CCSS.ELA-LITERACY.WHST.6-12.1 Write arguments focused on discipline- specific content. CCSS.ELA-LITERACY.WHST.6-12.2 Write informative/explanatory texts,

More info at sffilm.org/education LEARNING STANDARDS » PRESENTATION OVERVIEW » ABOUT THE SERIES » PRESENTER BIOS »

We live in a world where technology be accomplished by first identifying its mediates a large portion of human principal characteristics: media interaction and the exchange of (1) Medium: the physical means by information. Every projected image, every which it is contained and/or delivered word published on a page or a website, and every sound from a speaker reaches (2) Author: the person(s) responsible for literacy its creation and dissemination its audience through the medium, through the language of the device. The (3) Content: the information, emotions, ability to parse the vast array of media values or ideas it conveys resources: messages is an essential skill for young (4) Audience: the target audience to people, particularly in a mainstream whom it is delivered commercial culture that targets screening youth as a vulnerable, impressionable (5) Purpose: the objectives of its authors segment of the American marketplace. and the effects of its dissemination. Most students already have a keen understanding of the languages different Students who can readily identify these with five core characteristics will be equipped media use and the techniques they employ to inspire particular emotions to understand the incentives at work or reactions, but they often lack the skill behind media messages, as well as meaning or awareness to fully deconstruct the their potential consequences. Media messages they continuously receive. literacy education empowers students to Analysis of a media message—or any become responsible consumers, active piece of mass media content—can best citizens and critical thinkers. common core standards MEDIUM PURPOSE AUDIENCE All Media Is Constructed. All Media Messages Are Constructed for a Reason. All Media Messages Reach an Audience. • What is the message, how is it delivered and in what • Why was the message constructed? • Who receives the message? format? • Who benefits from dissemination of the message? • For whom is the message intended? • What technologies are used to present the message? How? • What is the public reaction to the media content and/ • What visual and auditory elements comprise the • To what extent does the message achieve its purpose? or its message? media content? • What effect does the message have on the audience it • What is your reaction to the media content and/or its • What expectations do you bring to the content, given reaches, if any? message? its medium and format? • How might others perceive this message differently? AUTHOR Why? CONTENT All Media Is Constructed by Someone.

Media Is A Language For Information. • Who is delivering the message? • What is the subject of the media message? • Who originally constructed the message? • What information, values, emotions or ideas are • What expectations do you have of the content, given conveyed by the media content? its author(s)? • What tools does the author employ to engage the viewer and evoke a response? • To what extent did the content meet your expectations, given the format/author?

More info at sffilm.org/education