Automated Staging for Virtual Cinematography Amaury Louarn, Marc Christie, Fabrice Lamarche
Total Page:16
File Type:pdf, Size:1020Kb
Load more
Recommended publications
-
Motion Enriching Using Humanoide Captured Motions
MASTER THESIS: MOTION ENRICHING USING HUMANOIDE CAPTURED MOTIONS STUDENT: SINAN MUTLU ADVISOR : A NTONIO SUSÌN SÀNCHEZ SEPTEMBER, 8TH 2010 COURSE: MASTER IN COMPUTING LSI DEPERTMANT POLYTECNIC UNIVERSITY OF CATALUNYA 1 Abstract Animated humanoid characters are a delight to watch. Nowadays they are extensively used in simulators. In military applications animated characters are used for training soldiers, in medical they are used for studying to detect the problems in the joints of a patient, moreover they can be used for instructing people for an event(such as weather forecasts or giving a lecture in virtual environment). In addition to these environments computer games and 3D animation movies are taking the benefit of animated characters to be more realistic. For all of these mediums motion capture data has a great impact because of its speed and robustness and the ability to capture various motions. Motion capture method can be reused to blend various motion styles. Furthermore we can generate more motions from a single motion data by processing each joint data individually if a motion is cyclic. If the motion is cyclic it is highly probable that each joint is defined by combinations of different signals. On the other hand, irrespective of method selected, creating animation by hand is a time consuming and costly process for people who are working in the art side. For these reasons we can use the databases which are open to everyone such as Computer Graphics Laboratory of Carnegie Mellon University. Creating a new motion from scratch by hand by using some spatial tools (such as 3DS Max, Maya, Natural Motion Endorphin or Blender) or by reusing motion captured data has some difficulties. -
Lightweight Procedural Animation with Believable Physical Interactions
Proceedings of the Fourth Artificial Intelligence and Interactive Digital Entertainment Conference Lightweight Procedural Animation with Believable Physical Interactions Ian Horswill Northwestern University, Departments of EECS and Radio/Television/Film 2133 Sheridan Road, Evanston IL 60208 [email protected] Abstract matics system. Posture control is performed by applying I describe a procedural animation system that uses tech- simulated forces and torques to the torso and pelvis. niques from behavior-based robot control, combined with a Interestingly, the use of a dynamic simulation actually minimalist physical simulation, to produce believable cha- simplifies control, allowing the use of relatively crude con- racter motions in a dynamic world. Although less realistic trol signals, which are then smoothed by the passive dy- than motion capture or full biomechanical simulation, the namics of the character body and body-environment inte- system produces compelling, responsive character behavior. raction; similar results have been found in both human and It is also fast, supports believable physical interactions be- robot motor control (Williamson, 2003). tween characters such as hugging, and makes it easy to au- Twig shows that surprisingly simple techniques can gen- thor new behaviors. erate believable2 motions and interactions. Much of the focus of this paper will be on ways in which Twig is able to Overview1 cheat to avoid doing complicated modeling or control, while still maintaining believability. This work is indebted Versatile procedural animation is a necessary component to the work of Jakobsen (Jakobsen, 2001) and Perlin (Per- for applications such as interactive drama, in which charac- lin, 1995, 2003; Perlin & Goldberg, 1996), both for their ters participate in complex interactions that cannot be pre- general approaches of using simple techniques to generate planned at authoring time. -
Inverse Kinematics Last Time? Today Keyframing Procedural Animation Physically-Based Animation
Last Time? • Navier-Stokes Equations • Conservation of Inverse Kinematics Momentum & Mass • Incompressible Flow Today Keyframing • How do we animate? • Use spline curves to automate the in betweening – Keyframing – Good control – Less tedious than drawing every frame – Procedural Animation • Creating a good animation still requires considerable – Physically-Based Animation skill and talent – Forward and Inverse Kinematics – Motion Capture • Rigid Body Dynamics • Finite Element Method ACM © 1987 “Principles of traditional animation applied to 3D computer animation” Procedural Animation Physically-Based Animation • Describes the motion algorithmically, • Assign physical properties to objects as a function of small number of (masses, forces, inertial properties) parameters • Example: a clock with second, minute • Simulate physics by solving equations and hour hands • Realistic but difficult to control – express the clock motions in terms of a “seconds” variable – the clock is animated by varying the v0 seconds parameter mg • Example: A bouncing ball -kt –Abs(sin(ωt+θ0))*e 1 Articulated Models Skeleton Hierarchy • Articulated models: • Each bone transformation – rigid parts described relative xyzhhhhhh,,,,,qf s – connected by joints to the parent in hips the hierarchy: qfttt,, s • They can be animated by specifying the joint left-leg ... angles as functions of time. r-thigh qc qi qi ()t r-calf y vs qfff, x r-foot z t1 t2 t1 t2 1 DOF: knee 2 DOF: wrist 3 DOF: arm Forward Kinematics Inverse Kinematics (IK) • Given skeleton xyzhhhhhh,,,,,qf -
Architectural Model for an Augmented Reality Based Mobile Learning Application Oluwaranti, A
Journal of Multidisciplinary Engineering Science and Technology (JMEST) ISSN: 3159-0040 Vol. 2 Issue 7, July - 2015 Architectural Model For An Augmented Reality Based Mobile Learning Application Oluwaranti, A. I., Obasa A. A., Olaoye A. O. and Ayeni S. Department of Computer Science and Engineering Obafemi Awolowo University Ile-Ife, Nigeria [email protected] Abstract— The work developed an augmented students. It presents a model to utilize an Android reality (AR) based mobile learning application for based smart phone camera to scan 2D templates and students. It implemented, tested and evaluated the overlay the information in real time. The model was developed AR based mobile learning application. implemented and its performance evaluated with This is with the view to providing an improved and respect to its ease of use, learnability and enhanced learning experience for students. effectiveness. The augmented reality system uses the marker- II. LITERATURE REVIEW based technique for the registration of virtual Augmented reality, commonly referred to as AR contents. The image tracking is based on has garnered significant attention in recent years. This scanning by the inbuilt camera of the mobile terminology has been used to describe the technology device; while the corresponding virtual behind the expansion or intensification of the real augmented information is displayed on its screen. world. To “augment reality” is to “intensify” or “expand” The recognition of scanned images was based on reality itself [4]. Specifically, AR is the ability to the Vuforia Cloud Target Recognition System superimpose digital media on the real world through (VCTRS). The developed mobile application was the screen of a device such as a personal computer or modeled using the Object Oriented modeling a smart phone, to create and show users a world full of techniques. -
Virtual Cinematography Using Optimization and Temporal Smoothing
Virtual Cinematography Using Optimization and Temporal Smoothing Alan Litteneker Demetri Terzopoulos University of California, Los Angeles University of California, Los Angeles [email protected] [email protected] ABSTRACT disagree both on how well a frame matches a particular aesthetic, We propose an automatic virtual cinematography method that takes and on the relative importance of aesthetic properties in a frame. a continuous optimization approach. A suitable camera pose or path As such, virtual cinematography for scenes that are planned is determined automatically by computing the minima of an ob- before delivery to the viewer, such as with 3D animated films made jective function to obtain some desired parameters, such as those popular by companies such as Pixar, is generally solved manu- common in live action photography or cinematography. Multiple ally by a human artist. However, when a scene is even partially objective functions can be combined into a single optimizable func- unknown, such as when playing a video game or viewing a pro- tion, which can be extended to model the smoothness of the optimal cedurally generated real-time animation, some sort of automatic camera path using an active contour model. Our virtual cinematog- virtual cinematography system must be used. raphy technique can be used to find camera paths in either scripted The type of system with which the present work is concerned or unscripted scenes, both with and without smoothing, at a rela- uses continuous objective functions and numerical optimization tively low computational cost. solvers. As an optimization problem, virtual cinematography has some difficult properties: it is generally nonlinear, non-convex, CCS CONCEPTS and cannot be efficiently expressed in closed form. -
Procedural Animation
Procedural Animation Computer Graphics Seminar 2017 Spring Andreas Sepp Coming up today ● Keyframe animation ● Procedural animation for basic character animation ○ Procedural animation with keyframe animation ○ Inverse kinematics ● Procedural animation as a broader field ○ Artificial life animation ○ Physics based modelling and animation Basic keyframe animation ● Animator draws or models the starting and ending points of a transition, called keyframes, and sets their position in time ● The remaining frames inbetween 2 keyframes are interpolated from them ● The animator is in control of everything at every point in time key key key Basic keyframe animation problems ● Transitions in interactive setting ○ Blend walking and running animation? ○ Create a walk ↔ run transition animation? ■ 15 animations - 105 blends required ● Unrealistic movement ○ No proper feedback from the environment ○ Not acceptable anymore Procedural Animation ● a type of computer animation, used to automatically generate animation in real-time to allow for a more diverse series of actions than could otherwise be created using predefined animations ● Animator not in control of everything anymore ● a) Integrated with keyframe animation ○ Roughly follows keyframes ○ Change dynamically ■ e.g. getting hit while running, going up the stairs ● b) Fully procedural animation ○ Initial parameters and some sort of input parameters are provided to control the animation ■ Initial position; forces, torques in time Keyframe + procedural animation ● Dynamic combining of multiple animations ○ Lower body running ○ Upper body swinging a sword ○ Body recoiling to a blow ● What you can achieve with just 14 keyframes and procedural animation: ○ http://www.gamasutra.com/view/news/216973/Video_An_indie_a pproach_to_procedural_animation.php [4:00-10:00] To actually feel connected to the world.. -
Teaching Visual Storytelling for Virtual Production Pipelines Incorporating Motion Capture and Visual Effects
Teaching Visual Storytelling for virtual production pipelines incorporating Motion Capture and Visual Effects Gregory Bennett∗ Jan Krusey Auckland University of Technology Auckland University of Technology Figure 1: Performance Capture for Visual Storytelling at AUT. Abstract solid theoretical foundation, and could traditionally only be ex- plored through theory and examples in a lecture/lab style context. Film, television and media production are subject to consistent Particularly programs that aim to deliver content in a studio-based change due to ever-evolving technological and economic environ- environment suffer from the complexity and cost-time-constraints ments. Accordingly, tertiary teaching of subject areas such as cin- inherently part of practical inquiry into storytelling through short ema, animation and visual effects require frequent adjustments re- film production or visual effects animation. Further, due to the garding curriculum structure and pedagogy. This paper discusses a structure and length of Film, Visual Effects and Digital Design de- multifaceted, cross-disciplinary approach to teaching Visual Narra- grees, there is normally only time for a single facet of visual nar- tives as part of a Digital Design program. Specifically, pedagogical rative to be addressed, for example a practical camera shoot, or challenges in teaching Visual Storytelling through Motion Capture alternatively a visual effects or animation project. This means that and Visual Effects are addressed, and a new pedagogical frame- comparative exploratory learning is usually out of the question, and work using three different modes of moving image storytelling is students might only take a singular view on technical and creative applied and cited as case studies. Further, ongoing changes in film story development throughout their undergraduate years. -
Fusing Multimedia Data Into Dynamic Virtual Environments
ABSTRACT Title of dissertation: FUSING MULTIMEDIA DATA INTO DYNAMIC VIRTUAL ENVIRONMENTS Ruofei Du Doctor of Philosophy, 2018 Dissertation directed by: Professor Amitabh Varshney Department of Computer Science In spite of the dramatic growth of virtual and augmented reality (VR and AR) technology, content creation for immersive and dynamic virtual environments remains a signifcant challenge. In this dissertation, we present our research in fusing multimedia data, including text, photos, panoramas, and multi-view videos, to create rich and compelling virtual environments. First, we present Social Street View, which renders geo-tagged social media in its natural geo-spatial context provided by 360° panoramas. Our system takes into account visual saliency and uses maximal Poisson-disc placement with spatiotem- poral flters to render social multimedia in an immersive setting. We also present a novel GPU-driven pipeline for saliency computation in 360° panoramas using spher- ical harmonics (SH). Our spherical residual model can be applied to virtual cine- matography in 360° videos. We further present Geollery, a mixed-reality platform to render an interactive mirrored world in real time with three-dimensional (3D) buildings, user-generated content, and geo-tagged social media. Our user study has identifed several use cases for these systems, including immersive social storytelling, experiencing the culture, and crowd-sourced tourism. We next present Video Fields, a web-based interactive system to create, cal- ibrate, and render dynamic videos overlaid on 3D scenes. Our system renders dynamic entities from multiple videos, using early and deferred texture sampling. Video Fields can be used for immersive surveillance in virtual environments. Fur- thermore, we present VRSurus and ARCrypt projects to explore the applications of gestures recognition, haptic feedback, and visual cryptography for virtual and augmented reality. -
Joint Vr Conference of Eurovr and Egve, 2011
VTT CREATES BUSINESS FROM TECHNOLOGY Technology and market foresight • Strategic research • Product and service development • IPR and licensing VTT SYMPOSIUM 269 • Assessments, testing, inspection, certification • Technology and innovation management • Technology partnership • • • VTT SYMPOSIUM 269 JOINT VR CONFERENCE OF EUROVR AND EGVE, 2011. CURRENT AND FUTURE PERSPECTIVE... • VTT SYMPOSIUM 269 JOINT VR CONFERENCE OF EUROVR AND EGVE, 2011. The Joint Virtual Reality Conference (JVRC2011) of euroVR and EGVE is an inter- national event which brings together people from industry and research including end-users, developers, suppliers and all those interested in virtual reality (VR), aug- mented reality (AR), mixed reality (MR) and 3D user interfaces (3DUI). This year it was held in the UK in Nottingham hosted by the Human Factors Research Group (HFRG) and the Mixed Reality Lab (MRL) at the University of Nottingham. This publication is a collection of the industrial papers and poster presentations at the conference. It provides an interesting perspective into current and future industrial applications of VR/AR/MR. The industrial Track is an opportunity for industry to tell the research and development communities what they use the tech- nologies for, what they really think, and their needs now and in the future. The Poster Track is an opportunity for the research community to describe current and completed work or unimplemented and/or unusual systems or applications. Here we have presentations from around the world. Joint VR Conference of -
VR As a Content Creation Tool for Movie Previsualisation
Online Submission ID: 1676 VR as a Content Creation Tool for Movie Previsualisation Category: Application Figure 1: We propose a novel VR authoring tool dedicated to sketching movies in 3D before shooting them (a phase known as previsualisation). Our tool covers the main stages in film-preproduction: crafting storyboards (left), creating 3D animations (center images), and preparing technical aspects of the shooting (right). ABSTRACT previsualisation technologies as a way to reduce the costs by early anticipation of issues that may occur during the shooting. Creatives in animation and film productions have forever been ex- ploring the use of new means to prototype their visual sequences Previsualisations of movies or animated sequences are actually before realizing them, by relying on hand-drawn storyboards, phys- crafted by dedicated companies composed of 3D artists, using tra- ical mockups or more recently 3D modelling and animation tools. ditional modelling/animation tools such as Maya, 3DS or Motion However these 3D tools are designed in mind for dedicated ani- Builder. Creatives in film crews (editors, cameramen, directors of mators rather than creatives such as film directors or directors of photography) however do not master these tools and hence can only photography and remain complex to control and master. In this intervene by interacting with the 3D artists. While a few tools such paper we propose a VR authoring system which provides intuitive as FrameForge3D, MovieStorm or ShotPro [2, 4, 6] or research pro- ways of crafting visual sequences, both for expert animators and totypes have been proposed to ease the creative process [23, 27, 28], expert creatives in the animation and film industry. -
(12) United States Patent (10) Patent No.: US 9,729,765 B2 Balakrishnan Et Al
USOO9729765B2 (12) United States Patent (10) Patent No.: US 9,729,765 B2 Balakrishnan et al. (45) Date of Patent: Aug. 8, 2017 (54) MOBILE VIRTUAL CINEMATOGRAPHY A63F 13/70 (2014.09); G06T 15/20 (2013.01); SYSTEM H04N 5/44504 (2013.01); A63F2300/1093 (71) Applicant: Drexel University, Philadelphia, PA (2013.01) (58) Field of Classification Search (US) None (72) Inventors: Girish Balakrishnan, Santa Monica, See application file for complete search history. CA (US); Paul Diefenbach, Collingswood, NJ (US) (56) References Cited (73) Assignee: Drexel University, Philadelphia, PA (US) PUBLICATIONS (*) Notice: Subject to any disclaimer, the term of this Lino, C. et al. (2011) The Director's Lens: An Intelligent Assistant patent is extended or adjusted under 35 for Virtual Cinematography. ACM Multimedia, ACM 978-1-4503 U.S.C. 154(b) by 651 days. 0616-Apr. 11, 2011. Elson, D.K. and Riedl, M.O (2007) A Lightweight Intelligent (21) Appl. No.: 14/309,833 Virtual Cinematography System for Machinima Production. Asso ciation for the Advancement of Artificial Intelligence. Available (22) Filed: Jun. 19, 2014 from www.aaai.org. (Continued) (65) Prior Publication Data US 2014/O378222 A1 Dec. 25, 2014 Primary Examiner — Maurice L. McDowell, Jr. (74) Attorney, Agent, or Firm — Saul Ewing LLP: Related U.S. Application Data Kathryn Doyle; Brian R. Landry (60) Provisional application No. 61/836,829, filed on Jun. 19, 2013. (57) ABSTRACT A virtual cinematography system (SmartWCS) is disclosed, (51) Int. Cl. including a mobile tablet device, wherein the mobile tablet H04N 5/222 (2006.01) device includes a touch-sensor Screen, a first hand control, a A63F 3/65 (2014.01) second hand control, and a motion sensor. -
Use Style: Paper Title
INTERNATIONAL CONFERENCE ON INFORMATICS AND CREATIVE MULTIMEDIA 2013 (ICICM’13) UTM, KUALA LUMPUR. SEPTEMBER 3-6, 2013, pp.104,109, 4-6 Sept. 2013 doi:10.1109/ICICM.2013.25 IEEEXplore Expression driven Trignometric based Procedural Animation of Quadrupeds Zeeshan Bhatti, Asadullah Shah, Mustafa Karabasi and Waheed Mahesar Khulliyyah of Information and Communication Technology International Islamic University Malaysia, Kuala Lumpur e-mail: [email protected], [email protected], [email protected], [email protected] Abstract— This research paper addresses the problem of riggers need [3]. So a character animator normally ends up generating involuntary and precise animation of quadrupeds building a custom skeletal rig for the ease of animation with automatic rigging system of various character types. The [3][4]. The process is also known as Character Rigging. We technique proposed through this research is based on a two have used MAYA as the basic development and simulation tier animation control curve with base simulation being driven tool with motion equations implemented as Maya Embedded through dynamic mathematical model using procedural Language (MEL) code written as expressions that gets algorithm and the top layer with a custom user controlled executed at every frame controlling and driving the various animation provided with intuitive Graphical User Interface body part of the character rig. (GUI). The character rig is based on forward and inverse kinematics driven through trigonometric based motion II. LITERATURE REVIEW equations. The User is provided with various manipulators and Quadruped motion has always been an integral part of attributes to control and handle the locomotion gaits of the characters and choose between various types of simulated character animation and simulation.