Recent 360° activities from Fraunhofer Ivo Haulsen 1 © Fraunhofer FOKUS IBC 2012 - Amsterdam New technologies shown on IBC – Desktop Warping – Active Stereo with 1920 x 1200 resolution – Autocalib Easy (without initial setup) 2 © Fraunhofer FOKUS Desktop Warping Windows Desktop can be warped and blended For running of arbitrary programs (like games) on warped rectangular screens (like cylinders, waves) For domes, simulators etc: – No need to change the image generator (before: changing the render loop in the source code) – Image generator needs the viewport information Running on Nvidia Quadro 5000 and 6000 and Quadroplex Currently on Windows, later on Linux 3 © Fraunhofer FOKUS Autocalib Easy For cylindrical screens (like Timelabs from HHI) and wave-form screens One camera only No initial setup necessary (projector type, camera, screen geometry) 4 © Fraunhofer FOKUS Immersive Telepresence in Deep Sea • Cooperation project with MARUM - Center for Marine Environmental Sciences, Bremen • Topics: • Immersive Telepresence • Augmented Reality Prelimary results: Mapping of the output of 3 virtual cameras from a simulator, 180° x 80° 5 © Fraunhofer FOKUS Immersive Telepresence in Deep Sea • Telepresence: • Using three Wide-Angle Cameras • Challenge: · Calibration of the cameras · Under Water calibration (refraction) · Stitching and blending Oceanexplorer: NOAA Vents, Susan Merle (parallax) – Cameras can be tilted • Augmented reality – Combination with Barymethry – Inclusion of Ultrasound data 6 © Fraunhofer FOKUS Entertainment: Recent installations Brainsalt Media / Kraftwerk Living Technologies Recently two installations in USA using AustriaTechnologies,LivingKraftwerk Images: our Auto-Alignment system Kraftwerk was system integrator Brainsalt: Video Server & Autoalignment Seaworld San Diego, „MANTA“ – 20m long tunnel – 18 projectors – More than 100.000 Lumen – Autoalignment with 13 cameras Seaworld Orlando, „TURTLE TREK“ – 360°omnidirectional 3D Dome – 34 projectors – 368.800 Lumen 7 © Fraunhofer FOKUS Entertainment: Other examples (Brainsalt Media) Sanyo ISE booth Autostadt Audi Pavillon - Wolfsburg C2 Turnkey Solutions: NanoSpheron Madame Tussauds London All Images: brainsalt, Austria 8 © Fraunhofer FOKUS Application in Simulators Cooperation with system integrators Image for simulators by Role of Fraunhofer FOKUS: Fraunhofer ITWM Fraunhofer – Autoalignment – Planning – Consulting Example: – Cooperation with Fraunhofer ITWM for an interactive driving simulator – Fraunhofer Fokus for projection planning and installation of autoalignment system 9 © Fraunhofer FOKUS Visual simulation ITWM IGD & ITWM FOKUS ITWM Warping, edge Spherical blending, colour projection and contrast 330° * 110° FOV calibration Graphics Cluster & scene graph Vehicle data 18 wuxga projectors HMI data 3D scene Pose Environment data Real-time Motion tracking PC © Fraunhofer ITWM 10 Fixed screen projection dome © Fraunhofer ITWM 11 Cooperations with fulldome producers • Cooperation with sofmachine (Peter Popp) to produce the fulldome show „Life of Trees“ – Stereoscopic rendering – Rendering farm • Cooperation with NSC Creative (Aaron Bradbury) – Stereoscopic tests Images: softmachine, NSC Creative • Planned cooperation with HFF Potsdam (Veit Quack) for stereoscopic dome camera Images: 12 © Fraunhofer FOKUS Dome Camera • Fraunhofer project SpatialAV – IIS – HHI – IDMT – FOKUS • Topics: – Different Camera systems (3D, omnidirectional, Light Field, Dome Camera) • 2 approaches for Dome Cameras; – High resolution with fisheye (CMOS Test with 2 Fisheye Cameras for 3D- with 25 Mpixel and 53fps exists) Dome real content – Camera clustering 13 © Fraunhofer FOKUS Thank you ! Contact: [email protected] 14 © Fraunhofer FOKUS .