360°News from Fraunhofer

Recent 360° activities from Fraunhofer

Ivo Haulsen

New technologies shown on IBC – Desktop Warping – Active Stereo with 1920 x 1200 resolution – Autocalib Easy (without initial setup)

Windows Desktop can be warped and blended For running of arbitrary programs (like games) on warped rectangular screens (like cylinders, waves) For domes, simulators etc: – No need to change the image generator (before: changing the render loop in the source code) – Image generator needs the viewport information Running on Nvidia Quadro 5000 and 6000 and Quadroplex Currently on Windows, later on Linux 3

For cylindrical screens (like Timelabs from HHI) and wave-form screens One camera only No initial setup necessary (projector type, camera, screen geometry)

• Cooperation project with MARUM - Center for Marine Environmental Sciences, Bremen • Topics: • Immersive Telepresence • Augmented Reality

Prelimary results: Mapping of the output of 3 virtual cameras from a simulator, 180° x 80°

• Telepresence: • Using three Wide-Angle Cameras • Challenge: · Calibration of the cameras · Under Water calibration (refraction) · Stitching and blending Oceanexplorer: NOAA Vents, Susan Merle (parallax) – Cameras can be tilted • Augmented reality – Combination with Barymethry – Inclusion of Ultrasound data

Recently two installations in USA using Images: Kraftwerk Living Technologies, Austria our Auto-Alignment system Kraftwerk was system integrator Brainsalt: Video Server & Autoalignment Seaworld San Diego, „MANTA“ – 20m long tunnel – 18 projectors – More than 100.000 Lumen

– Autoalignment with 13 cameras Seaworld Orlando, „TURTLE TREK“ – 360°omnidirectional 3D Dome – 34 projectors – 368.800 Lumen 7

Sanyo ISE booth Autostadt Audi Pavillon - Wolfsburg

C2 Turnkey Solutions: NanoSpheron Madame Tussauds London All Images: brainsalt, Austria

Cooperation with system integrators Image

for simulators by

Role of Fraunhofer FOKUS: FraunhoferITWM – Autoalignment – Planning – Consulting

Example: – Cooperation with Fraunhofer ITWM for an interactive driving simulator – Fraunhofer Fokus for projection planning and installation of autoalignment system

18 wuxga projectors HMI data 3D scene Pose Environment data

Real-time Motion tracking PC

• Cooperation with sofmachine (Peter Popp) to produce the fulldome show „Life of Trees“ – Stereoscopic rendering – Rendering farm

• Cooperation with NSC Creative (Aaron Bradbury) – Stereoscopic tests

Images: softmachine, NSC Creative • Planned cooperation with HFF Potsdam (Veit Quack) for stereoscopic dome camera

Images: 12

• Fraunhofer project SpatialAV – IIS – HHI – IDMT – FOKUS • Topics: – Different Camera systems (3D, omnidirectional, Light Field, Dome Camera) • 2 approaches for Dome Cameras; – High resolution with fisheye (CMOS Test with 2 Fisheye Cameras for 3D- with 25 Mpixel and 53fps exists) Dome real content – Camera clustering

Thank you !

Contact: [email protected]