Brief Alcatel-Lucent Overview

NMI 2013: VIDEO SOCIETY Cameras Omnipresent & Internetworked

Peter Domschitz – Alcatel-Lucent, Bell Labs Multimedia Technologies CAMERAFICATION

Forecast: Amount of digital data Entered Zettabyte era in 2010 created and replicated per year 1 Zettabyte = 1.000 Exabytes = as we approach the 1.000.000.000.000.000.000.000 video society… Bytes

That is a lot of data… REALLY!

Gedankenexperiment: Store all digital information generated in 2020 on DVD.

Gedankenexperiment: Store all that digital data predicted for 2020 on DVDs.

Picture a stack of those DVDs Mars The stack reaches halfway from Earth to Mars Actually the stack’s height is about 50 million kilometers It takes a light beam about 3 Earth minutes to travel along that stack…

Explosion in Data!

Not linear. Probably not even exponential. It’s just… exploding!

Digital data deluge is a REAL issue in the Video Society: • For each of us... • But also technology wise:  Impossible to store all that data  Impossible to transmit all that data

Connecting the world is no longer enough! Need to go beyond just providing access to data…

Moving from raw data to meaningful information.

• CAMERAS EVERYWHERE: WEARABLE DEVICES, ENVIRONMENTAL CAMERAS,… • EVER INCREASE OF VIDEO GENERATION • ADVENT OF AUTOMATED PROCESSING • MULTI-STREAM & MULTI-VIEW • SCENES OF THE FUTURE • IMPLICATIONS & DISCUSSIONS

Vint Cerf augments his reality. (Credit: Dan Farber/CNET)

2M action cameras (POV) sold in 2011, growing to 8M in 2014

GoPro HD Hero GoPro WiFi BacPac GoPro HD Hero 3 Local Recording WiFi

Looxcie 1 LooxcieLive Looxcie HD Local Recording via smartphone WiFi

Sept 2010 Jan 2011 Nov 2011 Jun 2011 Sep 2011 Nov 2011

13% of consumer video surveillance equipment is IP-networked

MORE VIDEO UPLOADED PER MINUTE ON

1M dashcams in Russia (3% of cars) DROPCAM THEN ON YOUTUBE

PANORAMIC LIGHTFIELD CAMERAS (ADJUST FOCUS AFTERWARDS)

1.85M connected CCTV in UK 4K networked CCTV in NY subway

“A pedestrian who strolls through Boston’s Financial District, an area of about 40 city blocks, can be seen by at least 233 private and public cameras. ”

230K police drones by 2020 in US

NEED FOR AUTOMATED ANALYSIS OF SITUATIONS AND EVENTS

DARPA SPACE TELESCOPE

CAPTURING CONSUMPTION DEVICES DEVICES

2H2012

Google+ automated photo analysis & improvement - Places - People - Blur, color schemes - Clustering - Esthetic assessment

MULTIMEDIA CLOUD NETWORK

August 2012: Instagram photo sharing daily active users passes Twitter

January 2013, Twitter introduces Vine: a mobile service that lets you capture and share short looping videos. Like Tweets, the brevity of videos on Vine (6 seconds or less) inspires creativity.

June 2013: Vine 6sec video sharing on Twitter surpasses Instagram

• CITIZEN JOURNALISM: RARE AND FAST • E.G. RUSSIAN METEOR • PRIVACY QUESTIONS • A TRANSPARENT SOCIETY • UNEXPECTED MEMORIES • …

FREE-VIEW VIDEO 3D MODEL CREATION (“MATRIX-LIKE BULLET VIEW)

… and set of well defined camera positions.

Enjoy the match from any place in the stadium …

… extending immersive experiences!

FREE-VIEW ON THE WORLD LIVE AND EVERY MOMENT IN HISTORY INTEGRATION OF ALL FEEDS VIDEO GOOGLE MAPS/EARTH

ASSISTED FOCUS AUTOMATED ANALYSIS CURATES EVENTS AND VIEWS OF INTEREST

INTUITIVE CONTROL NAVIGATE IN THE TELESCENE WITH NEW HUMAN COMPUTER INTERFACES

PUBLIC SAFETY PERSONAL ADVENTURES

• CAMERAFICATION IN THE PRIVATE AND THE PUBLIC SPHERE • AUTOMATED HANDSFREE CAPTURING – CONCENTRATE ON THE EXPERIENCE, NOT ON BEING A PHOTOGRAPHER/CAMERAMAN • ABUNDANCE OF GENERATED AND SHARED MEDIA CREATES NEEDS FOR CLOUD STORAGE AND BROADBAND TRAFFIC • DEALING WITH ABUNDANCE OF MEDIA CREATES NEED FOR AUTOMATED ANALYSIS, SELECTION, CURATION, GENERATION OF RELEVANT CONTENT. MEDIA PROCESSING IN THE CLOUD. • MULTI-STREAM AND MULTI-VIEW: THE WORLD CONTINUOUSLY VIDEOGRAPHED • A TRANSPARENT SOCIETY – PRIVACY AND COPYRIGHT CONCERNS

Example PUBLIC SAFETY

Scene 1: Big FIRE event Multiple points of interest, difficult to grasp the big picture

CCTV Historical / non-live scene recording

Drone Smart Phone

5 people in

IR cameras, correlations sensors,…

Historical scene recording with (visual) annotations

ECC

On road

Historical scene recording At scene with (visual) annotations

Police Hotel CCTV helmet

Dashcam Drone

Over-rule GPS-assisted digital signage scene navigator

Example PERSONAL ADVENTURES

PERSONAL ADVENTURES

Freeview Assisted Focus Assisted Focus

Context from multiple feeds

Freeview Intuitive Control

Freeview points-of-view Personalized focus

Freeview Freeview Assisted Focus Assisted Focus

>>> event / people detection <<< Context from multi-feeds Always perfectly in the picture

Assisted Focus Freeview

Personalized focus Privacy – opt-in and -out