Brief Alcatel-Lucent Overview
Total Page:16
File Type:pdf, Size:1020Kb
NMI 2013: VIDEO SOCIETY Cameras Omnipresent & Internetworked Peter Domschitz – Alcatel-Lucent, Bell Labs Multimedia Technologies CAMERAFICATION 2 | ALL RIGHTS RESERVED. COPYRIGHT © ALCATEL-LUCENT 2011-2013. CAMERAFICATION MAN’S NEW BEST FRIEND 3 | ALL RIGHTS RESERVED. COPYRIGHT © ALCATEL-LUCENT 2011-2013. CAMERAFICATION AVALANCHE OF DIGITAL MEDIA 4 | ALL RIGHTS RESERVED. COPYRIGHT © ALCATEL-LUCENT 2011-2013. CAMERAFICATION AVALANCHE OF DIGITAL MEDIA Forecast: Amount of digital data Entered Zettabyte era in 2010 created and replicated per year 1 Zettabyte = 1.000 Exabytes = as we approach the 1.000.000.000.000.000.000.000 video society… Bytes That is a lot of data… REALLY! Gedankenexperiment: Store all digital information generated in 2020 on DVD. 5 | ALL RIGHTS RESERVED. COPYRIGHT © ALCATEL-LUCENT 2011-2013. CAMERAFICATION AVALANCHE OF DIGITAL MEDIA Gedankenexperiment: Store all that digital data predicted for 2020 on DVDs. Picture a stack of those DVDs Mars The stack reaches halfway from Earth to Mars Actually the stack’s height is about 50 million kilometers It takes a light beam about 3 Earth minutes to travel along that stack… Explosion in Data! Not linear. Probably not even exponential. It’s just… exploding! 6 | ALL RIGHTS RESERVED. COPYRIGHT © ALCATEL-LUCENT 2011-2013. CAMERAFICATION AVALANCHE OF DIGITAL MEDIA Digital data deluge is a REAL issue in the Video Society: • For each of us... • But also technology wise: Impossible to store all that data Impossible to transmit all that data Connecting the world is no longer enough! Need to go beyond just providing access to data… Moving from raw data to meaningful information. 7 | ALL RIGHTS RESERVED. COPYRIGHT © ALCATEL-LUCENT 2011-2013. CAMERAFICATION ONLY THE BEGINNING • CAMERAS EVERYWHERE: WEARABLE DEVICES, ENVIRONMENTAL CAMERAS,… • EVER INCREASE OF VIDEO GENERATION • ADVENT OF AUTOMATED PROCESSING • MULTI-STREAM & MULTI-VIEW • SCENES OF THE FUTURE • IMPLICATIONS & DISCUSSIONS 8 | ALL RIGHTS RESERVED. COPYRIGHT © ALCATEL-LUCENT 2011-2013. CAMERAS EVERYWERE WEARABLES – AUTOMATED CAPTURING 9 | ALL RIGHTS RESERVED. COPYRIGHT © ALCATEL-LUCENT 2011-2013. CAMERAS EVERYWERE WEARABLES – AUTOMATED CAPTURING 10 | ALL RIGHTS RESERVED. COPYRIGHT © ALCATEL-LUCENT 2011-2013. CAMERAS EVERYWERE HEAD MOUNTED 11 | ALL RIGHTS RESERVED. COPYRIGHT © ALCATEL-LUCENT 2011-2013. CAMERAS EVERYWERE HEAD MOUNTED Vint Cerf augments his reality. (Credit: Dan Farber/CNET) 12 | ALL RIGHTS RESERVED. COPYRIGHT © ALCATEL-LUCENT 2011-2013. CAMERAS EVERYWERE MORE WEARABLE VIDEO CAMERAS 2M action cameras (POV) sold in 2011, growing to 8M in 2014 13 | ALL RIGHTS RESERVED. COPYRIGHT © ALCATEL-LUCENT 2011-2013. CAMERAS EVERYWERE CONNECTED WEARABLE CAMERAS GoPro HD Hero GoPro WiFi BacPac GoPro HD Hero 3 Local Recording WiFi Looxcie 1 LooxcieLive Looxcie HD Local Recording via smartphone WiFi Sept 2010 Jan 2011 Nov 2011 Jun 2011 Sep 2011 Nov 2011 14 | ALL RIGHTS RESERVED. COPYRIGHT © ALCATEL-LUCENT 2011-2013. CAMERAS EVERYWERE CONSUMER ENVIRONMENTAL CAMERAS 13% of consumer video surveillance equipment is IP-networked MORE VIDEO UPLOADED PER MINUTE ON 1M dashcams in Russia (3% of cars) DROPCAM THEN ON YOUTUBE 15 | ALL RIGHTS RESERVED. COPYRIGHT © ALCATEL-LUCENT 2011-2013. CAMERAS EVERYWERE NEW FORMATS PANORAMIC LIGHTFIELD CAMERAS (ADJUST FOCUS AFTERWARDS) 16 | ALL RIGHTS RESERVED. COPYRIGHT © ALCATEL-LUCENT 2011-2013. CAMERAS EVERYWERE ROBOTIC CAMERAS 17 | ALL RIGHTS RESERVED. COPYRIGHT © ALCATEL-LUCENT 2011-2013. CAMERAS EVERYWERE THE PUBLIC SPHERE 1.85M connected CCTV in UK 4K networked CCTV in NY subway “A pedestrian who strolls through Boston’s Financial District, an area of about 40 city blocks, can be seen by at least 233 private and public cameras. ” 230K police drones by 2020 in US NEED FOR AUTOMATED ANALYSIS OF SITUATIONS AND EVENTS 18 | ALL RIGHTS RESERVED. COPYRIGHT © ALCATEL-LUCENT 2011-2013. CAMERAS EVERYWERE EVEN MORE OMNIPRESENT BUT NOT VISIBLE DARPA SPACE TELESCOPE 19 | ALL RIGHTS RESERVED. COPYRIGHT © ALCATEL-LUCENT 2011-2013. TRANSFORMATION PAINS PRIVACY – ETIQUETTE – COPYRIGHT … 20 | ALL RIGHTS RESERVED. COPYRIGHT © ALCATEL-LUCENT 2011-2013. MEDIA ABUNDANCE EFFECTS 21 | ALL RIGHTS RESERVED. COPYRIGHT © ALCATEL-LUCENT 2011-2013. CLOUD STORAGE CAPTURING CONSUMPTION DEVICES DEVICES 22 | ALL RIGHTS RESERVED. COPYRIGHT © ALCATEL-LUCENT 2011-2013. VIDEO TRAFFIC – ALSO UPLOAD 2H2012 23 | ALL RIGHTS RESERVED. COPYRIGHT © ALCATEL-LUCENT 2011-2013. AUTOMATION – ANALYSIS AND SELECTION Google+ automated photo analysis & improvement - Places - People - Blur, color schemes - Clustering - Esthetic assessment 24 | ALL RIGHTS RESERVED. COPYRIGHT © ALCATEL-LUCENT 2011-2013. AUTOMATED CONTENT CREATION 25 | ALL RIGHTS RESERVED. COPYRIGHT © ALCATEL-LUCENT 2011-2013. AUTOMATED CONTENT CREATION 26 | ALL RIGHTS RESERVED. COPYRIGHT © ALCATEL-LUCENT 2011-2013. AUTOMATED PROCESSING MULTIMEDIA CLOUD NETWORK 27 | ALL RIGHTS RESERVED. COPYRIGHT © ALCATEL-LUCENT 2011-2013. USAGE – LIVE SHARING 28 | ALL RIGHTS RESERVED. COPYRIGHT © ALCATEL-LUCENT 2011-2013. USAGE – VIDEO AS COMMUNICATION 29 | ALL RIGHTS RESERVED. COPYRIGHT © ALCATEL-LUCENT 2011-2013. USAGE – VIDEO AS COMMUNICATION August 2012: Instagram photo sharing daily active users passes Twitter January 2013, Twitter introduces Vine: a mobile service that lets you capture and share short looping videos. Like Tweets, the brevity of videos on Vine (6 seconds or less) inspires creativity. June 2013: Vine 6sec video sharing on Twitter surpasses Instagram 30 | ALL RIGHTS RESERVED. COPYRIGHT © ALCATEL-LUCENT 2011-2013. USAGE – IMPLICATIONS • CITIZEN JOURNALISM: RARE AND FAST • E.G. RUSSIAN METEOR • PRIVACY QUESTIONS • A TRANSPARENT SOCIETY • UNEXPECTED MEMORIES • … 31 | ALL RIGHTS RESERVED. COPYRIGHT © ALCATEL-LUCENT 2011-2013. LEVERAGING THE CAMERA CROWD Today: MULTI-STREAM APPLICATIONS 32 | ALL RIGHTS RESERVED. COPYRIGHT © ALCATEL-LUCENT 2011-2013. LEVERAGING THE CAMERA CROWD Next: MULTI-STREAM & MULTI-VIEW FREE-VIEW VIDEO 3D MODEL CREATION (“MATRIX-LIKE BULLET VIEW) 33 | ALL RIGHTS RESERVED. COPYRIGHT © ALCATEL-LUCENT 2011-2013. Example: PERSONALIZED VIEWPOINT TV What we have is a stadium … 34 | ALL RIGHTS RESERVED. COPYRIGHT © ALCATEL-LUCENT 2011-2013. Example: PERSONALIZED VIEWPOINT TV … and set of well defined camera positions. 35 | ALL RIGHTS RESERVED. COPYRIGHT © ALCATEL-LUCENT 2011-2013. Example: PERSONALIZED VIEWPOINT TV Enjoy the match from any place in the stadium … … extending immersive experiences! 36 | ALL RIGHTS RESERVED. COPYRIGHT © ALCATEL-LUCENT 2011-2013. THE WORLD CONTINUOUSLY VIDEOGRAPHED CREATING NEW VIEWPOINTS FREE-VIEW ON THE WORLD LIVE AND EVERY MOMENT IN HISTORY INTEGRATION OF ALL FEEDS VIDEO GOOGLE MAPS/EARTH ASSISTED FOCUS AUTOMATED ANALYSIS CURATES EVENTS AND VIEWS OF INTEREST INTUITIVE CONTROL NAVIGATE IN THE TELESCENE WITH NEW HUMAN COMPUTER INTERFACES 37 | ALL RIGHTS RESERVED. COPYRIGHT © ALCATEL-LUCENT 2011-2013. THE WORLD CONTINUOUSLY VIDEOGRAPHED A WIDE RANGE OF APPLICATIONS PUBLIC SAFETY PERSONAL ADVENTURES 38 | ALL RIGHTS RESERVED. COPYRIGHT © ALCATEL-LUCENT 2011-2013. CAMERAS OMNIPRESENT & INTERNETWORKED REFLECTIONS • CAMERAFICATION IN THE PRIVATE AND THE PUBLIC SPHERE • AUTOMATED HANDSFREE CAPTURING – CONCENTRATE ON THE EXPERIENCE, NOT ON BEING A PHOTOGRAPHER/CAMERAMAN • ABUNDANCE OF GENERATED AND SHARED MEDIA CREATES NEEDS FOR CLOUD STORAGE AND BROADBAND TRAFFIC • DEALING WITH ABUNDANCE OF MEDIA CREATES NEED FOR AUTOMATED ANALYSIS, SELECTION, CURATION, GENERATION OF RELEVANT CONTENT. MEDIA PROCESSING IN THE CLOUD. • MULTI-STREAM AND MULTI-VIEW: THE WORLD CONTINUOUSLY VIDEOGRAPHED • A TRANSPARENT SOCIETY – PRIVACY AND COPYRIGHT CONCERNS 39 | ALL RIGHTS RESERVED. COPYRIGHT © ALCATEL-LUCENT 2011-2013. THE WORLD CONTINUOUSLY VIDEOGRAPHED Example PUBLIC SAFETY Scene 1: Big FIRE event Multiple points of interest, difficult to grasp the big picture 41 | ALL RIGHTS RESERVED. COPYRIGHT © ALCATEL-LUCENT 2011-2013. Scene 1: Big FIRE event LIVE 3D FREE-VIEW CCTV Historical / non-live scene recording Drone Smart Phone 42 | ALL RIGHTS RESERVED. COPYRIGHT © ALCATEL-LUCENT 2011-2013. Scene 1: Big FIRE event ASSISTED FOCUS 5 people in IR cameras, correlations sensors,… Historical scene recording with (visual) annotations 43 | ALL RIGHTS RESERVED. COPYRIGHT © ALCATEL-LUCENT 2011-2013. Emergency pre-plans Scene 1: Big FIRE event INTUITIVE CONTROL ECC On road Historical scene recording At scene with (visual) annotations 44 | ALL RIGHTS RESERVED. COPYRIGHT © ALCATEL-LUCENT 2011-2013. Scene 2: RIOT – DEMONSTRATION – PROTEST 45 | ALL RIGHTS RESERVED. COPYRIGHT © ALCATEL-LUCENT 2011-2013. Scene 2: RIOT – DEMONSTRATION – PROTEST LIVE 3D FREE-VIEW Police Hotel CCTV helmet Dashcam Drone 46 | ALL RIGHTS RESERVED. COPYRIGHT © ALCATEL-LUCENT 2011-2013. Scene 2: RIOT – DEMONSTRATION – PROTEST ASSISTED FOCUS 47 | ALL RIGHTS RESERVED. COPYRIGHT © ALCATEL-LUCENT 2011-2013. Scene 2: RIOT – DEMONSTRATION – PROTEST INTUITIVE CONTROL Over-rule GPS-assisted digital signage scene navigator 48 | ALL RIGHTS RESERVED. COPYRIGHT © ALCATEL-LUCENT 2011-2013. THE WORLD CONTINUOUSLY VIDEOGRAPHED Example PERSONAL ADVENTURES PERSONAL ADVENTURES 50 | ALL RIGHTS RESERVED. COPYRIGHT © ALCATEL-LUCENT 2011-2013. PERSONAL ADVENTURES Scene 1: CHILDREN’S SOCCER MATCH Freeview Assisted Focus Assisted Focus Context from multiple feeds Freeview Intuitive Control Freeview points-of-view Personalized focus 51 | ALL RIGHTS RESERVED. COPYRIGHT © ALCATEL-LUCENT 2011-2013. PERSONAL ADVENTURES Scene 2: FAMILY ZOO VISIT Freeview Freeview Assisted Focus Assisted Focus >>> event / people detection <<< Context from multi-feeds Always perfectly in the picture Assisted Focus Freeview Personalized focus Privacy – opt-in and -out 52 | ALL RIGHTS RESERVED. COPYRIGHT © ALCATEL-LUCENT 2011-2013. 53 | ALL RIGHTS RESERVED. COPYRIGHT © ALCATEL-LUCENT 2011-2013. .