Robust Watermarking Techniques for Stereoscopic Video Protection Afef Chammem

Total Page:16

File Type:pdf, Size:1020Kb

Robust Watermarking Techniques for Stereoscopic Video Protection Afef Chammem Robust watermarking techniques for stereoscopic video protection Afef Chammem To cite this version: Afef Chammem. Robust watermarking techniques for stereoscopic video protection. Other [cs.OH]. Institut National des Télécommunications, 2013. English. NNT : 2013TELE0008. tel-00917964 HAL Id: tel-00917964 https://tel.archives-ouvertes.fr/tel-00917964 Submitted on 12 Dec 2013 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. THESE DE DOCTORAT CONJOINT TELECOM SUDPARIS et L’UNIVERSITE PIERRE ET MARIE CURIE Spécialité : Informatique et Télécommunication Ecole doctorale : Informatique, Télécommunications et Electronique de Paris Méthodes de tatouage robuste pour la protection de l'imagerie numérique 3D Présentée par Afef Chammem Soutenu le 27 Mai 2013 à paris Devant le jury composé de : Prof. Touradj Ebrahimi Head of the MMSPG, EPFL Rapporteur Prof. Laurent Lucas Head of the SIC Group, URCA Rapporteur Prof. Patrick Gallinari Head of the LIP6, UPMC Président Dr. Frédéric Dufaux CNRS Research Director, TelecomParisTech Examinateur Prof. Faouzi Ghorbel Head of the CRISTAL Lab, ENSI Examinateur Head of the New Formats and New Coding Project, Mme. Maryline Clare Examinateur Orange Labs Prof. Françoise Preteux Deputy Scientific Director, Mines ParisTech Directeur de thèse HDR. Mihai Mitrea Associate Professor, Telecom SudParis Co-Directeur de thèse Thèse n°2013TELE0008 Table of Contents Table of Contents Abstract ...................................................................................................................................................... 1 Chapter 1 Context ................................................................................................................................... 5 1.1. Stereoscopic content .......................................................................................................................................... 7 1.1.1. Content proliferation .................................................................................................... 8 1.1.2. Device explosion ......................................................................................................... 14 1.1.3. Potential protection techniques .................................................................................. 17 1.2. Watermarking properties .............................................................................................................................. 18 1.2.1. Watermarking applicative panorama ......................................................................... 18 1.2.2. Main watermarking constraints ................................................................................. 20 1.2.3. From 2D to stereoscopic video watermarking ........................................................... 26 1.2.4. Theoretical framework for stereo watermarking ...................................................... 28 1.3. Thesis structure ................................................................................................................................................. 30 Chapter 2 Objectives ........................................................................................................................... 31 2.1. Disparity maps computation ........................................................................................................................ 33 2.1.1. Basic concepts ............................................................................................................. 33 2.1.2. Block matching disparity map computation in the literature .................................... 33 2.1.3. Conclusion ................................................................................................................... 38 2.2. Watermarking embedding techniques..................................................................................................... 38 2.2.1. Principles ..................................................................................................................... 38 2.2.2. State-of-the-art ............................................................................................................ 39 2.2.3. Discussion ................................................................................................................... 43 2.3. Conclusion and thesis objectives ................................................................................................................ 48 Chapter 3 A new insertion domain: 3D Video-New Three Step Search ............................ 51 3.1. Method presentation ....................................................................................................................................... 53 3.1.1. Principles ..................................................................................................................... 53 3.1.2. Pseudo-code and flowchart......................................................................................... 53 3.2. Experimental validation ................................................................................................................................. 58 3.2.1. Test bed ....................................................................................................................... 58 3.2.2. Horizontal and vertical displacements tendency ....................................................... 59 3.2.3. Visual investigation of the disparity maps.................................................................. 60 3.2.4. Reconstructed image quality assessment ................................................................... 62 3.2.5. Computational cost ..................................................................................................... 67 3.3. Discussion ............................................................................................................................................................ 70 3.4. Conclusion ............................................................................................................................................................ 70 i A.Chammem, Robust watermarking techniques for stereoscopic content protection Chapter 4 A reliable watermarking technique: Fast-IProtect ............................................. 71 4.1. IProtect: hybrid embedding technique .................................................................................................... 73 4.1.1. IProtect embedding scheme ....................................................................................... 73 4.1.2. IProtect detection ........................................................................................................ 78 4.2. Towards Fast-IProtect .................................................................................................................................... 78 4.2.1. Statistical models for watermarking attacks .............................................................. 80 4.2.2. Monte Carlo simulation for watermarking attacks ..................................................... 83 4.2.3. Experimental validation .............................................................................................. 86 4.3. Conclusion ............................................................................................................................................................ 87 Chapter 5 Stereoscopic watermarking benchmark ................................................................ 89 5.1. Embedding procedure .................................................................................................................................... 92 5.2. Embedding domains ........................................................................................................................................ 94 5.3. Transparency evaluation ............................................................................................................................... 96 5.3.1. Subjective protocol ..................................................................................................... 96 5.3.2. Objective assessment ................................................................................................ 104 5.4. Robustness evaluation .................................................................................................................................. 107 5.5. Computational cost ........................................................................................................................................ 110 5.5.1. Processing time ......................................................................................................... 110 5.5.2. Algorithmic complexity ............................................................................................. 110 5.6. Discussion .......................................................................................................................................................... 111 Chapter 6 Conclusion and future work .....................................................................................
Recommended publications
  • Stereoscopic 3D Videos and Panoramas Stereoscopic 3D Videos and Panoramas
    Christian Richardt Stereoscopic 3D Videos and Panoramas Stereoscopic 3D videos and panoramas 1. Capturing and displaying stereo 3D videos 2. Viewing comfort considerations 3. Editing stereo 3D videos (research papers) 4. Creating stereo 3D panoramas 2017-08-03 Christian Richardt – Stereoscopic 3D Videos and Panoramas 2 Stereo camera rigs Parallel Converged (‘toed-in’) 2017-08-03 Christian Richardt – Stereoscopic 3D Videos and Panoramas 3 Stereo camera rigs Parallel Converged (‘toed-in’) Kreylos Kreylos Oliver Oliver 2012 2012 © ©2012 Oliver 2017-08-03 Christian Richardt – Stereoscopic 3D Videos and Panoramas 4 Computational stereo 3D camera system et al./ACM et Computational stereo camera system with programmable control loop S. Heinzle, P. Greisen, D. Gallup, C. Chen, D. Saner, A. Smolic, A. Burg, W. Matusik & M. Gross Heinzle ACM Transactions on Graphics (SIGGRAPH), 2011, 30(4), 94:1–10 2011 © 2017-08-03 Christian Richardt – Stereoscopic 3D Videos and Panoramas 5 Commercial stereo 3D projection Polarised projection Wavelength multiplexing e.g. RealD 3D, MasterImage 3D e.g. Dolby 3D 3.0 - SA - BY - Commons/CC Wilkinson/Sound and Vision and Wilkinson/Sound NK, 3dnatureguy/Wikimedia Raoul Raoul ©2011 ©2011 Scott © 2017-08-03 Christian Richardt – Stereoscopic 3D Videos and Panoramas 6 Medium-scale stereo 3D displays Active shutter glasses Autostereoscopy e.g. NVIDIA 3D Vision, 3D TVs 3.0 - SA - BY - ©2011 ©2011 MTBS3D/NVIDIA /Wikimedia Commons/CC /Wikimedia Cmglee © 2017-08-03 Christian Richardt – Stereoscopic 3D Videos and Panoramas 7 Other stereo 3D displays Head-mounted displays (HMDs) Anaglyph stereo e.g. HTC Vive, Oculus Rift, Google Cardboard e.g. red cyan glasses, ColorCode 3-D, Inficolor 3D ©2016 HTC Corporation ©2016 HTC Taringa 2016 2016 © 2017-08-03 Christian Richardt – Stereoscopic 3D Videos and Panoramas 8 Cinema 3D Narrow angular range that spans a single seat et al.
    [Show full text]
  • Stereoscopic 3D in Games
    DEGREE PROJECT, IN COMPUTER SCIENCE , SECOND LEVEL STOCKHOLM, SWEDEN 2015 Stereoscopic 3D in games HENNING BENNET AND DAVID LINDSTRÖM KTH ROYAL INSTITUTE OF TECHNOLOGY SCHOOL OF COMPUTER SCIENCE AND COMMUNICATION (CSC) EXAMENSARBETE VID CSC, KTH Stereoskopisk 3D i spel Stereoscopic 3D in games Bennet, Henning & Lindström, David E-postadress vid KTH: [email protected] & [email protected] Exjobb i: Datalogi Program: Civilingenjör Datateknik Handledare: Arnborg, Stefan Examinator: Arnborg, Stefan Uppdragsgivare: Fabrication Games Datum: 2015-06-17 Sammanfattning Stereoskopisk 3D i spel I den här rapporten undersöks stereoskopisk 3D. Vi utreder hur ett spel ska anpassas för att ta fram en så bra och tydlig stereoskopisk 3D-effekt som möjligt och så att betraktaren upplever ett tydligt djup utan att uppleva ett obehag på grund av effekten. Rapporten tittar djupare på vilka tekniska aspekter man behöver ta hänsyn till vid spelutveckling i stereoskopisk 3D. Samt vilka prestandabegränsningar som man bör ta hänsyn till vid stereoskopisk 3D. Vi beskriver hur processen och framtagandet av prototypen Kodo med anaglyfisk stereoskopisk 3D såg ut. Prototypen togs fram för att testa och analysera resultatet av stereoskopisk 3D-effekten. Abstract Stereoscopic 3D in games In this report we investigate the technique of stereoscopic 3D. This report investigates the steps needed to create a game adapted for an improved stereoscopic 3D effect. Furthermore we investigate what improvements one should make to avoid the beholder to experience any discomfort due to the effect. The report talks about technical aspects one needs to consider when using stereoscopic 3D, as well as performance issues we might need to take into consideration.
    [Show full text]
  • 3D Content, Screens Building, 3D TV Slow to Catch On
    INITIAL David Franklin, [email protected], 415.364.3780 Ryan Duck, [email protected], 415.364.3779 REPORT 3D Content, Screens Building, 3D TV Slow to Catch On Companies: DLB, RLD, SEO:034220/LPL, SNE, TSE:IMX/IMAX, TYO:6502/ETR:TSE1, TYO:6758/SNE February 24, 2011 Research Question: What is the future of 3D content viewing, and how will that affect box-office receipts and TV sales? Silo Summaries Summary of Findings 1) CONTENT PROVIDERS These two UK-based sources expect demand for 3D content viewing continues to grow. Production and conversion 3D movies to continue to grow. Adoption of 3D are starting to include genres outside of animation and live action. TV is expected to be slow because of consumers’ dislike of the glasses, the high 3D movies’ financial success has been restricted by a lack of cost of monitors and the lack of quality TV screens, especially in Europe and Asia. content. Most moviegoers are willing to pay the 3D premium, but industry 2) CONVERSION PROVIDERS professionals expect pricing to level out within the next few years. All four sources reported growing interest and 3D TV adoption is being stymied by the sets’ high prices, 3D improving quality for 3D movies. One source said glasses, the different technologies, and the lack of content for TV. the “perfect storm” of creative interest, 3D technology advancements and the switch to Passive glasses and no glasses 3D TV have limited availability. digital movies is driving 3D adoption. Once these technologies are more widely deployed, 3D TVs should see an increase in adoption.
    [Show full text]
  • Quality-Aware 3D Video Delivery
    Quality-aware 3D Video Delivery by Ahmed Hamza M.Sc., Mansoura University, Egypt, 2008 B.Sc., Mansoura University, Egypt, 2003 Thesis Submitted in Partial Fulfillment of the Requirements for the Degree of Doctor of Philosophy in the School of Computing Science Faculty of Applied Science c Ahmed Hamza 2017 SIMON FRASER UNIVERSITY Spring 2017 All rights reserved. However, in accordance with the Copyright Act of Canada, this work may be reproduced without authorization under the conditions for “Fair Dealing.” Therefore, limited reproduction of this work for the purposes of private study, research, criticism, review and news reporting is likely to be in accordance with the law, particularly if cited appropriately. Approval Name: Ahmed Hamza Degree: Doctor of Philosophy Title: Quality-aware 3D Video Delivery Examining Committee: Chair: Arrvindh Shriraman Associate Professor Mohamed Hefeeda Senior Supervisor Professor Joseph Peters Supervisor Professor Jiangchuan Liu Internal Examiner Professor School of Computing Science Abdulmotaleb El Saddik External Examiner Professor School of Electrical Engineering and Computer Science University of Ottawa Date Defended: April 18, 2017 ii Abstract Three dimensional (3D) videos are the next natural step in the evolution of digital media technologies. In order to provide viewers with depth perception and immersive experience, 3D video streams contain one or more views and additional information describing the scene’s geometry. This greatly increases the bandwidth requirements for 3D video transport. In this thesis, we address the challenges associated with delivering high quality 3D video content to heterogeneous devices over both wired and wireless networks. We focus on three problems: energy-efficient multicast of 3D videos over 4/5G networks, quality-aware HTTP adaptive streaming of free-viewpoint videos, and achieving quality-of-experience (QoE) fair- ness in free-viewpoint video streaming in mobile networks.
    [Show full text]
  • 3Rd Dimension Veritas Et Visus August 2010 Vol 5 No 7/8
    3rd Dimension Veritas et Visus August 2010 Vol 5 No 7/8 Autodesk Research, p53 Microsoft, p70 Barco, p94 Nokia Research, p104 Letter from the publisher : Is poor quality 3D a danger to industry success? by Mark Fihn 2 News from around the world 3 Conference Summaries: 53 Conference on Advanced Human Interfaces, May 26-28, 2010, Rome, Italy 53 TV 3.0 – The Future of TVs, May 26-27, 2010, Seattle, Washington 56 SID Display Week 2010, May 25-28, 2010, Seattle, Washington 60 SID DisplaySearch Business Conference, May 24, 2010, Seattle, Washington 67 CHI, April 10-15, 2010, Atlanta, Georgia 69 NAB 2010, April 10-15, 2010, Las Vegas, Nevada, by Michael Starks 77 5th China International 3D World Forum, April 9-11, 2010, Shenzhen, China 92 Eye Tracking Research and Applications, March 22-24, 2010, Austin, Texas 95 Stereoscopic Displays and Applications, January 18-20, 2010, San Jose, California 100 New product introductions: lessons lost by Norman Hairston 107 To 3D or not 3D, that’s no longer the question by Jon Peddie 110 Is 3D doomed? – Point/Counterpoint Five reasons 3D display is doomed by Steve Peterson 112 Five reasons 3D display ISN'T doomed (a rebuttal) by Neil Schneider 113 MTBS visits Best Buy in Wilmington, DE by Neil Schneider 117 Frenzy in the Third Dimension by Marty Shindler 120 Last Word: “Avatar” as the “Jazz Singer” by Lenny Lipton 122 Display Industry Calendar 123 The 3rd Dimension is focused on bringing news and commentary about developments and trends related to the use of 3D displays and supportive components and software.
    [Show full text]
  • 3D at NAB 2010
    3D at NAB 2010 3D at NAB 2010 © 2010 Michael Starks 3DTV Corp Permission granted to reproduce in whole or part provided this copyright notice is included. Since my report on 3D at NAB 2009 the 3D industry has picked up speed and the range of products and projects is simply amazing. To assess what was at the show and where the industry is going we have to look at the whole world of stereoimaging. Driven originally mostly by the 3D cinema, 3D has now become the darling of the broadcast and electronics industries with everyone rushing to implement 3D hardware and software and many progams planned over broadcast, cable and satellite. Korea seems to be the first with regular 3D programs on a satellite pay tv channel (though some will recall the satellite broadcasts of C3D in the USA and of Japan 3D a decade ago (to both of whom I provided hardware, software and consulting) when CRT‘s and shutter glasses were the only available means. Live 3D broadcasts of sporting events to limited audiences (i.e., to theaters equipped to receive and display 3D) are occurring and FIFA has committed to 3D broadcast of the 2010 World Soccer Cup from South Africa. Sony has stated that they will broadcast 25 matches from FIFA 2010 with seven stereo rigs with Pro HDC-1500 cameras processed via their MPE-200 (with automatic parallax control) and 3D Outside Broadcast trucks. As I write, the French Tennis open and various USA baseball games will be 3D cast soon. Contrary to many announcements in the media, none of these were the first live 3D sports broadcasts, that honor belonging afaik (as far as I know- a webonym to the Milwaukee Brewers game done in anaglyph in 1953.
    [Show full text]
  • 1Dv438 Teori Contents
    1dv438 Teori Contents 1 Math 1 1.1 Basis (linear algebra) ......................................... 1 1.1.1 Definition ........................................... 1 1.1.2 Expression of a basis ..................................... 2 1.1.3 Properties .......................................... 2 1.1.4 Examples ........................................... 3 1.1.5 Extending to a basis ..................................... 3 1.1.6 Example of alternative proofs ................................ 3 1.1.7 Ordered bases and coordinates ................................ 4 1.1.8 Related notions ........................................ 4 1.1.9 Proof that every vector space has a basis ........................... 5 1.1.10 See also ............................................ 6 1.1.11 Notes ............................................. 6 1.1.12 References .......................................... 6 1.1.13 External links ......................................... 6 1.2 Multiplication of vectors ........................................ 6 1.2.1 See also ............................................ 7 1.3 Identity matrix ............................................. 7 1.3.1 See also ............................................ 7 1.3.2 Notes ............................................. 7 1.3.3 External links ......................................... 7 1.4 Translation (geometry) ........................................ 8 1.4.1 Matrix representation ..................................... 8 1.4.2 Translations in physics .................................... 9 1.4.3
    [Show full text]
  • 3Rd Dimension Veritas Et Visus October 2010 Vol 5 No 9
    3rd Dimension Veritas et Visus October 2010 Vol 5 No 9 Table of Contents Otto-von-Guerke Univ., p26 Kyung Hee Univ, P39 Univ. of Manitoba, p41 ELDIM, p42 Letter from the publisher : Holding the sun…by Mark Fihn 2 News from around the world 4 IFA DisplaySearch Business Conference, September 3, 2010, Berlin, Germany 17 Korea Display Conference, July 8-9, 2010, Seoul, South Korea 20 Graphics Interface Conference, May 31–June 2, 2010, Ottawa, Ontario 22 Conference on Advanced Human Interfaces, May 26-28, 2010, Rome, Italy 25 TV 3.0 – The Future of TVs, May 26-27, 2010, Seattle, Washington 27 SID Display Week 2010, May 25-28, 2010, Seattle, Washington 30 Stereoscopic Displays and Applications, January 18-20, 2010, San Jose, California 36 Subtitling for Stereographic Media by Jonathan Jenkyn 44 Clear Buildings by Boris Starosta 53 3D in the hand by Fluppeteer 57 Display Industry Calendar 59 The 3rd Dimension is focused on bringing news and commentary about developments and trends related to the use of 3D displays and supportive components and software. The 3rd Dimension is published electronically 10 times annually by Veritas et Visus, 3305 Chelsea Place, Temple, Texas, USA, 76502. Phone: +1 254 791 0603. http://www.veritasetvisus.com Publisher & Editor-in-Chief Mark Fihn [email protected] Managing Editor Phillip Hill [email protected] Contributors Fluppeteer, Jonathan Jenkyn, and Boris Starosta Subscription rate: US$47.99 annually. Single issues are available for US$7.99 each. Hard copy subscriptions are available upon request, at a rate based on location and mailing method.
    [Show full text]