A Method for the Assessment of the Quality of Stereoscopic 3D Images Raluca Vlad To cite this version: Raluca Vlad. A Method for the Assessment of the Quality of Stereoscopic 3D Images. Signal and Image Processing. Université de Grenoble, 2013. English. tel-00925280v1 HAL Id: tel-00925280 https://tel.archives-ouvertes.fr/tel-00925280v1 Submitted on 7 Jan 2014 (v1), last revised 28 Feb 2014 (v3) HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. THÈSE pour obtenir le grade de DOCTEUR DE L’UNIVERSITÉ DE GRENOBLE Spécialité : Signal, Image, Parole, Télécommunications (SIPT) Arrêté ministériel : 7 août 2006 Présentée par Mlle Raluca VLAD Thèse dirigée par Mme Anne GUÉRIN-DUGUÉ et Mme Patricia LADRET préparée au sein du laboratoire Grenoble - Images, Parole, Signal, Automatique (GIPSA-lab) dans l’école doctorale d’Électronique, Électrotechnique, Automatique et Traitement du signal (EEATS) Une méthode pour l’évaluation de la qualité des images 3D stéréoscopiques Thèse soutenue publiquement le 2 décembre 2013, devant le jury composé de : Patrick LE CALLET Professeur, Université de Nantes, Rapporteur Frederic DUFAUX Directeur de recherche, CNRS, Telecom Paris Tech, Rapporteur Pascal MAMASSIAN Directeur de recherche, CNRS, Université Paris Descartes, Examinateur, Président du jury Ingrid HEYNDERICKX Professeur, Technical University of Delft, Examinateur Alain BELLON Ingénieur, STMicroelectronics Grenoble, Examinateur Anne GUÉRIN-DUGUÉ Professeur, Université Joseph Fourier Grenoble, Directeur de thèse Patricia LADRET Maître de conférences, Université Joseph Fourier Grenoble, Encadrant de thèse UNIVERSITY OF GRENOBLE Doctoral school EEATS (Électronique, Électrotechnique, Automatique et Traitement du Signal) THESIS for obtaining the title of Doctor of Science of the University of Grenoble Mention: SIPT (Signal, Image, Parole, Télécommunications) Presented by Ms Raluca VLAD A Method for the Assessment of the Quality of Stereoscopic 3D Images Thesis supervised by Mrs Anne GUÉRIN-DUGUÉ and Mrs Patricia LADRET prepared at Grenoble - Images, Parole, Signal, Automatique Laboratory (GIPSA-lab) presented on December 2, 2013 Jury: Reviewers: Patrick LE CALLET - University of Nantes Frederic DUFAUX - CNRS, Telecom Paris Tech Examiners: Pascal MAMASSIAN - CNRS, Paris Descartes University Ingrid HEYNDERICKX - Technical University of Delft Alain BELLON - STMicroelectronics Grenoble Supervisor: Anne GUÉRIN-DUGUÉ - University Joseph Fourier of Grenoble Co-supervisor: Patricia LADRET - University Joseph Fourier of Grenoble Acknowledgments The three years of my PhD studies have finished (it seems now, so fast) and the most important trace they leave with me is one of extreme human richness, coming from the wonderful persons I have been surrounded by. I am so lucky! I am happy to address now my sincere thanks to Patricia and Anne, an excellent team of PhD supervisors, given their technicality, their precision, their high standards, but most of all, their admirable human qualities and their right words at the right time that have given me the confidence to overcome any challenge. I respectfully thank my PhD committee members (Patrick Le Callet, Frédéric Dufaux, Ingrid Heynderickx, Pascal Mamassian, and Alain Bellon), for their kind appreciations of my work. I particularly thank Alain Bellon of STMicroelectronics for his cordial support, for his very pertinent and detailed observations on my work and for the clear insight he allowed me to gain on the industrial side of my field of work. I must thank Gelu Ionescu and Laurent Ott for their prompt technical help, but also for the cordial discussions that I have often had with each of them. I thank Lucia Bouffard-Tocat and Isabelle Cieren for their precious help in administrative matters. They have made everything so much simpler for me. I would like to thank Jérôme Mars, him being my first contact with GIPSA-lab and the one who believed in me when, back in Romania, I told him once how I would love to work in research related to image processing in France. I owe many, many thanks to Simone and Fakhri. The numerous discussions with them on the subject of my PhD in our office have been so rich and have brought me so many good ideas. I sincerely thank Olha and Matthieu for their contributions to the results presented in this manuscript. They have been both honestly involved in the experimental studies that we carried out together. Olha was very patient and calm when I was not anymore and Matthieu did an excellent job providing proper results in a very efficient way during my third year of PhD, allowing me thus to finish this manuscript correctly on time. A I must thank Damien for his proper and very elegantly organized LTEX template that he A allowed me to use, for all the LTEX discussions (and jokes) he so often has to share, but also for the sincere and thorough help he has offered whenever I needed. I have huge thanks to offer to my colleagues from the DIS department of GIPSA-lab: Arnaud, Aude, Céline, Christophe, Cindy, Emmanuelle, Francesca, Florian, Hao, Hélène, Quentin, Ladan, Jérémie, Jonas, Manu, Rémy, Robin, Rodrigo, Saman, Son, Vincent, Weiyuan (alphabetical order, impossible to do otherwise) and not only. They were all so supportive, so helpful, so kind, so sincere, that I consider them more than colleagues, I consider them my friends. I am so glad to have had the chance to work in such a pleasant environment. I reserve particular thanks to Guanghan and Zhongyang, who have been my special com- i ii panions at GIPSA-lab since the beginning of my PhD and such devoted friends. I have shared with them so many great experiences. I do not forget my friends from Romania either: Andra, Bobi, Cristina, Ioana, Monica. Even if we meet rarely and we sometimes do not get to speak even for months, whenever we do, it feels like we were never apart. I had their warm support when I decided to take the big step of coming to France and great encouragements in all the other steps that followed ever since. I can always count on them and I spend such pleasant moments in their company. Cécile... Her friendship means so much to me. She is the first friend I made in France and definitely the most precious. I have learned so much from her, but most importantly I have learned that no effort is too big when you are doing it for a friend. Cécile, thank you! Vincent... The proud smile on his face when I finished my PhD defense presentation, that was the beautiful final note of all the last months of emotion and hard work, during which he supported me like I did not know it was possible. Long discussions on so many subjects, insight from his experience, confidence, encouragement, sometimes tough (but justified and so helpful) A remarks, typical (and cute) jokes, LTEXor French orthography counseling at any hour, night or day, and so many other huge or very small things are some of the strongest reasons why I declare myself so lucky. Thank you, Vincent! And, last, but most important, I would like to warmly thank my family: parents, grand- parents, cousins, uncles and aunts. I am so thankful to have such a beautiful and loving family. They have supported me enormously in every step I took and what I am is because of them. Thank you all ! Contents Acknowledgments i Introduction 3 I State-of-the-Art 7 1 The Evolution of Stereoscopy 9 1.1 Short history of stereoscopy .............................. 9 1.2 Stereoscopy today ................................... 13 2 The Human Stereoscopic Perception 15 2.1 The main HVS characteristics related to the binocular vision . 15 2.2 Mechanisms of human depth perception ....................... 25 3 The Stereoscopic Systems 31 3.1 Dual-camera geometry ................................. 31 3.2 Dual-camera capture .................................. 33 3.3 3D content compression ................................ 33 3.4 3D data formats .................................... 35 3.5 3D displays ....................................... 36 3.6 3D data rendering ................................... 43 4 The Assessment of the Stereoscopic Quality 49 4.1 Image quality ...................................... 50 4.2 Stereoscopic image quality ............................... 50 4.3 Assessing the stereoscopic image quality ....................... 51 4.4 The depth perceived .................................. 52 4.5 Impairments in the stereoscopic content ....................... 53 4.6 Visual fatigue and visual discomfort ......................... 63 4.7 Stereoscopic image quality assessment methods ................... 66 4.8 Stereoscopic image quality models .......................... 83 4.9 The Image Quality Circle of Engeldrum ....................... 85 iii iv Contents II Our Objectives and Our Approach 89 5 Our Objectives and Our Approach 91 5.1 Our objectives ..................................... 91 5.2 Our approach ...................................... 92 6 Our Stereoscopic System 99 6.1 Capture ......................................... 99 6.2 Image processing ....................................101 6.3 Displays .........................................102