Polarization Stereoscopic Imaging Prototype
Total Page:16
File Type:pdf, Size:1020Kb
UNIVERSITÉ DE BOURGOGNE Ecole Doctorale Environnement - Santé / STIC (E2S) THÈSE Présentée par Mohammad IQBAL pour obtenir le grade de Docteur de l’Université Discipline Instrumentation et Informatique de l’Image Polarization Stereoscopic Imaging Prototype Soutenue le 2 Novembre 2011 Jury Fabrice MERIAUDEAU Professeur Directeur de thèse Sarifuddin MADENDA Professeur Rapporteur Abdelaziz BENSRHAIR Professeur Rapporteur Samia AINOUZ (ZEMOUCHE) Maître de conférences Examinateur Olivier MOREL Maître de conférences Encadrant de thèse ii For my Parents, my wife and my children… If all the trees on earth become pens, and the sea replenished by seven more seas were to supply them with ink, the Words of God would not be exhausted. He is indeed Most Mighty, Most Wise… (Luqman 27) iii Acknowledgements Thanks to God because only with God’s help and permission I can finish this thesis in time. This thesis work has been performed at Laboratoire Electronique, Informatique et Image (LE2I) – IUT Le creusot, Université de Bourgogne, France with financial support from National Education Department of Republic of Indonesia in Beasiswa Unggulan program and Universitas Gunadarma, Jakarta, Indonesia. With all of my modesty, I want to take this opportunity to thank everyone who has helped me in one way or another during this thesis work period. My deepest gratitude is to my supervisor Fabrice Mériaudéau and co-advisor Olivier Morel, for their effort, guidance, support and patience that allowed me to finish this thesis. I am also grateful to Prof. Dr. E.S.Margianti, SE., MM., as Head of Gunadarma University and Prof. Dr. Suryadi Harmanto,SSI, MMSI as 2nd Assistance of Head of University that give me a valuable advice support and encourage. Appreciations are also expressed to Prof. Dr. Sarifuddin Madenda, Prof. Dr. Djati Kerami, Mrs. Trini Saptariani, Mrs. Peni Sawitri, Mrs. MS. Harlina, Mrs. Rini Tesniwati and Dr. Yuli Karyanti for their remarkable support. Of my colleagues in LE2i-IUT Le Creusot, I want to express particular thanks to Abd-el-rahman Shabayek and Rindra Rantoson, for a lot of assistance to refresh my knowledge in programming and mathematics. Deep thanks to helpful friends who have delivered valuable time and effort in my study ; Youssef, Ouadi, Ahlam, Bushra, Souhail, Nicholas, Intuon, Pierre and Alban. Also friends from master VIBOT ; Adhiguna, Arun, Arsalan, Naveed, Moazzam, Ruddy JS, and friends from Master of Computer Vision ; Kassem, Ali Mirzae, Diou, and Amine Mahiddin for sharing idea and for our fun time. I am blessed with wonderful friends that I could not stated one by one here in many ways, my successes are theirs, for mas Aries, mbak Cut, mbak Ira, Fitrin, Dian, iv Debyo, Musa, Imam Ahmad and Franco-Indo family such as mbak Agnes and Jean Louis, mbak Yati and Serge, Bang Ujai and Briggitte, Julia, Zooran, Inez, and also Vicky, for their support and to teach me how to live in Dijon and Le Creusot. Also for all brothers from Association Musulmane et Cultuelle Du creusot - Sheik Larabi Basyir and from Communaute Islamique De Milli Gorus Section de le Creusot - Sheik Mohamed. To my parents, Mohammad Rais Ahmad and Sri Astuti Rais, Prof. Dr. AM Saefuddin and Ati Surtiati, my sister Ummu Najiyah (Allahu yarham), Ani Khairani, Ibrahim Fajri and all of my big family, I greatly appreciate for their taken care of my wife and children when I was absent during my research time and the sincere prayer that never stops to strengthen my spirit here. Most importantly, I want to express thanks to my wife Dina Diana who has stayed long far away from me with our lovely children. She had difficult period, but still she ensured the ideal and warm atmosphere for me here. To all my children Alwan Muhammad Zaidan, Maryam Rif’atul Afifah and Nusaibah Karima Zuhda, the hope and your smiling was a great motivation to me to finish this research, and I dedicate this thesis to you all. What I am today, it cannot be happened without their love, support, and sacrifice. Finally, thanks for all the others that have contribution to this work and cannot be mentioned one by one. I realize that there are no perfect things in this world, same as this thesis. Therefore, I am looking forward to get some encouraging critics, advices and suggestions from anyone to make it better. It is wonderful and proudly if all people can use and take advantage of this thesis. v Abstract The polarization of light was introduced last ten years ago in the field of imaging system is a physical phenomenon that can be controlled for the purposes of the vision system. As that found in the human eyes, in general the imaging sensors are not under construction which is sensitive to the polarization of light. These properties can be measured by adding optical components on a conventional camera. The purpose of this thesis is to develop an imaging system that is sensitive both to the stereoscopic and to the state of polarization. As well as the visual system on a various of insects in nature such as bees, that are have capability to move in space by extracted relevant information from the polarization. The developed prototype should be possible to reconstruct three- dimensional of points of interest with the issues associated with a set of parameters of the state of polarization. The proposed system consists of two cameras, each camera equipped with liquid crystal components to obtain two images with different directions of polarization. For each acquisition, four images are acquired: two for each camera. Raised by the key of main capability to return polarization information from two different cameras. After an initial calibration step; geometric and photometric, the mapping of points of interest process is made difficult because of the optical components placed in front of different lenses. A detailed study of different methods of mapping was used to select sensitivity to the polarization effects. Once points are mapped, the polarization parameters of each point are calculated from the four values from four images acquired. The results on real scenes show the feasibility and desirability of this imaging system for robotic applications. Keywords: Stereo Vision, Stereo Matching, Polarization Imaging, feature extraction vi Resumé La polarisation de la lumière, phénomène physique parfaitement maîtrisé, a été introduit depuis une dizaine d'années seulement dans le domaine de l'imagerie. En effet, tout comme l'oeil humain, les capteurs ne sont pas, par construction, sensible à la polarisation de la lumière. Cette propriété particulièrement intéressante ne peut être obtenue qu'en ajoutant des composants optiques aux caméras classiques. L'objectif de ce travail de thèse est de développer un système à la fois stéréoscopique et sensible à l'état de polarisation. En effet, de nombreux insectes dans la nature, comme les abeilles par exemple, ont la capacité à s'orienter dans l'espace et à extraire des informations pertinentes issues de la polarisation. Le prototype ainsi développé doit permettre de reconstruire en trois dimensions des points d'intérêt tout en associant à ces points un ensemble de paramètres relatifs à l'état de polarisation. Le système proposé ici est constitué de deux caméras équipés chacune de deux composants à cristaux liquides permettant d'obtenir deux images avec des orientations de polarisation différentes. Pour chaque acquisition, quatre images sont obtenues : deux pour chacune des caméras. Le verrou majeur soulevé ici est la possibilité de remonter à des informations de polarisation à partir de deux caméras différentes. Après une première étape de calibration géométrique et photométrique, la mise en correspondance des points d'intérêt est rendue délicate en raison des composants optiques placés devant les objectifs. Une étude approfondie des différentes méthodes de mise en correspondance a permis de sélectionner la méthode la moins sensible aux effets de polarisation. Une fois les points mis en correspondance, les paramètres de polarisation de chacun des points sont calculés à partir des quatre valeurs issues des quatre images acquises. Les résultats obtenus sur des scènes réelles montrent la faisabilité et l'intérêt d'un tel système pour des applications robotiques. Mots clés : imagerie polarimétrique, stéréovision, mise en correspondance, reconstruction 3D vii Table of Contents Acknowledgements............................................................................................................ iv Abstract.............................................................................................................................. vi Resumé.............................................................................................................................. vii Table of Contents............................................................................................................. viii List of Tables ..................................................................................................................... xi List of Figures................................................................................................................... xii CHAPTER 1 INTRODUCTION ....................................................................................1 1.1 Background..............................................................................................................2 1.1.1 Polarization Vision.............................................................................................3 1.1.2 Stereo Vision......................................................................................................4