Generation of 3-D Synthetic Autostereoscopic Integral Images Using Computer Simulated Cameras
Total Page:16
File Type:pdf, Size:1020Kb
GENERATION OF 3-D SYNTHETIC AUTOSTEREOSCOPIC INTEGRAL IMAGES USING COMPUTER SIMULATED CAMERAS A thesis submitted in partial fulfilment of the requirements for the degree of Doctor of Philosophy By Shafik Salih Electronic and Computer Engineering School of Engineering and Design Brunel University March 2014 Abstract ________________________________________________________ Production of artificial Three-Dimension (3-D) images was the aim of many researches over hundreds of years. 3-D images are the images that create sense of depth when viewing them. 3-D images are closer to the real world scenes than 2-D images due to the 3-D effect or the sense of depth the 3-D images provide. Sense of depth can be caused by binocular cues including convergence and parallax. Convergence is created by the difference between the angles of the left eye and the right eye viewing axes. Parallax is the effect of viewing with one eye a view of the scene that is inherently shifted to the view seen by the other eye. Several techniques have targeted the creation of 3-D images with the mentioned cues. The technique is preferred when it is able to create 3-D images so that the viewer can view these images without wearing special glasses and the occurrence of viewer fatigue. Integral photography that was invented in 1908 is able to meet the previous requirements. Based on integral photography, several techniques, research and studies have been published. The purposes of this thesis include the computer simulation of flexible integral photography systems, the computer generation of good quality 3-D static and animated integral images using the simulated systems, optimising the generation process to be more accurate, less expensive, more effective, and faster, and producing a portable specialist software tool to achieve these targets. New techniques and algorithms are needed to meet these purposes. A literature survey was carried out about the closest researches and studies to the subject of computer-generated integral images; these were compared with the new techniques introduced in this study to prove the advantages and the necessity of these new techniques. The closest technique to the suggested techniques was implemented using more developed tools to compare the quality of the resulting integral images with the targeted integral images that are going to be produced using the tools and algorithms proposed in this thesis. A method to simulate an imaging system and produce integral images based on the new technique of dividing the view volume of the scene was introduced, explained, proved, and implemented with a program designed for this purpose. To optimise the processing time and the image quality, the previous method is developed, new features are added to the resulting integral images, and better performance was achieved by introducing the method of i Displacing the Virtual Camera Target (DCT). Application software with Graphical User Interface is designed and implemented to allow users to select the required parameters of the imaging system and the required features of the resultant integral images. The software tool that is based on the developed techniques and employing OpenGL is useful to simulate the imaging systems, tune their parameters before the actual implementation of these systems, and as a result, save time and materials when designing these systems. The introduced techniques and the software tools are faster, more effective, and cheaper original methods to help in optimising both the integral imaging systems and the quality of integral images. These software tools based on the new techniques can be used on a wide range of devices and platforms because these are employing the portable Application Interface OpenGL. With these methods, integral imaging systems are simulated, and optimised; good quality static and animated integral images were created. ii Acknowledgments _______________________________________________ I would like to express my thanks to Professor Amar Aggoun for the great support he has given me during this research. Thanks to Dr Emmanuel Tsekleves for his constant help and support. Thanks to Dr Maysam Abbod for his wholehearted help and support. Special thanks to Professor Luiz C. Wrobel for his help and financial support. I thank the School of Engineering and Design at Brunel University for providing the funding for this research. Many thanks to the employees in CEME Company, East London, and my colleagues in the High Speed Sustainable Manufacturing Institute who helped me and participated in the assessment test and the integral images evaluation process I conducted in CEME Company. My thanks to my wife Nesrin Eshtay for the encouragement she has given me. iii Contents Abstract . i - ii Acknowledgments . iii Contents. iv - vii List of Figures . .viii - xi List of Tables. xii List of Acronyms . ivi List of Definitions . .ivi Chapter 1 1-10 Introduction 1.1. 3-D Imaging . .. 1 1.2. 3-D Imaging systems . 1 1.3. Aim and objectives. 3 1.4. Contributions to knowledge. 5 1.4.1. Dividing Image Volume using OpenGL (DIVGL) algorithm. .. 6 1.4.2. Displacing the Camera Target (DCTarget) algorithm. .6 1.4.3. Application software. 7 1.4.4. A method to evaluate the integral images. .7 1.5. The thesis structure. 8 1.5.1 Chapter 1 . 8 1.5.2 Chapter 2. 8 1.5.3 Chapter 3. 8 1.5.4 Chapter 4. 9 1.5.5 Chapter 5. 10 1.5.6 Chapter 6. .10 1.5.7 Chapter 7. .10 Chapter 2 11-38 A Literature Survey on the Computer Generation of Integral Images 2.1. Introduction . 11 2.2. Autostereoscopic 3-D images . 11 2.2.1 Multiview imaging technique. .12 iv 2.2.2 Integral imaging technique . .13 2.3. Computer generation of autostereoscopic 3-D images. 14 2.3.1. Computer Generation of Multiview images . 14 2.3.2. Computer Generation of Integral imaging . .15 2.3.2.1. Image processing for 3-D display . 15 2.3.2.2. The simulation environment for generating integral images. .18 2.3.2.3. Invert the pseudoscopic image to produce an orthoscopic image. 20 2.3.2.4. Integral photography systems using a High Definition Television camera. .22 2.3.2.5. Displaying 3-D integral images. .23 2.3.2.6. The field of view of integral imaging systems . 26 2.3.2.7. Animated Computer-Generated integral images . .30 2.3.2.8. The software used to render integral images. .32 2.3.2.9. Lens arrays for 3-D imaging systems. 34 2.3.2.10. Computer reconstruction of 3-D images. 35 2.3.2.11. Depth of field improvement in the 3-D integral imaging systems. 36 2.4 Summary. 38 Chapter 3 39-86 Computer Generation and Rendering of Integral Images Using OpenGL (DIVGL) 3.1. Introduction. .39 3.2. Computer generation of integral images with OpenGL using Forward Projection rendering model. 40 3.2.1. The Forward Projection Finite-Sized Aperture Rendering Model . 43 3.2.2. The Forward Projection Pinhole Rendering Model . 49 3.3. Computer generation and rendering of Integral Images with the method of dividing image volume using OpenGL (DIVGL) . 52 3.3.1. The method of dividing image volume . 53 3.3.2. The capture stage . .60 3.3.2.1. The clipping windows. 63 3.3.2.2. The analogy between the lens effect and the viewport mapping in OpenGL. 65 3.3.2.3. The resulting integral images. .69 3.3.3. The replay stage. .73 v 3.3.4. Perspective projection using spherical lens array. 74 3.3.5. The implementation of the integral images computer generation method DIVGL. 79 3.3.6. Generating animated scenes with DIVGL algorithm . 84 3.4. Summary. .86 Chapter 4 88-155 Computer Generation and Rendering of Integral Images by Displacing the Virtual Camera Target (DCTarget) 4.1. Introduction. .88 4.2. The pickup stage . 90 4.3. The new target point calculation in relation to the rotation angles of the camera. 100 4.4. The image plane rotation angles calculation. .104 4.5. The reconstruction stage . 115 4.6. Displaying the image behind and in front of the display screen. 120 4.7. Animated integral images. 124 4.8. Implementation and Results. 133 4.9. Improvements. 138 4.9.1. Using two different resolutions . ..