This document is downloaded from DR‑NTU (https://dr.ntu.edu.sg) Nanyang Technological University, Singapore. Performance enhancement and size reduction of near‑eye display Cheng, Qijia 2020 Cheng, Q. (2020). Performance enhancement and size reduction of near‑eye display. Doctoral thesis, Nanyang Technological University, Singapore. https://hdl.handle.net/10356/144165 https://doi.org/10.32657/10356/144165 This work is licensed under a Creative Commons Attribution‑NonCommercial 4.0 International License (CC BY‑NC 4.0). Downloaded on 07 Oct 2021 13:23:00 SGT PERFORMANCE ENHANCEMENT AND SIZE REDUCTION OF NEAR-EYE DISPLAY CHENG QIJIA SCHOOL OF ELECTRICAL & ELECTRONIC ENGINEERING 2020 PERFORMANCE ENHANCEMENT AND SIZE REDUCTION OF NEAR-EYE DISPLAY CHENG QIJIA SCHOOL OF ELECTRICAL & ELECTRONIC ENGINEERING A thesis submitted to the Nanyang Technological University in partial fulfillment of the requirement for the degree of Doctor of Philosophy 2020 Statement of Originality I certify that the work embodied in this thesis is the result of original research, is free of plagiarized materials, and has not been submitted for a higher degree to any other University or Institution. 16 Aug 2019 . Date Cheng Qijia Supervisor Declaration Statement I have reviewed the content and presentation style of this thesis and declare it is free of plagiarism and of sufficient grammatical clarity to be examined. To the best of my knowledge, the research and writing are those of the candidate except as acknowledged in the Author Attribution Statement. I confirm that the investigations were conducted in accord with the ethics policies and integrity standards of Nanyang Technological University and that the research data are presented honestly and without prejudice. Aug.18, 2019 . Date Assoc. Prof. Zheng Yuanjin Authorship Attribution Statement This thesis contains material from 3 paper(s) published in the following peer-reviewed journal(s) / from papers accepted at conferences in which I am listed as an author. Chapter 3 is published as: Qijia Cheng, Weitao Song, Feng Lin, Yue Liu, Yongtian Wang, and Yuanjin Zheng. "Resolution enhancement of near-eye displays by overlapping images." Optics Communications 458 (2020): 124723. The contributions of the co-authors are as follows: • Assoc. Prof. Zheng Yuanjin provided the initial project direction and edited the manuscript. • Assoc. Prof. Lin Feng advised on the algorithm and edited manuscript. • Dr. Song Weitao provided guidance on the experiment procedure, assisted the data analysis, and revised manuscript. • I prepared the manuscript drafts. • Dr. Liu Yue and Prof. Wang Yongtian revised the manuscript and provided suggestions. • Dr. Song Weitao and I designed the experiment procedure. All the experiments were performed by me at the School of Electrical and Electronic Engineering, NTU. I analyzed the data. • All system designs and setup were conducted by me. Chapter 4 is published as: Zhenfeng Zhuang, Qijia Cheng, Phil Surman, Yuanjin Zheng, and Xiao Wei Sun. "A compact and lightweight off-axis lightguide prism in near to eye display." Optics Communications 393 (2017): 143-151. The contributions of the co-authors are as follows: • Assoc. Prof. Zheng Yuanjin and Prof. Sun Xiao Wei provided the initial project direction and edited the manuscript. • Dr. Zhuang Zhenfeng provided initial optical design. • I performed the optimization and fabrication of the optical elements. • Dr. Zhuang Zhenfeng and I wrote the manuscript and revised. • All the experiments were performed by me at the School of Electrical and Electronic Engineering, NTU. • Dr. Phil Surman revised the manuscript. Chapter 5 is published as: Weitao Song, Qijia Cheng, Phil Surman, Yue Liu, Yuanjin Zheng, Zhiping Lin, and Yongtian Wang. "Design of a light-field near-eye display using random pinholes." Optics Express 27, no. 17 (2019): 23763-23774. The contributions of the co-authors are as follows: • Assoc. Prof. Zheng Yuanjin and Assoc. Prof. Lin Zhiping provided the initial project direction and edited the manuscript. • Dr. Song Weitao and I wrote the initial manuscript draft and revised the manuscripts. • The manuscript was revised by Dr. Liu Yue and Prof. Wang Yongtian. • Dr. Song Weitao and I designed the experiment procedure. I performed experiments at the School of Electrical and Electronic Engineering, NTU. • System design, fabrication, and setup were conducted by me. • Dr. Phil Surman revised the manuscript. 16 Aug 2019 . Date Cheng Qijia Acknowledgements I would like to take this chance to thank all the people that helped me during my Ph.D. program. First of all, I would like to thank my supervisor, Professor Zheng Yuanjin, for giving me this opportunity to carry this state-of-the-art research on virtual reality and display technology. Thanks to his patience and forgiveness, I gradually picked up the required skills for my research project. I also thank my co- supervisor, Professor Lin Feng for guiding me through the project and answering my puzzles. His vast experience in computer science provides a different point-of-view. I am thankful to Dr. Song Weitao for his assistance on the implementation of the research. His knowledge of optics and algorithm is proved to be helpful from time to time. I would like to thank Professor Sun Xiao Wei for his guidance in the first year of my Ph.D. From him, I learned lots of technopreneurship. I am also grateful to Professor Cuong Dang to let me work in his group in the last few months of my study and provide me future opportunities. I would like to thank all the members at the Advanced Display Lab, NTU, including Dr. Zhang Xiangyu, Dr. Zhuang Zhenfeng, Dr. Phil Surman, Mr. Zhang Lei, Dr. Wang Shizheng, and Ms. Wang Hongjuan. Great thanks to Dr. Sun Mingyu for helping me on the procedure of submitting and preparing the thesis. I am also grateful to my family for their constant support, without which my study cannot be accomplished. Last but not least, I also thank Singapore National Research Foundation NRF- CRP11-2012-01 for sponsoring me through my Ph.D. program at Nanyang Technological University. Table of Contents Statement of Originality ................................................................................... III Supervisor Declaration Statement ................................................................... IV Authorship Attribution Statement ...................................................................... V Acknowledgements ....................................................................................... VII Table of Contents ........................................................................................... IX Summary ..................................................................................................... XII List of Figures .............................................................................................. XIV List of Tables ............................................................................................... XXII Chapter 1 Introduction .............................................................................. 1 1.1 Near-eye Display (NED) ..................................................................... 1 1.1.1 Virtual Reality .............................................................................. 1 1.1.2 Near-eye Display ......................................................................... 6 1.2 Motivation and Objectives .................................................................. 8 1.3 Major contributions of the Thesis ........................................................ 9 1.4 Organization of the Thesis ............................................................... 10 Chapter 2 Literature review ..................................................................... 13 2.1 Resolution enhancement .................................................................. 13 2.1.1 Resolution limitation of near-eye display ........................................ 13 2.1.2 Resolution enhancement methods ................................................. 16 2.1.3. Display super-sampling and super-resolution ............................... 20 2.1.4. Display calibration ......................................................................... 22 2.2 Near-eye display with free-form optical design ................................. 23 2.3 Light field near-eye display ............................................................... 24 Chapter 3 Resolution enhancement utilizing overlapping multiple display panels ............................................................................................... 28 IX 3.1 Introduction ...................................................................................... 28 3.2 Method ............................................................................................. 30 3.2.1 System set-up ................................................................................ 30 3.2.2 Image generation ........................................................................... 37 3.2.3 Image formation from two overlapping images ............................... 41 3.2.4 Generic computational rendering algorithm for two-dimensional image and multiple display panels ..................................................................... 45 3.2.5 Display calibration .......................................................................... 47 3.3 Experiment setup ................................................................................. 57 3.4 Results ............................................................................................