Ucalgary 2016 Lu Kokyee.Pdf
Total Page:16
File Type:pdf, Size:1020Kb
University of Calgary PRISM: University of Calgary's Digital Repository Graduate Studies The Vault: Electronic Theses and Dissertations 2016 Design and Implementation of a Wearable Device for Prosopagnosia Rehabilitation Lu, Kok Yee Lu, K. Y. (2016). Design and Implementation of a Wearable Device for Prosopagnosia Rehabilitation (Unpublished master's thesis). University of Calgary, Calgary, AB. doi:10.11575/PRISM/25570 http://hdl.handle.net/11023/3219 master thesis University of Calgary graduate students retain copyright ownership and moral rights for their thesis. You may use this material in any way that is permitted by the Copyright Act or through licensing that has been assigned to the document. For uses that are not allowable under copyright legislation or licensing, you are required to seek permission. Downloaded from PRISM: https://prism.ucalgary.ca UNIVERSITY OF CALGARY Design and Implementation of a Wearable Device for Prosopagnosia Rehabilitation by Kok Yee Lu A THESIS SUBMITTED TO THE FACULTY OF GRADUATE STUDIES IN PARTIAL FULFILMENT OF THE REQUIREMENTS FOR THE DEGREE OF MASTER OF SCIENCE GRADUATE PROGRAM IN ELECTRICAL ENGINEERING CALGARY, ALBERTA AUGUST, 2016 © Kok Yee Lu 2016 P a g e | ii Abstract This study introduces a wearable facial recognition system for face blindness, or prosopagnosia, rehabilitation. Prosopagnosia is the inability to recognize familiar faces, which affects 2.5% of the world population (148 million people). The design and implementation of a facial recognition system tailored to patients with prosopagnosia is a priority in the field of clinical neuroscience. The goal of this study is to demonstrate the feasibility of implementing a wearable stand-alone (not connected to a PC or a smartphone) system-on-chip (SoC) that performs facial recognition and could be used to assist individuals affected by prosopagnosia. This system is designed as an autonomous embedded platform built on eyewear with SoC and a custom designed circuit board. The implementation is based on the open source computer vision image processing algorithms embedded within a compact-scale processor. The advantages of the device are its lightness, compactness, single independent image processing capability and long operational time. The system performs real-time facial recognition and informs the user of the results by displaying the name of the recognized person. P a g e | iii P a g e | iv Acknowledgement First, I would like to express my sincere gratitude to my advisor, Professor Dr. Svetlana Yanushkevich for her continuous support for my MSc study and related research, as well as for her patience, motivation, and immense knowledge. Her guidance has helped me throughout the research and writing of this thesis. I could not have imagined having a better advisor and mentor for my MSc study. Additionally, I would like to thank the rest of my thesis committee: Dr. Ed Nowicki and Dr. Steve Liang, and most importantly, Professor Giuseppe Iaria for suggesting this research topic in the very practical area of application. We acknowledge the Canadian Microelectronics Corporation (CMC) for providing the universities in Canada with a license for PCB design. P a g e | v P a g e | vi Table of Content Abstract ......................................................................................................................................................... ii Acknowledgement ....................................................................................................................................... iv Table of Content .......................................................................................................................................... vi List of Figures .............................................................................................................................................. xii List of Tables ............................................................................................................................................... xvi List of Symbols, Abbreviations and Nomenclature ................................................................................... xviii Chapter 1. Introduction ................................................................................................................................ 1 1.1 Motivation for the research ................................................................................................................ 1 1.2 Study objectives and hypothesis ......................................................................................................... 2 1.3 Design approach ................................................................................................................................. 3 1.4 Research contributions ....................................................................................................................... 4 1.5 Outline of the thesis ............................................................................................................................ 6 Chapter 2. Literature Review ........................................................................................................................ 7 2.1 Introduction ........................................................................................................................................ 7 2.2 Prosopagnosia and facial recognition ................................................................................................. 7 2.3 Computerized face detection ............................................................................................................. 8 2.3.1 Facial detection using Haar Feature-Based Cascade Classifier .................................................... 8 2.3.2 Face detection using Local Binary Pattern ................................................................................. 10 2.4 Computerized facial recognition ....................................................................................................... 11 2.5 Approaches to wearable facial recognition ...................................................................................... 16 2.6 Conclusion ......................................................................................................................................... 18 Chapter 3. Wearable Device Architecture .................................................................................................. 19 3.1 Introduction ...................................................................................................................................... 19 3.2 The proposed wearable device architecture .................................................................................... 19 P a g e | vii 3.3 Embedded Software for face detection and recognition ................................................................. 21 3.3.1 Embedded facial recognition software ...................................................................................... 22 3.3.2 Hardware design ........................................................................................................................ 23 3.3.3 Initial wearable display prototype design .................................................................................. 24 3.3.4 Proof-of-concept for portability ................................................................................................. 26 3.4 Custom printed circuit board (PCB) design ....................................................................................... 29 3.5 Schematics design ............................................................................................................................. 32 3.5.1 DDR2 connector ......................................................................................................................... 32 3.5.2 Camera module interface .......................................................................................................... 34 3.5.3 HDMI connection ....................................................................................................................... 35 3.5.4 I/O voltage selection connector ................................................................................................. 37 3.5.5 USB interface.............................................................................................................................. 38 3.5.6 Video display .............................................................................................................................. 41 3.5.7 Power section and power management .................................................................................... 41 3.6 Conclusion ......................................................................................................................................... 44 Chapter 4. Power Section Design and Simulation ...................................................................................... 45 4.1 Introduction ...................................................................................................................................... 45 4.2 Redesigning the power section ......................................................................................................... 45 4.3 Efficiency of PAM2306 DC/DC converter on CMIO ........................................................................... 46 4.3.1 Power efficiency for 3.3V output ..............................................................................................