SIGN LANGUAGE TEACHING GLOVE By Daniel Fong Mayapati Tiwari Reebbhaa Mehta Final Report for ECE 445, Senior Design, Spring 2013 TA: Igor Federov 01/May 2013 Project No. 29 Abstract Our group designed and built a glove that can help a person learn gestures to alphabets in sign language. The device consists of a sensing unit, which detects the gestures and a classification algorithm to check the each gesture. The device also provides feedback to the user after each gesture. The device is connected to the computer via Bluetooth to avoid any wires thereby making the device user friendly. Our device can help a person learn sign language quicker. 1 Table of Contents 1.0 Introduction ...........................................................................................................1 1.1. Statement of Purpose ......................................................................................................................................1 1.2. Objectives .............................................................................................................................................................1 1.2.1. Goals.....................................................................................................................................................................1 1.2.2. Functions............................................................................................................................................................1 1.2.3. Benefits................................................................................................................................................................1 1.2.4. Features ..............................................................................................................................................................1 2.0 Design ....................................................................................................................2 2.1. Design Procedure..............................................................................................................................................2 2.1.1. Hardware...........................................................................................................................................................2 2.1.2. Software..............................................................................................................................................................3 2.2. Design Detail .......................................................................................................................................................4 2.2.1. Hardware...........................................................................................................................................................4 2.2.2. Software..............................................................................................................................................................7 3.0 Verification ..........................................................................................................10 3.1. Power Supply ................................................................................................................................................... 10 3.2. Microcontroller ............................................................................................................................................... 10 3.3. Bluetooth............................................................................................................................................................ 10 3.4. Flex Sensors...................................................................................................................................................... 10 3.5. Accelerometers & Gyroscopes (MPU6050) ........................................................................................ 10 3.6. Feedback Unit (LED’s).................................................................................................................................. 11 3.7. Kalman Filtering ............................................................................................................................................. 11 3.8. Perceptron......................................................................................................................................................... 11 4.0. Cost Analysis .......................................................................................................11 4.1. Labor.................................................................................................................................................................... 12 4.2. Parts ..................................................................................................................................................................... 12 5.0. Conclusion...........................................................................................................12 5.1. Accomplishments........................................................................................................................................... 12 5.2. Uncertainties.................................................................................................................................................... 12 5.3. Future Work ..................................................................................................................................................... 12 5.3.1. Replacing Parts ............................................................................................................................................13 5.3.2. Haptic Feedback...........................................................................................................................................13 5.3.3. Computer Software.....................................................................................................................................12 5.4. Ethical Considerations ................................................................................................................................. 13 6.0. Appendix.............................................................................................................14 6.1. Appendix A – Design ..................................................................................................................................... 14 6.2. Appendix B – Requirements & Verification ........................................................................................ 24 6.3. Appendix C – Cost Analysis........................................................................................................................ 29 7.0. Citations..............................................................................................................30 1 1.0 Introduction 1.1. Statement of Purpose Presently there are no gloves available in the market that can teach sign language, but research has been done to make sign language gloves that can interpret gestures and convert them to speech. The aim oF this project was to make a glove device that can be useFul to teach sign language. The goal oF was to create a glove device that detects sign language gestures for letters used in American Sign Language, and inputs them into a computer, where a computer program checks the gesture. ThereaFter a Feedback unit, consisting oF LED’s, inForms the users if the gesture was correct. It can be a good learning tool For sign language and the idea can be built on in the future. Our main focus while undertaking this project was to make the device easy to handle, and user Friendly. 1.2. Objectives 1.2.1. Goals • Build a glove device to detect sign language. • Develop a database oF the gestures oF sign language alphabets For the computer program to use as reFerence while checking input gestures. • Develop a computer program that checks the input gestures. • Develop a Feedback unit to make the user aware oF any mistake • Bluetooth communication between computer and glove device. • Maximum utilization oF space available on the glove so that all the hardware components can Fit on it. 1.2.2. Functions • Flex Sensors, accelerometers and gyroscopes to detect sign language gestures. • Bluetooth communication between device and computer. • Perceptron program checks each gesture. • LED’s to help the user correct any errors. • Glove device powered by batteries to avoid any risk oF shocking users. 1.2.3. Benefits • Vibration Feedback and LED alerts help to correct any errors with gestures. • Convenient to use as the device is wirelessly connected to the computer. • Help users to become more adept with sign language. 1.2.4. Features • Tri-axis accelerometer and Tri-axis gyroscope in one glove. • Bluetooth transmission between computer and glove. • LED response For error correction. • One-directional Flex sensors on each Finger For reFerence. • Mathematical Kalman Filtering • Perceptron Algorithm 1 2.0 Design 2.1. Design Procedure The top-level block diagram can be seen in Appendix A, Fig.1. As can be seen From the diagram the top level diagram, is further divided into three main separate components – the main board, sensing unit and Feedback unit. The main board consists oF the battery, microcontroller and Bluetooth module and the Feedback unit as can be seen in Appendix A, Fig 2. The sensing unit, Appendix A Fig.3, consists oF accelerometers, gyroscopes and flex sensors that are responsible for detecting gestures. The Feedback