PROJECT REPORT 2015-2016 NITTE MEENAKSHI INSTITUTE OF TECHNOLOGY (An Autonomous Institute, Affiliated to Visvesvaraya Technological University, Belgaum, Approved by AICTE & Govt. of Karnataka) ACADEMIC YEAR 2015-16 Final Year Project Report on “Providing voice enabled gadget assistance to inmates of old age home (vridddhashrama) including physically disabled people.” Submitted in partial fulfillment of the requirement for the award of the degree of BACHELOR OF ENGINEERING Submitted by ABHIRAMI BALARAMAN (1NT12EC004) AKSHATHA P(1NT12EC013) INTERNAL GUIDE : "MS. KUSHALATHA M R" (Assistant Professor) Department of Electronics and Communication Engineering NITTE MEENAKSHI INSTITUTE OF TECHNOLOGY Yelahanka, Bangalore-560064 DEPARTMENT OF ECE, NMIT PROJECT REPORT 2015-2016 NITTE MEENAKSHI INSTITUTE OF TECHNOLOGY (An Autonomous Institute, Affiliated to VTU, Belgaum, Approved by AICTE & State Govt. of Karnataka), Yelahanka, Bangalore-560064 Department Of Electronics And Communication Engineering CERTIFICATE Certified that the Project Work entitled “Providing voice enabled gadget assistance to inmates of old age home(vridddhashrama) including physically disabled people.” guided by IISc was carried out by Abhirami Balaraman (1NT12EC004), Akshatha.P(1NT12EC013) bonafide students of Nitte Meenakshi Institute of Technology in partial fulfillment for the award of Bachelor of Engineering in Electronics and Communication of the Visvesvaraya Technological University, Belgaum during the academic year 2015-2016.The project report has been approved as it satisfies the academic requirement in respect of project work for completion of autonomous scheme of Nitte Meenakshi Institute of Technology for the above said degree. Signature of the Guide Signature of the HOD (Ms.Kushalatha M R) (Dr. S. Sandya) External Viva Name of the Examiners Signature with Date ……………………………… …............................................ DEPARTMENT OF ECE, NMIT PROJECT REPORT 2015-2016 ACKNOWLEDGEMENT We express our deepest thanks to our principal Dr. H. C. Nagaraj and Dr N. R. Shetty, Director Nitte Meenakshi Institute of Technology, Bangalore for allowing us to carry out the industrial training and supporting us throughout. We also thank Indian Institute of Science for giving us the opportunity to carry out our internship project in their esteemed instituition & giving us all the support we need to carry on the idea as our final year project. We express our deepest thanks to Dr.Rathna G N for taking part in useful decision , guidance and necessary equipment for the project and progresssing it to our final year project. We choose this moment to acknowledge her contribution gratefully. We also express our deepest thanks to our HOD Dr.S.Sandya for allowing us to carry our industrial training and helped us in all the way so that we could gain a practical experience of the industry. We also take this opportunity to thank Ms. Kushalatha M R [Asst. Prof, ECE Dept.] for guiding us in the right path and being of immense help to us. Finally we thank all other unnamed who helped us in various ways to gain knowledge and have a good training. DEPARTMENT OF ECE, NMIT PROJECT REPORT 2015-2016 ABSTRACT Speech recognition is one of the most recently developing field of research at both industrial and scientific levels. Until recently, the idea of holding a conversation with a computer seemed pure science fiction. If you asked a computer to “open the pod bay doors”—well, that was only in movies. But things are changing, and quickly. A growing number of people now talk to their mobile smart phones, asking them to send e-mail and text messages, search for directions, or find information on the Web. Our Project aims at one such application. Project was designed keeping in mind ,the various categories of people who suffer from loneliness due to absence of others to care for them,especially the ones who are under cancer treatment and old aged people.The system will provide interaction and entertainment and control appliances such as television on voice commands. DEPARTMENT OF ECE, NMIT PROJECT REPORT 2015-2016 LITERATURE SURVEY Books are available to read and learn about speech recognition ,these enabled us to see what happens beyond the code. Claudio Becchetti, Klucio Prina Ricotti.“Speech Recognition: Theory and C++ Implementation “ 2008 edition, In this book we learned how to write and implement the c++ code. A most recent comprehensive textbook, "Fundamentals of Speaker Recognition" by Homayoon Beigi, is an in depth source for up to date details on the theory and practice. A good insight into the techniques used in the best modern systems can be gained by paying attention to government sponsored evaluations such as those organised by DARPA (the largest speech recognition-related project ongoing as of 2007 is the GALE project, which involves both speech recognition and translation components). "Automatic Speech Recognition: A Deep Learning Approach" (Publisher: Springer) written by D. Yu and L. Deng published near the end of 2014, with highly mathematically-oriented technical detail on how deep learning methods are derived and implemented in modern speech recognition systems based on DNNs and related deep learning methods.This gave us an insight into the conversion algorithm used by Google. Here are some IEEE and other articles we referred : Waibel, Hanazawa, Hinton, Shikano, Lang. (1989) "Phoneme recognition using time-delay neural networks. IEEE Transactions on Acoustics, Speech and Signal Processing." Reynolds, Douglas; Rose, Richard (January 1995). "Robust text-independent speaker identification using Gaussian mixture speaker models" (PDF). IEEE Transactions on Speech and Audio Processing (IEEE) 3 (1): 72–83. doi:10.1109/89.365379. ISSN 1063- 6676. OCLC 26108901. Retrieved 21 February 2014. DEPARTMENT OF ECE, NMIT PROJECT REPORT 2015-2016 SURVEY QUESTIONNNAIRE CONDUCTED IN OLD AGE HOME: 1.What is the total number of people in this old age home? Ans. There are 22 people of age above 70. 2.What are the facilities available to you? Ans. All basic needs are provided. 3. Is 24/7 medical assistance for someone who's bed- ridden? Ans. No 24/7 nursing. 4. What are the technological facilities provided at your organization for entertainment purpose? Ans. There was only television in each room. 5. Do you have access to computers,internet and mobile phones at your organization? Ans. No, we are not aware of using all of it. Also it is expensive. 6. What are the changes you would like to have in your daily rountine? Ans. The rountine is monotonous, so we like means to pass time, like playing games, learning anything based on our intrest. 7. Do you think our project is helpful to you? Ans Yes. It provides us entertainment and keeps us engaged and not feel bored. Speech activation is very helpful for us as it easy for us to use,especially tv. 8. Any suggestions? Ans. Add books,scriptures since our eyes gets weak with age. Add quiz games so that we can improve our knowledge. We need something that can train us to learning new languages or anything based on our intrest, without using internet. DEPARTMENT OF ECE, NMIT PROJECT REPORT 2015-2016 CONTENTS 1.INTRODUCTION ..................................................................................................................................... 8 2. OUR OBJECTIVE ............................................................................................................................... 11 3.SYSTEM REQUIREMENTS ............................................................................................................ 13 3.1 HARDWARE COMPONENTS ............................................................................................... 13 3.2 SOFTWARE REQUIRED .......................................................................................................... 16 4.IMPLEMENTATION ............................................................................................................................. 19 4.1 ALGORITHMS ............................................................................................................................... 19 4.2 SETTING UP RASPBERRY PI .............................................................................................. 22 4.3 DOWNLOADING OTHER SOFTWARE ............................................................................ 43 4.4 SETTING UP LIRC ...................................................................................................................... 46 4.5 WORKING OF IR LED ............................................................................................................... 50 4.6 FLOWCHART .................................................................................................................................. 51 4.7 BLOCK DIAGRAM ....................................................................................................................... 52 5.FURTHER ENHANCEMENTS ........................................................................................................ 53 6.APPLICATIONS .................................................................................................................................... ,55 7.REFERENCES …...............................................................................................................59 DEPARTMENT OF ECE, NMIT PROJECT REPORT 2015-2016 LIST OF FIGURES 1.Block diagram of WATSON recognition system ..................................................................... 2 2.Raspberry Pi