ISSN 2321 3361 © 2020 IJESC Research Article Volume 10 Issue No.3 Intelligent Virtual Assistant for Visually Impaired People using Raspberry Pi S. Sivakumar1, T. M. Pavithra2, K. Pooja Shree3, S. Reshma4 Assistant Professor1, Student2, 3, 4 Department of ECE Jeppiaar SRR Engineering College, Chennai, India Abstract: An OCR (Optical Character Recognition) system which may be a branch of computer vision and successively a sub-class of AI. Optical character recognition is that the translation of optically scanned bitmaps of printed or hand transcription into audio output by using of Raspberry Pi. OCR's are developed for many world languages are already under efficient use. This method extracts moving object region by a mixture-of-Gaussian based-background subtraction method. A text localization and recognition are conducted to accumulate text information. To automatically localize the text regions from the image, a text localization and Tesseract algorithm by learning gradient features of stroke orientations and distributions of edge pixels in an Ada boost model. Text characters in the localized text regions are then converted into binary codes and recognized by optical character recognition software. The recognized text codes are given as output to blind users. Performance of the proposed text localization algorithm. As the recognition process is completed, the character codes within the document are processed using Raspberry pi device on which recognize character using Tesseract algorithm and python programming, the audio output is listened. This model is mounted on a shopping trolley to help visually challenged people to shop individually. Keywords: Capturing Image, Distance measuring, OCR Software, Tesseract Algorithm, Final Audio output. I. INTRODUCTION document that was printed on paper are time-consuming and labour-intensive. It is widely wont to convert books and Visually challenged people face many problems with documents into electronic files to be used in storage and accessing printed text, which includes problems with document analysis. OCR makes it is possible to use techniques alignment, focus, accuracy, mobility, and efficiency. We like MT, text-to-speech and text mining to the capture/ present a smart device that assists the visually impaired which scanned page. The final recognized text document is fed to the effectively and efficiently reads the paper-printed text. The output devices, depending on the choice of the user. The proposed project uses the methodology of a camera based output device are often a headset connected to the raspberry pi assistive device which will be employed by people to read or a speaker which may spell out the text document loud. Text document. The main idea of this project is for implementing image capturing technique in an embedded II. LITERATURE SURVEY system based on Raspberry Pi board. In this project, we proposed a text read out a system for the visually challenged. 1. Mrs. Shilpa Reddy K, Mounika S. k, Pooja K, Sahana N. The proposed system uses a camera image as input and the Text to Speech for the Visually Impaired”, IRJCS Journal, image is processed using OCR software module and the output 2017. is given in audio format. A methodology is implemented to recognition sequence of characters, and the line of reading. As Abstract a part of the software development, the Open CV (Open source Computer Vision) libraries are utilized to do image Perusing is prime in day by day life for everyone. Outwardly capture of text, to do the character recognition. Most of the debilitated people can read just by utilizing unique access technology tools built for people with blindness and applications by them like Braille dialect. The disadvantage of limited vision is built on the two basic building blocks of OCR this framework is that every item doesn't give the content in software and Text-to-Speech (TTS) engines. optical character Braille. In this paper, they have proposed an assistive content recognition (OCR) is the translation of captured images of perusing system to help outwardly impaired people to peruse printed text into binary codes. OCR may be a process which writings from different questions in their day by day lives. At associates a symbolic meaning with objects(letters, symbols a first, we catch the image of the specified, pre-handling is number) with the image of a character. It is defined because performed thereon. Pre-handling incorporates steps like dark the process of converting scanned images of machine printed scale and binarization, question of intrigue acknowledgment. into a computer process able format. An optical Character In the proposed framework, we are making the utilization of recognition is additionally useful for visually impaired people OTSU calculation to change over the dim scale picture into that cannot read Text document, but got to access the content binarized one. The content districts from the caught picture of the Text documents. An optical Character recognition is are then separated and perceived by utilizing optical used to digitize and reproduce texts that have been produced character acknowledgment programming (OCR).The principle with the non-computerized system. Digitizing texts also helps calculation in OCR to be specific MODI is utilized here. This reduce storage space. Editing and Reprinting of a Text extricated content of different textual styles and sizes then can IJESC, March 2020 24843 http:// ijesc.org/ be perceived independently and afterward consolidated in a words. By the utilization of varied Mat lab commands i.e. word giving its yield as sound utilizing Text-to-discourse wavered, subplot etc. the waves are sampled and extracted to utilizing the SAPI libraries. get the desired result. This method is straightforward to implement and involves much lesser use of memory spaces. 2. MallapaD.Gurav, Shruti S. Salimath, Shruti B. Hatti, Vijayalaxmi I. Byakod, ShivaleelaKanade “A Reading aid Disadvantages: for the Blind People using OCR and OpenCV”, IJSRET Journal 2017. Braille system is very slow and not very practical. Existing OCR systems are not automatic. Abstract Require full-fledged computers to run effective. Optical character recognition (OCR) is used to detect printed or typed characters using photoelectric devices and computer Cell phone does not allows the user to read mail, receipts, files software. It converts images of typed or printed text into machine encoded text from scanned document. In this research IV. PROPOSED SYSTEM these printed text are converted into audio output. OCR is employed in machine process like cognitive computing, text to In this system we've described a prototype system to read speech, key data and text mining. It is mainly utilized in the printed or typed texts on hand-held objects for guiding blind sector of research in Character recognition, AI and computer persons. In order to unravel the common aiming problem for vision. The recognition process is completed using OCR the blind users, we've proposed a motion-based method to detect character code in text files are processed using Raspberry Pi the thing of interest. The automatic ROI detection and text device on which it recognizes character using tesseract localization algorithms were independently evaluated to make algorithm and python programming and audio output is sure effectiveness and robustness of the entire system. We listened. For pattern recognition and to perform Document subsequently evaluated this prototype system of assistive text Image Analysis (DIA) we use information in grid format in reading using images of hand-held objects captured by ten virtual digital library’s design and construction. This research blind users face to face. Two calibrations were applied to mainly deals on the OCR based automatic book reader for the organize for the system test. First, we instructed blind users to visually impaired using raspberry pi. Raspberry pi features a put hand-held object within the camera view. Since it's Broadcom System On a Chip (SOC) which incorporates ARM difficult for blind users to aim their held objects, we employed compatible CPU and an on chip graphics processing unit a camera with a fairly wide angle. Secondly, in an applicable GPU. It promotes Python programming as main programming blind-assistive system, a text localization algorithm might language. prefer higher recall by sacrificing some precision. By using ultrasonic sensor, we can measure the distance between the 3. Miss. Kirti P. Bhure, Mrs. J. D. Dhande” Object blind people and obstacle then the distance will be played Detection Methodologies for Blind People” IJRIT Journal through earphones. OCR is used for converting images of 2017. typed, handwritten or printed text into machine-encoded text, whether form a scanned document, a photo of a document. It Abstract is widely used to produce the information entry from printed paper. It is a method of analyzing printed texts so that they can Vision is the most important sense. Image plays vital role be easily edited, searched, stored, displayed online and utilized within the human perception of the encompassing in machine process like cognitive computing, machine environment. Industry has created a spread of computer vision translation and text-to-text.This module can also be mounted products and services by developing new electronic on a shopping trolley which can help the visually challenged technologies for the blind so as to beat the difficulties. Digital people shop individually on super markets. Four buttons is image processing is that the field which processes the digital added along with this model. These four buttons are assigned image by using computer. An increasing interest in developing with four basic food products and a DC motor and a driver is technologies attempts to assist visually impaired people in fixed at the wheel of the shopping trolley. The buttons, DC their daily lives. It is shown that the thing identification is that motor and driver is connected to Raspberry Pi's General the difficult task for visually impaired people.