DOCSLIB.ORG

Jamithireddysocculcom.Pdf (1023.Kb)

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Jamithireddysocculcom.Pdf (1023.Kb) SOCIO-CULTURAL COMMUNICATION SYSTEM – A COMMUNICATION MECHANISM FOR MULTI-MEDIA INFORMATION ACCESS SYSTEM FOR NON- LITERATE AND LINGUISTICALLY DIVERSE USERS A THESIS IN Computer Science Presented to the Faculty of the University of Missouri-Kansas City in partial fulfillment of the requirements for the degree MASTER OF SCIENCE by VENKATA RAMA KRISHNA JAMITHIREDDY Bachelor of Technology, Andhra University, 2005 Kansas City, Missouri 2010 © 2010 VENKATA RAMA KRISHNA JAMITHIREDDY ALL RIGHTS RESERVED SOCIO-CULTURAL COMMUNICATION SYSTEM – A COMMUNICATION MECHANISM FOR MULTI-MEDIA INFORMATION ACCESS SYSTEM FOR NON-LITERATE AND LINGUISTICALLY DIVERSE USERS Venkata Rama Krishna Jamithireddy, Candidate for the Master of Science Degree University of Missouri-Kansas City, 2010 ABSTRACT Current Internet services are not optimal for the access of information for non-literate or linguistically diverse users. Almost all Internet content is available only in written form and still in a limited number of languages. However, there is a growing need to provide network services to non-literate or linguistically diverse users. The Socio-cultural communication system (SoCCS) is a communication mechanism for building an information access system that helps both literate and non-literate users to access information in various media formats. SoCCS is designed using client server architecture, isolating much of the logic from the client. This helps the client run on a basic system of a very low end configuration with an application based on a web-browser. The client will send the text/image/audio/video request to the request interpreter (RI) and it will then process the request and respond with text, image, audio, or video link information. Audio/video is streamed using a streaming server. This helps in reducing the play delay on the client side with a low bandwidth. RI will handle the request in text/image/audio using text-to-text, text-to-speech and speech-to-text translators. RI will also handle the client’s preference on the response i.e., the client can choose to get the response in a text/image/audio/video format. The SoCCS application protocol of the current design project is based on a request– response mechanism without any limitations on the natural language, client software and hardware requirements, and the type of request. SoCCS will accept a text or audio request and iii respond to the user with a text or an audio message. The unique SoCCS features are providing the conversion from one language to another language, from one format to another format and consider user preferences for displaying search results. In this thesis, a prototype implementation of SoCCS is also discussed. iv The undersigned, appointed by the Dean of School of Graduate Studies, have examined the thesis titled “Socio-Cultural Communication System – A Communication Mechanism for Multi-Media Information Access System for Non-literate and Linguistically Diverse Users,” presented by Venkata Rama Krishna Jamithireddy, a candidate for the Master of Science degree, and hereby certify that in their opinion it is worthy of acceptance. Supervisory Committee Deepankar Medhi, Ph.D., Committee Chairperson Department of Computer Science and Electrical Engineering Kenneth Mitchell, Ph.D. Department of Computer Science and Electrical Engineering Yugyung Lee, Ph.D. Department of Computer Sciences and Electrical Engineering v CONTENTS ABSTRACT ................................................................................................................................... iii LIST OF ILLUSTRATIONS .......................................................................................................... x ACKNOWLEDGEMENTS ........................................................................................................... ix Chapter 1 BACKGROUND AND SIGNIFICANCE ................................................................................. 1 1.1. Socio-Cultural Communication System ........................................................................... 1 2 OVERVIEW .............................................................................................................................. 4 2.1. Requirements for SoCCS Design ......................................................................................... 4 2.1.1. Inclusive......................................................................................................................... 4 2.1.2. Dialectic ......................................................................................................................... 5 2.1.3. Adaptive......................................................................................................................... 5 2.1.4. Evolving......................................................................................................................... 5 2.1.5. People Sensitive ............................................................................................................. 5 2.3. SoCCS and e-Governance .................................................................................................... 5 2.4. SoCCS and e-Systems .......................................................................................................... 6 2.4.1. Population Factor ........................................................................................................... 7 2.4.2. Mode of Access to Information ..................................................................................... 7 2.4.3. Priorities and Types of Information............................................................................... 7 2.4.4. Content Type ................................................................................................................. 7 3 ARCHITECTURAL AND DESIGN APPROACH................................................................... 8 vi 3.1. Architecture .......................................................................................................................... 8 3.1.1. User Agent (UA) ........................................................................................................... 9 3.1.2. Request Interpreter ...................................................................................................... 10 3.1.3. Translator ..................................................................................................................... 12 3.2. Possible Cases for Data Flow between Different Modules ................................................ 13 3.2.1. Case1: Translator Responding for the User Request ................................................... 13 3.2.2. Case2: Request Interpreter Handles the Translation Data ........................................... 15 3.2.3. Case3: Request Interpreter Forwards the Data Handle to Translator .......................... 17 3.3. Design Algorithm ............................................................................................................... 19 3.4. Communication between Modules ..................................................................................... 22 3.4.1. User Agent – Request Interpreter Communication ..................................................... 22 3.4.2. User Agent – Media Base Communication ................................................................. 24 3.4.3. Request Interpreter – Translator Communication ....................................................... 24 4 SEQUENCE DIAGRAMS FOR REQUEST HANDLING .................................................... 26 4.1. No Translation for Request and Response ......................................................................... 26 4.2. Request Translation ............................................................................................................ 27 4.3. Response Translation ......................................................................................................... 29 4.4. Request and Response Translation ..................................................................................... 30 4.5. Streaming Sequence Diagram ............................................................................................ 31 5 IMPLEMENTATION OF SoCCS FRAMEWORK ................................................................ 33 5.1. User Agent (UA) ................................................................................................................ 34 vii 5.1.1. Web browser ................................................................................................................ 34 5.1.2. Java Sonics ListenUp Applet ....................................................................................... 34 5.1.3. Google Virtual Keyboard ............................................................................................ 35 5.2. Request Interpreter (RI) ..................................................................................................... 35 5.2.1. Web Server .................................................................................................................. 36 5.3. Translator (TR) ................................................................................................................... 36 5.3.1. Google Translate .......................................................................................................... 36 5.3.2. eSpeak .......................................................................................................................... 37 5.3.3. Sphinx
Load more

Recommended publications
  • Current Perspectives on Linux Accessibility Tools for Visually Impaired Users
    ЕЛЕКТРОННО СПИСАНИЕ „ИКОНОМИКА И КОМПЮТЪРНИ НАУКИ“, БРОЙ 2, 2019, ISSN 2367-7791, ВАРНА, БЪЛГАРИЯ ELECTRONIC JOURNAL “ECONOMICS AND COMPUTER SCIENCE”, ISSUE 2, 2019, ISSN 2367-7791, VARNA, BULGARIA Current Perspectives on Linux Accessibility Tools for Visually Impaired Users Radka NACHEVA1 1 University of Economics, Varna, Bulgaria [email protected] Abstract. The development of user-oriented technologies is related not only to compliance with standards, rules and good practices for their usability but also to their accessibility. For people with special needs, assistive technologies have been developed to ensure the use of modern information and communication technologies. The choice of a particular tool depends mostly on the user's operating system. The aim of this research paper is to study the current state of the accessibility software tools designed for an operating system Linux and especially used by visually impaired people. The specific context of the considering of the study’s objective is the possibility of using such technologies by Bulgarian users. The applied approach of the research is content analysis of scientific publications, official documentation of Linux accessibility tools, and legal provisions and classifiers of international organizations. The results of the study are useful to other researchers who work in the area of accessibility of software technologies, including software companies that develop solutions for visually impaired people. For the purpose of the article several tests are performed with the studied tools, on the basis of which the conclusions of the study are made. On the base of the comparative study of assistive software tools the main conclusion of the paper is made: Bulgarian visually impaired users are limited to work with Linux operating system because of the lack of the Bulgarian language support.
    [Show full text]
  • Embed Text to Speech in Website
    Embed Text To Speech In Website KingsleyUndefended kick-off or pinchbeck, very andantino. Avraham Plagued never and introspects tentier Morlee any undercurrent! always outburn Multistorey smugly andOswell brines except his herenthymemes. earthquake so accelerando that You in speech recognition Uses premium Acapela TTS voices with license for battle use my the. 21 Best proud to Speech Software 2021 Free & Paid Online TTS. Add the method to deity the complete API endpoint for your matter The most example URL represents a crop to Speech instance group is. Annyang is a JavaScript SpeechRecognition library that makes adding voice. The speech recognition portion of the WebSpeech API allows websites to enable. A high-quality unlimited TTS voice app that runs in your Chrome browser Tool for creating voice from despair or Google Drive file. Speech synthesis is so artificial production of human speech A computer system used for this claim is called a speech computer or speech synthesizer and telling be implemented in software building hardware products A text-to-speech TTS system converts normal language text into speech. Which reads completely consume it? How we Add run to Speech in WordPress WPBeginner. The divine tool accepts both typed and handwritten input and supports. RingCentral Embeddable Voice into Text Widget. It is to in your people. Most of the embed the files, voice from gallo romance, embed text to speech in website where the former is built in the pronunciation for only in the spelling with. The type an external program, and continue to a few steps in your blog publishers can be spoken version is speech text? Usted tiene teclear cualquier texto, website to in text speech recognition is the home with a female voice? The Chrome extension lets you highlight the text tag any webpage to hear even read aloud.
    [Show full text]
  • A Simplified Overview of Text-To-Speech Synthesis
    Proceedings of the World Congress on Engineering 2014 Vol I, WCE 2014, July 2 - 4, 2014, London, U.K. A Simplified Overview of Text-To-Speech Synthesis J. O. Onaolapo, F. E. Idachaba, J. Badejo, T. Odu, and O. I. Adu open-source software while SpeakVolumes is commercial. It must however be noted that Text-To-Speech systems do Abstract — Computer-based Text-To-Speech systems render not sound perfectly natural due to audible glitches [4]. This is text into an audible form, with the aim of sounding as natural as possible. This paper seeks to explain Text-To-Speech synthesis because speech synthesis science is yet to capture all the in a simplified manner. Emphasis is placed on the Natural complexities and intricacies of human speaking capabilities. Language Processing (NLP) and Digital Signal Processing (DSP) components of Text-To-Speech Systems. Applications and II. MACHINE SPEECH limitations of speech synthesis are also explored. Text-To-Speech system processes are significantly different Index Terms — Speech synthesis, Natural Language from live human speech production (and language analysis). Processing, Auditory, Text-To-Speech Live human speech production depends of complex fluid mechanics dependent on changes in lung pressure and vocal I. INTRODUCTION tract constrictions. Designing systems to mimic those human Text-To-Speech System (TTS) is a computer-based constructs would result in avoidable complexity. system that automatically converts text into artificial A In general terms, a Text-To-Speech synthesizer comprises human speech [1]. Text-To-Speech synthesizers do not of two parts; namely the Natural Language Processing (NLP) playback recorded speech; rather, they generate sentences unit and the Digital Signal Processing (DSP) unit.
    [Show full text]
  • Masterarbeit
    Masterarbeit Erstellung einer Sprachdatenbank sowie eines Programms zu deren Analyse im Kontext einer Sprachsynthese mit spektralen Modellen zur Erlangung des akademischen Grades Master of Science vorgelegt dem Fachbereich Mathematik, Naturwissenschaften und Informatik der Technischen Hochschule Mittelhessen Tobias Platen im August 2014 Referent: Prof. Dr. Erdmuthe Meyer zu Bexten Korreferent: Prof. Dr. Keywan Sohrabi Eidesstattliche Erklärung Hiermit versichere ich, die vorliegende Arbeit selbstständig und unter ausschließlicher Verwendung der angegebenen Literatur und Hilfsmittel erstellt zu haben. Die Arbeit wurde bisher in gleicher oder ähnlicher Form keiner anderen Prüfungsbehörde vorgelegt und auch nicht veröffentlicht. 2 Inhaltsverzeichnis 1 Einführung7 1.1 Motivation...................................7 1.2 Ziele......................................8 1.3 Historische Sprachsynthesen.........................9 1.3.1 Die Sprechmaschine.......................... 10 1.3.2 Der Vocoder und der Voder..................... 10 1.3.3 Linear Predictive Coding....................... 10 1.4 Moderne Algorithmen zur Sprachsynthese................. 11 1.4.1 Formantsynthese........................... 11 1.4.2 Konkatenative Synthese....................... 12 2 Spektrale Modelle zur Sprachsynthese 13 2.1 Faltung, Fouriertransformation und Vocoder................ 13 2.2 Phase Vocoder................................ 14 2.3 Spectral Model Synthesis........................... 19 2.3.1 Harmonic Trajectories........................ 19 2.3.2 Shape Invariance..........................
    [Show full text]
  • Espeak : Speech Synthesis
    Software Requirements Specification for ESpeak : Speech Synthesis Version 1.48.15 Prepared by Dimitrios Koufounakis January 10, 2018 Copyright © 2002 by Karl E. Wiegers. Permission is granted to use, modify, and distribute this document. Software Requirements Specification for <Project> Page ii Table of Contents Table of Contents .......................................................................................................................... ii Revision History ............................................................................................................................ ii 1. Introduction ..............................................................................................................................1 1.1 Purpose ............................................................................................................................................. 1 1.2 Document Conventions .................................................................................................................... 1 1.3 Intended Audience and Reading Suggestions................................................................................... 1 1.4 Project Scope .................................................................................................................................... 1 1.5 References......................................................................................................................................... 1 2. Overall Description ..................................................................................................................2
    [Show full text]
  • A University-Based Smart and Context Aware Solution for People with Disabilities (USCAS-PWD)
    computers Article A University-Based Smart and Context Aware Solution for People with Disabilities (USCAS-PWD) Ghassan Kbar 1,*, Mustufa Haider Abidi 2, Syed Hammad Mian 2, Ahmad A. Al-Daraiseh 3 and Wathiq Mansoor 4 1 Riyadh Techno Valley, King Saud University, P.O. Box 3966, Riyadh 12373-8383, Saudi Arabia 2 FARCAMT CHAIR, Advanced Manufacturing Institute, King Saud University, Riyadh 11421, Saudi Arabia; [email protected] (M.H.A.); [email protected] (S.H.M.) 3 College of Computer and Information Sciences, King Saud University, Riyadh 11421, Saudi Arabia; [email protected] 4 Department of Electrical Engineering, University of Dubai, Dubai 14143, United Arab Emirates; [email protected] * Correspondence: [email protected] or [email protected]; Tel.: +966-114693055 Academic Editor: Subhas Mukhopadhyay Received: 23 May 2016; Accepted: 22 July 2016; Published: 29 July 2016 Abstract: (1) Background: A disabled student or employee in a certain university faces a large number of obstacles in achieving his/her ordinary duties. An interactive smart search and communication application can support the people at the university campus and Science Park in a number of ways. Primarily, it can strengthen their professional network and establish a responsive eco-system. Therefore, the objective of this research work is to design and implement a unified flexible and adaptable interface. This interface supports an intensive search and communication tool across the university. It would benefit everybody on campus, especially the People with Disabilities (PWDs). (2) Methods: In this project, three main contributions are presented: (A) Assistive Technology (AT) software design and implementation (based on user- and technology-centered design); (B) A wireless sensor network employed to track and determine user’s location; and (C) A novel event behavior algorithm and movement direction algorithm used to monitor and predict users’ behavior and intervene with them and their caregivers when required.
    [Show full text]
  • Personal Medication Advisor
    FACULDADE DE ENGENHARIA DA UNIVERSIDADE DO PORTO Personal Medication Advisor Joana Polónia Lobo MASTER IN BIOENGINEERING Supervisor at FhP: Liliana Ferrreira (PhD) Supervisor at FEUP: Aníbal Ferreira (PhD) July, 2013 © Joana Polónia Lobo, 2013 Personal Medication Advisor Joana Polónia Lobo Master in Bioengineering Approved in oral examination by the committee: Chair: Artur Cardoso (PhD) External Examiner: Fernando Perdigão (PhD) Supervisor at FhP: Liliana Ferrreira (PhD) Supervisor at FEUP: Aníbal Ferreira (PhD) ____________________________________________________ July, 2013 Abstract Healthcare faces new challenges with automated medical support systems and artificial intelligence applications for personal care. The incidence of chronic diseases is increasing and monitoring patients in a home environment is inevitable. Heart failure is a chronic syndrome and a leading cause of death and hospital readmission on developed countries. As it has no cure, patients will have to follow strict medication plans for the rest of their lives. Non-compliance with prescribed medication regimens is a major concern, especially among older people. Thus, conversational systems will be very helpful in managing medication and increasing adherence. The Personal Medication Advisor aimed to be a conversational assistant, capable of interacting with the user through spoken natural language to help him manage information about his prescribed medicines. This patient centred approach to personal healthcare will improve treatment quality and efficacy. System architecture encompassed the development of three modules: a language parser, a dialog manager and a language generator, integrated with already existing tools for speech recognition and synthesis. All these modules work together and interact with the user through an Android application. System evaluation was performed through a usability test to assess feasibility, coherence and naturalness of the Personal Medication Advisor.
    [Show full text]
  • Community Notebook
    Community Notebook Free Software Projects Projects on the Move Accessibility for computer users with disabilities is one of the noblest goals for Linux and open source software. Vinux, Orca, and Gnome lead the way in Linux accessibility. By Carla Schroder ccessibility of any kind for people with disabilities has a long history of neglect and opposition. The US Rehabilitation Act of 1973 prohibited fed- eral agencies from discriminating on the basis of disability (Sections 501, A503, 504, 508) [1]. Passing a law is one thing; enforcing it is another, and it took years of activism to make any progress. In the 1980s, the Reagan Adminis- tration targeted Section 504 (addressing civil rights for people with disabilities) for de- Lisa Young, 123RF regulation because it was too “burdensome.” Once again advocates organized, and after two years of intensive effort, they succeeded in preserving Section 504. However, years more of Supreme Court fights, legislative battles, and public education efforts had to be won. The culmination of that work was the Americans with Disabilities Act (ADA) of 1990, which addresses some of the basic aspects of everyday life: employ- ment, public accommodations, telecommunications, and government agencies. This law still leaves an awful lot of gaps. Designing for accessibility is more than just bolting on a few aids as an afterthought – it’s a matter of architecture, of design- ing for everyone from the ground up. Accessibility covers a lot of ground, including: • Impaired vision to complete blindness • Impaired hearing to complete deafness • Color blindness • Difficulty or inability to type or use a mouse • Cognitive, learning, or reading problems • Low stamina, difficulty sitting up Talking computers have existed in science fiction for decades, but the world isn’t much closer to having them than it was 10 years ago.
    [Show full text]
  • Evaluating the Accessibility of Digital Audio Workstations for Blind Or Visually Impaired People
    Evaluating the Accessibility of Digital Audio Workstations for Blind or Visually Impaired People Gemma Pedrini, Luca Andrea Ludovico a and Giorgio Presti b Laboratorio di Informatica Musicale, Dipartimento di Informatica “Giovanni Degli Antoni”, Universita` degli Studi di Milano, Via G. Celoria 18, Milano, Italy Keywords: Accessibility, Blind or Visually Impaired (BVI), Digital Audio Workstations. Abstract: This paper proposes a methodology to assess the accessibility for blind or visually impaired people of mu- sic production software known as Digital Audio Workstations. The products chosen for the tests are Cockos REAPER, Avid Pro Tools, and Steinberg Cubase, three of the most popular solutions falling in this cate- gory. Both Microsoft Windows and macOS versions were tested, since these two operating systems natively integrate assistive technologies which provide a further layer to be considered. The degree of accessibility was evaluated in relation to the possibility for blind or visually impaired people to invoke key functions and perform basic operations. Finally, a focus group with visually impaired professional music producers was organized in order to assess the proposed evaluation methodology. 1 INTRODUCTION The theme of accessibility in the context of Information Society, also known as e-accessibility Accessibility means enabling as many people as pos- (Klironomos et al., 2006), concerns the integration of sible to use a resource, even when those people’s abil- all users into the Information Society, including peo- ities are limited in some way. The International Clas- ple with disabilities. Such a subject is tightly con- sification of Functioning, Disability and Health (ICF) nected to e-inclusion, which aims to prevent the risk denotes with the term disability the negative aspects that people with lack of digital literacy, poor access of the interaction between an individual and that indi- to technology and some form of impairment are left vidual’s contextual factors.
    [Show full text]
  • RT-Voice PRO Hearing Is Understanding
    RT-Voice PRO Hearing is understanding Documentation Date: 31.08.2021 Version: 2021.3.0 © 2015-2021 crosstales LLC htt s:/!""".crosstales.com #$-Voice PRO 2021.3.0 Table of Contents 1. %&er&ie".........................................................................................................5 2. 'eatures..........................................................................................................( 2.1. Con&ert te)t to &oice.............................................................................................( 2.2. Documentation * control.......................................................................................( 2.3. Com ati+ilit,........................................................................................................( 2.4. .ntegrations........................................................................................................./ 2.5. 0latform-speci1ic 1eatures and limitations.................................................................8 2.5.1. %&er&ie"..................................................................................................................8 2.5.2. 2indo"s..................................................................................................................8 2.5.3. mac%3.....................................................................................................................8 2.5.-. 4ndroid....................................................................................................................5 2.5.5. i%3.........................................................................................................................
    [Show full text]
  • The Umbra Simulation and Integration Framework Applied to Emergency Response Training
    The Umbra Simulation And Integration Framework Applied To Emergency Response Training Paul Lawrence Hamilton and Robert Brittain ORION International Technologies, Inc., Albuquerque, NM, USA [email protected] Abstract. The Mine Emergency Response Interactive Training Simulation (MERITS) is intended to prepare personnel to manage an emergency in an underground coal mine. The creation of an effective training environment required realistic emergent behavior in response to simulation events and trainee interventions, exploratory modification of miner behavior rules, realistic physics, and incorporation of legacy code. It also required the ability to add rich media to the simulation without conflicting with normal desktop security settings. Our Umbra Simulation and Integration Framework facilitated agent-based modeling of miners and rescuers and made it possible to work with subject matter experts to quickly adjust behavior through script editing, rather than through lengthy programming and recompilation. Integration of Umbra code with the WebKit browser engine allowed the use of JavaScript-enabled local web pages for media support. This project greatly extended the capabilities of Umbra in support of training simulations and has implications for simulations that combine human behavior, physics, and rich media. 1.0 INTRODUCTION number of new technologies for messaging and miner tracking. Dr. R. Larry Grayson, chair of the 1.1 Problem and Significance recently formed National Mining Association (NMA) On January 2, 2006, there was an explosion at the Committee on Mine Safety, points out the Sago mine in Upshur County, West Virginia. limitations of this approach. "What miners really Twelve miners were trapped. Eleven miners died. need", he says," is a comprehensive system with According to one mine rescue expert, in theory, scenario-based training and multiple options for they could have all walked out.
    [Show full text]
  • Speech Synthesizer Based on the Project MBROLA
    Rajs Arkadiusz, Banaszak-Piechowska Agnieszka, Drzycimski Paweł. Speech synthesizer based on the project MBROLA. Journal of Education, Health and Sport. 2015;5(12):160-164. ISSN 2391-8306. DOI http://dx.doi.org/10.5281/zenodo.35266 http://ojs.ukw.edu.pl/index.php/johs/article/view/2015%3B5%2812%29%3A160-164 http://pbn.nauka.gov.pl/works/678876 Formerly Journal of Health Sciences. ISSN 1429-9623 / 2300-665X. Archives 2011–2014 http://journal.rsw.edu.pl/index.php/JHS/issue/archive Deklaracja. Specyfika i zawartość merytoryczna czasopisma nie ulega zmianie. Zgodnie z informacją MNiSW z dnia 2 czerwca 2014 r., że w roku 2014 nie będzie przeprowadzana ocena czasopism naukowych; czasopismo o zmienionym tytule otrzymuje tyle samo punktów co na wykazie czasopism naukowych z dnia 31 grudnia 2014 r. The journal has had 5 points in Ministry of Science and Higher Education of Poland parametric evaluation. Part B item 1089. (31.12.2014). © The Author (s) 2015; This article is published with open access at Licensee Open Journal Systems of Kazimierz Wielki University in Bydgoszcz, Poland and Radom University in Radom, Poland Open Access. This article is distributed under the terms of the Creative Commons Attribution Noncommercial License which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author(s) and source are credited. This is an open access article licensed under the terms of the Creative Commons Attribution Non Commercial License (http://creativecommons.org/licenses/by-nc/3.0/) which permits unrestricted, non commercial use, distribution and reproduction in any medium, provided the work is properly cited.
    [Show full text]