DOCSLIB.ORG

VŠB – TECHNICKÁ UNIVERZITA OSTRAVA Fakulta Elektrotechniky a Informatiky Katedra Informatiky

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
VŠB – TECHNICKÁ UNIVERZITA OSTRAVA Fakulta Elektrotechniky a Informatiky Katedra Informatiky View metadata, citation and similar papers at core.ac.uk brought to you by CORE provided by DSpace at VSB Technical University of Ostrava VŠB – TECHNICKÁ UNIVERZITA OSTRAVA Fakulta elektrotechniky a informatiky Katedra informatiky Zpracování zvukového signálu na po číta či Processing Sound Signal on Computer 2010 Tereza Moudrá „Prohlašuji, že jsem tuto bakalá řskou práci vypracovala samostatn ě. Uvedla jsem všechny literární prameny a publikace, ze kterých jsem čerpala.“ V Ostrav ě ……………. Podpis Pod ěkování Na tomto míst ě bych cht ěla pod ěkovat vedoucímu své bakalá řské práce panu doc. Ing. Li čevovi, CSc. za rady a p řipomínky k obsahu a form ě zpracování. Abstrakt Ve své práci se zabývám problematikou optického rozpoznávání znak ů. Výsledná aplikace se skládá ze dvou částí. V první části je vy řešen p řevod textu z obrázku na normální text a ve druhé části je tento text p řeveden do audio formy. Aplikace využívá pro p řevod na text freeware program Asprise OCR a pro zvukovou část používá aplikaci z bakalá řské práce p. Brettšnajdra. Řešení p ředkládané bakalá řské práce je rozd ěleno do n ěkolika úkon ů v rámci jednoho celku tak, aby tato aplikace mohla sloužit zejména slabozrakým lidem, kte ří kv ůli svému postižení nemohou plnohodnotn ě získávat textové informace. Dále se tato bakalá řská práce zabývá formátem .jpeg a okrajov ě seznamuje čtená ře s prácí s grafickým uživatelským rozhraním v Jav ě. Klí čová slova Optické rozpoznání znak ů, OCR, JPEG, JPG, Java, Asprise OCR Abstract In my thesis I deal with problems of optical character recognition. The final application consists of two parts. The first part is solved by the transfer of text from an image file to a normal text and in the second part the text is converted into audio form. The application uses freeware Asprise OCR for conversion to a text and for audio section it uses an application from the Bachelor thesis of Mr. Brettšnajdr. Solution of this thesis is divided into several tasks within a single unit so that this particular application could serve especially visually impaired people who cannot efficiently obtain text information due to their disability. This thesis also deals with jpeg format and marginally introduces the work with the graphical user interface in Java. Keywords Optical character recognition, OCR, JPEG, JPG, Java, Asprise OCR Seznam použitých symbol ů a zkratek OCR - Optical Character Recognition JPEG - Joint Photographics Experts Group GUI - Graphical User Interface HTML - HyperText Markup Language PDF - Portable Document Format Obsah 1. ÚVOD.................................................................................................................................... 1 2. OPTICKÉ ROZPOZNÁVÁNÍ ZNAK Ů............................................................................ 2 2.1 VYSV ĚTLENÍ POJMU OPTICKÉHO ROZPOZNÁVÁNÍ ZNAK Ů.............................................. 2 2.2 HISTORIE A VYUŽITÍ OCR .............................................................................................. 2 2.3 PRINCIP OCR .................................................................................................................. 2 2.3.1 Digitalizace dokumentu........................................................................................... 3 2.3.2 Obrazové úpravy ..................................................................................................... 3 2.3.3 Rozd ělení dokumentu na bloky................................................................................ 3 2.3.4 Rozpoznání blok ů .................................................................................................... 4 2.3.5 Lexikální postprocessing......................................................................................... 4 2.3.6 Uložení ve zvoleném formátu .................................................................................. 4 2.4 METODY OCR ................................................................................................................ 4 2.4.1 Porovnání matic ...................................................................................................... 4 2.4.2 Extrakce p říznak ů.................................................................................................... 5 2.5 OCR FONTY .................................................................................................................... 6 2.5.1 OCR-A ..................................................................................................................... 7 2.5.2 OCR-B ..................................................................................................................... 8 3. GRAFICKÉ FORMÁTY .................................................................................................... 9 3.1 JPEG............................................................................................................................... 9 3.2 BEZEZTRÁTOVÉ KOMPRIMA ČNÍ METODY ....................................................................... 9 3.3 ZTRÁTOVÉ KOMPRIMA ČNÍ METODY ............................................................................. 10 3.4 METODY KOMPRESE ..................................................................................................... 10 4. VOLBA SOFTWAROVÝCH PROST ŘEDK Ů .............................................................. 11 4.1 GRAFICKÉ UŽIVATELSKÉ ROZHRANÍ - GUI .................................................................. 11 5. APLIKACE PRO P ŘEVOD POMOCÍ OCR ................................................................. 14 5.1 INSTALACE OCR........................................................................................................... 14 5.2 VYUŽITÍ OCR ............................................................................................................... 14 5.2.1 Rozpoznávání znak ů z obrázku.............................................................................. 14 5.2.2 Rozpoznávání znak ů z části obrázku ..................................................................... 15 5.2.3 Explicitní nastavení nativní knihovny.................................................................... 15 6. NÁVRH A REALIZACE APLIKACE ............................................................................ 16 6.1 VOLBA SOFTWAROVÝCH PROST ŘEDK Ů ........................................................................ 16 6.2 VOLBA TYPU APLIKACE ................................................................................................ 16 6.3 KOREKTURA ................................................................................................................. 17 6.4 ZVUK ............................................................................................................................. 18 6.5 DATOVÉ TOKY .............................................................................................................. 18 6.6 ARCHITEKTURA APLIKACE ........................................................................................... 20 6.7 DOPL ŇUJÍCÍ FUNKCE ..................................................................................................... 22 6.8 TESTOVÁNÍ ................................................................................................................... 22 6.9 GRAFICKÉ UŽIVATELSKÉ ROZHRANÍ ............................................................................. 25 7. ZÁV ĚR ............................................................................................................................... 27 Seznam obrázk ů [1] Roz člen ění bod ů 5 [2] Transformace znaku 6 [3] Geometrický zp ůsob rozložení a popsání znaku 6 [4] ukázka fontu OCR-A 7 [5] ukázka fontu OCR-A Extended 8 [6] ukázka fontu OCR-B 8 [7] Schéma datových tok ů 19 [8] Architektura aplikace 21 [9] Test 1 23 [10] Test 2 23 [11] Test 3 24 [12] Hlavní okno 25 [13] Jízdní řád 26 [14] Vyhledání spoje 26 1. Úvod Dnešní doba klade stále v ětší d ůraz na automatizaci ve všech r ůzných odv ětvích. Automatizace zrychluje a zjednodušuje celý proces, což je v moderní dob ě velmi žádoucí. Tuto automatizaci obstarává často informa ční a výpo četní technika. Jedním z mnoha podobor ů, snažících se o automatizaci je i tzv. optické rozpoznávání znak ů neboli OCR (Optical Character Recognition). Tento podobor se zabývá problematikou rozpoznávání textu z obrazu a jeho různými metodami. OCR m ůžeme využít i v b ěžném život ě. Lidé, kte ří trpí lehkou zrakovou vadou, toto optické rozpoznávání jist ě pln ě využijí. Nabízí jim totiž komfort v podob ě poskytnutí hodnotných informací, kterých nejsou schopni jiným zp ůsobem dosáhnout. Jedná se o textové informace, které jsou špatn ě čitelné. Tito lidé mají poškozený zrak do té míry, že jim čtení d ělá obtížné problémy a lušt ěním textu si ješt ě více namáhají už tak dost namáhané o či. Cílem této bakalá řské práce bylo vyvinout aplikaci, která by pomohla práv ě těmto lidem trpícím špatným zrakem a umožnit jim kvalitn ější p řísun textových informací. Umožnit jim tak, aby si mohli p řečíst jakoukoli knihu, či jízdní řád. Aplikace je implementována v jazyce Java, nebo ť umož ňuje nezávislost platformy a dovoluje tvorbu desktopové i mobilní aplikace. Na základ ě zadání své bakalá řské práce se nejprve seznamuji s technologií optického rozpoznávání, a to v kapitole Optické rozpoznávání znak ů, kde rozebírám jednotlivé pojmy spjaté s tímto tématem. Dále také popisuji metody a principy rozpoznávání a také seznamuji s fonty písma, které jsou vhodné pro dokonalejší rozpoznávání. Dalším
Load more

Recommended publications
  • Video-Based Tracking of Physical Documents on a Desk
    FACULTY OF ENGINEERING Department of Electronics and Informatics Video-based Tracking of Physical Documents on a Desk Graduation thesis submitted in partial fulfillment of the requirements for the degree of Master of Science in Applied Sciences and Engineering: Applied Computer Science Sone Nsime Ngole Promoter: Prof. Dr. Beat Signer Advisor: Dr. Bruno Dumas JANUARY 2014 FACULTEIT INGENIEURSWETENSCHAPPEN Vakgroep Elektronica en Informatica Video-based Tracking of Physical Documents on a Desk Afstudeer eindwerk ingediend in gedeeltelijke vervulling van de eisen voor het behalen van de graad Master of Science in de Ingenieurswetenschappen: Toegepaste Computerwetenschappen Sone Nsime Ngole Promoter: Prof. Dr. Beat Signer Advisors: Dr. Bruno Dumas JANUARI 2014 Abstract Currently, physical and digital documents tend to stay in their world, without any direct relationship linking them. How- ever, a lot of physical documents are printed from digital doc- uments and conversely, digital documents can be scanned ver- sions of printed papers. Furthermore, the organization of piles of physical documents on a desk hints at shared semantic fea- tures between a set of documents. This thesis explores an ap- proach to link or re-link physical documents with their digital counterpart. This integration will be done by designing a sys- tem that uses an overhead digital camera to recognize, identify, localize and track paper documents on the physical desk space in real time (or offline by means of a pre-recorded video stream) and automatically matching them against an image database of electronic documents. The system locates each paper docu- ment that is present on the desk and reconstructs a complete configuration of documents on the desk at each instant in time.
    [Show full text]
  • Diplomová Práce Inteligentní Vyhledávání Dokumentů
    Západočeská univerzita v Plzni Fakulta aplikovaných věd Katedra informatiky a výpočetní techniky Diplomová práce Inteligentní vyhledávání dokumentů Plzeň 2017 Jiří Martínek Místo této strany bude zadání práce. Prohlášení Prohlašuji, že jsem diplomovou práci vypracoval samostatně a výhradně s použitím citovaných pramenů. V Plzni dne 16. května 2017 Jiří Martínek Poděkování Na tomto místě bych chtěl poděkovat svému vedoucímu diplomové práce doc. Ing. Pavlu Královi Ph.D. za odborné vedení, za pomoc a rady při zpracování této práce. Jiří Martínek Abstract This diploma thesis deals with information retrieval in a set of scanned documents in form of raster images. First, the images are converted into the text form using optical character recognition (OCR) methods. Unfortunately, there are errors in conversion, therefore another part of the work deals with error correction. This thesis propose several error correction methods that are combined to achieve the best possible results. Then, the corrected documents are indexed into the full-text Apache Solr database. The resulting application allows to efficiently find the requested document according to a full-text query. Error correction of the OCR output helps to increase the accuracy of full-text search. The accuracy of the system was experimentally verified on the real data. Abstrakt Tato diplomová práce se zabývá problematikou vyhledávání informací v množině naskenovaných dokumentů v podobě rastrových obrázků. Nejdříve je proto proveden převod rastrového obrázku do textové podoby pomocí metod optického rozpoznávání znaků (OCR). V rámci převodu bohužel dochází k chybám, proto se další část práce zabývá samotnou opravou chyb. V práci je navrženo několik metod oprav chyb, které jsou zkombinovány pro dosažení co nejlepšího výsledku.
    [Show full text]
  • OCR Pwds and Assistive Qatari Using OCR Issue No
    Arabic Optical State of the Smart Character Art in Arabic Apps for Recognition OCR PWDs and Assistive Qatari using OCR Issue no. 15 Technology Research Nafath Efforts Page 04 Page 07 Page 27 Machine Learning, Deep Learning and OCR Revitalizing Technology Arabic Optical Character Recognition (OCR) Technology at Qatar National Library Overview of Arabic OCR and Related Applications www.mada.org.qa Nafath About AboutIssue 15 Content Mada Nafath3 Page Nafath aims to be a key information 04 Arabic Optical Character resource for disseminating the facts about Recognition and Assistive Mada Center is a private institution for public benefit, which latest trends and innovation in the field of Technology was founded in 2010 as an initiative that aims at promoting ICT Accessibility. It is published in English digital inclusion and building a technology-based community and Arabic languages on a quarterly basis 07 State of the Art in Arabic OCR that meets the needs of persons with functional limitations and intends to be a window of information Qatari Research Efforts (PFLs) – persons with disabilities (PWDs) and the elderly in to the world, highlighting the pioneering Qatar. Mada today is the world’s Center of Excellence in digital work done in our field to meet the growing access in Arabic. Overview of Arabic demands of ICT Accessibility and Assistive 11 OCR and Related Through strategic partnerships, the center works to Technology products and services in Qatar Applications enable the education, culture and community sectors and the Arab region. through ICT to achieve an inclusive community and educational system. The Center achieves its goals 14 Examples of Optical by building partners’ capabilities and supporting the Character Recognition Tools development and accreditation of digital platforms in accordance with international standards of digital access.
    [Show full text]
  • Desenvolvimento De Um Sistema De Apoio Ao Arquivo E À Gestão De
    Diogo Alexandre Nascimento Alves Licenciatura em Ciências da Engenharia Electrotécnica e de Computadores [Nome completo do autor] Desenvolvimento de um Sistema de Apoio ao Arquivo e à [Habilitações Académicas]Gestão de Blocos Histológicos [Nome completo do autor] [Habilitações Académicas] [Nome[Título completo da Tese] do autor] Dissertação para obtenção do Grau de Mestre em [Habilitações Académicas] Engenharia Electrotécnica e de Computadores [Nome completo do autor] Orientador: José Manuel Matos Ribeiro da Fonseca, Professor Auxiliar com Dissertação para obtenção do Grau de Mestre em [Habilitações Agregação,Académicas] Faculdade de Ciências e Tecnologia da Universidade [Engenharia Informática] Nova de Lisboa Co-orientador[Nome completo: André do Teixeira autor] Bento Damas Mora, Professor Auxiliar, Faculdade de Ciências e Tecnologia da Universidade Nova de Lisboa [Habilitações Académicas] [Nome completo do autor] [Habilitações Académicas] [Nome completo do autor] [Habilitações Académicas] i Setembro, 2018 Desenvolvimento de um Sistema de Apoio ao Arquivo e á Gestão de Blocos Histológicos Copyright © Diogo Alexandre Nascimento Alves, Faculdade de Ciências e Tecnologia, Univer- sidade Nova de Lisboa. A Faculdade de Ciências e Tecnologia e a Universidade Nova de Lisboa têm o direito, perpétuo e sem limites geográficos, de arquivar e publicar esta dissertação através de exemplares impres- sos reproduzidos em papel ou de forma digital, ou por qualquer outro meio conhecido ou que venha a ser inventado, e de a divulgar através de repositórios
    [Show full text]
  • Download Resume
    [email protected] +919635337441 Bibhash Chandra Mitra A dynamic professional, targeting challenging & rewarding opportunities in Machine Learning and Artificial Intelligence with an organization of high repute and big challenges preferably in Pune, Bangalore or Kolkata. https://www.linkedin.com/in/bibhashmitra220896 https://github.com/Bibyutatsu https://bibyutatsu.github.io https://bibyutatsu.github.io/Blogs Profile Summary A focused and goal-oriented professional with 1+ year of industrial exposure in Data Science, Machine Learning-supervised/unsupervised, Artificial Intelligence and Algorithms Alumni of IIT, Kharagpur ; graduated with a Major in Aerospace Engineering and a Minor in Computer Science Engineering Currently associated with Innoplexus Consulting Services Pvt. Ltd.; working on critical projects likeNovel Drug Discovery with AI and Cluster- ing Graph Networks for Entity Normalisation Received rating of 5/5 employee for “Outstanding” performance for two quarters (Jun’19 to Dec’19) Expertise in OCR Engines, Deep Learning, Data Exploration and Visualization, Predictive Modelling and Optimization Proficiency in using various AI techniques such as RCNN, VAE, GAN and RL Worked on projects such as ‘Table Detection and Extraction using FRCNN and Image processing’ & ‘Hierarchy using Graphs Hands-on experience in Docker, Virtual Environments, Anaconda, DGX-1, Tesla V100 Modeling: Designing and implementing statistical/predictive models and cutting edge algorithms by utilizing diverse sources of data to predict demand,
    [Show full text]
  • Gradu04243.Pdf
    Paperilomakkeesta tietomalliin Kalle Malin Tampereen yliopisto Tietojenkäsittelytieteiden laitos Tietojenkäsittelyoppi Pro gradu -tutkielma Ohjaaja: Erkki Mäkinen Toukokuu 2010 i Tampereen yliopisto Tietojenkäsittelytieteiden laitos Tietojenkäsittelyoppi Kalle Malin: Paperilomakkeesta tietomalliin Pro gradu -tutkielma, 61 sivua, 3 liitesivua Toukokuu 2010 Tässä tutkimuksessa käsitellään paperilomakkeiden digitalisointiin liittyvää kokonaisprosessia yleisellä tasolla. Prosessiin tutustutaan tarkastelemalla eri osa-alueiden toimintoja ja laitteita kokonaisjärjestelmän vaatimusten näkökul- masta. Tarkastelu aloitetaan paperilomakkeiden skannaamisesta ja lopetetaan kerättyjen tietojen tallentamiseen tietomalliin. Lisäksi luodaan silmäys markki- noilla oleviin valmisratkaisuihin, jotka sisältävät prosessin kannalta oleelliset toiminnot. Avainsanat ja -sanonnat: lomake, skannaus, lomakerakenne, lomakemalli, OCR, OFR, tietomalli. ii Lyhenteet ADRT = Adaptive Document Recoginition Technology API = Application Programming Interface BAG = Block Adjacency Graph DIR = Document Image Recognition dpi= Dots Per Inch ICR = Intelligent Character Recognition IFPS = Intelligent Forms Processing System IR = Information Retrieval IRM = Image and Records Management IWR = Intelligent Word Recognition NAS = Network Attached Storage OCR = Optical Character Recognition OFR = Optical Form Recognition OHR = Optical Handwriting Recognition OMR = Optical Mark Recognition PDF = Portable Document Format SAN = Storage Area Networks SDK = Software Development Kit SLM
    [Show full text]
  • Insight MFR By
    Manufacturers, Publishers and Suppliers by Product Category 11/6/2017 10/100 Hubs & Switches ASCEND COMMUNICATIONS CIS SECURE COMPUTING INC DIGIUM GEAR HEAD 1 TRIPPLITE ASUS Cisco Press D‐LINK SYSTEMS GEFEN 1VISION SOFTWARE ATEN TECHNOLOGY CISCO SYSTEMS DUALCOMM TECHNOLOGY, INC. GEIST 3COM ATLAS SOUND CLEAR CUBE DYCONN GEOVISION INC. 4XEM CORP. ATLONA CLEARSOUNDS DYNEX PRODUCTS GIGAFAST 8E6 TECHNOLOGIES ATTO TECHNOLOGY CNET TECHNOLOGY EATON GIGAMON SYSTEMS LLC AAXEON TECHNOLOGIES LLC. AUDIOCODES, INC. CODE GREEN NETWORKS E‐CORPORATEGIFTS.COM, INC. GLOBAL MARKETING ACCELL AUDIOVOX CODI INC EDGECORE GOLDENRAM ACCELLION AVAYA COMMAND COMMUNICATIONS EDITSHARE LLC GREAT BAY SOFTWARE INC. ACER AMERICA AVENVIEW CORP COMMUNICATION DEVICES INC. EMC GRIFFIN TECHNOLOGY ACTI CORPORATION AVOCENT COMNET ENDACE USA H3C Technology ADAPTEC AVOCENT‐EMERSON COMPELLENT ENGENIUS HALL RESEARCH ADC KENTROX AVTECH CORPORATION COMPREHENSIVE CABLE ENTERASYS NETWORKS HAVIS SHIELD ADC TELECOMMUNICATIONS AXIOM MEMORY COMPU‐CALL, INC EPIPHAN SYSTEMS HAWKING TECHNOLOGY ADDERTECHNOLOGY AXIS COMMUNICATIONS COMPUTER LAB EQUINOX SYSTEMS HERITAGE TRAVELWARE ADD‐ON COMPUTER PERIPHERALS AZIO CORPORATION COMPUTERLINKS ETHERNET DIRECT HEWLETT PACKARD ENTERPRISE ADDON STORE B & B ELECTRONICS COMTROL ETHERWAN HIKVISION DIGITAL TECHNOLOGY CO. LT ADESSO BELDEN CONNECTGEAR EVANS CONSOLES HITACHI ADTRAN BELKIN COMPONENTS CONNECTPRO EVGA.COM HITACHI DATA SYSTEMS ADVANTECH AUTOMATION CORP. BIDUL & CO CONSTANT TECHNOLOGIES INC Exablaze HOO TOO INC AEROHIVE NETWORKS BLACK BOX COOL GEAR EXACQ TECHNOLOGIES INC HP AJA VIDEO SYSTEMS BLACKMAGIC DESIGN USA CP TECHNOLOGIES EXFO INC HP INC ALCATEL BLADE NETWORK TECHNOLOGIES CPS EXTREME NETWORKS HUAWEI ALCATEL LUCENT BLONDER TONGUE LABORATORIES CREATIVE LABS EXTRON HUAWEI SYMANTEC TECHNOLOGIES ALLIED TELESIS BLUE COAT SYSTEMS CRESTRON ELECTRONICS F5 NETWORKS IBM ALLOY COMPUTER PRODUCTS LLC BOSCH SECURITY CTC UNION TECHNOLOGIES CO FELLOWES ICOMTECH INC ALTINEX, INC.
    [Show full text]
  • Extracción De Eventos En Prensa Escrita Uruguaya Del Siglo XIX Por Pablo Anzorena Manuel Laguarda Bruno Olivera
    UNIVERSIDAD DE LA REPÚBLICA Extracción de eventos en prensa escrita Uruguaya del siglo XIX por Pablo Anzorena Manuel Laguarda Bruno Olivera Tutora: Regina Motz Informe de Proyecto de Grado presentado al Tribunal Evaluador como requisito de graduación de la carrera Ingeniería en Computación en la Facultad de Ingeniería ​ ​ 1 1. Resumen ​ ​ En este proyecto, se plantea el diseño y la implementación de un sistema de extracción de eventos en prensa uruguaya del siglo XIX digitalizados en formato de imagen, generando clusters de eventos agrupados según su similitud semántica. La solución propuesta se divide en 4 módulos: módulo de preprocesamiento compuesto por el OCR y un corrector de texto, módulo de extracción de eventos implementado en Python y utilizando Freeling1, módulo de clustering de eventos implementado en Python utilizando Word Embeddings y por último el módulo de etiquetado de los clusters también utilizando Python. Debido a la cantidad de ruido en los datos que hay en los diarios antiguos, la evaluación de la solución se hizo sobre datos de prensa digital de la actualidad. Se evaluaron diferentes medidas a lo largo del proceso. Para la extracción de eventos se logró conseguir una Precisión y Recall de un 56% y 70% respectivamente. En el caso del módulo de clustering se evaluaron las medidas de Silhouette Coefficient, la Pureza y la Entropía, dando 0.01, 0.57 y 1.41 respectivamente. Finalmente se etiquetaron los clusters utilizando como etiqueta las secciones de los diarios de la actualidad, realizándose una evaluación del etiquetado. 1 http://nlp.lsi.upc.edu/freeling/demo/demo.php 2 Índice general 1.
    [Show full text]
  • A Java Autopilot for Parrot A.R. Drone Designed with Diaspec
    UNIVERSIDADE FEDERAL DO RIO GRANDE DO SUL INSTITUTO DE INFORMÁTICA CURSO DE ENGENHARIA DE COMPUTAÇÃO JOÃO VICTOR PORTAL A Java Autopilot for Parrot A.R. Drone Designed with DiaSpec Trabalho de Graduação. Prof. Dr. Carlos Eduardo Pereira Orientador Porto Alegre, novembro de 2011. UNIVERSIDADE FEDERAL DO RIO GRANDE DO SUL Reitor: Prof. Carlos Alexandre Netto Vice-Reitor: Prof. Rui Vicente Oppermann Pró-Reitora de Graduação: Profa. Valquiria Link Bassani Diretor do Instituto de Informática: Prof. Luís da Cunha Lamb Coordenador do ECP: Prof. Sérgio Luís Cechin Bibliotecária-Chefe do Instituto de Informática: Beatriz Regina Bastos Haro SUMMARY LISTA DE ABREVIATURAS E SIGLAS..........................................................................................4 LISTA DE FIGURAS............................................................................................................................5 RESUMO...............................................................................................................................................6 ABSTRACT...........................................................................................................................................7 1 CONTEXT.........................................................................................................................................8 1.1 Motivation.......................................................................................................................................8 1.2 Objectives........................................................................................................................................8
    [Show full text]
  • A Deep Learning Approach to Drug Label Identification Through Image
    DLI-IT: A Deep Learning Approach to Drug Label Identication Through Image and Text Embedding Xiangwen Liu National Center for Toxicological Research Joe Meehan National Center for Toxicological Research Weida Tong National Center for Toxicological Research Leihong Wu ( [email protected] ) National Center for Toxicological Research https://orcid.org/0000-0002-4093-3708 Xiaowei Xu University of Arkansas at Little Rock Joshua Xu National Center for Toxicological Research Research article Keywords: Deep learning, pharmaceutical packaging, Neural network, Drug labeling, Opioid drug, Semantic similarity, Similarity identication, Image recognition, Scene text detection, Daily-Med Posted Date: January 10th, 2020 DOI: https://doi.org/10.21203/rs.2.20538/v1 License: This work is licensed under a Creative Commons Attribution 4.0 International License. Read Full License Version of Record: A version of this preprint was published on April 15th, 2020. See the published version at https://doi.org/10.1186/s12911-020-1078-3. Page 1/12 Abstract [Background] Drug label, or packaging insert play a signicant role in all the operations from production through drug distribution channels to the end consumer. Image of the label also called Display Panel or label could be used to identify illegal, illicit, unapproved and potentially dangerous drugs. Due to the time-consuming process and high labor cost of investigation, an articial intelligence-based deep learning model is necessary for fast and accurate identication of the drugs. [Methods] In addition to image-based identication technology, we take advantages of rich text information on the pharmaceutical package insert of drug label images. In this study, we developed the Drug Label Identication through Image and Text embedding model (DLI-IT) to model text-based patterns of historical data for detection of suspicious drugs.
    [Show full text]
  • DLI-IT: a Deep Learning Approach to Drug Label Identification Through
    Liu et al. BMC Medical Informatics and Decision Making (2020) 20:68 https://doi.org/10.1186/s12911-020-1078-3 RESEARCH ARTICLE Open Access DLI-IT: a deep learning approach to drug label identification through image and text embedding Xiangwen Liu1,2, Joe Meehan1, Weida Tong1, Leihong Wu1* , Xiaowei Xu2* and Joshua Xu1* Abstract Background: Drug label, or packaging insert play a significant role in all the operations from production through drug distribution channels to the end consumer. Image of the label also called Display Panel or label could be used to identify illegal, illicit, unapproved and potentially dangerous drugs. Due to the time-consuming process and high labor cost of investigation, an artificial intelligence-based deep learning model is necessary for fast and accurate identification of the drugs. Methods: In addition to image-based identification technology, we take advantages of rich text information on the pharmaceutical package insert of drug label images. In this study, we developed the Drug Label Identification through Image and Text embedding model (DLI-IT) to model text-based patterns of historical data for detection of suspicious drugs. In DLI-IT, we first trained a Connectionist Text Proposal Network (CTPN) to crop the raw image into sub-images based on the text. The texts from the cropped sub-images are recognized independently through the Tesseract OCR Engine and combined as one document for each raw image. Finally, we applied universal sentence embedding to transform these documents into vectors and find the most similar reference images to the test image through the cosine similarity. Results: We trained the DLI-IT model on 1749 opioid and 2365 non-opioid drug label images.
    [Show full text]
  • Sensitive Text Icon Classification for Android Apps
    SENSITIVE TEXT ICON CLASSIFICATION FOR ANDROID APPS by ZHIHAO CAO Submitted in partial fulfillment of the requirements for the degree of Master of Science Thesis Advisor: Dr. Xusheng Xiao Department of Electrical Engineering and Computer Science CASE WESTERN RESERVE UNIVERSITY January, 2018 CASE WESTERN RESERVE UNIVERSITY SCHOOL OF GRADUATE STUDIES We hereby approve the thesis/dissertation of Zhihao Cao candidate for the degree of Master of Science. Committee Chair Xusheng Xiao Committee Member Andy Podgurski Committee Member Ming-Chun Huang Date of Defense Nov. 30 2017 *We also certify that written approval has been obtained for any proprietary material contained therein. Contents List of Tables 3 List of Figures 4 List of Abbreviations 7 Abstract 8 1 Introduction 9 2 Background 16 2.1 Permission System in Android…………………………………………………..16 2.2 Sensitive UI Detection in Android……………………………………………….17 2.3 Pixel and Color Model…………………………………………………………...19 2.4 Optical Character Recognition…………………………………………………...21 3 Design of DroidIcon 23 3.1 Overview…………………………………………………………..……………..23 3.2 Image Mutation…………………………………………………………………..24 3.2.1 Image Scaling………………………………………………………………24 3.2.2 Color Inversion…………………………………………………………….31 1 3.2.3 Opacity Conversion………………………………………………………..33 3.2.4 Grayscale Conversion………..…………………………………………….37 3.2.5 Contrast Adjustment……………………………………………………….42 3.3 Text Icon Classification 48 3.3.1 Text Cleaning……………………...……………………………………….48 3.3.2 Keyword Dataset Construction…………………………………………….49 3.3.3 Classification Algorithm…………………………………………………...50
    [Show full text]