DOCSLIB.ORG

(12) United States Patent (10) Patent No.: US 9,547,804 B2 Nirenberg Et Al

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
(12) United States Patent (10) Patent No.: US 9,547,804 B2 Nirenberg Et Al USO09547804B2 (12) United States Patent (10) Patent No.: US 9,547,804 B2 Nirenberg et al. (45) Date of Patent: Jan. 17, 2017 (54) RETNAL ENCODER FOR MACHINE (58) Field of Classification Search VISION CPC ...... G06K 9/4619; H04N 19760; H04N 19/62; H04N 19/85; G06N 3/049 (75) Inventors: Sheila Nirenberg, New York, NY (US); (Continued) Illya Bomash, Brooklyn, NY (US) (56) References Cited (73) Assignee: Cornell University, Ithaca, NY (US) U.S. PATENT DOCUMENTS (*) Notice: Subject to any disclaimer, the term of this 5,103,306 A * 4/1992 Weiman .................. GOS 5.163 patent is extended or adjusted under 35 348/400.1 U.S.C. 154(b) by 0 days. 5,815,608 A 9/1998 Lange et al. (21) Appl. No.: 14/239,828 (Continued) (22) PCT Filed: Aug. 24, 2012 FOREIGN PATENT DOCUMENTS CN 101.239008 A 8, 2008 (86) PCT No.: PCT/US2O12/052348 CN 101.336856. A 1, 2009 S 371 (c)(1), (Continued) (2), (4) Date: Jul. 15, 2014 OTHER PUBLICATIONS (87) PCT Pub. No.: WO2O13AO29OO8 Piedade, Moises, Gerald, Jose, Sousa, Leonel Augusto, Tavares, PCT Pub. Date: Feb. 28, 2013 Goncalo, Tomas, Pedro. “Visual Neuroprothesis: A Non Invasive System for Stimulating the Cortex'IEEE Transactions on Circuits (65) Prior Publication Data and Systems-I: Regular Papers, vol. 53 No. 12, Dec. 2005.* US 2014/0355861 A1 Dec. 4, 2014 (Continued) Primary Examiner — Kim Vu Related U.S. Application Data Assistant Examiner — Molly Delaney (60) Provisional application No. 61/527.493, filed on Aug. (74) Attorney, Agent, or Firm — Foley & Lardner LLP 25, 2011, provisional application No. 61/657.406, filed on Jun. 8, 2012. (57) ABSTRACT A method is disclosed including: receiving raw image data (51) Int. C. corresponding to a series of raw images; processing the raw G06T 700 (2006.01) image data with an encoder to generate encoded data, where G06K 9/46 (2006.01) the encoder is characterized by an input/output transforma (Continued) tion that Substantially mimics the input/output transforma (52) U.S. C. tion of one or more retinal cells of a vertebrate retina; and CPC ........... G06K 9/4619 (2013.01); G06K 9/4628 applying a first machine vision algorithm to data generated (2013.01); G06N 3/049 (2013.01); G06T based at least in part on the encoded data. 7/0012 (2013.01); (Continued) 28 Claims, 30 Drawing Sheets 204 Generate Refinal Images 2O5 Postprocessing 2O6 Output Retinal Images to Machine Vision Module US 9,547,804 B2 Page 2 (51) Int. Cl. 2010, O135591 A1 6, 2010 Zador 2010/0152849 A1 6/2010 Degenaar et al. G06T 9/00 (2006.01) 2010/0234273 A1 9/2010 Boyden et al. G06N, 3/04 (2006.01) 2010/0262212 A1 10, 2010 Shoham et al. H04N 9/62 (2014.01) 2010/0272688 A1 10, 2010 Acland et al. H04N 9/85 (2014.01) 2010/0286748 A1 11/2010 Midlani et al. H04N 9/60 (2014.01) 2011/009 1102 A1 * 4/2011 Cimbalista, Jr. ......... HO4N 5/33 382, 167 (52) U.S. Cl. 2011/0213266 A1 9, 2011 Williams et al. CPC ................. G06T 9/00 (2013.01); G06T 9/002 2011/0270352 A1 11/2011 Nanduri et al. (2013.01): G06T 9/007 (2013 01); H4N 2011/0307079 A1 12/2011 Oweiss et al. s • us 2012/O123293 A1 5, 2012 Shah et al. 19/60 (2014.11); H04N 19/62 (2014.11); 2012/0303091 A1* 11/2012 Izhikevich ............. GO6N 3,049 H04N 19/85 (2014.11); G06K 2209/05 6O7.54 (2013.01); G06T 2207/20024 (2013.01); G06T 2014/0364796 A1* 12/2014 Fridman .................. A61N 1.44 2207/20048 (2013.01); G06T 2207/20084 604/20 (2013.01); G06T 2207/30041 (2013.01) (58) Field of Classification Search FOREIGN PATENT DOCUMENTS USPC .......................................................... 382/133 CN 101393,789 A 3, 2009 See application file for complete search history. EP 1864 690 A2 12/2007 EP 1891976 A1 2, 2008 (56) References Cited WO WO-96, 13598 5, 1996 WO WO-98/48O27 10, 1998 U.S. PATENT DOCUMENTS WO WO-OOf 15822 3, 2000 WO WO-01.94605 A2 12/2001 5,836,996 A 11, 1998 Doorish WO WO-02/082904 A2 10, 2002 5,856,152 A 1, 1999 Wilson et al. WO WO-03/047525 A2 6, 2003 5,871,982 A 2, 1999 Wilson et al. WO WO-03/080648 A2 10, 2003 5,974,159 A 10, 1999 Lubin et al. WO WO-03/093479 A1 11, 2003 6, 2002 Eckmiller .......... A61N 1,36046 WO WO-03/104413 A2 12/2003 6,400,989 B1* WO WO-2005/080573 A1 9, 2005 10, 2002 WO WO-2007/127428 A2 11/2007 6.458,157 B1 * Suaning ............... A61N 1.0543 WO WO2007/148038 12/2007 623,663 WO WO-2009/126112 10/2009 6,530,954 B1 3, 2003 Eckmiller WO WO-2010/011.404 A2 1, 2010 6,533,798 B2 3, 2003 Greenberg et al. 6,801,655 B2 10, 2004 Woodall 7,149,586 B2 12, 2006 Greenberg et al. OTHER PUBLICATIONS 8, 103,352 B2 1, 2012 Fried et al. 8, 108,147 B1 * 1, 2012 Blackburn ............. G08G 1,166 Wohrer, Adrien, Kornpobst, Pierre. “Virtual Retinal: A biological 235/454 8.467,623 B2 * 6, 2013 Izhikevich ............... GO6K9/46 retina model and simulator with contrast gain control'. Journal of 348,471 Computational Neuroscience. Aug. 1, 2008.* 8,956,396 B1 2, 2015 Friend et al. Ahuja, A.K. et al., "Blind Subjects implanted with the Argus II 9,302,103 B1 4, 2016 Nirenberg retinal prosthesis are able to improve performance in a spatial-motor 2002/011 1655 A1 8, 2002 Scribner task.” Br J Ophthalmol. (2011), vol. 95, pp. 539-543. 2002fO161417 A1 10, 2002 Scribner Arenkiel, Benjamin R. et al., “In vivo light-induced activation of 2002fO168100 A1* 11, 2002 Woodall ................... GO6K9/66 neural circuitry in transgenic mice expressing channelrhodopsin-2.” 382,156 2003, OO88081 A1 5/2003 Maliga et al. Neuron, (Apr. 19, 2007), vol. 54(2), pp. 205-218. 2003/0093129 A1 5/2003 Nicolelis et al. Ausubel, Frederick M. et al., “Current Protocols in Molecular 2003. O105409 A1 6, 2003 Donoghue et al. Biology.” (2003), John Wiley & Sons, New York, Chapter 1 Only, 2004/O147975 A1 T/2004 Popovic et al. 7 pages. 2004/0176821 A1 9, 2004 Delbeke et al. Bach, M. et al., “Visual evoked potential-based acuity assessment in 2005, OO15120 A1 1/2005 Seibel et al. normal vision, artificially degraded vision, and in patients, Br J 2006.000516O A1* 1, 2006 Schultz ..................... G06F 8.34 Ophthalmol, (2008), vol. 92, pp. 396–403. 717/105 Barnstable, C.J. et al., “Thy-1 antigen: a ganglion cell specific 2006/01292O7 A1 6, 2006 Fried et al. 2006, O184062 A1 8, 2006 Greenberg et al. marker in rodent retina,” Neuroscience, (1984), vol. 11, No. 4, pp. 2006, O251621 A1 11, 2006 Campochiaro et al. 847-855. 2007/005 0046 A1 3, 2007 Georgopoulos Bi, Anding et al., "Ectopic expression of a microbial-type rhodopsin 2007. O198066 A1 8, 2007 Greenberg et al. restores visual responses in mice with photoreceptor degeneration.” 2007/0261127 A1 11/2007 Boyden et al. Neuron, (Apr. 6, 2006), vol. 50, pp. 23-33. 2008, 0021515 A1 1, 2008 Horsager et al. Bomash I. et al., “A virtual retina that works on a broad array of 2008, OO86206 A1 4, 2008 Nasiatka et al. stimuli including natural scenes: A tool to simplify the problem of 2008, 0221653 A1 9, 2008 Agrawal et al. population coding.' 40th Annual Neuroscience Presentation, Soci 2008/0234.781 A1 9, 2008 Einav et al. ety for Neuroscience (2010) Program No. 891.5, 2 pages. 2008/0249588 A1 10, 2008 Greenberg et al. Bookstein, Robert et al., “Promoter deletion and loss of 2008/0294217 A1 11/2008 Lian et al. retinoblastoma gene expression in human prostate carcinoma, 2009 OO88399 A1 4, 2009 Balya et al. 2009/0105786 A1 4, 2009 Fetz et al. Proc. Natl. Acad. Sci. USA, (Oct. 1990), vol. 87, pp. 7762-7766. 2009/O118793 A1 5/2009 McClure et al. Busskamp, Volker et al., “Genetic reactivation of cone photorecep 2009/0118794 A1 5/2009 McClure et al. tors restores visual responses in retinitis pigmentosa,” Science, (Jul. 2009/0326623 A1 12, 2009 Greenberg et al. 2010), vol. 329, pp. 413-417. 2010, OO15095 A1 1, 2010 Pan et al. Cai, Xue et al., “Gene delivery to mitotic and postmitotic 2010, OO16732 A1 1, 2010 Wells et al. photoreceptors via compacted DNA nanoparticles results in 2010.0036,457 A1* 2, 2010 Sarpeshkar .......... GO9B 21,008 improved phenotype in a mouse model of retinitis pigmentosa, FASEB J., (Apr. 2010), vol. 24, pp. 1178-1191. US 9,547,804 B2 Page 3 (56) References Cited Technology Review. http://www.technologyreview.com/biomedi cine/23539/. Boston, MA: MIT (2009), 2 pages. OTHER PUBLICATIONS Greenberg, Kenneth P. et al., “Differential Targeting of Optical Neuromodulators to Ganglion Cell Soma and Dendrites Allows Campagnola, Luke et al., “Fiber-coupled light-emitting diode for Dynamic Control of Center-Surround Antagonism.” Neuron, (Feb. localized photostimulation of neurons expressing chan 2011), vol. 69, pp. 713-720. nelrhodopsin-2,” Journal of Neuroscience Methods, (2008), vol. Grinstead, Charles M. et al., “Introduction to Probability.” American 169, pp. 27-33. Mathematical Society, 2nd Revised Edition, Chapter 1 only,(1997), Cardin, Jesicca A. et al., “Targeted optogenetic stimulation and 7 pages. recording of neurons in vivo using cell-type-specific expression of Grossman, Nir et al., “Multi-site optical excitation using ChR2 and Channelrhodopsin-2,” Nat Protoc, (2010), vol. 5, No. 2, pp. 247 micro-LED array,” J.
Load more

Recommended publications
  • Vision-Based Positioning for Internet-Of-Vehicles Kuan-Wen Chen, Chun-Hsin Wang, Xiao Wei, Qiao Liang, Chu-Song Chen, Ming-Hsuan Yang, and Yi-Ping Hung
    http://ieeexplore.ieee.org/Xplore Vision-Based Positioning for Internet-of-Vehicles Kuan-Wen Chen, Chun-Hsin Wang, Xiao Wei, Qiao Liang, Chu-Song Chen, Ming-Hsuan Yang, and Yi-Ping Hung Abstract—This paper presents an algorithm for ego-positioning Structure by using a low-cost monocular camera for systems based on from moon the Internet-of-Vehicles (IoV). To reduce the computational and For local model memory requirements, as well as the communication load, we construc,on tackle the model compression task as a weighted k-cover problem for better preserving the critical structures. For real-world vision-based positioning applications, we consider the issue of large scene changes and introduce a model update algorithm to For image collec,on address this problem. A large positioning dataset containing data collected for more than a month, 106 sessions, and 14,275 images is constructed. Extensive experimental results show that sub- meter accuracy can be achieved by the proposed ego-positioning algorithm, which outperforms existing vision-based approaches. (a) Index Terms—Ego-positioning, model compression, model up- date, long-term positioning dataset. Download local 3D Upload newly scene model acquired images for model update I. INTRODUCTION NTELLIGENT transportation systems have been exten- I sively studied in the last decade to provide innovative and proactive services for traffic management and driving safety issues. Recent advances in driving assistance systems mostly For image matching provide stand-alone solutions to these issues by using sensors and posi1oning limited to the line of sight. However, many vehicle accidents occur because of other vehicles or objects obstructing the (b) view of the driver.
    [Show full text]
  • Artificial Intelligence in Health Care: the Hope, the Hype, the Promise, the Peril
    Artificial Intelligence in Health Care: The Hope, the Hype, the Promise, the Peril Michael Matheny, Sonoo Thadaney Israni, Mahnoor Ahmed, and Danielle Whicher, Editors WASHINGTON, DC NAM.EDU PREPUBLICATION COPY - Uncorrected Proofs NATIONAL ACADEMY OF MEDICINE • 500 Fifth Street, NW • WASHINGTON, DC 20001 NOTICE: This publication has undergone peer review according to procedures established by the National Academy of Medicine (NAM). Publication by the NAM worthy of public attention, but does not constitute endorsement of conclusions and recommendationssignifies that it is the by productthe NAM. of The a carefully views presented considered in processthis publication and is a contributionare those of individual contributors and do not represent formal consensus positions of the authors’ organizations; the NAM; or the National Academies of Sciences, Engineering, and Medicine. Library of Congress Cataloging-in-Publication Data to Come Copyright 2019 by the National Academy of Sciences. All rights reserved. Printed in the United States of America. Suggested citation: Matheny, M., S. Thadaney Israni, M. Ahmed, and D. Whicher, Editors. 2019. Artificial Intelligence in Health Care: The Hope, the Hype, the Promise, the Peril. NAM Special Publication. Washington, DC: National Academy of Medicine. PREPUBLICATION COPY - Uncorrected Proofs “Knowing is not enough; we must apply. Willing is not enough; we must do.” --GOETHE PREPUBLICATION COPY - Uncorrected Proofs ABOUT THE NATIONAL ACADEMY OF MEDICINE The National Academy of Medicine is one of three Academies constituting the Nation- al Academies of Sciences, Engineering, and Medicine (the National Academies). The Na- tional Academies provide independent, objective analysis and advice to the nation and conduct other activities to solve complex problems and inform public policy decisions.
    [Show full text]
  • Visual Prosthetics Wwwwwwwwwwwww Gislin Dagnelie Editor
    Visual Prosthetics wwwwwwwwwwwww Gislin Dagnelie Editor Visual Prosthetics Physiology, Bioengineering, Rehabilitation Editor Gislin Dagnelie Lions Vision Research & Rehabilitation Center Johns Hopkins University School of Medicine 550 N. Broadway, 6th floor Baltimore, MD 21205-2020 USA [email protected] ISBN 978-1-4419-0753-0 e-ISBN 978-1-4419-0754-7 DOI 10.1007/978-1-4419-0754-7 Springer New York Dordrecht Heidelberg London Library of Congress Control Number: 2011921400 © Springer Science+Business Media, LLC 2011 All rights reserved. This work may not be translated or copied in whole or in part without the written permission of the publisher (Springer Science+Business Media, LLC, 233 Spring Street, New York, NY 10013, USA), except for brief excerpts in connection with reviews or scholarly analysis. Use in connection with any form of information storage and retrieval, electronic adaptation, computer software, or by similar or dissimilar methodology now known or hereafter developed is forbidden. The use in this publication of trade names, trademarks, service marks, and similar terms, even if they are not identified as such, is not to be taken as an expression of opinion as to whether or not they are subject to proprietary rights. Printed on acid-free paper Springer is part of Springer Science+Business Media (www.springer.com) Preface Visual Prosthetics as a Multidisciplinary Challenge This is a book about the quest to realize a dream: the dream of restoring sight to the blind. A dream that may have been with humanity much longer than the idea that disabilities can be treated through technology – which itself is probably a very old idea.
    [Show full text]
  • Machine Vision for the Iot and I0.4
    International Journal of Management, Technology And Engineering ISSN NO : 2249-7455 MACHINE VISION FOR THE IOT AND I0.4 ROHIT KUMAR1, HARJOT SINGH GILL2 1Student, Department of Mechatronics Engineering Chandigarh University, Gharuan 2Assistant Professor, Department of Mechatronics Engineering Chandigarh University, Gharuan Abstract: Human have six sense and vision is one of the most used sense in the daily life. So here the concept if we have to replace the human by machine .We need the high quality sensor that can provid the real time vision for the machine . It also help to make control system. It can be used in industry very easily at different stages of manufacturing for preventive maintenance and fault diagnosis. Machine vision aslo help in industry to speed up inspection processes and reduces the wastage by preventing production quality. For instance, consider an arrangement of pictures demonstrating a tree influencing in the breeze on a splendid summer's day while a cloud moves over the sun changing the power and range of the enlightening light. For instance, consider an arrangement of pictures demonstrating a tree influencing in the breeze on a brilliant summer's day while a cloud moves over the sun adjusting the power and range of the enlightening light. Key words: Artificial Intelligence, Machine vision, Artificial neural network, , image processing. Introduction: The expanded utilization, consciousness of value, security has made a mindfulness for enhanced quality in customer items. The interest of client particular custom-misation, increment of rivalry has raised the need of cost decrease. This can be accomplished by expanding the nature of items, decreasing the wastage amid the generation, adaptability in customisation and quicker creation.
    [Show full text]
  • An Overview of Computer Vision
    U.S. Department of Commerce National Bureau of Standards NBSIR 82-2582 AN OVERVIEW OF COMPUTER VISION September 1982 f— QC Prepared for iuu National Aeronautics and Space . Ibo Administration Headquarters 61-2562 Washington, D.C. 20546 National Bureau ot Standard! OCT 8 1982 ftsVac.c-'s loo - 2% NBSIR 82-2582 AN OVERVIEW OF COMPUTER VISION William B. Gevarter* U.S. DEPARTMENT OF COMMERCE National Bureau of Standards National Engineering Laboratory Center for Manufacturing Engineering Industrial Systems Division Metrology Building, Room A127 Washington, DC 20234 September 1982 Prepared for: National Aeronautics and Space Administration Headquarters Washington, DC 20546 U.S. DEPARTMENT OF COMMERCE, Malcolm Baldrige, Secretary NATIONAL BUREAU OF STANDARDS, Ernest Ambler, Director * Research Associate at the National Bureau of Standards Sponsored by NASA Headquarters * •' ' J s rou . Preface Computer Vision * Computer Vision — visual perception employing computers — shares with "Expert Systems" the role of being one of the most popular topics in Artificial Intelligence today. Commercial vision systems have already begun to be used in manufacturing and robotic systems for inspection and guidance tasks. Other systems at various stages of development, are beginning to be employed in military, cartograhic and image inter pretat ion applications. This report reviews the basic approaches to such systems, the techniques utilized, applications, the current existing systems, the state-of-the-art of the technology, issues and research requirements, who is doing it and who is funding it, and finally, future trends and expectations. The computer vision field is multifaceted, having many participants with diverse viewpoints, with many papers having been written. However, the field is still in the early stages of development — organizing principles have not yet crystalized, and the associated technology has not yet been rationalized.
    [Show full text]
  • A Neuromorphic Approach for Tracking Using Dynamic Neural Fields on a Programmable Vision-Chip
    A Neuromorphic Approach for Tracking using Dynamic Neural Fields on a Programmable Vision-chip Julien N.P. Martel Yulia Sandamirskaya Institute of Neuroinformatics Institute of Neuroinformatics University of Zurich and ETH Zurich University of Zurich and ETH Zurich 8057 Zurich, Switzerland 8057 Zurich, Switzerland [email protected] [email protected] ABSTRACT DNF activation Saliency map In artificial vision applications, such as tracking, a large Frame amount of data captured by sensors is transferred to pro- Processor Array cessors to extract information relevant for the task at hand. Smart vision sensors offer a means to reduce the computa- Lens tional burden of visual processing pipelines by placing more processing capabilities next to the sensor. In this work, we use a vision-chip in which a small processor with memory is located next to each photosensitive element. The architec- Scene ture of this device is optimized to perform local operations. To perform a task like tracking, we implement a neuromor- phic approach using a Dynamic Neural Field, which allows to segregate, memorize, and track objects. Our system, con- sisting of the vision-chip running the DNF, outputs only the activity that corresponds to the tracked objects. These out- Cellular Processor Array Vision-chip puts reduce the bandwidth needed to transfer information as well as further post-processing, since computation happens Figure 1: An illustration of the system implemented at the pixel level. in this work: A vision-chip is directed at a scene and captures a stream of images processed on-chip CCS Concepts in a saliency map. This map is fed as an input to a •Computing methodologies ! Object detection; Track- Dynamic Neural Field (DNF), also run on-chip and ing; Massively parallel and high-performance simulations; used for tracking objects.
    [Show full text]
  • AI: What It Is, and Should You Use It
    AI: What it is, and should you use it AI: What it is, and should you use it In this E-Guide: The hype surrounding artificial intelligence (AI) and all its potential applications is seemingly unending—but, could it really as powerful as people say it is? AI (artificial intelligence) Keep reading to discover what AI is by definition, why it’s becoming a hot commodity for contact centers, and the pros and cons of implementing it for yourself. 5 trends driving AI in contact centers The pros and cons of customer service AI Page 1 of 21 SPONSORED BY AI: What it is, and should you use it AI (artificial intelligence) Margaret Rouse, WhatIs.com Artificial intelligence (AI) is the simulation of human intelligence processes by machines, especially computer systems. These processes include learning (the acquisition of AI (artificial information and rules for using the information), reasoning (using rules to reach approximate intelligence) or definite conclusions) and self-correction. Particular applications of AI include expert systems, speech recognition and machine vision. 5 trends driving AI in contact centers AI can be categorized as either weak or strong. Weak AI, also known as narrow AI, is an AI system that is designed and trained for a particular task. Virtual personal assistants, such as The pros and cons of Apple's Siri, are a form of weak AI. Strong AI, also known as artificial general intelligence, is customer service AI an AI system with generalized human cognitive abilities. When presented with an unfamiliar task, a strong AI system is able to find a solution without human intervention.
    [Show full text]
  • Neural Network Based Fault Detection on Painted Surface
    UMEÅ UNIVERSITY MASTER THESIS Neural network based fault detection on painted surface Author: Midhumol Augustian A thesis submitted in partial fulfillment of the requirements for the degree of Masters in Robotics and Control Engineering Department of Applied Physics and Electronics Umeå University 2017 iii Declaration of Authorship I, Midhumol Augustian, declare that this thesis titled, “Neural network based fault detection on painted surface ” and the work presented in it are my own. I confirm that: • This work was done wholly while in candidature for a Masters degree in Robotics and control Engineering at Umeå University. • Where I have consulted the published work of others, this is always clearly attributed. • Where I have quoted from the work of others, the source is always given. With the exception of such quotations, this thesis is entirely my own work. • I have acknowledged all main sources of help. • Where the thesis is based on work done by myself jointly with others, I have made clear exactly what was done by others and what I have contributed myself. Signed: Date: v Abstract Machine vision systems combined with classification algorithms are being in- creasingly used for different applications in the age of automation. One such application would be the quality control of the painted automobile parts. The fundamental elements of the machine vision system include camera, illumi- nation, image acquisition software and computer vision algorithms. Tradi- tional way of thinking puts too much importance on camera systems and ig- nores other elements while designing a machine vision system. In this thesis work, it is shown that selecting an appropriate illumination for illuminating the surface being examined is equally important in case of machine vision system for examining specular surface.
    [Show full text]
  • Vision, Brain and Assistive Technologies Rationale Course
    Vision, Brain and Assistive Technologies Rationale Based on the World Health Organization 2012 Report, there are more than 285 million visually impaired people, of which 39 million are blind. About 65% of all people who are visually impaired are aged 50 and older, while this age group comprises about 20% of the world's population. With an in- creasing elderly population in many countries, more people will be at risk of age-related visual impairment. Research on multimodal and alternative perception will have a long term impact on the health and wellness of soci- ety, not only for the visually challenged, but for people who often work in dangerous environments, such as firefighters, drivers and soldiers. Course Description This course will discuss modern vision science and explore how the brain sees the world, thus including introductory on computational neuroscience, mo- tion, color and several other topics. Then the basics of computer vision will be introduced, for both preprocessing and 3D computer vision. Finally, we will discuss the needs and state-of-art in sensing, processing and stimulation for assisting visually challenged people (blind and visually impaired people) using advanced technologies in machine vision, robotics, displays, materials, portable devices and infrastructure. The course will be offered as an interdisciplinary seminar course, in which a few lectures will be provided from the recommended textbook on human vision as well as the lecture notes of the instructor on computer vision, and then students from mathematics, physics, electrical engineering, computer science and psychology and other social sciences will be assigned to read, present and discuss materials in vision, brain, computing and devices for assisting the visually impaired.
    [Show full text]
  • Machine Vision and Industrial Automation Accelerating Adoption in Industrial Automation Jayavardhana Gubbi Jayavardhana P Balamuralidhar
    Machine Vision and Industrial Automation Accelerating Adoption in Industrial Automation Jayavardhana Gubbi Jayavardhana P Balamuralidhar Machine vision has harnessed deep learning admirably. Disruptive solutions are in the market for security and surveillance, autonomous vehicles, industrial inspection, digital twins, and augmented reality (AR). However, historically, data acquisition within computer vision has been hamstrung by manual interpretation of captured image data. Fortunately though, deep learning has generated data-driven models that could replace handcrafted preprocessing and feature extraction superbly. IN BRIEF The future has already arrived. TCS has, for instance, not only delivered revolutionary deep learning-powered machine vision solutions, but is also using advanced software algorithms to design industry-grade spatial cognition-enabled computer vision applications. A field established in the 1960s, Machine vision today it’s only in the past 30 months or so that the machine vision Key technological developments in industry has harnessed deep miniaturized cameras, embedded learning—with extremely devices, and machine learning good results. Poised where AI, have historically enabled adoption imaging sensors, and image of machine vision in a multitude processing meet, machine vision of applications—satellite image is now making a massive impact in analysis and medical image industrial applications. interpretation, among others— across diverse domains. This has brought disruptive industry-grade solutions to the But the game-changer today is market. Table 11 sets out the key the power and affordability of industry sectors in which computer computing devices, including vision has made inroads. the advent of digital and mobile cameras. This has resulted in image The key application trends processing spreading to other bringing machine vision to the fore areas and making humongous include security and surveillance, volumes of real (as against autonomous vehicles, industrial synthetic) visual data available inspection, digital twins, and AR.
    [Show full text]
  • Improving Perception from Electronic Visual Prostheses
    Improving Perception from Electronic Visual Prostheses Justin Robert Boyle BEng (Mech) Hons1 Image and Video Research Laboratory School of Engineering Systems Queensland University of Technology Submitted as a requirement for the degree of Doctor of Philosophy February 2005 Keywords image processing, visual prostheses, bionic eye, artificial human vision, visual perception, subjective testing, visual information ii Abstract This thesis explores methods for enhancing digital image-like sensations which might be similar to those experienced by blind users of electronic visual prostheses. Visual prostheses, otherwise referred to as artificial vision systems or bionic eyes, may operate at ultra low image quality and information levels as opposed to more common electronic displays such as televisions, for which our expectations of image quality are much higher. The scope of the research is limited to enhancement by digital image processing: that is, by manipulating the content of images presented to the user. The work was undertaken to improve the effectiveness of visual prostheses in representing the visible world. Presently visual prosthesis development is limited to animal models in Australia and prototype human trials overseas. Consequently this thesis deals with simulated vision experiments using normally sighted viewers. The experiments involve an original application of existing image processing techniques to the field of low quality vision anticipated from visual prostheses. Resulting from this work are firstly recommendations for effective image processing methods for enhancing viewer perception when using visual prosthesis prototypes. Although limited to low quality images, recognition of some objects can still be achieved, and it is useful for a viewer to be presented with several variations of the image representing different processing methods.
    [Show full text]
  • Genie Nano Series™ Camera User’S Manual 1 Gb Gige Vision – Monochrome & Color Area Scan
    Genie Nano Series™ Camera User’s Manual 1 Gb GigE Vision – Monochrome & Color Area Scan sensors | cameras | frame grabbers | processors | software | vision solutions February 12, 2021 Rev: 0024 P/N: G3-G00M-USR00 www.teledynedalsa.com Notice © 2015-2020 Teledyne Digital Imaging Inc. All information provided in this manual is believed to be accurate and reliable. No responsibility is assumed by Teledyne DALSA for its use. Teledyne DALSA reserves the right to make changes to this information without notice. Reproduction of this manual in whole or in part, by any means, is prohibited without prior permission having been obtained from Teledyne DALSA. Microsoft and Windows are registered trademarks of Microsoft Corporation in the United States and other countries. Windows, Windows 7, Windows 10 are trademarks of Microsoft Corporation. All other trademarks or intellectual property mentioned herein belong to their respective owners. Document Date: February 12, 2021 Document Number: G3-G00M-USR00 About Teledyne DALSA, a business unit of Teledyne Digital Imaging Inc. Teledyne DALSA is an international high performance semiconductor and Electronics Company that designs, develops, manufactures, and markets digital imaging products and solutions, in addition to providing wafer foundry services. Teledyne DALSA Digital Imaging offers the widest range of machine vision components in the world. From industry-leading image sensors through powerful and sophisticated cameras, frame grabbers, vision processors and software to easy-to-use vision appliances and custom vision modules. This document does not contain information whose export/transfer/disclosure is restricted by the Canadian Export Control regulation. Contents GENIE NANO SERIES OVERVIEW _________________________________ 1 DESCRIPTION .............................................................................................. 1 GigE with TurboDrive ...........................................................................
    [Show full text]