Signal Processing, 3(2), April 2009

Total Page:16

File Type:pdf, Size:1020Kb

Signal Processing, 3(2), April 2009 The Asia-Pacific Signal and Information Processing Association (APSIPA) Distinguished Lecture 2012 Human-vision Friendly Processing fIfor Images an dGhid Graphics Weisi Lin Email: [email protected] . sg School of Computer Engineering Nanyang Technological University Singapore Presentation at National Sun Yat-Sen University, 20 April 2012 • Introduction ialial • Relevant ppyhysiolog ical & ppysycholog ical rrrr phenomena utouto • Basic Computational Modules T TTT • Perceptual Visual Processing & Applications e of e of • Concluding Remarks, Further Discussion & nnn n Possible Future Work utliutli • List of Most Relevant References (for further OOO O reading) 2 3 Current Problem in Visual Processing System Design The Human Visual System (HVS): the ultimate receiver of most processed images, video, and graphics Gap in most systems: tthtarget: human consumpti ti/on/appreci itiation technical design: non-perceptual criteria Perceptual modeling: user-oriented performance booster 4 Traditional Signal Quality Definitions & Measures • MSE (Mean Square Error) •SNR (Signal Noise Ratio) • PSNR (Peak SNR) • QoS (Quality of Service) • or their relatives 5 Possibilities of Perceptual Evaluation • Subjective viewing tests – ITU BT 500 standard, etc. – MOS (mean opinion score) – Shortcomings • Expensive, time consuming • No t su itabl e for au toma tic in-loop processing e.g., encoding, transmission, relaying, etc. • Not always reliable depending on viewers' physical conditions, emotional states, personalidilttl experience, display context • Objective visual quality metrics (VQMs) – MOS prediction – HVS mo de ling • physiology • psychophysics – Difficulties • inadequate understanding of the HVS • difficulty in modeling • computational complexity 6 Perceptual Modeling sensory perceptual emotional domain- specific non-perceptual models perceptual models application-specific perceptual models performance, difficulty, complexity application scopes Core models Enhanced models 7 8 • Introduction ialial • Relevant ppyhysiolog ical & ppysycholog ical rrrr phenomena utouto • Basic Computational Modules T TTT • Perceptual Visual Processing & Applications e of e of • Concluding Remarks, Further Discussion & nnn n Possible Future Work utliutli • List of Most Relevant References (for further OOO O reading) 9 Which square is brighter, A or B? 10 Adelson’s “Checker-shadow illusion” http://web.mit.edu/persci/people/adelson/checkershadow_ illusion.html 11 Visua l P at hways (lateral geniculate nucleus) 12 Human Eyes 13 The HVS: Specialized Processes & Information Differentiation • Cones – fovea on the retina – color vision • S-cones: blue • M-cones: green • L-cones: red – high visual acuity 14 The HVS: Specialized Processes & Information Differentiation (cont’d) • two pathways from the retina to the primary visual cortex (V1) – Magnocellular pathway • majority of the nerve fibres • thin fibres • slow in info transfer • all color and contrast info – Pavocellular pathway • thick fibres • fast in information transfer • all transient, motion related info • not responsive to chromatic info 15 The HVS: Specialized Processes & Information Differentiation (cont’d) • The visual cortex (V1~V4) distinguish – orientation –form – color – motion 16 Eye Movement – spontaneous smooth-pursuit eye movement (SPEM) • tend to track moving objects •reduce t he ret ilinal vel liocity of fi image – other eye movement • natural drift movement – responsible for perception of static images – very slow (0.8–1.5 deg/s) • saccadic movemen t – responsible for rapidly moving objects 17 Visual Attention • Selectivity – selective awareness of the sensory environment – selective responsiveness to visual stimuli • Two types – bottom-up: external stimuli – top-down: task related • Three stages for bottom-up process – pre-attentive • No capacity limitation • all the information can be processed (color, orientation, motion, curvature, size, depth, luster, shape) – Attention • feature integration • competition – Post-attention • improved search efficiency 18 Psychophysical Experiments Weber-Fechner law Contrast Sensitivity Function (CSF) sine-wave gratings DCT bas is funct ions Kelly’ 79 ,83 19 Contrast masking: relationship between maskee and masker dependency on orientations Legge’80 CT: maskee contrast CM: masker contrast facilitation The c hange o f con trast masking with maskee’s frequency 20 • Introduction ialial • Relevant ppyhysiolog ical & ppysycholog ical rrrr phenomena utouto • Basic Computational Modules T TTT • Signal Decomposition e of e of • Just-noticeable Difference (JND) nnn n • Modeling Visual Attention (VA) utliutli • Perceptual Visual Processing & Applications OOO O • Concluding Remarks, Further Discussion & Possible Future Work • List ofMf Most RlRelevant RfReferences (for furt her reading) 21 Temporal Decomposition • Physiological evidence – two main visual pathways – visual cortex • Signal decomposition – Implemented as FIR/IIR filters • sustained (low-pass) channel • transient (band-pass) channel Coefficients for the sustained and transient 9 -tap FIR filters 22 Spatial Decomposition Simoncelli et al.’92 – Filters Gabor, Cortex, wavelets Gaussian/sterrable pyramid – Stimuli : ori ent ati ons, f requenci es 23 Just-noticeable Difference (JND) • JND: the visibility threshold below which any change cannot be detected by the HVS – e.g.,75% of the subjects • difference: not necessarily distortion better not to say “just-noticeable distortion” – Edge enhancement – Removal of flickers – Post-processing • explicit model is helpful • 2 JNDs, 3 JNDs, …can be also determined 24 JND in DCT Subbands GlfliDCTbbdGeneral formula in DCT subbands: n: DCT block index iji,j: DCT subband where : base threshold due to spatial CSF : eltilevation paramet tdtlier due to luminance adaptation, intra-band masking, and inter-band masking, etc. 25 Modeling Spatial CSF parabola equation (Ahumada & Peterson’92): T: visibility threshold due to spatial CSF f: spatial frequency vertex location: threshold at fp: (Van Nes & Bouman’67) Tmin L: the lumnance other parameters: 26 Luminance Adaptation • a simplified model with Weber-Fechner law (Wa tson’93) 0.649 αlum(n) ~ c (n,0,0) where c(n, 0, 0): DC coefficient of the block •more realisti c mod eli ng Jayant & Safranek’93, Chou & Li’95 25 20 15 10 threshold 5 0 0 50 100 150 200 250 grey-level 27 Contrast Masking • Intra-bdband Mas king (Watson’93, Hontsch & Karam’02) where 0<ζ<1 28 Contrast Masking (cont’d) • Inter-band Masking (Tong&Venetsanopoulos’98) Emh(n): energy in MF and HF 29 JND with Pixels Yang, et al .’05 luminance adaptation overlapping effect texture masking 25 20 dd 15 ~ gradient 10 threshol measure: 5 0 0 50 100 150 200 250 grey-level 30 Temporal Masking Effect (Chou & Chen’96) average inter-frame luminance difference increase of maskinggg effect with increase in interframe changes 31 Eye movement model (Da ly’01) retiliinal image vel liocity: v()(n,t)=vI()(n,t)-vE()(n,t) image plane object velocity in retina eye movement velocity if no eye motion were involved 32 Modeling Visual Attention (VA) The VA -- • a result of the million years’ evolution • foveainretinafovea in retina • eye movement Therefore, the HVS-- • seltilective sensor • with limited source - “processing power” - “internal memory” 33 Auto-generation of visual attention map motion face-eye skin color contrast texture Lu, et al, ’05, IEEE T-IP 34 In line with eye tracking Correspondence with fMRI Lee, et al.’07 Overa ll visua l sensit iv ity --modulation of JND by VA --both local & global features various eye trackers 35 Alternative approach to detect bottom-up VA For an image I(x; y), Fourier Transform VA: (Hou & Zhangg)’07) 36 Influence from audio/speech • Integration of “aural attention” • Multimedia: correlation & interaction of difference media • More often than not , presented simultaneously • Examples in joint modelling – Ma, et. al. ’05 – You, et. al. ’07 37 • Introduction ialial • Relevant ppyhysiolog ical & ppysycholog ical rrrr phenomena utouto • Basic Computational Modules T TTT • Perceptual Visual Processing & Applications e of e of • Concluding Remarks, Further Discussion & nnn n Possible Future Work utliutli • List of Most Relevant References (for further OOO O reading) 38 Visual Quality Gauge 1 XY MAE = ∑∑ Δd(x, y) XY xy−=11 a traditional metric fails 1 XY MSE = ∑∑ MAE 2 XY x−11y= A2 PSNR = 10lg MSE major reasons for failure: is noticeable local characteristics not every Δ d ( x , y ) results in distortion receives same attention global characteristics 39 Noti ceabl e Con tr ast C h an ges ⎧ 0 if I(x, y) − I(x, y) ≤ jnd(x, y) ⎪ c(x, y) = ⎨ I(x, y) − I(x, y) ⎪ otherwise ⎩⎪ jnd(x, y) I(x, y) is calculated in a image neighborhood 40 New Visual Quality Metric • Discrimination of c((,y)x,y) + c ne: c increase at non-edge pixels—degradation - c ne: c decrease at non-edge pixels—degradation + c e: c increase at edge —enhancement c-e: c decrease at edge contrast—the worst degradation − + − + D = α1c ne + α 2c ne + α 3c e − α 4c e where α 3 > max(α1 ,α 2 ) >α 4 >0 Lin, et al.’05 • D reduces to the mean absolute error (MAE) measure, if – JND is constant – different contrast changes are not differentiated 41 “…to tell a good picture from a good one…” •Database with demosaiced image •50 images •1524x1012 scenes •9 subjects Better quality than the original image (Longere, et al.’02) (new metric) (due to edge sharpening) 42 Further Test Results Pearson correlation (for accuracy) (with VQEG-I Data) •320 comppqressed video sequences •Both PAL and NTSC format •Different codecs •768
Recommended publications
  • The Role of One-Shot Learning in #Thedress
    Journal of Vision (2017) 17(3):15, 1–7 1 The role of one-shot learning in #TheDress Laboratory of Psychophysics, Brain Mind Institute, Ecole´ Polytechnique Fed´ erale´ de Lausanne (EPFL), Leila Drissi Daoudi Lausanne, Switzerland $ Laboratory of Psychophysics, Brain Mind Institute, Ecole´ Polytechnique Fed´ erale´ de Lausanne (EPFL), Adrien Doerig Lausanne, Switzerland $ Institute of Cognitive Neurosciences, Khatuna Parkosadze Agricultural University of Georgia, Tbilisi, Georgia $ Institute of Cognitive Neurosciences, Marina Kunchulia Agricultural University of Georgia, Tbilisi, Georgia $ Laboratory of Psychophysics, Brain Mind Institute, Ecole´ Polytechnique Fed´ erale´ de Lausanne (EPFL), Michael H. Herzog Lausanne, Switzerland $ #TheDress is remarkable in two aspects. First, there is a dress are black and blue. Although the differences in bimodal split of the population in the perception of the the perceived and true colors are striking, apparent dress’s colors (white/gold vs. black/blue). Second, changes in color are common in many illusions, such as whereas interobserver variance is high, intra-observer the checker shadow illusion (Adelson, 1995). These variance is low, i.e., the percept rarely switches in a given illusions are usually explained in terms of color individual. There are two plausible routes of explanations: constancy, where the luminance of the context plays the either one-shot learning during the first presentation of the image splits observers into two different, stable crucial role. Also in #TheDress, color constancy plays populations, or the differences are caused by stable traits an important role (Brainard & Hurlbert, 2015; Ge- of observers, such as different visual systems. Here, we genfurtner, Bloj, & Toscani, 2015; Winkler, Spillmann, hid large parts of the image by white occluders.
    [Show full text]
  • Uncertainty and Decision-Making in the Human Brain
    UNCERTAINTY AND DECISION-MAKING IN THE HUMAN BRAIN Iris M. D. Vilares Dissertation presented to obtain the Ph.D degree in Biology | Neuroscience Instituto de Tecnologia Química e Biológica | Universidade Nova de Lisboa Research work coordinated by: Oeiras, December, 2013 ii To my family iii iv APOIO FINANCEIRO/FINANCIAL SUPPORT Apoio financeiro da FCT e do FSE no âmbito do Quadro Comunitário de Apoio, bolsa de doutoramento n° SFRH/BD/33272/2007. O ultimo ano foi financiado pelo National Institute of Health, bolsa n° 2P01NS044393. Financial support for this thesis was provided by FCT and FSE through the Quadro Comunitário de Apoio, doctoral fellowship n° SFRH/BD/33272/2007. The last year was provided by the National Institute of Health, grant n° 2P01NS044393. v vi ACKNOWLEDGEMENTS Many people have helped me through this path, and I am immensely grateful to all of them. I would like to thank: My supervisor, Dr. Konrad Kording. Thank you for being an amazing supervisor, for always being there to help me. You developed in me a love for science and always believed in my scientific skills, sometimes even more than myself. Thank you for your guidance and support at all times. For always feeling welcomed to go to you for any question, be it scientific or not. Thank you for an incredible mentorship. You are my scientific role model. My internal supervisor, Dr. Rui Costa. Thank you for your enthusiasm and support at all times. Thank you for all the help you gave me in taking care of bureaucracy, especially this past month, when almost every day I was sending you an email.
    [Show full text]
  • UC Berkeley UC Berkeley Electronic Theses and Dissertations
    UC Berkeley UC Berkeley Electronic Theses and Dissertations Title Light, Nearwork, and Visual Environment Risk Factors in Myopia Permalink https://escholarship.org/uc/item/1bj5m20w Author Alvarez, Amanda Aleksandra Publication Date 2012 Peer reviewed|Thesis/dissertation eScholarship.org Powered by the California Digital Library University of California Light, Nearwork, and Visual Environment Risk Factors in Myopia By Amanda Aleksandra Alvarez A dissertation submitted in partial satisfaction of the requirements for the degree of Doctor of Philosophy in Vision Science in the Graduate Division of the University of California, Berkeley Committee in charge: Professor Christine F. Wildsoet, Chair Professor Austin Roorda Professor Ruzena Bajcsy Fall 2012 Light, Nearwork, and Visual Environment Risk Factors in Myopia Copyright © 2012 by Amanda Aleksandra Alvarez Abstract Light, Nearwork, and Visual Environment Risk Factors in Myopia By Amanda Aleksandra Alvarez Doctor of Philosophy in Vision Science University of California, Berkeley Professor Christine F. Wildsoet, Chair Myopia, or nearsightedness, is a form of visual impairment in which distant objects appear blurry due to excessive axial eye growth that is mismatched to the eye’s refractive power. This condition, though treatable with spectacles, contact lenses, or refractive surgery, continues to increase in prevalence, particularly in some Asian countries, where up to 80-90% of young people and students are myopic. High myopia (< -6.00 D) is associated with greater risk of glaucoma, retinal detachment, and other blinding complications. Myopia is a complex disease with both genetic and environmental components. Rising myopia prevalence rates have mirrored lifestyle shifts that include reduced outdoor and light exposure. The directionality and impact of environmental risk factors, particularly light exposure, on myopia, continue to be poorly understood, partly due to the lack of in vivo and realtime instruments for measuring these effects.
    [Show full text]
  • Optical Illusions and Effects on Clothing Design1
    International Journal of Science Culture and Sport (IntJSCS) June 2015 : 3(2) ISSN : 2148-1148 Doi : 10.14486/IJSCS272 Optical Illusions and Effects on Clothing Design1 Saliha AĞAÇ*, Menekşe SAKARYA** * Associate Prof., Gazi University, Ankara, TURKEY, Email: [email protected] ** Niğde University, Niğde, TURKEY, Email: [email protected] Abstract “Visual perception” is in the first ranking between the types of perception. Gestalt Theory of the major psychological theories are used in how visual perception realizes and making sense of what is effective in this process. In perception stage brain takes into account not only stimulus from eyes but also expectations arising from previous experience and interpreted the stimulus which are not exist in the real world as if they were there. Misperception interpretations that brain revealed are called as “Perception Illusion” or “Optical Illusion” in psychology. Optical illusion formats come into existence due to factors such as brightness, contrast, motion, geometry and perspective, interpretation of three-dimensional images, cognitive status and color. Optical illusions have impacts of different disciplines within the study area on people. Among the most important types of known optical illusion are Oppel-Kundt, Curvature-Hering, Helzholtz Sqaure, Hermann Grid, Muller-Lyler, Ebbinghaus and Ponzo illusion etc. In fact, all the optical illusions are known to be used in numerous area with various techniques and different product groups like architecture, fine arts, textiles and fashion design from of old. In recent years, optical illusion types are frequently used especially within the field of fashion design in the clothing model, in style, silhouette and fabrics. The aim of this study is to examine the clothing design applications where optical illusion is used and works done in this subject.
    [Show full text]
  • CS 543 / ECE 549 – Saurabh Gupta Spring 2021, UIUC
    Color CS 543 / ECE 549 – Saurabh Gupta Spring 2021, UIUC http://saurabhg.web.illinois.edu/teaching/ece549/sp2021/ Many slides adapted from S. Seitz, L. Lazebnik, J. Hayes, S. Palmer While we wait, what color is the dress? Today, • Light & Shading • Color • Dynamic Perspective • A. White and gold • B. Blue and Black • C. Other (use chat) https://www.wired.com/2015/02/science-one-agrees-color-dress/ Slide by L. Lazebnik What is color? • Color is the result of interaction between physical light in the environment and our visual system • Color is a psychological property of our visual experiences when we look at objects and lights, not a physical property of those objects or lights (S. Palmer, Vision Science: Photons to Phenomenology) Slide by L. Lazebnik Outline • Physical origin of color • Spectra of sources and surfaces • Physiology of color vision • Trichromatic color theory • Color spaces • Color constancy, white balance Electromagnetic spectrum Human Luminance Sensitivity Function Slide by L. Lazebnik The Physics of Light Any source of light can be completely described physically by its spectrum: the amount of energy emitted (per time unit) at each wavelength 400 - 700 nm. Relative # Photonsspectral (per powerms.) 400 500 600 700 Wavelength (nm.) © Stephen E. Palmer, 2002 Spectra of Light Sources Some examples of the spectra of light sources . A. Ruby Laser B. Gallium Phosphide Crystal # Photons # Photons Rel. power Rel. power 400 500 600 700 400 500 600 700 Wavelength (nm.) Wavelength (nm.) C. Tungsten Lightbulb D. Normal Daylight Rel. power # Photons # Photons Rel. power 400 500 600 700 400 500 600 700 © Stephen E.
    [Show full text]
  • The Neuroscience of Optical Illusions, Explained - Vox 6/22/20, 10:04 AM “Reality” Is Constructed by Your Brain
    The neuroscience of optical illusions, explained - Vox 6/22/20, 10:04 AM “Reality” is constructed by your brain. Here’s what that means, and why it matters. What the science of visual illusions can teach us about our polarized world. Brian Resnick Jun 22, 2020, 8:30am EDT https://www.vox.com/science-and-health/20978285/optical-illusion-science-humility-reality-polarization Page 1 of 20 The neuroscience of optical illusions, explained - Vox 6/22/20, 10:04 AM “It’s really important to understand we’re not seeing reality,” says neuroscientist Patrick Cavanagh. “We’re seeing a story that’s being created for us.” Photo Illustration by Zac Freeland/Vox; Akiyoshi Kitaoka Fix your gaze on the black dot on the left side of this image. But wait! Finish reading this paragraph first. As you gaze at the left dot, try to answer this https://www.vox.com/science-and-health/20978285/optical-illusion-science-humility-reality-polarization Page 2 of 20 The neuroscience of optical illusions, explained - Vox 6/22/20, 10:04 AM question: In what direction is the object on the right moving? Is it drifting diagonally, or is it moving up and down? Remember, focus on the dot on the left. Courtesy of Patrick Cavanagh It appears as though the object on the right is moving diagonally, up to the right and then back down to the left. Right? Right?! Actually, it’s not. It’s moving up and down in a straight, vertical line. See for yourself. Trace it with your finger. This is a visual illusion.
    [Show full text]
  • Diapositivo 1
    VC 11/12 – T2 Image Formation Mestrado em Ciência de Computadores Mestrado Integrado em Engenharia de Redes e Sistemas Informáticos Miguel Tavares Coimbra Outline • „Computer Vision‟? • The Human Visual System • Image Capturing Systems Acknowledgements: Most of this course is based on the excellent courses offered by Prof. Shree Nayar at Columbia University, USA and by Prof. Srinivasa Narasimhan at CMU, USA. Please acknowledge the original source when reusing these slides for academic purposes. VC 11/12 - T2 - Image Formation Topic: Computer Vision? • „Computer Vision‟? • The Human Visual System • Image Capturing Systems VC 11/12 - T2 - Image Formation A Picture is Worth 1000 Words VC 11/12 - T2 - Image Formation A Picture is Worth 100.000 Words VC 11/12 - T2 - Image Formation A Picture is Worth a Million Words VC 11/12 - T2 - Image Formation A Picture is Worth a ...? Necker‟s Cube Reversal VC 11/12 - T2 - Image Formation A Picture is Worth a ...? Checker Shadow Illusion [E. H. Adelson] VC 11/12 - T2 - Image Formation A Picture is Worth a ...? Checker Shadow Illusion [E. H. Adelson] VC 11/12 - T2 - Image Formation Human Vision • Can do amazing things like: – Recognize people and objects – Navigate through obstacles – Understand mood in the scene – Imagine stories • But: – Suffers from Illusions – Ignores many details – Ambiguous description of the world – Doesn‟t care about accuracy of world VC 11/12 - T2 - Image Formation Digital Images What we see What a computer sees VC 11/12 - T2 - Image Formation Computer Vision “The goal of Computer
    [Show full text]
  • Chapter 6 Visual Perception
    Chapter 6 Visual Perception Steven M. LaValle University of Oulu Copyright Steven M. LaValle 2019 Available for downloading at http://vr.cs.uiuc.edu/ 154 S. M. LaValle: Virtual Reality Chapter 6 Visual Perception This chapter continues where Chapter 5 left off by transitioning from the phys- iology of human vision to perception. If we were computers, then this transition might seem like going from low-level hardware to higher-level software and algo- rithms. How do our brains interpret the world around us so effectively in spite of our limited biological hardware? To understand how we may be fooled by visual stimuli presented by a display, you must first understand how our we perceive or interpret the real world under normal circumstances. It is not always clear what we will perceive. We have already seen several optical illusions. VR itself can be Figure 6.1: This painting uses a monocular depth cue called a texture gradient to considered as a grand optical illusion. Under what conditions will it succeed or enhance depth perception: The bricks become smaller and thinner as the depth fail? increases. Other cues arise from perspective projection, including height in the vi- Section 6.1 covers perception of the distance of objects from our eyes, which sual field and retinal image size. (“Paris Street, Rainy Day,” Gustave Caillebotte, is also related to the perception of object scale. Section 6.2 explains how we 1877. Art Institute of Chicago.) perceive motion. An important part of this is the illusion of motion that we perceive from videos, which are merely a sequence of pictures.
    [Show full text]
  • 37Th European Conference on Visual Perception Belgrade, Serbia 24 – 28 August 2014
    Perception, 2014, volume 43, supplement, page 1 – 183 37th European Conference on Visual Perception Belgrade, Serbia 24 – 28 August 2014 Abstracts Sunday Talks: Visual Search 63 Invited Talk: Perception Lecture 1 Talks: Motion 65 Talks: Colour 67 Monday Talks: Biological Motion 69 Symposium: A celebration of the life 2 Posters: Face Perception II 71 and scientific work of Ian Howard Posters: Illusions II 77 Symposium: Advances in studying the 4 perception of surface properties Posters: Brain Mechanisms II 79 Talks: Attention 6 Posters: Attention II 82 Talks: Art and Vision 9 Posters: Perception and Action II 84 Talks: Eye Movements 11 Posters: Eye Movements II 86 Talks: Lightness 13 Posters: Colour and Illumination II 88 Posters: Face Perception I 15 Posters: Clinical II 90 Posters: Illusions I 20 Posters: Multisensory Processing II 91 Posters: Brain Mechanisms I 22 Posters: Sensory Development and 93 Aging II Posters: Attention I 25 Posters: Visual Search 94 Posters: Perception and Action I 27 Posters: Visual Memory 98 Posters: Eye Movements I 30 Posters: Biological Motion 102 Posters: Colour and Illumination I 32 Posters: Applications 105 Posters: Clinical I 33 Posters: Object Recognition and 107 Posters: Multisensory Processing I 35 Categorization Posters: Sensory Development and 37 Posters: Spatial Vision 109 Aging I Posters: Rivalry 111 Posters: Motion 39 Posters: Grouping Principles 43 Wednesday Posters: Depth, 3D, Stereo 47 Invited Talk: Rank Prize Lecture 113 Posters: Aftereffects 50 Symposium: Amodal completion: 113 Posters: Surface,
    [Show full text]
  • Ach and NE: Bayes, Uncertainty, Attention, and Learning
    ACh and NE: Bayes, Uncertainty, Attention, and Learning by Angela Jie Yu B.S. Brain & Cognitive Sci., B.S. Comp. Sci., B.S. Mathematics Massachusetts Institute of Technology 2000 Gatsby Computational Neuroscience Unit University College London 17 Queen Square London WC1N 3AR, United Kingdom THESIS Submitted for the degree of Doctor of Philosophy University of London 2005 2 Abstract Uncertainty in various forms plagues our interactions with the environment. In a Bayesian statistical framework, optimal inference and learning, based on im- perfect observation in changing contexts, require the representation and manip- ulation of different forms of uncertainty. We propose that the neuromodulatory systems such as acetylcholine (ACh) and norepinephrine (NE) play a major role in the brain's implementation of these uncertainty computations. ACh and NE have long been supposed to be critically involved in cognitive processes such as attention and learning. However, there has been little consensus on their precise computational functions. We propose that acetylcholine reports expected uncer- tainty; norepinephrine signals unexpected uncertainty. The interaction between these formally distinct sorts of uncertainty is suggested as playing a important role in mediating the interaction between top-down and bottom-up processing in inference and learning. The generative models we use to describe probabilistic relationships in the en- vironment belong to the class of noisy dynamical systems related to the Hidden Markov Model (HMM). At any given time point, the animal has uncertainty about the hidden state of the world that arises from two sources: the noisy relationship between the true state and imperfect sensory observations, and the inherent non- stationarity of these hidden states.
    [Show full text]
  • Copyright and Use of This Thesis This Thesis Must Be Used in Accordance with the Provisions of the Copyright Act 1968
    COPYRIGHT AND USE OF THIS THESIS This thesis must be used in accordance with the provisions of the Copyright Act 1968. Reproduction of material protected by copyright may be an infringement of copyright and copyright owners may be entitled to take legal action against persons who infringe their copyright. Section 51 (2) of the Copyright Act permits an authorized officer of a university library or archives to provide a copy (by communication or otherwise) of an unpublished thesis kept in the library or archives, to a person who satisfies the authorized officer that he or she requires the reproduction for the purposes of research or study. The Copyright Act grants the creator of a work a number of moral rights, specifically the right of attribution, the right against false attribution and the right of integrity. You may infringe the author’s moral rights if you: - fail to acknowledge the author of this thesis if you quote sections from the work - attribute this thesis to another author - subject this thesis to derogatory treatment which may prejudice the author’s reputation For further information contact the University’s Copyright Service. sydney.edu.au/copyright The Computation of Surface Lightness in Simple and Complex Scenes Alexandra C. Schmid School of Psychology The University of Sydney A thesis submitted in partial fulfilment of the requirements for the degree of Doctor of Philosophy (PhD) 2016 Declaration of Originality This thesis is submitted to the University of Sydney in fulfilment of the requirements for the Degree of Doctor of Philosophy. The work presented in this thesis is, to the best of my knowledge and belief, original except as acknowledged in the text.
    [Show full text]
  • Validation of Brief Cognitive Tests in Mild Cognitive Impairment, Alzheimer's Disease and Dementia with Lewy Bodies
    Validation of brief cognitive tests in mild cognitive impairment, Alzheimer's disease and dementia with Lewy bodies. Palmqvist, Sebastian 2011 Link to publication Citation for published version (APA): Palmqvist, S. (2011). Validation of brief cognitive tests in mild cognitive impairment, Alzheimer's disease and dementia with Lewy bodies. Clinical Memory Research Unit, Lund University. Total number of authors: 1 General rights Unless other specific re-use rights are stated the following general rights apply: Copyright and moral rights for the publications made accessible in the public portal are retained by the authors and/or other copyright owners and it is a condition of accessing publications that users recognise and abide by the legal requirements associated with these rights. • Users may download and print one copy of any publication from the public portal for the purpose of private study or research. • You may not further distribute the material or use it for any profit-making activity or commercial gain • You may freely distribute the URL identifying the publication in the public portal Read more about Creative commons licenses: https://creativecommons.org/licenses/ Take down policy If you believe that this document breaches copyright please contact us providing details, and we will remove access to the work immediately and investigate your claim. LUND UNIVERSITY PO Box 117 221 00 Lund +46 46-222 00 00 VALIDATION OF BRIEF COGNITIVE TESTS in mild cognitive impairment, Alzheimer’s disease and dementia with Lewy bodies Sebastian Palmqvist MD Clinical Memory Research Unit Department of Clinical Sciences, Malmö Faculty of Medicine Lund University Sweden Front cover: Drawings from two patients (right).
    [Show full text]