DOCSLIB.ORG

Learning Learning and Reinforcement Simple Learning Habituation and Sensitization Classical Conditioning Classical Conditioning

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Learning Learning and Reinforcement Simple Learning Habituation and Sensitization Classical Conditioning Classical Conditioning Learning Learning and reinforcement Learning A long-lasting change in behavior, or potential to change behavior, that results from experience Reinforcement Anything that affects the probability that a particular behavior will occur Simple learning Habituation and sensitization Aplysia Repeated presentation of stimulus chaffinch Habituation Sensitization Percent birds respondingbirds Percent Playbacks Eric Kandel Classical conditioning Classical conditioning Is there any adaptive significance of classical conditioning? food (US) salivation (UR) food (US) + tone (CS) salivation (UR) tone (CS) salivation (CR) Ivan Pavlov 1 Classical conditioning Classical conditioning ♂ ♀ blue gourami Karen Hollis Mount Holyoke Classical conditioning Classical conditioning How might classical conditioning work in nature? Courtship behavior by female (US) Courtship (UR) Courtship behavior by female (US) + sex-recognition cue (CS) Courtship (UR) Sex-recognition cue (CS) Courtship (CR) Japanese quail Heritability of conditioned response Gene × environment interactions Proboscis extension response conditioned to various odors Evidence of significant heritability Tryon Maze Dull and Bright rats Offspring score Offspring Parent score 2 Operant conditioning Laws of effect and exercise Thorndike Operant conditioning Operant conditioning Operant conditioning = association between Negative behavior and its consequences Positive reinforcement reinforcement Increase likelihood that behavior will occur B.F. Skinner Operant conditioning What factors affect conditioning? Response cost “Punishment” 1. Contiguity 2. Relevance Decrease likelihood that behavior will occur John Garcia 3 The “Garcia effect” The “Garcia effect” Practical applications of the Garcia effect Schedules of reinforcement Operant conditioning 1. Fixed (also continuous) 2. Variable 3. Ratio schedules 4. Interval schedules What produces the characteristic “scalloping” effect in the FI schedule? Operant conditioning Learning sets Trials 1-5 Block 1 A B A B A B A B A B Trials 1-5 Block 2 A B A B A B A B A B Why the “stair-step” pattern? Where should monkey look first? Now where should monkey look? rhesus macaque 4 Learning sets Latent learning Development of generalized Reinforcement not evident learning strategy Wisconsin general test apparatus Harry Harlow (1905-1981) Rhesus macaque Domestic cat Gray squirrel Percent correct Percent Number of problems solved Latent learning Latent learning Tinbergen observed beewolf’s circular flight as it departed burrow Wolfgang Kohler Insight learning Social learning Learning by applying Local enhancement: previous knowledge presence attracts others Social facilitation: presence facilitates learning 5 Social learning Social learning Two groups of cows conditioned to avoid larkspur by pairing with LiCl Copying versus imitation Reinforced in one group, extinct in the other Both paired with naïve cows Extinction cows Reinforcement cows Larkspur consumed Social learning Mate choice copying Mate choice copying in guppies Alternative explanations? focal A1: Focal female wants to ♀ ♀ ♀ school with groups of fish. ♀ model here or here Replaced end males with females, and focal female showed no Focal female chose male preference for 2 fish vs. 1 fish focal near model 17 of 20 times ♂ ♀ ♀ ♀ ♂ (10 of 20 trials) model here or here Mate choice copying Social learning Alternative explanations? Classic example in humans = Bandura’s “Bobo” experiments new focal A1: Focal female cues on behavior or physiological ♂ ♀ ♂ changes of chosen male. Removed focal and model female, replaced with new female. She had Why copy mate choice of others? no preference for primed male. May allow less discriminating, younger animals to make better choices 6 Social learning Teaching Can be vertical or horizontal A working definition of teaching Sex differences in tool-use imitation in chimpanzees Tandem running in Temnothorax ants Teaching Teaching prey capture Meerkats present toxic prey to young R = distance of antennal reach Teaching prey capture Groups with young pups Experimental playback of pup begging calls Groups with old pups 7 .
Load more

Recommended publications
  • Eric Kandel Form in Which This Information Is Stored
    RESEARCH I NEWS pendent, this system would be expected to [2] HEEsch and J E Bums. Distance estimation work quite well, since the new recruit bees by foraging honeybees, The Journal ofExperi­ mental Biology, Vo1.199, pp. 155-162, 1996. tend to take the same route as the experi­ [3] M V Srinivasan, S W Zhang, M Lehrer, and T enced scout bee. What dOJhe ants do when S Collett, Honeybee Navigation en route to they cover similarly several kilometres on the goal: Visual flight control and odometry, foot to look for food? Preliminary evidence The Journal ofExperimental Biology, Vol. 199, pp. 237-244, 1996. indicates that they don't use an odometer but [4] M V Srinivasan, S W Zhang, M Altwein, and instead might count steps! J Tautz, Honeybee Navigation: Nature and Calibration of the Odometer, Science, Vol. Suggested Reading 287, pp. 851-853, 1996. [1] Karl von Frisch, The dance language and OT­ Moushumi Sen Sarma, Centre for Ecological Sci­ ientation of bees, Harvard Univ. Press, Cam­ ences, Indian Institute of Science, Bangalore 560012, bridge, MA, USA, 1993. India. Email: [email protected] Learning from a Sea Snail: modify future behaviour, then memory is the Eric Kandel form in which this information is stored. Together, they represent one of the most valuable and powerful adaptations ever to Rohini Balakrishnan have evolved in nervous systems, for they In the year 2000, Eric Kandel shared the allow the future to access the past, conferring Nobel Prize in Physiology and Medicinel flexibility to behaviour and improving the with two other neurobiologists: Arvid chances of survival in unpredictable, rapidly Carlsson and Paul Greengard.
    [Show full text]
  • Gabab Regulation of Methamphetamine-Induced Associative Learning
    Loyola University Chicago Loyola eCommons Dissertations Theses and Dissertations 2010 Gabab Regulation of Methamphetamine-Induced Associative Learning Robin Michelle Voigt Loyola University Chicago Follow this and additional works at: https://ecommons.luc.edu/luc_diss Part of the Pharmacology Commons Recommended Citation Voigt, Robin Michelle, "Gabab Regulation of Methamphetamine-Induced Associative Learning" (2010). Dissertations. 38. https://ecommons.luc.edu/luc_diss/38 This Dissertation is brought to you for free and open access by the Theses and Dissertations at Loyola eCommons. It has been accepted for inclusion in Dissertations by an authorized administrator of Loyola eCommons. For more information, please contact [email protected]. This work is licensed under a Creative Commons Attribution-Noncommercial-No Derivative Works 3.0 License. Copyright © 2010 Robin Michelle Voigt LOYOLA UNIVERSITY CHICAGO GABAB REGULATION OF METHAMPHETAMINE-INDUCED ASSOCIATIVE LEARNING A DISSERTATION SUBMITTED TO THE FACULTY OF THE GRADUATE SCHOOL IN CANDIDACY FOR THE DEGREE OF DOCTOR OF PHILOSOPHY PROGRAM IN MOLECULAR PHARMACOLOGY & THERAPEUTICS BY ROBIN MICHELLE VOIGT CHICAGO, IL DECEMBER 2010 Copyright by Robin Michelle Voigt, 2010 All rights reserved ACKNOWLEDGEMENTS Without the support of so many generous and wonderful individuals I would not have been able to be where I am today. First, I would like to thank my Mother for her belief that I could accomplish anything that I set my mind to. I would also like to thank my dissertation advisor, Dr. Celeste Napier, for encouraging and challenging me to be better than I thought possible. I extend gratitude to my committee members, Drs. Julie Kauer, Adriano Marchese, Micky Marinelli, and Karie Scrogin for their guidance and insightful input.
    [Show full text]
  • Introduction and Historical Perspective
    Chapter 1 Introduction and Historical Perspective “ Nothing in biology makes sense except in the light of evolution. ” modified by the developmental history of the organism, Theodosius Dobzhansky its physiology – from cellular to systems levels – and by the social and physical environment. Finally, behaviors are shaped through evolutionary forces of natural selection OVERVIEW that optimize survival and reproduction ( Figure 1.1 ). Truly, the study of behavior provides us with a window through Behavioral genetics aims to understand the genetic which we can view much of biology. mechanisms that enable the nervous system to direct Understanding behaviors requires a multidisciplinary appropriate interactions between organisms and their perspective, with regulation of gene expression at its core. social and physical environments. Early scientific The emerging field of behavioral genetics is still taking explorations of animal behavior defined the fields shape and its boundaries are still being defined. Behavioral of experimental psychology and classical ethology. genetics has evolved through the merger of experimental Behavioral genetics has emerged as an interdisciplin- psychology and classical ethology with evolutionary biol- ary science at the interface of experimental psychology, ogy and genetics, and also incorporates aspects of neuro- classical ethology, genetics, and neuroscience. This science ( Figure 1.2 ). To gain a perspective on the current chapter provides a brief overview of the emergence of definition of this field, it is helpful
    [Show full text]
  • Consciousness Eclipsed: Jacques Loeb, Ivan P. Pavlov, and the Rise of Reductionistic Biology After 1900
    Consciousness and Cognition Consciousness and Cognition 14 (2005) 219–230 www.elsevier.com/locate/concog Consciousness eclipsed: Jacques Loeb, Ivan P. Pavlov, and the rise of reductionistic biology after 1900 Ralph J. Greenspan*, Bernard J. Baars The Neurosciences Institute, 10640 John Jay Hopkins Dr., San Diego, CA 92121, United States Received 17 May 2004 Available online 25 November 2004 Abstract The life sciences in the 20th century were guided to a large extent by a reductionist program seeking to explain biological phenomena in terms of physics and chemistry. Two scientists who figured prominently in the establishment and dissemination of this program were Jacques Loeb in biology and Ivan P. Pavlov in psychological behaviorism. While neither succeeded in accounting for higher mental functions in physical- chemical terms, both adopted positions that reduced the problem of consciousness to the level of reflexes and associations. The intellectual origins of this view and the impediment to the study of consciousness as an object of inquiry in its own right that it may have imposed on peers, students, and those who followed is explored. Ó 2004 Elsevier Inc. All rights reserved. Keywords: History of ideas; Reductionism; Tropism; Conditional reflex 1. Introduction The current acceptance of consciousness as a suitable object of study in the life sciences came late in the 20th century (Flanagan, 1984). By that time other biological processes—physiology, biochemistry, genetics, embryology, and even many aspects of brain function—had long since * Corresponding author. Fax: +1 858 626 2099. E-mail addresses: [email protected] (R.J. Greenspan), [email protected] (B.J.
    [Show full text]
  • The Fessard's School of Neurophysiology After
    The fessard’s School of neurophysiology after the Second World War in france: globalisation and diversity in neurophysiological research (1938-1955) Jean-Gaël Barbara To cite this version: Jean-Gaël Barbara. The fessard’s School of neurophysiology after the Second World War in france: globalisation and diversity in neurophysiological research (1938-1955). Archives Italiennes de Biologie, Universita degli Studi di Pisa, 2011. halshs-03090650 HAL Id: halshs-03090650 https://halshs.archives-ouvertes.fr/halshs-03090650 Submitted on 11 Jan 2021 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. The Fessard’s School of neurophysiology after the Second World War in France: globalization and diversity in neurophysiological research (1938-1955) Jean- Gaël Barbara Université Pierre et Marie Curie, Paris, Centre National de la Recherche Scientifique, CNRS UMR 7102 Université Denis Diderot, Paris, Centre National de la Recherche Scientifique, CNRS UMR 7219 [email protected] Postal Address : JG Barbara, UPMC, case 14, 7 quai Saint Bernard, 75005,
    [Show full text]
  • The Role of Habituation in Social Fear by Suzanne N. Avery Dissertation
    Slow to Warm Up: The Role of Habituation in Social Fear By Suzanne N. Avery Dissertation Submitted to the Faculty of the Graduate School of Vanderbilt University in partial fulfillment of the requirements for the degree of DOCTOR OF PHILOSOPHY in Neuroscience August, 2015 Nashville, Tennessee Approved: David Zald, Ph.D. Bunmi Olatunji, Ph.D. Brandon Ally, Ph.D. Jennifer Blackford, Ph.D. Copyright © 2015 by Suzanne N. Avery All Rights Reserved ii To my husband, Stacy, for his unending support, and my daughter, Sophie, for whom I do everything iii ACKNOWLEDGMENTS I would first and foremost like to thank my advisor, Dr. Jennifer Blackford, who is a truly exceptional scientist, teacher and mentor. She has encouraged me to pursue every opportunity for scientific achievement and has mentored me closely through each step. Her enthusiasm to help me become an excellent scientist and her generosity with her time and effort have made my graduate training an incredible experience. She has an incredible passion for science and possesses a brilliant combination of curiosity, creativity, motivation, intelligence and passion that inspires all of those who have the pleasure to work with her. I am eternally grateful for your mentorship—thank you is not enough. I would also like to thank the current and former members of the Blackford lab, including Jacqueline Clauss, Ross VanDerKlok, and Brittany Matthews, whose assistance and encouragement have made this work possible. My gratitude goes out to my dissertation committee, who have provided invaluable feedback and whose suggestions have significantly improved this project. Thank you for your insights and help Dr.
    [Show full text]
  • Cells of the Nervous System
    3/23/2015 Nervous Systems | Principles of Biology from Nature Education contents Principles of Biology 126 Nervous Systems A flock of Canada geese use auditory and visual cues to maintain a V­ formation in flight. How are these animals able to respond so quickly to environmental cues? All animals possess neurons, cells that form a complex network capable of transmitting and receiving signals. This neural network forms the nervous system. The nervous system coordinates the movement and internal physiology of an organism, as well as its decision­making and behavior. In all but the simplest animals, neurons are bundled into nerves that facilitate signal transmission. More complex animals have a central nervous system (CNS) that includes the brain and nerve cords. Vertebrates also have a peripheral nervous system (PNS) that transmits signals between the body and the CNS. Cells of the Nervous System Structure of the neuron. Figure 1 shows the general structure of a neuron. The organelles and nucleus of a neuron are contained in a large central structure called the cell body, or soma. Most nerve cells also have multiple dendrites in addition to the cell body. Dendrites are short, branched extensions that receive signals from other neurons. Each neuron also has a single axon, a long extension that transmits signals to other cells. The point of attachment of the axon to the cell body is called the axon hillock. The other end of the axon is usually branched, and each branch ends in a synaptic terminal. The synaptic terminal forms a synapse, or junction, with another cell.
    [Show full text]
  • Disrupted Habituation in the Early Stage of Psychosis
    Biological Psychiatry: CNNI Archival Report Disrupted Habituation in the Early Stage of Psychosis Suzanne N. Avery, Maureen McHugo, Kristan Armstrong, Jennifer U. Blackford, Neil D. Woodward, and Stephan Heckers ABSTRACT BACKGROUND: Learning and memory are impaired in schizophrenia. Some theories have proposed that one form of memory, habituation, is particularly impaired. Preliminary evidence suggests that memory impairment is associated with failed hippocampal habituation in patients with chronic schizophrenia. We studied how abnormal habituation of the hippocampus is related to relational memory deficits in the early stage of psychosis. METHODS: We measured hippocampal activity in 62 patients with early psychosis and 70 healthy individuals using functional magnetic resonance imaging. Habituation was defined as the slope of functional magnetic resonance imaging signal change to repeated presentations of faces and objects. Relational memory ability was measured as the slope of preferential viewing during a face-scene pair eye movement task outside the scanner. RESULTS: Patients with early psychosis showed impaired relational memory (p , .001) and less hippocampal habituation to objects (p = .01) than healthy control subjects. In the healthy control group, better relational memory was associated with faster anterior hippocampal habituation (faces, r = 2.28, p = .03). In contrast, patients with early psychosis showed no brain-behavior relationship (r = .12, p = .40). CONCLUSIONS: We found evidence for disrupted hippocampal habituation in the early stage of psychosis along with an altered association between hippocampal habituation and relational memory ability. These results suggest that neural habituation may provide a novel target for early cognitive interventions in psychosis. Keywords: First episode, Hippocampus, Novelty, Relational memory, Schizophrenia, Visual cortex https://doi.org/10.1016/j.bpsc.2019.06.007 Repetition is one of the most familiar memory tools.
    [Show full text]
  • Kandel and Hawkins
    © 1992 SCIENTIFIC AMERICAN, INC The Biological Basis of Learnin and Individuality Recent discoveries suggestg that learning engages a simple set of rules that modify the strength of connections between neurons in the brain. These changes play an important role in making each individual unique by Eric R. Kandel and Robert D. Hawkins ver the past several decades, there surgeon at the Montreal Neurological Institute. has been a gradual merger of two In the 1940s Penfield began to use electri­ originally separate fields of science: cal stimulation to map motor, sensory and neurobiology,O the science of the brain, and language functions in the cortex of patients cognitive psychology, the science of the mind. undergoing neurosurgery for the relief of Recently the pace of unification has quick­ epilepsy. Because the brain itself does not ened, with the result that a new intellectual have pain receptors, brain surgery can be car­ framework has emerged for examining percep­ ried out under local anesthesia in fully con­ tion, language, memory and conscious aware­ scious patients, who can describe what they ness. This new framework is based on the abil­ experience in response to electric stimuli ap­ ity to study the biological substrates of these plied to different cortical areas. Penfield ex­ mental functions. A particularly faSCinating plored the cortical surface in more than 1,000 example can be seen in the study of learning. Elementary as­ patients. Occasionally he found that electrical stimulation pects of the neuronal mechanisms important for several dif­ produced an experiential response, or flashback, in which ferent types of learning can now be studied on the cellular the patients described a coherent recollection of an earlier and even on the molecular level.
    [Show full text]
  • 1. Overview 2. Database Architecture 3. Example Tree 6. Mentorship Network Influences?
    Neurotree: Graphing the academic genealogy of neuroscience Stephen V. David1, Will Chertoff1, Titipat Achakulvisut2, Daniel Acuna2 1Oregon Health & Science University, 2Northwestern University 1. Overview 3. Example tree 4. Founding ancestors Neurotree (http://neurotree.org, [1]) is a collaborative, open-access Name N Resarch area Family tree The distance between two nodes can be Johannes Müller 7715 Physiology website that tracks and visualizes the academic genealogy and history P+ William Fitch measured by the number of mentorship Sir Charles Sherrington 4758 Neurophysiology of neuroscience. After 10 years of growth driven by user-generated Allen Hermann von Helmholtz 3048 Psychophysics University of P- steps connecting them through a Sir John Eccles 2998 Synapses content, the site has captured information about the mentorship of over Rudolf Oregon Ludwig Robert Samuel Alexander Sir Charles Medical common ancestor i(below). The list at Karl Lashley 2558 Learning and memory 80,000 neuroscientists. It has become a unique tool for a community of John Friedrich Karl Koch Sir Charles Kinnier Charles Gordon John Scott Sir Charles Harvey Sir Charles Karl Edgar School C+ Louis Agassiz 2241 Anatomy Sir Michael Newport Goltz Virchow Universität Scott Wilson Symonds Holmes Farquhar Sherrington Scott Williams Scott Spencer Wilder Douglas Frederic right shows the 30 most frequent primary researchers, students, journal editors, and the press. Once Foster Langley Kaiser-Wilhelms- Universität Berlin (ID Sherrington National Hospital, Queen National
    [Show full text]
  • Habituation As a Neural Algorithm for Online Odor Discrimination
    Habituation as a neural algorithm for online odor discrimination Yang Shena, Sanjoy Dasguptab, and Saket Navlakhaa,1 aSimons Center for Quantitative Biology, Cold Spring Harbor Laboratory, Cold Spring Harbor, NY 11724; and bComputer Science and Engineering Department, University of California San Diego, La Jolla, CA 92093 Edited by Timothy O’Leary, University of Cambridge, Cambridge, United Kingdom, and accepted by Editorial Board Member Gina G. Turrigiano April 13, 2020 (received for review September 5, 2019) Habituation is a form of simple memory that suppresses neural the extinction of the stimulus. This is in contrast with faster forms activity in response to repeated, neutral stimuli. This process is crit- of habituation, such as odorant receptor neuron (ORN) adapta- ical in helping organisms guide attention toward the most salient tion (17, 18) occurring on the order of hundreds of milliseconds, and novel features in the environment. Here, we follow known and longer forms of habituation, such as long-term habituation circuit mechanisms in the fruit fly olfactory system to derive a (16), which lasts for days. Different time scales of habituation simple algorithm for habituation. We show, both empirically and have also been described in the vertebrate olfactory system (1). analytically, that this algorithm is able to filter out redundant infor- Short-term habituation is of interest because it requires a rela- mation, enhance discrimination between odors that share a similar tively fast online mechanism for its initiation and decay, yet it is background, and improve detection of novel components in odor also stable enough to have a lasting effect. mixtures. Overall, we propose an algorithmic perspective on the Prior work has studied the mechanisms of short-term habitu- biological mechanism of habituation and use this perspective to ation in the mouse and honeybee olfactory circuits (19–22), but understand how sensory physiology can affect odor perception.
    [Show full text]
  • The Fessard's School of Neurophysiology After the Second
    Archives Italiennes de Biologie, 149 (Suppl.): 187-195, 2011. The fessard’s School of neurophysiology after the Second World War in france: globalisation and diversity in neurophysiological research (1938-1955) J.-G. BARBARA Université Pierre et Marie Curie, Paris, Centre National de la Recherche Scientifique, CNRS UMR 7102; Université Denis Diderot, Paris, Centre National de la Recherche Scientifique, CNRS UMR 7219 ABSTRACT In France, neurophysiology emerged after the Second World War as a dynamic discipline in different schools, Toulouse, Lyons, Montpellier, Marseilles, and Paris, where Lapicque was losing credit with his studies on the excitability of nerves. Parisian neurophysiologist, Alfred Fessard (1900-1982) was a key figure in establishing a new school of neurophysiology on the model of Edgar Adrian’s department in Cambridge, where he worked for a few months in the late thirties. Fessard was initially a student of Henri Piéron involved in experimental psychology. He also made parallel oscillographic studies on elementary activities in various animal and plant preparations. His school trained leading French neurophysiologists in Paris until recently and Fessard was instrumental in the creation of IBRO in 1961. Key words Neurophysiology • France • Fessard • IBRO • Torpedo fish • Chemical neurotransmission After the Second World War, major French figures Marey suggested the creation of an International in neurophysiology emerged from different tradi- Commission for the control of graphical instruments tions in Toulouse, Lyons Montpellier, Strasburg, devoted to physiology. A new cottage named Institut Marseilles, and Paris. Alfred Fessard (1900-1982) is Marey was built near the Physiological Station recognized today as a most talented neurophysiolo- Marey had planned for his studies on movement in gist in the 1940s and 1950s who was able to create Boulogne-Billancourt, Le Parc des Princes, near his own school near Paris, in the former Institut Paris.
    [Show full text]