DOCSLIB.ORG

UNIVERSITY of CALIFORNIA Los Angeles Causal Action: A

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
UNIVERSITY of CALIFORNIA Los Angeles Causal Action: A UNIVERSITY OF CALIFORNIA Los Angeles Causal Action: A Framework to Connect Action Perception and Understanding A dissertation submitted in partial satisfaction of the requirements for the degree Doctor of Philosophy in Psychology by Yujia Peng 2019 ©Copyright by Yujia Peng 2019 ABSTRACT OF THE DISSERTATION Causal Action: A Framework to Connect Action Perception and Understanding by Yujia Peng Doctor of Philosophy in Psychology University of California, Los Angeles, 2019 Professor Hongjing Lu, Chair Human actions are more than mere body movements. In contrast to dynamic events involving inanimate objects, human actions have a special status in that they control interactions with the world and afford privileged access to the experience of agency and to control interactions with the world. Several causal constraints on human actions support the generation and the understanding of actions. For example, human actions inherently involve a causal structure: limb movements generally cause changes in body position along a path through the environment to achieve intentional goals. However, it remains unclear how the system that supports action perception communicates with high-level reasoning system to recognize actions, and more importantly, to achieve a deeper understanding of observed actions. My dissertation aims to ii determine whether causality imposes critical motion constraints on action perception and understanding, and how causal relations involved in actions impact behavioral judgments. The project also investigates the developmental trajectory and neural substrate of action processing, and whether a feedforward deep learning model is able to learn causal relations solely from visual observations of human actions. Through behavioral experiments, an infant eye movement study, a neural study using magnetoencephalography, and model simulations, my dissertation yields a number of insights. 1) Humans implicitly and automatically rely on causal expectations to explain motion information when perceiving body movements and meaningful social interactions; 2) Sensitivity to causal constraints on actions develops early in infants even before 18 months of age, and shows a clear relation with the development of gross motor functions. 3) Congruency to causal relations involved in human actions can be decoded from neural MEG signals, with the processing of causal actions eliciting a distributed neural network. The brain network involves temporal, parietal, and frontal regions that are important locus for spatial relation reasoning, decision making, and intention understanding. 4) Recent stimulus-driven deep learning neural networks are unable to learn the causal relations involved in actions, failing to create high-level representations for causal actions. Overall, my dissertation reveals the importance of causality in bridging action perception and understanding, highlights the key missing computational components in deep learning models for complex visual stimuli such as human actions, and provides a potential framework to connect seeing and thinking. iii The dissertation of Yujia Peng is approved. Chris Hak Wan Lau Scott Pratt Johnson Yingnian Wu Hongjing Lu, Committee Chair University of California, Los Angeles 2019 iv Dedication This dissertation is dedicated to my inspiring parents, for their endless love, support, and wisdom; My wonderful husband, Jiming, for his love and knowledge that encourage me to pursue my dreams. v TABLE OF CONTENTS ACKNOWLEDGEMENTS .......................................................................................................... xii VITA ............................................................................................................................................ xiv CHAPTER 1: Introduction ............................................................................................................. 1 1.1 The Phenomenal Causality in Moving Objects ................................................................ 5 1.2 The developmental trajectory of causal perception .......................................................... 8 1.3 Neural Bases for Perceptual Causality and Action Recognition .................................... 11 1.4 Computational Models and Deep Learning Algorithms of Action Recognition ........... 13 CHAPTER 2: Causal Action: A Fundamental Constraint on Perception and Inference about Body Movements .......................................................................................................................... 17 2.1 Abstract .......................................................................................................................... 17 2.2 Introduction .................................................................................................................... 17 2.3 Experiment 1 .................................................................................................................. 20 2.3.1 Method .................................................................................................................... 20 2.3.2 Results .................................................................................................................... 24 2.4 Experiment 2a ................................................................................................................ 26 2.4.1 Method .................................................................................................................... 27 2.4.2 Results ..................................................................................................................... 29 2.5 Experiment 2b ................................................................................................................ 32 2.5.1 Method .................................................................................................................... 33 2.5.2 Results ..................................................................................................................... 33 2.6 An Ideal Observer Model Based on Visual Statistics .................................................... 37 2.7 General Discussion ......................................................................................................... 39 CHAPTER 3: Perception of Continuous Movements from Causal Actions ................................ 43 3.1 Abstract .......................................................................................................................... 43 3.2 Introduction .................................................................................................................... 44 3.2 Experiment 1 .................................................................................................................. 48 3.2.1 Methods................................................................................................................... 48 3.2.2 Results ..................................................................................................................... 53 3.3 Experiment 2 .................................................................................................................. 55 vi 3.3.1 Methods................................................................................................................... 56 3.3.2 Results ..................................................................................................................... 57 3.4 Experiment 3 .................................................................................................................. 58 3.4.1 Methods................................................................................................................... 59 3.4.2 Results ..................................................................................................................... 60 3.5 Experiment 4 .................................................................................................................. 62 3.5.1 Methods................................................................................................................... 62 3.5.2 Results ..................................................................................................................... 63 3.6 General Discussion ......................................................................................................... 65 CHAPTER 4: A motion consistency constraint on infant perception of body movements.......... 69 4.1 Abstract .......................................................................................................................... 69 4.2 Introduction .................................................................................................................... 69 4.3 Method ........................................................................................................................... 72 4.3 Results ............................................................................................................................ 75 4.4 Discussion ...................................................................................................................... 81 CHAPTER 5: Revealing the Neural Mechanism of Causal Action Perception Using MEG ....... 85 5.1 Abstract .......................................................................................................................... 85 5.2 Introduction .................................................................................................................... 86 5.2 Methods .........................................................................................................................
Load more

Recommended publications
  • The Mathematics of Causal Relations
    In P.E. Shrout, K. Keyes, and K. Ornstein (Eds.), Causality and Psychopathology: Finding the TECHNICAL REPORT Determinants of Disorders and their Cures, Oxford University Press, 47-65, 2010. R-338 September 2010 The Mathematics of Causal Relations Judea Pearl Introduction Almost two decades have passed since Paul Holland published his highly cited review paper on the Neyman-Rubin approach to causal inference [Holland, 1986]. Our understanding of causal inference has since increased severalfold, due primarily to advances in three areas: 1. Nonparametric structural equations 2. Graphical models 3. Symbiosis between counterfactual and graphical methods These advances are central to the empirical sciences because the research questions that motivate most studies in the health, social, and behavioral sciences are not statistical but causal in nature. For example, what is the efficacy of a given drug in a given population? Can data prove an employer guilty of hiring discrimination? What fraction of past crimes could have been avoided by a given policy? What was the cause of death of a given individual in a specific incident? Remarkably, although much of the conceptual framework and many of the algorithmic tools needed for tackling such problems are now well established, they are hardly known to researchers in the field who could put them into practical use. Why? Solving causal problems mathematically requires certain extensions in the standard mathematical language of statistics, and these extensions are not generally emphasized in the mainstream literature and education. As a result, large segments of the statistical research community find it hard to appreciate and benefit from the many results that causal analysis has produced in the past two decades.
    [Show full text]
  • Causal Knowledge and the Development of Inductive Reasoning ⇑ Aimée K
    View metadata, citation and similar papers at core.ac.uk brought to you by CORE provided by Elsevier - Publisher Connector Journal of Experimental Child Psychology 122 (2014) 48–61 Contents lists available at ScienceDirect Journal of Experimental Child Psychology journal homepage: www.elsevier.com/locate/jecp Causal knowledge and the development of inductive reasoning ⇑ Aimée K. Bright a, , Aidan Feeney b a Psychology Division, School of Biological and Chemical Sciences, Queen Mary University of London, London E1 4NS, UK b School of Psychology, Queen’s University Belfast, Belfast BT7 1NN, Northern Ireland, UK article info abstract Article history: We explored the development of sensitivity to causal relations in chil- Received 5 April 2013 dren’s inductive reasoning. Children (5-, 8-, and 12-year-olds) and Revised 27 November 2013 adults were given trials in which they decided whether a property Available online 8 February 2014 known to be possessed by members of one category was also possessed by members of (a) a taxonomically related category or (b) a causally Keywords: related category. The direction of the causal link was either predictive Category-based induction Causal knowledge (prey ? predator) or diagnostic (predator ? prey), and the property Causal asymmetry that participants reasoned about established either a taxonomic or cau- Taxonomic knowledge sal context. There was a causal asymmetry effect across all age groups, Inductive selectivity with more causal choices when the causal link was predictive than Knowledge over-generalization when it was diagnostic. Furthermore, context-sensitive causal reason- ing showed a curvilinear development, with causal choices being most frequent for 8-year-olds regardless of context.
    [Show full text]
  • Novel Pancreatic Endocrine Maturation Pathways Identified by Genomic Profiling and Causal Reasoning
    Novel Pancreatic Endocrine Maturation Pathways Identified by Genomic Profiling and Causal Reasoning Alex Gutteridge2*, J. Michael Rukstalis1,4, Daniel Ziemek3, Mark Tie´ 1, Lin Ji1,4, Rebeca Ramos-Zayas1, Nancy A. Nardone4, Lisa D. Norquay4, Martin B. Brenner4, Kim Tang1, John D. McNeish1, Rebecca K. Rowntree1* 1 Pfizer Regenerative Medicine, Cambridge, Massachusetts, United States of America, 2 Pfizer Regenerative Medicine, Cambridge, United Kingdom, 3 Pfizer Computational Sciences Center of Emphasis, Cambridge, Massachusetts, United States of America, 4 Pfizer Cardiovascular and Metabolic Diseases, Cambridge, Massachusetts, United States of America Abstract We have used a previously unavailable model of pancreatic development, derived in vitro from human embryonic stem cells, to capture a time-course of gene, miRNA and histone modification levels in pancreatic endocrine cells. We investigated whether it is possible to better understand, and hence control, the biological pathways leading to pancreatic endocrine formation by analysing this information and combining it with the available scientific literature to generate models using a casual reasoning approach. We show that the embryonic stem cell differentiation protocol is highly reproducible in producing endocrine precursor cells and generates cells that recapitulate many aspects of human embryonic pancreas development, including maturation into functional endocrine cells when transplanted into recipient animals. The availability of whole genome gene and miRNA expression data from the early stages of human pancreatic development will be of great benefit to those in the fields of developmental biology and diabetes research. Our causal reasoning algorithm suggested the involvement of novel gene networks, such as NEUROG3/E2F1/KDM5B and SOCS3/STAT3/IL-6, in endocrine cell development We experimentally investigated the role of the top-ranked prediction by showing that addition of exogenous IL-6 could affect the expression of the endocrine progenitor genes NEUROG3 and NKX2.2.
    [Show full text]
  • Development of Causal Reasoning
    The Development of Causal Reasoning Oxford Handbooks Online The Development of Causal Reasoning Paul Muentener and Elizabeth Bonawitz The Oxford Handbook of Causal Reasoning Edited by Michael R. Waldmann Print Publication Date: Jun 2017 Subject: Psychology, Cognitive Psychology Online Publication Date: May 2017 DOI: 10.1093/oxfordhb/9780199399550.013.40 Abstract and Keywords Research on the development of causal reasoning has broadly focused on accomplishing two goals: understanding the origins of causal reasoning, and examining how causal reasoning changes with development. This chapter reviews evidence and theory that aim to fulfill both of these objectives. In the first section, it focuses on the research that explores the possible precedents for recognizing causal events in the world, reviewing evidence for three distinct mechanisms in early causal reasoning: physical launching events, agents and their actions, and covariation information. The second portion of the chapter examines the question of how older children learn about specific causal relationships. It focuses on the role of patterns of statistical evidence in guiding learning about causal structure, suggesting that even very young children leverage strong inductive biases with patterns of data to inform their inferences about causal events, and discussing ways in which children’s spontaneous play supports causal learning. Keywords: development, causal reasoning, learning, induction, bias Causality plays a fundamental role in human cognition, and has long been a topic of interest for many developmental researchers—causal reasoning has been proposed to be a central aspect of early learning in the physical (Baillargeon, 2004; Carey, 2009; Cohen, Amsel, Redford, & Casasola, 1998; Leslie, 1995; Spelke, 1990), psychological (Csibra & Gergely, 1998; Gopnik & Wellman, 1992; Meltzoff, 2007; White, 2014; Woodward, 2009), and biological world (Carey, 2009; Wellman & Gelman, 1992).
    [Show full text]
  • 1/4 New Caledonian Crows Afford Invaluable Comparative Insights Into
    Target article: Osiurak and Reynaud Word counts: abstract (60 words), main text (995), references (1191), entire text (2356) New Caledonian crows afford invaluable comparative insights into human cumulative technological culture Christian Rutza,b and Gavin R. Huntc aCentre for Biological Diversity, School of Biology, University of St Andrews, St Andrews KY16 9TH, UK; bRadcliffe Institute for Advanced Study, Harvard University, Cambridge MA 02138, USA; and cUnaffiliated. +1 617 899 6744 (C.R.) [email protected] [email protected] https://aviantooluse.org Abstract The New Caledonian crow may be the only non-primate species exhibiting cumulative technological culture. Its foraging tools show clear signs of diversification and progressive refinement, and it seems likely that at least some tool-related information is passed across generations via social learning. Here, we explain how these remarkable birds can help us uncover the basic biological processes driving technological progress. Cumulative culture – the social transmission and accumulation of innovations across generations – has enabled humans to develop technologies of astonishing complexity (Boyd & Richerson 1996). Osiurak and Reynaud (O&R) present a timely re-evaluation of the potential cognitive capacities enabling this process, shifting the focus from social-learning to technical-reasoning skills. We enjoyed O&R’s fresh perspective, but were surprised that they did not examine more carefully their starting assumption that only humans possess cumulative technological culture. Two non-human species have been suggested to refine their foraging tools in a cumulative manner – one of our closest relatives, the chimpanzee, and a tropical corvid, the New Caledonian crow (Dean et al. 2014).
    [Show full text]
  • Potency and Process: a Naturalistic Defense of Mental Causation
    University of Nevada, Reno Potency and Process: A Naturalistic Defense of Mental Causation A thesis submitted in partial fulfillment of the requirements for the degree of Master of Arts in Philosophy By Devin J. Bray Dr. Thomas Nickles/Thesis Advisor May, 2016 THE GRADUATE SCHOOL We recommend that the thesis prepared under our supervision by DEVIN JAMES BRAY Entitled Potency and Process: A Naturalistic Defense of Mental Causation be accepted in partial fulfillment of the requirements for the degree of MASTER OF ARTS Thomas Nickles, Ph.D., Advisor Christopher Williams, Ph.D., Committee Member Michael Webster, Ph.D., Graduate School Representative David W. Zeh, Ph.D., Dean, Graduate School May, 2016 i Abstract It has been argued extensively in contemporary philosophy of mind and neuroscience that physicalism precludes the possibility of robust mental causation. “Exclusion arguments” of the sort offered by Jaegwon Kim present the physicalist with an apparent dilemma: either all putatively “mental” causation reduces to mere “bottom-up” causation, or else it is epiphenomenal. However, the purportedly “scientific” premises that bolster these arguments can be argued are metaphysically overladen, smuggling in assumptions about the fundamental nature of matter that are not warranted by our best current data. By examining the evidence against such assumptions and the feasibility of alternative metaphysical frameworks, serious doubt can be cast on the validity of Exclusion arguments. Accepting the plausibility of causal entanglements leading from
    [Show full text]
  • The Nebulous Issue of Coincidences
    This is an Open Access document downloaded from ORCA, Cardiff University's institutional repository: http://orca.cf.ac.uk/76252/ This is the author’s version of a work that was submitted to / accepted for publication. Citation for final published version: Johansen, Mark K. and Osman, Magda 2015. Coincidences: a fundamental consequence of rational cognition. New Ideas in Psychology 39 , pp. 34-44. 10.1016/j.newideapsych.2015.07.001 file Publishers page: http://dx.doi.org/10.1016/j.newideapsych.2015.07.0... <http://dx.doi.org/10.1016/j.newideapsych.2015.07.001> Please note: Changes made as a result of publishing processes such as copy-editing, formatting and page numbers may not be reflected in this version. For the definitive version of this publication, please refer to the published source. You are advised to consult the publisher’s version if you wish to cite this paper. This version is being made available in accordance with publisher policies. See http://orca.cf.ac.uk/policies.html for usage policies. Copyright and moral rights for publications made available in ORCA are retained by the copyright holders. Coincidences and Rational Cognition 2 Coincidences: A Fundamental Consequence of Rational Cognition* Accepted postprint for New Ideas in Psychology Mark K. Johansena Magda Osmanb ** [email protected] *Authors Note. The author list is presented alphabetically. However, it should be noted that both Authors contributed equally to this article and so first authorship is joint. ** Corresponding author a. School of Psychology, Cardiff University, Tower Building, 70 Park Place, Cardiff, CF10 3AT, UK b.
    [Show full text]
  • Cause and Intent: Social Reasoning in Causal Learning Noah D
    Cause and Intent: Social Reasoning in Causal Learning Noah D. Goodman, Chris L. Baker, Joshua B. Tenenbaum {ndg, clbaker, jbt}@mit.edu MIT, Dept. of Brain and Cognitive Sciences Abstract the structure of the world as background knowledge avail- able to all agents. We combine these modeling approaches by The acquisition of causal knowledge is a primary goal of child- hood; yet most of this knowledge is known already to adults. constructing a model of intuitive psychology in which beliefs We argue that causal learning which leverages social reason- about the causal structure of the world are represented and ing is a rapid and important route to knowledge. We present used for action selection, and showing how such an intuitive a computational model integrating knowledge about causality with knowledge about intentional agency, but using a domain- theory of causal-agency can explain the source of interven- general mechanism for reasoning. Inference in this model pre- tions and speed causal learning. dicts qualitatively different learning than an equivalent model We test this model experimentally by studying adult intu- based on causality alone or a hybrid causal-encoding model. We test these predictions experimentally with adult partici- itions in a set of scenarios that provide both social and causal pants, and discuss the relation of these results to the devel- information. These scenarios are chosen to distinguish be- opmental phenomenon of over-imitation. tween the combined social-causal model and two alternatives: Keywords: Causal learning, social cognition, Bayesian mod- a similar causal-only model, and a hybrid gated-inference eling, imitation. model.
    [Show full text]
  • Do New Caledonian Crows Solve Physical Problems Through Causal Reasoning? A
    Proc. R. Soc. B (2009) 276, 247–254 doi:10.1098/rspb.2008.1107 Published online 16 September 2008 Do New Caledonian crows solve physical problems through causal reasoning? A. H. Taylor*, G. R. Hunt, F. S. Medina and R. D. Gray* Department of Psychology, University of Auckland, Private Bag 92019, Auckland, New Zealand The extent to which animals other than humans can reason about physical problems is contentious. The benchmark test for this ability has been the trap-tube task. We presented New Caledonian crows with a series of two-trap versions of this problem. Three out of six crows solved the initial trap-tube. These crows continued to avoid the trap when the arbitrary features that had previously been associated with successful performances were removed. However, they did not avoid the trap when a hole and a functional trap were in the tube. In contrast to a recent primate study, the three crows then solved a causally equivalent but visually distinct problem—the trap-table task. The performance of the three crows across the four transfers made explanations based on chance, associative learning, visual and tactile generalization, and previous dispositions unlikely. Our findings suggest that New Caledonian crows can solve complex physical problems by reasoning both causally and analogically about causal relations. Causal and analogical reasoning may form the basis of the New Caledonian crow’s exceptional tool skills. Keywords: New Caledonian crows; causal reasoning; analogical reasoning; trap tube; trap table 1. INTRODUCTION that non-human animals use sophisticated cognition when The eighteenth century philosopher David Hume solving complex physical problems has led to suggestions (1711–1776) famously used the example of one billiard that causal reasoning in humans is fundamentally different ball rolling into another to illustrate his argument that (Penn & Povinelli 2007; Penn et al.
    [Show full text]
  • Causal Reasoning in Economics a Selective Exploration of Semantic, Epistemic and Dynamical Aspects
    Causal Reasoning in Economics A Selective Exploration of Semantic, Epistemic and Dynamical Aspects Causaal redeneren in de economische wetenschap Een selectieve studie naar semantische, epistemische en dynamische aspecten Thesis to obtain the degree of Doctor from the Erasmus University Rotterdam by command of the rector magnificus Prof.dr. H.G. Schmidt and in accordance with the decision of the Doctorate Board The public defence shall be held on Thursday the 13th of December 2012 at 15.30 hours by François Simon Claveau born in Dolbeau, Canada Doctoral Committee Promotors: Prof.dr. J.J. Vromen Prof.dr. K.D. Hoover Other members: Prof.dr. H.C.M. de Swart Prof.dr. J. de Koning Prof.dr. J. Williamson Copromotor: Dr. J. Reiss Contents List of Figures . iv List of Tables . v Acknowledgments . vii Introduction 1 I Semantics 19 1 Semantic Analysis of Causal Generalizations in Policy- Oriented Social Sciences 21 1.1 Introduction . 21 1.2 On the meaning of causal generalizations: a referentialist approach . 24 1.2.1 The meaning of the causal relata . 27 1.2.2 The relevant units . 30 1.2.3 Which causal relation? . 31 1.2.4 Truth-conditions of the generalizations . 41 1.3 A challenge for the referentialist procedure . 42 1.4 On the meaning of causal generalizations: an inferentialist approach . 46 1.4.1 Elements of an inferentialist semantics . 48 1.4.2 OECD Jobs Study: An inferentialist analysis . 50 1.4.3 Discussion . 60 1.5 Conclusion . 63 II Epistemology 65 Preliminaries 67 ii Causal Reasoning in Economics 2 Evidential Variety as a Source of Credibility for Causal Inference 73 2.1 Introduction .
    [Show full text]
  • Great Apes`Causal Cognition in the Physical Domain
    Humboldt-Universität zu Berlin Dissertation Great Apes’ Causal Cognition in the Physical Domain Zur Erlangung des akademischen Grades Doctor rerum naturalium Mathematisch-Naturwissenschaftliche Fakultät II Daniel Hanus Dekan: Prof. Dr. Peter Frensch Gutachter: 1. Prof. Dr. Elke van der Meer, Humboldt-Universität, Berlin 2. Prof. Dr. Michael Tomasello, Max Planck Institut für evolutionäre Anthropologie, Leipzig 3. Dr. Josep Call, Max Planck Institut für evolutionäre Anthropologie, Leipzig eingereicht: 04. August 2009 Datum der Promotion: 03. Dezember 2009 1 Table of content Zusammenfassung .................................................................................................................... 4 Summary ................................................................................................................................... 5 Acknowledgements ................................................................................................................... 6 List of original publications ..................................................................................................... 7 GENERAL INTRODUCTION ............................................................................................... 8 Prologue ................................................................................................................................. 8 General approach .................................................................................................................... 9 Causal cognition in children ................................................................................................
    [Show full text]
  • Implications for Theories of Consciousness and Artificial Intelligence
    Integrated World Modeling Theory (IWMT) Expanded: Implications for Theories of Consciousness and Artificial Intelligence Adam Safron* 1,2,3 1 Center for Psychedelic and Consciousness Research, Johns Hopkins University School of Medicine, Baltimore, MD 21218, USA 2 Kinsey Institute, Indiana University, Bloomington, IN 47405, USA 3 Cognitive Science Program, Indiana University, Bloomington, IN 47405, USA * [email protected] Abstract Integrated World Modeling Theory (IWMT) is a synthetic theory of consciousness that uses the Free Energy Principle and Active Inference (FEP-AI) framework to combine insights from Integrated Information Theory (IIT) and Global Neuronal Workspace Theory (GNWT). Here, I first review philosophical principles and neural systems contributing to IWMT’s integrative perspective. I then go on to describe predictive processing models of brains and their connections to machine learning architectures, with particular emphasis on autoencoders (perceptual and active inference), turbo- codes (establishment of shared latent spaces for multi-modal integration and inferential synergy), and graph neural networks (spatial and somatic modeling and control). Particular emphasis is placed on the hippocampal/entorhinal system, which may provide a source of high-level reasoning via predictive contrasting and generalized navigation, so affording multiple kinds of conscious access. Future directions for IIT and GNWT are considered by exploring ways in which modules and workspaces may be evaluated as both complexes of integrated information and arenas for iterated Bayesian model selection. Based on these considerations, I suggest novel ways in which integrated information might be estimated using concepts from probabilistic graphical models, flow networks, and game theory. Mechanistic and computational principles are also considered with respect to the ongoing debate between IIT and GNWT regarding the physical substrates of different kinds of conscious and unconscious phenomena.
    [Show full text]