An Affective Computational Model for Machine Consciousness
Total Page:16
File Type:pdf, Size:1020Kb
Load more
Recommended publications
-
Arxiv:2012.10390V2 [Cs.AI] 20 Feb 2021 Inaccessible
Opinion - Paper under review Deep Learning and the Global Workspace Theory Rufin VanRullen1, 2 and Ryota Kanai3 1CerCo, CNRS UMR5549, Toulouse, France 2ANITI, Universit´ede Toulouse, France 3Araya Inc, Tokyo. Japan Abstract Recent advances in deep learning have allowed Artificial Intelligence (AI) to reach near human-level performance in many sensory, perceptual, linguistic or cognitive tasks. There is a growing need, however, for novel, brain-inspired cognitive architectures. The Global Workspace theory refers to a large-scale system integrating and distributing infor- mation among networks of specialized modules to create higher-level forms of cognition and awareness. We argue that the time is ripe to consider explicit implementations of this theory using deep learning techniques. We propose a roadmap based on unsu- pervised neural translation between multiple latent spaces (neural networks trained for distinct tasks, on distinct sensory inputs and/or modalities) to create a unique, amodal global latent workspace (GLW). Potential functional advantages of GLW are reviewed, along with neuroscientific implications. 1 Cognitive neural architectures in brains and ma- chines Deep learning denotes a machine learning system using artificial neural networks with multiple \hidden" layers between the input and output layers. Although the underlying theory is more than 3 decades old [1, 2], it is only in the last decade that these systems have started to fully reveal their potential [3]. Many of the recent breakthroughs in AI (Artificial Intelligence) have been fueled by deep learning. Neuroscientists have been quick to point out the similarities (and differences) between the brain and these deep artificial neural networks [4{9]. The advent of deep learning has allowed the efficient computer implementation of perceptual and cognitive functions that had been so far arXiv:2012.10390v2 [cs.AI] 20 Feb 2021 inaccessible. -
Artificial Consciousness and the Consciousness-Attention Dissociation
Consciousness and Cognition 45 (2016) 210–225 Contents lists available at ScienceDirect Consciousness and Cognition journal homepage: www.elsevier.com/locate/concog Review article Artificial consciousness and the consciousness-attention dissociation ⇑ Harry Haroutioun Haladjian a, , Carlos Montemayor b a Laboratoire Psychologie de la Perception, CNRS (UMR 8242), Université Paris Descartes, Centre Biomédical des Saints-Pères, 45 rue des Saints-Pères, 75006 Paris, France b San Francisco State University, Philosophy Department, 1600 Holloway Avenue, San Francisco, CA 94132 USA article info abstract Article history: Artificial Intelligence is at a turning point, with a substantial increase in projects aiming to Received 6 July 2016 implement sophisticated forms of human intelligence in machines. This research attempts Accepted 12 August 2016 to model specific forms of intelligence through brute-force search heuristics and also reproduce features of human perception and cognition, including emotions. Such goals have implications for artificial consciousness, with some arguing that it will be achievable Keywords: once we overcome short-term engineering challenges. We believe, however, that phenom- Artificial intelligence enal consciousness cannot be implemented in machines. This becomes clear when consid- Artificial consciousness ering emotions and examining the dissociation between consciousness and attention in Consciousness Visual attention humans. While we may be able to program ethical behavior based on rules and machine Phenomenology learning, we will never be able to reproduce emotions or empathy by programming such Emotions control systems—these will be merely simulations. Arguments in favor of this claim include Empathy considerations about evolution, the neuropsychological aspects of emotions, and the disso- ciation between attention and consciousness found in humans. -
Theoretical Models of Consciousness: a Scoping Review
brain sciences Review Theoretical Models of Consciousness: A Scoping Review Davide Sattin 1,2,*, Francesca Giulia Magnani 1, Laura Bartesaghi 1, Milena Caputo 1, Andrea Veronica Fittipaldo 3, Martina Cacciatore 1, Mario Picozzi 4 and Matilde Leonardi 1 1 Neurology, Public Health, Disability Unit—Scientific Department, Fondazione IRCCS Istituto Neurologico Carlo Besta, 20133 Milan, Italy; [email protected] (F.G.M.); [email protected] (L.B.); [email protected] (M.C.); [email protected] (M.C.); [email protected] (M.L.) 2 Experimental Medicine and Medical Humanities-PhD Program, Biotechnology and Life Sciences Department and Center for Clinical Ethics, Insubria University, 21100 Varese, Italy 3 Oncology Department, Mario Negri Institute for Pharmacological Research IRCCS, 20156 Milan, Italy; veronicaandrea.fi[email protected] 4 Center for Clinical Ethics, Biotechnology and Life Sciences Department, Insubria University, 21100 Varese, Italy; [email protected] * Correspondence: [email protected]; Tel.: +39-02-2394-2709 Abstract: The amount of knowledge on human consciousness has created a multitude of viewpoints and it is difficult to compare and synthesize all the recent scientific perspectives. Indeed, there are many definitions of consciousness and multiple approaches to study the neural correlates of consciousness (NCC). Therefore, the main aim of this article is to collect data on the various theories of consciousness published between 2007–2017 and to synthesize them to provide a general overview of this topic. To describe each theory, we developed a thematic grid called the dimensional model, which qualitatively and quantitatively analyzes how each article, related to one specific theory, debates/analyzes a specific issue. -
Information Theory Techniques for Multimedia Data Classification and Retrieval
INFORMATION THEORY TECHNIQUES FOR MULTIMEDIA DATA CLASSIFICATION AND RETRIEVAL Marius Vila Duran Dipòsit legal: Gi. 1379-2015 http://hdl.handle.net/10803/302664 http://creativecommons.org/licenses/by-nc-sa/4.0/deed.ca Aquesta obra està subjecta a una llicència Creative Commons Reconeixement- NoComercial-CompartirIgual Esta obra está bajo una licencia Creative Commons Reconocimiento-NoComercial- CompartirIgual This work is licensed under a Creative Commons Attribution-NonCommercial- ShareAlike licence DOCTORAL THESIS Information theory techniques for multimedia data classification and retrieval Marius VILA DURAN 2015 DOCTORAL THESIS Information theory techniques for multimedia data classification and retrieval Author: Marius VILA DURAN 2015 Doctoral Programme in Technology Advisors: Dr. Miquel FEIXAS FEIXAS Dr. Mateu SBERT CASASAYAS This manuscript has been presented to opt for the doctoral degree from the University of Girona List of publications Publications that support the contents of this thesis: "Tsallis Mutual Information for Document Classification", Marius Vila, Anton • Bardera, Miquel Feixas, Mateu Sbert. Entropy, vol. 13, no. 9, pages 1694-1707, 2011. "Tsallis entropy-based information measure for shot boundary detection and • keyframe selection", Marius Vila, Anton Bardera, Qing Xu, Miquel Feixas, Mateu Sbert. Signal, Image and Video Processing, vol. 7, no. 3, pages 507-520, 2013. "Analysis of image informativeness measures", Marius Vila, Anton Bardera, • Miquel Feixas, Philippe Bekaert, Mateu Sbert. IEEE International Conference on Image Processing pages 1086-1090, October 2014. "Image-based Similarity Measures for Invoice Classification", Marius Vila, Anton • Bardera, Miquel Feixas, Mateu Sbert. Submitted. List of figures 2.1 Plot of binary entropy..............................7 2.2 Venn diagram of Shannon’s information measures............ 10 3.1 Computation of the normalized compression distance using an image compressor.................................... -
Combinatorial Reasoning in Information Theory
Combinatorial Reasoning in Information Theory Noga Alon, Tel Aviv U. ISIT 2009 1 Combinatorial Reasoning is crucial in Information Theory Google lists 245,000 sites with the words “Information Theory ” and “ Combinatorics ” 2 The Shannon Capacity of Graphs The (and) product G x H of two graphs G=(V,E) and H=(V’,E’) is the graph on V x V’, where (v,v’) = (u,u’) are adjacent iff (u=v or uv є E) and (u’=v’ or u’v’ є E’) The n-th power Gn of G is the product of n copies of G. 3 Shannon Capacity Let α ( G n ) denote the independence number of G n. The Shannon capacity of G is n 1/n n 1/n c(G) = lim [α(G )] ( = supn[α(G )] ) n →∞ 4 Motivation output input A channel has an input set X, an output set Y, and a fan-out set S Y for each x X. x ⊂ ∈ The graph of the channel is G=(X,E), where xx’ є E iff x,x’ can be confused , that is, iff S S = x ∩ x′ ∅ 5 α(G) = the maximum number of distinct messages the channel can communicate in a single use (with no errors) α(Gn)= the maximum number of distinct messages the channel can communicate in n uses. c(G) = the maximum number of messages per use the channel can communicate (with long messages) 6 There are several upper bounds for the Shannon Capacity: Combinatorial [ Shannon(56)] Geometric [ Lovász(79), Schrijver (80)] Algebraic [Haemers(79), A (98)] 7 Theorem (A-98): For every k there are graphs G and H so that c(G), c(H) ≤ k and yet c(G + H) kΩ(log k/ log log k) ≥ where G+H is the disjoint union of G and H. -
Biocentrism in Environmental Ethics: Questions of Inherent Worth, Etiology, and Teleofunctional Interests David Lewis Rice III University of Arkansas, Fayetteville
University of Arkansas, Fayetteville ScholarWorks@UARK Theses and Dissertations 8-2016 Biocentrism in Environmental Ethics: Questions of Inherent Worth, Etiology, and Teleofunctional Interests David Lewis Rice III University of Arkansas, Fayetteville Follow this and additional works at: http://scholarworks.uark.edu/etd Part of the Ethics and Political Philosophy Commons Recommended Citation Rice, David Lewis III, "Biocentrism in Environmental Ethics: Questions of Inherent Worth, Etiology, and Teleofunctional Interests" (2016). Theses and Dissertations. 1650. http://scholarworks.uark.edu/etd/1650 This Dissertation is brought to you for free and open access by ScholarWorks@UARK. It has been accepted for inclusion in Theses and Dissertations by an authorized administrator of ScholarWorks@UARK. For more information, please contact [email protected], [email protected]. Biocentrism in Environmental Ethics: Questions of Inherent Worth, Etiology, and Teleofunctional Interests A dissertation submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy in Philosophy by David Rice Delta State University Bachelor of Science in Biology, 1994 Delta State University Master of Science in Natural Sciences in Biology, 1999 University of Mississippi Master of Arts in Philosophy, 2009 August 2016 University of Arkansas This dissertation is approved for recommendation to the Graduate Council. ____________________________________ Dr. Richard Lee Dissertation Director ____________________________________ ____________________________________ Dr. Warren Herold Dr. Tom Senor Committee Member Committee Member Abstract Some biocentrists argue that all living things have "inherent worth". Anything that has inherent worth has interests that provide a reason for why all moral agents should care about it in and of itself. There are, however, some difficulties for biocentric individualist arguments which claim that all living things have inherent worth. -
2020 SIGACT REPORT SIGACT EC – Eric Allender, Shuchi Chawla, Nicole Immorlica, Samir Khuller (Chair), Bobby Kleinberg September 14Th, 2020
2020 SIGACT REPORT SIGACT EC – Eric Allender, Shuchi Chawla, Nicole Immorlica, Samir Khuller (chair), Bobby Kleinberg September 14th, 2020 SIGACT Mission Statement: The primary mission of ACM SIGACT (Association for Computing Machinery Special Interest Group on Algorithms and Computation Theory) is to foster and promote the discovery and dissemination of high quality research in the domain of theoretical computer science. The field of theoretical computer science is the rigorous study of all computational phenomena - natural, artificial or man-made. This includes the diverse areas of algorithms, data structures, complexity theory, distributed computation, parallel computation, VLSI, machine learning, computational biology, computational geometry, information theory, cryptography, quantum computation, computational number theory and algebra, program semantics and verification, automata theory, and the study of randomness. Work in this field is often distinguished by its emphasis on mathematical technique and rigor. 1. Awards ▪ 2020 Gödel Prize: This was awarded to Robin A. Moser and Gábor Tardos for their paper “A constructive proof of the general Lovász Local Lemma”, Journal of the ACM, Vol 57 (2), 2010. The Lovász Local Lemma (LLL) is a fundamental tool of the probabilistic method. It enables one to show the existence of certain objects even though they occur with exponentially small probability. The original proof was not algorithmic, and subsequent algorithmic versions had significant losses in parameters. This paper provides a simple, powerful algorithmic paradigm that converts almost all known applications of the LLL into randomized algorithms matching the bounds of the existence proof. The paper further gives a derandomized algorithm, a parallel algorithm, and an extension to the “lopsided” LLL. -
How Can We Solve the Meta-Problem of Consciousness?
How Can We Solve the Meta-Problem of Consciousness? David J. Chalmers I am grateful to the authors of the 39 commentaries on my article “The Meta-Problem of Consciousness”. I learned a great deal from reading them and from thinking about how to reply.1 The commentaries divide fairly nearly into about three groups. About half of them discuss po- tential solutions to the meta-problem. About a quarter of them discuss the question of whether in- tuitions about consciousness are universal, widespred, or culturally local. About a quarter discuss illusionism about consciousness and especially debunking arguments that move from a solution to the meta-problem to illusionism. Some commentaries fit into more than one group and some do not fit perfectly into any, but with some stretching this provides a natural way to divide them. As a result, I have divided my reply into three parts, each of which can stand alone. This first part is “How can We Solve the Meta-Problem of Conscousness?”. The other two parts are “Is the Hard Problem of Consciousness Universal?” and “Debunking Arguments for Illusionism about Consciousness”. How can we solve the meta-problem? As a reminder, the meta-problem is the problem of explaining our problem intuitions about consciousness, including the intuition that consciousness poses a hard problem and related explanatory and metaphysical intuitions, among others. One constraint is to explain the intuitions in topic-neutral terms (for example, physical, computational, structural, or evolutionary term) that do not make explicit appeal to consciousness in the explana- tion. In the target article, I canvassed about 15 potential solutions to the meta-problem. -
Information Theory for Intelligent People
Information Theory for Intelligent People Simon DeDeo∗ September 9, 2018 Contents 1 Twenty Questions 1 2 Sidebar: Information on Ice 4 3 Encoding and Memory 4 4 Coarse-graining 5 5 Alternatives to Entropy? 7 6 Coding Failure, Cognitive Surprise, and Kullback-Leibler Divergence 7 7 Einstein and Cromwell's Rule 10 8 Mutual Information 10 9 Jensen-Shannon Distance 11 10 A Note on Measuring Information 12 11 Minds and Information 13 1 Twenty Questions The story of information theory begins with the children's game usually known as \twenty ques- tions". The first player (the \adult") in this two-player game thinks of something, and by a series of yes-no questions, the other player (the \child") attempts to guess what it is. \Is it bigger than a breadbox?" No. \Does it have fur?" Yes. \Is it a mammal?" No. And so forth. If you play this game for a while, you learn that some questions work better than others. Children usually learn that it's a good idea to eliminate general categories first before becoming ∗Article modified from text for the Santa Fe Institute Complex Systems Summer School 2012, and updated for a meeting of the Indiana University Center for 18th Century Studies in 2015, a Colloquium at Tufts University Department of Cognitive Science on Play and String Theory in 2016, and a meeting of the SFI ACtioN Network in 2017. Please send corrections, comments and feedback to [email protected]; http://santafe.edu/~simon. 1 more specific, for example. If you ask on the first round \is it a carburetor?" you are likely wasting time|unless you're playing the game on Car Talk. -
An Information-Theoretic Approach to Normal Forms for Relational and XML Data
An Information-Theoretic Approach to Normal Forms for Relational and XML Data Marcelo Arenas Leonid Libkin University of Toronto University of Toronto [email protected] [email protected] ABSTRACT Several papers [13, 28, 18] attempted a more formal eval- uation of normal forms, by relating it to the elimination Normalization as a way of producing good database de- of update anomalies. Another criterion is the existence signs is a well-understood topic. However, the same prob- of algorithms that produce good designs: for example, we lem of distinguishing well-designed databases from poorly know that every database scheme can be losslessly decom- designed ones arises in other data models, in particular, posed into one in BCNF, but some constraints may be lost XML. While in the relational world the criteria for be- along the way. ing well-designed are usually very intuitive and clear to state, they become more obscure when one moves to more The previous work was specific for the relational model. complex data models. As new data formats such as XML are becoming critically important, classical database theory problems have to be Our goal is to provide a set of tools for testing when a revisited in the new context [26, 24]. However, there is condition on a database design, specified by a normal as yet no consensus on how to address the problem of form, corresponds to a good design. We use techniques well-designed data in the XML setting [10, 3]. of information theory, and define a measure of informa- tion content of elements in a database with respect to a set It is problematic to evaluate XML normal forms based of constraints. -
1 Applications of Information Theory to Biology Information Theory Offers A
Pacific Symposium on Biocomputing 5:597-598 (2000) Applications of Information Theory to Biology T. Gregory Dewey Keck Graduate Institute of Applied Life Sciences 535 Watson Drive, Claremont CA 91711, USA Hanspeter Herzel Innovationskolleg Theoretische Biologie, HU Berlin, Invalidenstrasse 43, D-10115, Berlin, Germany Information theory offers a number of fertile applications to biology. These applications range from statistical inference to foundational issues. There are a number of statistical analysis tools that can be considered information theoretical techniques. Such techniques have been the topic of PSB session tracks in 1998 and 1999. The two main tools are algorithmic complexity (including both MML and MDL) and maximum entropy. Applications of MML include sequence searching and alignment, phylogenetic trees, structural classes in proteins, protein potentials, calcium and neural spike dynamics and DNA structure. Maximum entropy methods have appeared in nucleotide sequence analysis (Cosmi et al., 1990), protein dynamics (Steinbach, 1996), peptide structure (Zal et al., 1996) and drug absorption (Charter, 1991). Foundational aspects of information theory are particularly relevant in several areas of molecular biology. Well-studied applications are the recognition of DNA binding sites (Schneider 1986), multiple alignment (Altschul 1991) or gene-finding using a linguistic approach (Dong & Searls 1994). Calcium oscillations and genetic networks have also been studied with information-theoretic tools. In all these cases, the information content of the system or phenomena is of intrinsic interest in its own right. In the present symposium, we see three applications of information theory that involve some aspect of sequence analysis. In all three cases, fundamental information-theoretical properties of the problem of interest are used to develop analyses of practical importance. -
Metaphilosophy of Consciousness Studies
Part Three Metaphilosophy of Consciousness Studies Bloomsbury companion to the philosophy of consciousness.indb 185 24-08-2017 15:48:52 Bloomsbury companion to the philosophy of consciousness.indb 186 24-08-2017 15:48:52 11 Understanding Consciousness by Building It Michael Graziano and Taylor W. Webb 1 Introduction In this chapter we consider how to build a machine that has subjective awareness. The design is based on the recently proposed attention schema theory (Graziano 2013, 2014; Graziano and Kastner 2011; Graziano and Webb 2014; Kelly et al. 2014; Webb and Graziano 2015; Webb, Kean and Graziano 2016). This hypothetical building project serves as a way to introduce the theory in a step-by-step manner and contrast it with other brain-based theories of consciousness. At the same time, this chapter is more than a thought experiment. We suggest that the machine could actually be built and we encourage artificial intelligence experts to try. Figure 11.1 frames the challenge. The machine has eyes that take in visual input (an apple in this example) and pass information to a computer brain. Our task is to build the machine such that it has a subjective visual awareness of the apple in the same sense that humans describe subjective visual awareness. Exactly what is meant by subjective awareness is not a priori clear. Most people have an intuitive notion that is probably not easily put into words. One goal of this building project is to see if a clearer definition of subjective awareness emerges from the constrained process of trying to build it.