SPASS-XDB Automated Reasoning with World Knowledge
Total Page:16
File Type:pdf, Size:1020Kb
Load more
Recommended publications
-
Commonsense Reasoning for Natural Language Processing
Introductory Tutorial: Commonsense Reasoning for Natural Language Processing Maarten Sap 1 Vered Shwartz 1;2 Antoine Bosselut 1;2 Yejin Choi 1;2 Dan Roth 3 1 Paul G. Allen School of Computer Science & Engineering, Seattle, WA, USA 2 Allen Institute for Artificial Intelligence, Seattle, WA, USA 3 Department of Computer and Information Science, University of Pennsylvania fmsap, vereds, antoineb, yejing @cs.washington.edu, [email protected] 1 Introduction settings, such as social interactions (Sap et al., 2019b; Rashkin et al., 2018a) and physical situ- Commonsense knowledge, such as knowing that ations (Zellers et al., 2019; Talmor et al., 2019). “bumping into people annoys them” or “rain We hope that in the future, machines develop makes the road slippery”, helps humans navigate the kind of intelligence required to, for exam- everyday situations seamlessly (Apperly, 2010). ple, properly assist humans in everyday situations Yet, endowing machines with such human-like (e.g., a chatbot that anticipates the needs of an el- commonsense reasoning capabilities has remained derly person; Pollack, 2005). Current methods, an elusive goal of artificial intelligence research however, are still not powerful or robust enough to for decades (Gunning, 2018). be deployed in open-domain production settings, Commonsense knowledge and reasoning have despite the clear improvements provided by large- received renewed attention from the natural lan- scale pretrained language models. This shortcom- guage processing (NLP) community in recent ing is partially due to inadequacy in acquiring, years, yielding multiple exploratory research di- understanding and reasoning about commonsense rections into automated commonsense under- knowledge, topics which remain understudied by standing. -
Why Machines Don't
KI - Künstliche Intelligenz https://doi.org/10.1007/s13218-019-00599-w SURVEY Why Machines Don’t (yet) Reason Like People Sangeet Khemlani1 · P. N. Johnson‑Laird2,3 Received: 15 February 2019 / Accepted: 19 June 2019 © This is a U.S. government work and not under copyright protection in the U.S.; foreign copyright protection may apply 2019 Abstract AI has never come to grips with how human beings reason in daily life. Many automated theorem-proving technologies exist, but they cannot serve as a foundation for automated reasoning systems. In this paper, we trace their limitations back to two historical developments in AI: the motivation to establish automated theorem-provers for systems of mathematical logic, and the formulation of nonmonotonic systems of reasoning. We then describe why human reasoning cannot be simulated by current machine reasoning or deep learning methodologies. People can generate inferences on their own instead of just evaluating them. They use strategies and fallible shortcuts when they reason. The discovery of an inconsistency does not result in an explosion of inferences—instead, it often prompts reasoners to abandon a premise. And the connectives they use in natural language have diferent meanings than those in classical logic. Only recently have cognitive scientists begun to implement automated reasoning systems that refect these human patterns of reasoning. A key constraint of these recent implementations is that they compute, not proofs or truth values, but possibilities. Keywords Reasoning · Mental models · Cognitive models 1 Introduction problems for mathematicians). Their other uses include the verifcation of computer programs and the design of com- The great commercial success of deep learning has pushed puter chips. -
Review Articles
review articles DOI:10.1145/2701413 AI has seen great advances of many kinds recently, but there is one critical area where progress has been extremely slow: ordinary commonsense. BY ERNEST DAVIS AND GARY MARCUS Commonsense Reasoning and Commonsense Knowledge in Artificial Intelligence WHO IS TALLER, Prince William or his baby son Prince key insights George? Can you make a salad out of a polyester shirt? ˽ To achieve human-level performance in domains such as natural language If you stick a pin into a carrot, does it make a hole processing, vision, and robotics, basic knowledge of the commonsense world— in the carrot or in the pin? These types of questions time, space, physical interactions, people, may seem silly, but many intelligent tasks, such as and so on—will be necessary. understanding texts, computer vision, planning, and ˽ Although a few forms of commonsense reasoning, such as taxonomic reasoning scientific reasoning require the same kinds of real- and temporal reasoning are well world knowledge and reasoning abilities. For instance, understood, progress has been slow. ˽ Extant techniques for implementing if you see a six-foot-tall person holding a two-foot-tall commonsense include logical analysis, handcrafting large knowledge bases, person in his arms, and you are told they are father Web mining, and crowdsourcing. Each of these is valuable, but none by itself is a and son, you do not have to ask which is which. If you full solution. need to make a salad for dinner and are out of lettuce, ˽ Intelligent machines need not replicate you do not waste time considering improvising by human cognition directly, but a better understanding of human commonsense taking a shirt of the closet and cutting might be a good place to start. -
An Overview of Automated Reasoning
An overview of automated reasoning John Harrison Intel Corporation 3rd February 2014 (10:30{11:30) Talk overview I What is automated reasoning? I Early history and taxonomy I Automation, its scope and limits I Interactive theorem proving I Hobbes (1651): \Reason . is nothing but reckoning (that is, adding and subtracting) of the consequences of general names agreed upon, for the marking and signifying of our thoughts." I Leibniz (1685) \When there are disputes among persons, we can simply say: Let us calculate [calculemus], without further ado, to see who is right." Nowadays, by `automatic and algorithmic' we mean `using a computer program'. What is automated reasoning? Attempting to perform logical reasoning in an automatic and algorithmic way. An old dream! I Leibniz (1685) \When there are disputes among persons, we can simply say: Let us calculate [calculemus], without further ado, to see who is right." Nowadays, by `automatic and algorithmic' we mean `using a computer program'. What is automated reasoning? Attempting to perform logical reasoning in an automatic and algorithmic way. An old dream! I Hobbes (1651): \Reason . is nothing but reckoning (that is, adding and subtracting) of the consequences of general names agreed upon, for the marking and signifying of our thoughts." Nowadays, by `automatic and algorithmic' we mean `using a computer program'. What is automated reasoning? Attempting to perform logical reasoning in an automatic and algorithmic way. An old dream! I Hobbes (1651): \Reason . is nothing but reckoning (that is, adding and subtracting) of the consequences of general names agreed upon, for the marking and signifying of our thoughts." I Leibniz (1685) \When there are disputes among persons, we can simply say: Let us calculate [calculemus], without further ado, to see who is right." What is automated reasoning? Attempting to perform logical reasoning in an automatic and algorithmic way. -
Downloading Programs
Futures of Artificial Intelligence through Technology Readiness Levels Fernando Mart´ınez-Plumed1,2, Emilia Gomez´ 1, Jose´ Hernandez-Orallo´ 2 Abstract Artificial Intelligence (AI) offers the potential to transform our lives in radical ways. However, the main unanswered questions about this foreseen transformation are its depth, breadth and timelines. To answer them, not only do we lack the tools to determine what achievements will be attained in the near future, but we even ignore what various technologies in present-day AI are capable of. Many so-called breakthroughs in AI are associated with highly-cited research papers or good performance in some particular benchmarks. However, research breakthroughs do not directly translate into a technology that is ready to use in real-world environments. In this paper, we present a novel exemplar- based methodology to categorise and assess several AI technologies, by mapping them onto Technology Readiness Levels (TRL) (representing their depth in maturity and availability). We first interpret the nine TRLs in the context of AI, and identify several categories in AI to which they can be assigned. We then introduce a generality dimension, which represents increasing layers of breadth of the technology. These two dimensions lead to the new readiness-vs-generality charts, which show that higher TRLs are achievable for low-generality technologies, focusing on narrow or specific abilities, while high TRLs are still out of reach for more general capabilities. We include numerous examples of AI technologies in a variety of fields, and show their readiness-vs-generality charts, serving as exemplars. Finally, we show how the timelines of several AI technology exemplars at different generality layers can help forecast some short-term and mid-term trends for AI. -
Commonsense Knowledge in Wikidata
Commonsense Knowledge in Wikidata Filip Ilievski1, Pedro Szekely1, and Daniel Schwabe2 1 Information Sciences Institute, University of Southern California 2 Dept. of Informatics, Pontificia Universidade Cat´olicaRio de Janeiro filievski,[email protected], [email protected] Abstract. Wikidata and Wikipedia have been proven useful for reason- ing in natural language applications, like question answering or entity linking. Yet, no existing work has studied the potential of Wikidata for commonsense reasoning. This paper investigates whether Wikidata con- tains commonsense knowledge which is complementary to existing com- monsense sources. Starting from a definition of common sense, we devise three guiding principles, and apply them to generate a commonsense subgraph of Wikidata (Wikidata-CS). Within our approach, we map the relations of Wikidata to ConceptNet, which we also leverage to integrate Wikidata-CS into an existing consolidated commonsense graph. Our ex- periments reveal that: 1) albeit Wikidata-CS represents a small portion of Wikidata, it is an indicator that Wikidata contains relevant com- monsense knowledge, which can be mapped to 15 ConceptNet relations; 2) the overlap between Wikidata-CS and other commonsense sources is low, motivating the value of knowledge integration; 3) Wikidata-CS has been evolving over time at a slightly slower rate compared to the overall Wikidata, indicating a possible lack of focus on commonsense knowl- edge. Based on these findings, we propose three recommended actions to improve the coverage and quality of Wikidata-CS further. Keywords: Commonsense Knowledge · Wikidata · Knowledge Graphs 1 Introduction Common sense is \the basic ability to perceive, understand, and judge things that are shared by nearly all people and can be reasonably expected of nearly all people without need for debate" [10]. -
Natural Language Understanding with Commonsense Reasoning
E.T.S. DE INGENIEROS INFORMÁTICOS UNIVERSIDAD POLITÉCNICA DE MADRID MASTER TESIS MSc IN ARTIFICIAL INTELLIGENCE (MUIA) NATURAL LANGUAGE UNDERSTANDING WITH COMMONSENSE REASONING: APPLICATION TO THE WINOGRAD SCHEMA CHALLENGE AUTHOR: ALFONSO LÓPEZ TORRES SUPERVISOR: MARTÍN MOLINA GONZÁLEZ JUNE, 2016 This is for my children Carla and Alonso, and my wife Véronique Thanks for their unconditional support and patient (also for the coming adventures…) v Acknowledgments: I’d like to thank the advices and help received from Martín. I was very lucky being your student. vi RESUMEN En 1950, Alan Turing propuso un test para evaluar el grado de inteligencia humana que podría presentar una máquina. La idea principal era realmente sencilla: llevar a cabo una charla abierta entre un evaluador y la máquina. Si dicho evaluador era incapaz de discernir si el examinado era una persona o una máquina, podría afirmarse que el test había sido superado. Desde entonces, a lo largo de los últimos 60 años se han presentado numerosas propuestas a través de los cuales se han puesto al descubierto ciertas debilidades del test. Quizás la más importante es el hecho de centrarse en la inteligencia humana, dejando a un lado otros tipos de inteligencia. El test obliga en gran medida a definir en la máquina un comportamiento antropomórfico y de imitación con el único fin de pasar el test. Con el fin de superar estos y otros puntos débiles, Hector Levesque propuso en 2011 un nuevo reto, “The Winograd Schema Challenge”. Un sencillo test basado en Pregunta y Respuesta sobre una frase que describe una situación cotidiana. -
Evaluating Commonsense Reasoning in Neural Machine Translation
The Box is in the Pen: Evaluating Commonsense Reasoning in Neural Machine Translation Jie Hey∗, Tao Wangz∗, Deyi Xiongy, and Qun Liux y College of Intelligence and Computing, Tianjin University, Tianjin, China z School of Computer Science and Technology, Soochow University, Suzhou, China x Huawei Noah’s Ark Lab, Hong Kong, China [email protected], [email protected] [email protected], [email protected] Abstract evidence for the need of commonsense knowl- edge in machine translation is “The box is in the Does neural machine translation yield transla- pen”, where machine translation is expected to per- tions that are congenial with common sense? form reasoning on the relative sizes of “box” and In this paper, we present a test suite to evalu- “pen”. Bar-Hillel also doubts that a machine, even ate the commonsense reasoning capability of equipped with extra-linguistic knowledge, would neural machine translation. The test suite consists of three test sets, covering lexical be able to reason with such knowledge sponta- and contextless/contextual syntactic ambiguity neously as human translators do (Bar-Hillel, 1960a; that requires commonsense knowledge to re- Macklovitch, 1995). solve. We manually create 1,200 triples, each Modern natural language processing (NLP) has of which contain a source sentence and two made tremendous progress, not only in building contrastive translations, involving 7 different abundant resources to develop linguistic insights, common sense types. Language models pre- but also in plenty of methodological practices. On trained on large-scale corpora, such as BERT, GPT-2, achieve a commonsense reasoning ac- the one hand, machine translation has been sub- curacy of lower than 72% on target transla- stantially advanced with large-scale parallel data tions of this test suite. -
Automated Reasoning for Explainable Artificial Intelligence∗
EPiC Series in Computing Volume 51, 2017, Pages 24–28 ARCADE 2017. 1st International Workshop on Automated Reasoning: Challenges, Appli- cations, Directions, Exemplary Achievements Automated Reasoning for Explainable Artificial Intelligence∗ Maria Paola Bonacina1 Dipartimento di Informatica Universit`adegli Studi di Verona Strada Le Grazie 15 I-37134 Verona, Italy, EU [email protected] Abstract Reasoning and learning have been considered fundamental features of intelligence ever since the dawn of the field of artificial intelligence, leading to the development of the research areas of automated reasoning and machine learning. This paper discusses the relationship between automated reasoning and machine learning, and more generally be- tween automated reasoning and artificial intelligence. We suggest that the emergence of the new paradigm of XAI, that stands for eXplainable Artificial Intelligence, is an oppor- tunity for rethinking these relationships, and that XAI may offer a grand challenge for future research on automated reasoning. 1 Artificial Intelligence, Automated Reasoning, and Ma- chine Learning Ever since the beginning of artificial intelligence, scientists concurred that the capability to learn and the capability to reason about problems and solve them are fundamental pillars of intelligent behavior. Similar to many subfields of artificial intelligence, automated reasoning and machine learning have grown into highly specialized research areas. Both have experienced the dichotomy between the ideal of imitating human intelligence, whereby the threshold of success would be the indistinguishability of human and machine, as in the Turing’s test [12], and the ideal that machines can and should learn and reason in their own way. According to the latter ideal, the measure of success is independent of similarity to human behavior. -
The Ratiolog Project: Rational Extensions of Logical Reasoning
The RatioLog Project: Rational Extensions of Logical Reasoning Ulrich Furbach · Claudia Schon · Frieder Stolzenburg · Karl-Heinz Weis · Claus-Peter Wirth Abstract Higher-level cognition includes logical reasoning 1 Rational Reasoning and Question Answering and the ability of question answering with common sense. The RatioLog project addresses the problem of rational rea- The development of formal logic played a big role in the soning in deep question answering by methods from auto- field of automated reasoning, which led to the development mated deduction and cognitive computing. In a first phase, of the field of artificial intelligence (AI). Applications of au- we combine techniques from information retrieval and ma- tomated deduction in mathematics have been investigated chine learning to find appropriate answer candidates from from the early years on. Nowadays automated deduction the huge amount of text in the German version of the free techniques are successfully applied in hard- and software encyclopedia “Wikipedia”. In a second phase, an automated verification and many other areas (for an overview see [2]). theorem prover tries to verify the answer candidates on In contrast to formal logical reasoning, however, human the basis of their logical representations. In a third phase reasoning does not strictly follow the rules of classical logic. — because the knowledge may be incomplete and inconsis- Reasons may be incomplete knowledge, incorrect beliefs, tent —, we consider extensions of logical reasoning to im- and inconsistent norms. From the very beginning of AI re- prove the results. In this context, we work toward the appli- search, there has been a strong emphasis on incorporating cation of techniques from human reasoning: We employ de- mechanisms for rationality, such as abductive or defeasible feasible reasoning to compare the answers w.r.t. -
Automated Reasoning on the Web
Automated Reasoning on the Web Slim Abdennadher1, Jos´eJ´ulioAlves Alferes2, Grigoris Antoniou3, Uwe Aßmann4, Rolf Backofen5, Cristina Baroglio6, Piero A. Bonatti7, Fran¸coisBry8, W lodzimierz Drabent9, Norbert Eisinger8, Norbert E. Fuchs10, Tim Geisler11, Nicola Henze12, Jan Ma luszy´nski4, Massimo Marchiori13, Alberto Martelli14, Sara Carro Mart´ınez15, Wolfgang May16, Hans J¨urgenOhlbach8, Sebastian Schaffert8, Michael Schr¨oder17, Klaus U. Schulz8, Uta Schwertel8, and Gerd Wagner18 1 German University in Cairo (Egypt), 2 New University of Lisbon (Portugal), 3 Institute of Computer Science, Foundation for Research and Technology – Hel- las (Greece), 4 University of Link¨oping (Sweden), 5 University of Jena (Germany), 6 University of Turin (Italy), 7 University of Naples (Italy), 8 University of Mu- nich (Germany), 9 Polish Academy of Sciences (Poland), 10 University of Zurich (Switzerland), 11 webXcerpt (Germany), 12 University of Hannover (Germany), 13 University of Venice (Italy), 14 University of Turin (Italy), 15 Telef´onica Investi- gaci´ony Desarollo (Spain), 16 University of G¨ottingen(Germany), 17 University of Dresden (Germany), 18 University of Eindhoven (The Netherlands) Abstract Automated reasoning is becoming an essential issue in many Web systems and applications, especially in emerging Semantic Web applications. This article first discusses reasons for this evolution. Then, it presents research issues currently investigated towards automated reasoning on the Web and it introduces into selected applications demonstrating the practical impact of the approach. Finally, it introduces a research endeavor called REWERSE (cf. http://rewerse.net) recently launched by the authors of this article which is concerned with developing automated reasoning methods and tools for the Web as well as demonstrator applications. -
Frege's Influence on the Modern Practice of Doing Mathematics
논리연구 20-1(2017) pp. 97-112 Frege’s influence on the modern practice of doing mathematics 1) Gyesik Lee 【Abstract】We discuss Frege’s influence on the modern practice of doing mathematical proofs. We start with explaining Frege’s notion of variables. We also talk of the variable binding issue and show how successfully his idea on this point has been applied in the field of doing mathematics based on a computer software. 【Key Words】Frege, Begriffsschrift, variable binding, mechanization, formal proofs Received: Nov. 11, 2016. Revised: Feb. 10, 2017. Accepted: Feb. 11, 2017. 98 Gyesik Lee 1. Introduction Around the turn of the 20th century, mathematicians and logicians were interested in a more exact investigation into the foundation of mathematics and soon realized that ordinary mathematical arguments can be represented in formal axiomatic systems. One prominent figure in this research was Gottlob Frege. His main concern was twofold: (1) whether arithmetical judgments could be proved in a purely logical manner, and (2) how far one could progress in arithmetic merely by using the laws of logic. In Begriffsschrift (Frege, 1879), he invented a special kind of language system, where statements can be proved as true based only upon some general logical laws and definitions. This system is then used later in the two volumes of Grundgesetze der Arithmetik (Frege, 1893, 1903), where he provided and analyzed a formal system for second order arithmetic. Although the system in (Frege, 1893, 1903) is known to be inconsistent, it contains all of the essential materials to provide a fundamental basis for dealing with propositions of arithmetic based on an axiomatic system.