Computability and Complexity

Total Page:16

File Type:pdf, Size:1020Kb

Computability and Complexity Computability and Complexity Lecture Notes Herbert Jaeger, Jacobs University Bremen Version history Jan 30, 2018: created as copy of CC lecture notes of Spring 2017 Feb 16, 2018: cleaned up font conversion hickups up to Section 5 Feb 23, 2018: cleaned up font conversion hickups up to Section 6 Mar 15, 2018: cleaned up font conversion hickups up to Section 7 Apr 5, 2018: cleaned up font conversion hickups up to the end of these lecture notes 1 1 Introduction 1.1 Motivation This lecture will introduce you to the theory of computation and the theory of computational complexity. The theory of computation offers full answers to the questions, • what problems can in principle be solved by computer programs? • what functions can in principle be computed by computer programs? • what formal languages can in principle be decided by computer programs? Full answers to these questions have been found in the last 70 years or so, and we will learn about them. (And it turns out that these questions are all the same question). The theory of computation is well-established, transparent, and basically simple (you might disagree at first). The theory of complexity offers many insights to questions like • for a given problem / function / language that has to be solved / computed / decided by a computer program, how long does the fastest program actually run? • how much memory space has to be used at least? • can you speed up computations by using different computer architectures or different programming approaches? The theory of complexity is historically younger than the theory of computation – the first surge of results came in the 60ties of last century. It grounds in the theory of computation. In comparison to the theory of computation, the theory of complexity is itself much more complex, is haunted by difficult unsolved fundamental questions, and is a highly active field of research. Why should you want to know about either of the two? There are three sorts of reasons. First, a philosophical reason. Being (or becoming) computer scientists, you should (want to) know what computation is. Just out of curiosity, just like a physicist should have sharp, rich and immediate intuitions about energy, mass or spacetime. We will use the largest part of today's lecture to outline the philosophical/mathematical history of how some of the most famous thinkers of mankind tried to come to terms with "computation". Second, a social reason. If you are a computer science professional, you will talk to other computer science professionals over lunch or in cozy conference lounges. Your colleagues will have learnt all that is standardly learnt about computation and complexity. A lecture on computation and complexity is taught in every CS program on every habitable planet in the universe. Just in order to be accepted by your colleagues, you need to know how to keep a conversation running that starts like, "I have a problem that seems undecidable to me...", or "no chance to solve this task in a thousand years of runtime... ", or "smells like NP-complete, I don't envy you, ha-ha..." (very funny). Third, some practical reasons: 2 1. The theory of computation has led to a mathematical formalism called lambda calculus that in turn has spawned a family of pragramming languages called functional programming languages. The best known among them are probably LISP, the workhorse language for many applications in artificial intelligence, and ML (you know it from your GenCS lecture). 2. In your future career as professional computer scientist you might be asked to write computer programs that solve tasks like the following: • Given an electronic ciruit, find a VLSI chip layout that minimizes connection wiring length. • Given a microprocessor program for an airplane autopilot, prove that the program will never stall (the certification-of-airworthiness authorities will want such a proof). • Given the daily assignment of customers to serve in different cities, schedule a fleet of delivery trucks such that effective mileage is minimized. • Given two DNA sequences, decide whether they share some subsequence, possibly with omissions and insertions within the shared subsequence. Three among these four problems are practically unsolvable, and one is (comparably) easy. Unfortunately, the autopilot certification task is not the simple one – and in fact, passenger airplanes have crashed because of onboard computer program failure. In this lecture you will • learn what “practically unsolvable” means (roughly, it means NP-complete), • get a hands-on feeling for detecting a practically unsolvable problem when you see it (by studying numerous examples), • learn about ways to attack "practically unsolvable" problems (by resorting to a slightly different but solvable problem; by finding approximate solutions; or by finding the correct solution with high probability). In sum, a training in computational complexity will prepare you for the diagnosis of, and the coping with, computationally complex tasks. 3. The theory of complexity (together with number theory) is at the core of modern cryptography techniques – and encrypting data is essential for safe communication protocols. In this sense, the future commercial impact of web-based technology hinges on (advanced) results from the theory of complexity. 1.2 Overview This is the planned contents for this course. Parts marked by * are optional; we will enter them as time admits. 1. History of "computation" 2. Our workhorse: Turing machines 3. Computability and decidability, computing functions vs. deciding languages 4. Recursive functions 5. Lambda calculus 6. Functional programming 7. What "problems" are in the perspective of complexity theory 8. Complexity classes 3 9. NP-complete problems: your bread and butter as a computer scientist 10. *Logical characterization of complexity In parts 1. through 6., I used many sources and recommend to rely mainly on these lecture notes. For parts 2. and 3., the textbook Introduction to Automata Theory, Languages, and Computation by Hopcroft, Motwani and Ullman will be helpful as an additional reference, but I will not follow it too closely. In 7. through 11., I will largely follow the book Computational Complexity by Christos H. Papadimitriou – a standard textbook. These lecture notes are intended to be a fully self-contained course companion, and the material covered herein is what you need to know for exams. 4 Part 1: Computation 2. A short history of "computation" Philosophers and mathematicians struggled with the question what "computation" is for over two thousand years. You are in the happy historical condition that today this question is deemed understood and even answered. In the beginning, computation was not called computation. Instead, the question first appeared in the form of what is logical reasoning. Roughly speaking, logical reasoning is the art of arriving at a conclusion from some assumptions in a step-by-step fashion, executing justifiable rules of argumentation for every step of the argumentation chain. Only today we understand that this is largely the same thing as performing a computation – which also, on a digital von-Neumann computer such as your PC, proceeds by executing "correct" instructions in step-by-step fashion. The theory of computation departed from logics only quite recently, roughly since 130 years. In this little overview we will cover both the "ancient" and the more modern developments. A handy overview1 of this philosophical history of logic and computation can be found at the Website of theoretical computer scientist Grant Malcolm2 – I have taken some inspirations for the following overview from it, as well as from the magnificent collection of mathematician's biographies3 maintained by John J O'Connor4 and Edmund F Robertson5 at the University of St. Andrews, Scotland. Aristotle6 (384-322 B.C.) is, in many respects, the original inventor of the natural sciences. He emphasized rational reasoning over myth and mystics and painstakingly described and catalogued natural phenomena, especially animals and plants. He also investigated what correct argumentation (as opposed to mere rhetoric and "sophisms") is and found formal reasoning rules called syllogisms. The most famous syllogism is 1. All humans are mortal. 2. All Greeks are humans. 3. Therefore: All Greeks are mortal. Syllogisms describe "logical" derivations of one conclusion (3.) from two premises (1., 2.). When the premises are true, the conclusion is true, too – because of the logical form of the argument itself. Aristotle presented and systematicised 19 syllogisms and claimed "that every deductive argument can be expressed as a series of syllogistic inferences. That the argument is unconvincing masks the fact that simply by raising the problem, Aristotle earns the right to be considered not only the father of logic, but also the (grand)father of metalogic." (Jonathan Lear, Aristotle and Logical Theory. Cambridge: Cambridge University Press, 1980.). Euclid7 (330? – 275? B.C.) invented what is today understood by mathematicians as mathematics. He used sequences of strict arguments to derive true (geometrical) theorems from axioms which were evidently true. You can still buy Euclid's book "The Elements" at Amazon, which is remarkable in many ways (consider, for instance, that the webserver 1 http://www.csc.liv.ac.uk/~grant/Teaching/COMP317/logic.html 2 http://www.csc.liv.ac.uk/~grant/index.html 3 http://www-history.mcs.st-and.ac.uk/ 4 http://www-history.mcs.st-andrews.ac.uk/%7Ejohn 5 http://www-history.mcs.st-andrews.ac.uk/%7Eedmund 6 http://www-history.mcs.st-andrews.ac.uk/history/Mathematicians/Aristotle.html 7 http://www-history.mcs.st-andrews.ac.uk/history/Mathematicians/Euclid.html 5 software of Amazon runs by the same principles as the arguments in Euclid's book – not from axioms to theorems but from your typed-in commands to the billing message). Middle ages in Europe: academic thinking – both subjects and methods – was rigidly ruled by the ideology of scholasticism8, very much a re-brew of Aristotelian philosophy.
Recommended publications
  • Artificial Consciousness and the Consciousness-Attention Dissociation
    Consciousness and Cognition 45 (2016) 210–225 Contents lists available at ScienceDirect Consciousness and Cognition journal homepage: www.elsevier.com/locate/concog Review article Artificial consciousness and the consciousness-attention dissociation ⇑ Harry Haroutioun Haladjian a, , Carlos Montemayor b a Laboratoire Psychologie de la Perception, CNRS (UMR 8242), Université Paris Descartes, Centre Biomédical des Saints-Pères, 45 rue des Saints-Pères, 75006 Paris, France b San Francisco State University, Philosophy Department, 1600 Holloway Avenue, San Francisco, CA 94132 USA article info abstract Article history: Artificial Intelligence is at a turning point, with a substantial increase in projects aiming to Received 6 July 2016 implement sophisticated forms of human intelligence in machines. This research attempts Accepted 12 August 2016 to model specific forms of intelligence through brute-force search heuristics and also reproduce features of human perception and cognition, including emotions. Such goals have implications for artificial consciousness, with some arguing that it will be achievable Keywords: once we overcome short-term engineering challenges. We believe, however, that phenom- Artificial intelligence enal consciousness cannot be implemented in machines. This becomes clear when consid- Artificial consciousness ering emotions and examining the dissociation between consciousness and attention in Consciousness Visual attention humans. While we may be able to program ethical behavior based on rules and machine Phenomenology learning, we will never be able to reproduce emotions or empathy by programming such Emotions control systems—these will be merely simulations. Arguments in favor of this claim include Empathy considerations about evolution, the neuropsychological aspects of emotions, and the disso- ciation between attention and consciousness found in humans.
    [Show full text]
  • Inventing Computational Rhetoric
    INVENTING COMPUTATIONAL RHETORIC By Michael W. Wojcik A THESIS Submitted to Michigan State University in partial fulfillment of the requirements for the degree of Digital Rhetoric and Professional Writing — Master of Arts 2013 ABSTRACT INVENTING COMPUTATIONAL RHETORIC by Michael W. Wojcik Many disciplines in the humanities are developing “computational” branches which make use of information technology to process large amounts of data algorithmically. The field of computational rhetoric is in its infancy, but we are already seeing interesting results from applying the ideas and goals of rhetoric to text processing and related areas. After considering what computational rhetoric might be, three approaches to inventing computational rhetorics are presented: a structural schema, a review of extant work, and a theoretical exploration. Copyright by MICHAEL W. WOJCIK 2013 For Malea iv ACKNOWLEDGEMENTS Above all else I must thank my beloved wife, Malea Powell, without whose prompting this thesis would have remained forever incomplete. I am also grateful for the presence in my life of my terrific stepdaughter, Audrey Swartz, and wonderful granddaughter Lucille. My thesis committee, Dean Rehberger, Bill Hart-Davidson, and John Monberg, pro- vided me with generous guidance and inspiration. Other faculty members at Michigan State who helped me explore relevant ideas include Rochelle Harris, Mike McLeod, Joyce Chai, Danielle Devoss, and Bump Halbritter. My previous academic program at Miami University did not result in a degree, but faculty there also contributed greatly to my the- oretical understanding, particularly Susan Morgan, Mary-Jean Corbett, Brit Harwood, J. Edgar Tidwell, Lori Merish, Vicki Smith, Alice Adams, Fran Dolan, and Keith Tuma.
    [Show full text]
  • Computability Theory
    CSC 438F/2404F Notes (S. Cook and T. Pitassi) Fall, 2019 Computability Theory This section is partly inspired by the material in \A Course in Mathematical Logic" by Bell and Machover, Chap 6, sections 1-10. Other references: \Introduction to the theory of computation" by Michael Sipser, and \Com- putability, Complexity, and Languages" by M. Davis and E. Weyuker. Our first goal is to give a formal definition for what it means for a function on N to be com- putable by an algorithm. Historically the first convincing such definition was given by Alan Turing in 1936, in his paper which introduced what we now call Turing machines. Slightly before Turing, Alonzo Church gave a definition based on his lambda calculus. About the same time G¨odel,Herbrand, and Kleene developed definitions based on recursion schemes. Fortunately all of these definitions are equivalent, and each of many other definitions pro- posed later are also equivalent to Turing's definition. This has lead to the general belief that these definitions have got it right, and this assertion is roughly what we now call \Church's Thesis". A natural definition of computable function f on N allows for the possibility that f(x) may not be defined for all x 2 N, because algorithms do not always halt. Thus we will use the symbol 1 to mean “undefined". Definition: A partial function is a function n f :(N [ f1g) ! N [ f1g; n ≥ 0 such that f(c1; :::; cn) = 1 if some ci = 1. In the context of computability theory, whenever we refer to a function on N, we mean a partial function in the above sense.
    [Show full text]
  • Introduction to the Theory of Computation Computability, Complexity, and the Lambda Calculus Some Notes for CIS262
    Introduction to the Theory of Computation Computability, Complexity, And the Lambda Calculus Some Notes for CIS262 Jean Gallier and Jocelyn Quaintance Department of Computer and Information Science University of Pennsylvania Philadelphia, PA 19104, USA e-mail: [email protected] c Jean Gallier Please, do not reproduce without permission of the author April 28, 2020 2 Contents Contents 3 1 RAM Programs, Turing Machines 7 1.1 Partial Functions and RAM Programs . 10 1.2 Definition of a Turing Machine . 15 1.3 Computations of Turing Machines . 17 1.4 Equivalence of RAM programs And Turing Machines . 20 1.5 Listable Languages and Computable Languages . 21 1.6 A Simple Function Not Known to be Computable . 22 1.7 The Primitive Recursive Functions . 25 1.8 Primitive Recursive Predicates . 33 1.9 The Partial Computable Functions . 35 2 Universal RAM Programs and the Halting Problem 41 2.1 Pairing Functions . 41 2.2 Equivalence of Alphabets . 48 2.3 Coding of RAM Programs; The Halting Problem . 50 2.4 Universal RAM Programs . 54 2.5 Indexing of RAM Programs . 59 2.6 Kleene's T -Predicate . 60 2.7 A Non-Computable Function; Busy Beavers . 62 3 Elementary Recursive Function Theory 67 3.1 Acceptable Indexings . 67 3.2 Undecidable Problems . 70 3.3 Reducibility and Rice's Theorem . 73 3.4 Listable (Recursively Enumerable) Sets . 76 3.5 Reducibility and Complete Sets . 82 4 The Lambda-Calculus 87 4.1 Syntax of the Lambda-Calculus . 89 4.2 β-Reduction and β-Conversion; the Church{Rosser Theorem . 94 4.3 Some Useful Combinators .
    [Show full text]
  • Programming with Recursion
    Purdue University Purdue e-Pubs Department of Computer Science Technical Reports Department of Computer Science 1980 Programming With Recursion Dirk Siefkes Report Number: 80-331 Siefkes, Dirk, "Programming With Recursion" (1980). Department of Computer Science Technical Reports. Paper 260. https://docs.lib.purdue.edu/cstech/260 This document has been made available through Purdue e-Pubs, a service of the Purdue University Libraries. Please contact [email protected] for additional information. '. \ PI~Q(:[V\!'<lMTNr. 11'1'1'11 nr:CUI~SrON l1irk Siefke$* Tcchnische UniveTsit~t Berlin Inst. Soft\~are Theor. Informatik 1 Berlin 10, West Germany February, 1980 Purdue University Tech. Report CSD-TR 331 Abstract: Data structures defined as term algebras and programs built from recursive definitions complement each other. Computing in such surroundings guides us into Nriting simple programs Nith a clear semantics and performing a rigorous cost analysis on appropriate data structures. In this paper, we present a programming language so perceived, investigate some basic principles of cost analysis through it, and reflect on the meaning of programs and computing. -;;----- - -~~ Visiting at. the Computer Science Department of Purdue University with the help of a grant of the Stiftung Volksl.... agem.... erk. I am grateful for the support of both, ViV-Stiftung and Purdue. '1 1 CONTENTS O. Introduction I. 'llle formnlislIl REe Syntax and semantics of REC-programs; the formalisms REC(B) and RECS; recursive functions. REC l~ith VLI-r-t'iblcs. -2. Extensions and variations Abstract languages and compilers. REC over words as data structure; the formalisms REC\\'(q). REe for functions with variable I/O-dimension; the forma l:i sms VREC (B) .
    [Show full text]
  • Computer Algorithms As Persuasive Agents: the Rhetoricity of Algorithmic Surveillance Within the Built Ecological Network
    COMPUTER ALGORITHMS AS PERSUASIVE AGENTS: THE RHETORICITY OF ALGORITHMIC SURVEILLANCE WITHIN THE BUILT ECOLOGICAL NETWORK Estee N. Beck A Dissertation Submitted to the Graduate College of Bowling Green State University in partial fulfillment of the requirements for the degree of DOCTOR OF PHILOSOPHY May 2015 Committee: Kristine Blair, Advisor Patrick Pauken, Graduate Faculty Representative Sue Carter Wood Lee Nickoson © 2015 Estee N. Beck All Rights Reserved iii ABSTRACT Kristine Blair, Advisor Each time our students and colleagues participate online, they face invisible tracking technologies that harvest metadata for web customization, targeted advertising, and even state surveillance activities. This practice may be of concern for computers and writing and digital humanities specialists, who examine the ideological forces in computer-mediated writing spaces to address power inequality, as well as the role ideology plays in shaping human consciousness. However, the materiality of technology—the non-human objects that surrounds us—is of concern to those within rhetoric and composition as well. This project shifts attention to the materiality of non-human objects, specifically computer algorithms and computer code. I argue that these technologies are powerful non-human objects that have rhetorical agency and persuasive abilities, and as a result shape the everyday practices and behaviors of writers/composers on the web as well as other non-human objects. Through rhetorical inquiry, I examine literature from rhetoric and composition, surveillance studies, media and software studies, sociology, anthropology, and philosophy. I offer a “built ecological network” theory that is the manufactured and natural rhetorical rhizomatic network full of spatial, material, social, linguistic, and dynamic energy layers that enter into reflexive and reciprocal relations to support my claim that computer algorithms have agency and persuasive abilities.
    [Show full text]
  • 6.2 Presenting Formal and Informal Mathematics
    PDF hosted at the Radboud Repository of the Radboud University Nijmegen The following full text is a publisher's version. For additional information about this publication click this link. http://hdl.handle.net/2066/119001 Please be advised that this information was generated on 2021-09-27 and may be subject to change. Documentation and Formal Mathematics Web Technology meets Theorem Proving Proefschrift ter verkrijging van de graad van doctor aan de Radboud Universiteit Nijmegen, op gezag van de rector magnificus prof. mr. S.C.J.J. Kortmann, volgens besluit van het college van decanen in het openbaar te verdedigen op dinsdag 17 december 2013 om 12.30 uur precies door Carst Tankink geboren op 21 januari 1986 te Warnsveld Promotor: Prof. dr. J.H. Geuvers Copromotor: Dr. J.H. McKinna Manuscriptcommissie: Prof. dr. H.P. Barendregt Prof. dr. M. Kohlhase (Jacobs University, Bremen) Dr. M. Wenzel (Université Paris Sud) ISBN:978-94-6191-963-2 This research has been carried out under the auspices of the research school IPA (Institute for Programming research and Algorithmics). The author was supported by the Netherlands Organisation for Scientific Research (NWO) under the project “MathWiki: a Web-based Collaborative Authoring Environment for Formal Proofs”. cbaThis work is licensed under a Creative Commons Attribution-ShareAlike 3.0 Unported License. The source code of this thesis is available at https://bitbucket.org/Carst/thesis. Contents Contents iii Preface vii 1 Introduction 1 1.1 Wikis and other Web Technology . .2 1.2 Tools of the Trade: Interactive Theorem Provers . .4 1.3 Collaboration or Communication .
    [Show full text]
  • Michael Trott
    Mathematical Search Some thoughts from a Wolfram|Alpha perspective Michael Trott Wolfram|Alpha Slide 1 of 16 A simple/typical websearch in 2020? Slide 2 of 16 Who performs mathematical searches? Not only mathematicians, more and more engineers, biologists, …. Slide 3 of 16 The path/cycle of mathematical search: An engineer, biologist, economist, physicist, … needs to know mathematical results about a certain problem Step 1: find relevant literature citations (Google Scholar, Microsoft Academic Search, MathSciNet, Zentralblatt) fl Step 2: obtain copy of the book or paper (printed or electronic) fl Step 3: read, understand, apply/implement the actual result (identify typos, misprints, read references fl Step 1) The ideal mathematical search shortens each of these 3 steps. Assuming doing the work; no use of newsgroups, http://stackexchange.com, …. Ideal case: Mathematical search gives immediate theSlide answer,4 of 16 not just a pointer to a paper that might contain the answer; either by computation of by lookup Current status of computability: • fully computable (commutative algebra, quantifier elimination, univariate integration, …) • partially computable (nonlinear differential equations, proofs of theorem from above, …) • barely or not computable (Lebesgue measures, C* algebras, …), but can be semantically annotated How are the 100 million pages of mathematics distributed? J. Borwein: Recalibrate Watson to solve math problems Cost : $500 million Timeframe : Five years Last years: Watson, Wolfram|Alpha Slide 5 of 16 Slide 6 of 16 Slide 7 of 16 Ask your smartphone (right now only SIRI) for the gravitational potential of a cube Slide 8 of 16 And in the not too distant future play with orbits around a cube on your cellphone: find closed orbits of a particle in the gravitational potential of a cube initial position x0 1.3 y 0 0 z0 0 initial velocity v x,0 0 v y ,0 -0.29 v z,0 0 charge plot range solution time 39.8 Slide 9 of 16 Returned results are complete semantic representations of the mathematical fact And, within Mathematica, they are also fully computable.
    [Show full text]
  • Knowledge Representation in Bicategories of Relations
    Knowledge Representation in Bicategories of Relations Evan Patterson Department of Statistics, Stanford University Abstract We introduce the relational ontology log, or relational olog, a knowledge repre- sentation system based on the category of sets and relations. It is inspired by Spivak and Kent’s olog, a recent categorical framework for knowledge representation. Relational ologs interpolate between ologs and description logic, the dominant for- malism for knowledge representation today. In this paper, we investigate relational ologs both for their own sake and to gain insight into the relationship between the algebraic and logical approaches to knowledge representation. On a practical level, we show by example that relational ologs have a friendly and intuitive—yet fully precise—graphical syntax, derived from the string diagrams of monoidal categories. We explain several other useful features of relational ologs not possessed by most description logics, such as a type system and a rich, flexible notion of instance data. In a more theoretical vein, we draw on categorical logic to show how relational ologs can be translated to and from logical theories in a fragment of first-order logic. Although we make extensive use of categorical language, this paper is designed to be self-contained and has considerable expository content. The only prerequisites are knowledge of first-order logic and the rudiments of category theory. 1. Introduction The representation of human knowledge in computable form is among the oldest and most fundamental problems of artificial intelligence. Several recent trends are stimulating continued research in the field of knowledge representation (KR). The birth of the Semantic Web [BHL01] in the early 2000s has led to new technical standards and motivated new machine learning techniques to automatically extract knowledge from unstructured text [Nic+16].
    [Show full text]
  • Shaping Wikipedia Into a Computable Knowledge Base
    SHAPING WIKIPEDIA INTO A COMPUTABLE KNOWLEDGE BASE Michael K. Bergman1, Coralville, Iowa USA March 31, 2015 AI3:::Adaptive Information blog Wikipedia is arguably the most important information source yet invented for natural language processing (NLP) and artificial intelligence, in addition to its role as humanity’s largest encyclopedia. Wikipedia is the principal information source for such prominent services as IBM’s Watson [1], Freebase [2], the Google Knowledge Graph [3], Apple’s Siri [4], YAGO [5], and DBpedia [6], the core reference structure for linked open data [7]. Wikipedia information has assumed a prominent role in NLP applications in word sense disambiguation, named entity recognition, co-reference resolution, and multi-lingual alignments; in information retrieval in query expansion, multi-lingual retrieval, question answering, entity ranking, text categorization, and topic indexing; and in semantic applications in topic extraction, relation extraction, entity extraction, entity typing, semantic relatedness, and ontology building [8]. The massive size of Wikipedia — with more than 26 million articles across 250 different language versions [9,10] — makes it a rich resource for reference entities and concepts. Structural features of Wikipedia that help to inform the understanding of relationships and connections include articles (and their embedded entities and concepts), article abstracts, article titles, infoboxes, redirects, internal and external links, editing histories, categories (in part), discussion pages, disambiguation pages, images and associated metadata, templates, tables, and pages of lists, not to mention Wikipedia as a whole being used as a corpus or graph [11]. It is no wonder that Wikipedia is referenced in about 665,000 academic articles and books [12].
    [Show full text]
  • Ontology for Information Systems (O4IS) Design Methodology Conceptualizing, Designing and Representing Domain Ontologies
    Ontology for Information Systems (O4IS) Design Methodology Conceptualizing, Designing and Representing Domain Ontologies Vandana Kabilan October 2007. A Dissertation submitted to The Royal Institute of Technology in partial fullfillment of the requirements for the degree of Doctor of Technology . The Royal Institute of Technology School of Information and Communication Technology Department of Computer and Systems Sciences IV DSV Report Series No. 07–013 ISBN 978–91–7178–752–1 ISSN 1101–8526 ISRN SU–KTH/DSV/R– –07/13– –SE V All knowledge that the world has ever received comes from the mind; the infinite library of the universe is in our own mind. – Swami Vivekananda. (1863 – 1902) Indian spiritual philosopher. The whole of science is nothing more than a refinement of everyday thinking. – Albert Einstein (1879 – 1955) German-Swiss-U.S. scientist. Science is a mechanism, a way of trying to improve your knowledge of na- ture. It’s a system for testing your thoughts against the universe, and seeing whether they match. – Isaac Asimov. (1920 – 1992) Russian-U.S. science-fiction author. VII Dedicated to the three KAs of my life: Kabilan, Rithika and Kavin. IX Abstract. Globalization has opened new frontiers for business enterprises and human com- munication. There is an information explosion that necessitates huge amounts of informa- tion to be speedily processed and acted upon. Information Systems aim to facilitate human decision-making by retrieving context-sensitive information, making implicit knowledge ex- plicit and to reuse the knowledge that has already been discovered. A possible answer to meet these goals is the use of Ontology.
    [Show full text]
  • PRINCIPLES of SYNTHETIC INTELLIGENCE
    PRINCIPLES of SYNTHETIC INTELLIGENCE Building Blocks for an Architecture of Motivated Cognition Joscha Bach, Universität Osnabrück Cover artwork by Alex Guillotte (based on a painting by Leonardo da Vinci), used with friendly permission of the artist. Principles of Synthetic Intelligence Building Blocks for an Architecture of Motivated Cognition Dissertation submitted in partial fulfillment of the requirements for the doctoral degree (PhD) in Cognitive Science at the Fachbereich Humanwissenschaften, Universität Osnabrück by Joscha Bach 30th of March 2007 Advisors: Prof. Dr. Hans-Dieter Burkhard Prof. Dr. Dietrich Dörner Prof. Dr. Kai-Uwe Kühnberger Abstract Computational models of cognitive functioning have become a thriving paradigm in Cognitive Science, yet they usually only emphasize problem solving and reasoning, or treat perception and motivation as isolated modules. A very promising approach towards a broader architecture of cognition is the Psi theory of Dietrich Dörner. By dealing with the integration of motivation and emotion with perceptual and reasoning processes and including grounded neuro-symbolic representations, it contributes to an integrated understanding of the mind. The Psi theory supplies a conceptual framework highlighting the interrelations between perception and memory, language and mental representation, reasoning and motivation, emotion and cognition, autonomy and social behavior. However, its origin in psychology, its methodology and the lack of documentation have limited its impact to cognitive modeling. This work adapts the Psi theory to Cognitive Science and Artificial Intelligence, by summarizing and structuring it, by identifying its contribution to understanding cognition, and by providing a technical framework for implementing models of the theory. These goals are reflected in the three parts of this thesis.
    [Show full text]