Image schemas in conceptual blending as a method for formal concept invention Maria M. Hedblom Otto-von-Guericke University, Magdeburg http//:www.mariamhedblom.com Supervisors: Oliver Kutz1, Till Mossakowski2 The ‘image schema’ is thought to be the abstracted spatial pattern from the embodied experience learnt in early infancy. Introduction Classic examples are CONTAINMENT,SUPPORT and PATH. In many fields artificial agents surpass humans, e.g. memory These mental structures offer a foundation to ground cogni- capacity, speed and accuracy of calculation. However, there tive phenomena, such as language, understanding, and rea- is at least one field in which humans still are superior: cre- soning, by providing a connection between the bodily expe- ative ability. Research investigating the creative side of AI is rienced relationships of physical objects in time and space called computational creativity and it has some success with with the internal conceptual world of an agent. results such as artificial agents that paint (e.g. The Painting The cognitive benefit of image schemas lies in their gen- Fool (Colton, 2012)) and generate stories (Gervas,´ 2009). eralised nature, which enables analogical transfer of knowl- One of the hardest problems yet to be solved in computa- edge or expectations onto unknown situations. E.g., if the tional creativity and artificial general intelligence, is concept image schema of SUPPORT has been learnt through percep- invention and concept grounding. Here both what this means tual exposure of ‘plates on tables’, an infant can infer that on a cognitive level and how this is to be implemented are table-like objects such as ‘desks’ can SUPPORT ‘books’ as issues that needs to be addressed. well. As the environment becomes increasingly complex for the infant, this information transfer becomes a fundamental Research Foundation part of cognition and concept understanding. This extends to abstract language as well, where spatial Concept invention through embodied cognition and embodied language often is used for metaphors, e.g. “to The cognitive processes underlying concept invention are fall into a deep depression” (CONTAINMENT) and “the rise still largely unexplored ground, although promising theories to power” (VERTICALITY). have been developed within the last few decades. One of One important aspect of image schemas is their ability these is the embodied mind theory (Shapiro, 2011). It pro- to be combined with one another (and other building blocks poses that human cognition is grounded in our bodily ex- such as visual attributes) to explain increasingly complex sit- perience with the environment, and that these experiences uations. For example, consider how PATH can be combined are at the heart of how we structure our concepts, including with SUPPORT or CONTAINMENT to capture the essential abstract ones. meaning of the concept ‘transportation’. Looking at experimental studies in linguistic neuro- science (e.g. Tettamanti et al. (2005)) there are strong in- Conceptual blending dications that physical experiences are essential for concep- Conceptual blending (CB) is a theory of concept invention tual understanding. Given the role of bodily experiences in Fauconnier (1997). It argues the foundation of novel concept concept meaning, computational concept invention could be generation to occur as a product from combining already approached within this general framework. existing knowledge. By merging two, or more, conceptual Image schemas spaces, a blended conceptual space results. This blend con- tains information from both input spaces and has emergent The theory of image schemas aims to make concrete the ab- properties due to its own unique composition. The classic stract embodied experience Lakoff (1987); Johnson (1987). example is the blend of a ‘houseboat’, containing merged information from the input spaces ‘house’ and ‘boat’. 1The KRDB Research Centre, Faculty of Computer Science, Free University of Bozen-Bolzano, 39100 Bozen-Bolzano, Italy. One of the most important aspects of blending is not only http://www.inf.unibz.it/ okutz/about.html the merging of the input spaces, but also the search for com- 2Institute for Knowledge and Language Engineering, Fac- mon structure, represented as a generic space. The common ulty of Computer Science, Otto-von-Guericke University structure of the input spaces plays a vital role in rendering Madgeburg, 39106 Magdeburg, Germany. http://theo.cs.uni- the newly constructed concept meaningful, as it ensures that magdeburg.de/Staff/Till+Mossakowski.html the blended space also contains the structure found in the generic space. In order to integrate the image schemas into computa- Some ideas of how to formalise CB to make them tional concept invention, these abstracted patterns need to amenable to computational techniques can be seen in Kutz be translated into a formal language readable by a computa- et al. (2014). tional conceptual blending system. Problem Formalisation Related Research Research idea Defining the nature of image schemas One problem for concept invention through CB is the gen- Within the research field a central idea is how image eration of a ‘sensible’ blend. In a completely automatised schemas can be combined with one another to generate more system, there is currently no simple way to distinguish the specific and complex image schemas (Kuhn, 2007; Oakley, blends that a human would consider meaningful from those 2010). Therefore, an alternative way to perceive the IN and that lack cognitive value. This captures the biggest problem OUT image schema is to view them as combinations of the for computational creativity research. This problem grows two image schemas CONTAINMENT and PATH, rather than exponentially in relation to the size of the input spaces. In part of the CONTAINMENT schema. real life scenarios, the amount of information in the input One attempt to hierarchically structure the range from spaces can be vast, making successful computational con- simple to more complex and dynamic image schemas is that cept invention a problem. of Mandler and Pagan´ Canovas´ (2014). They build their sug- The framework of embodied cognition and more specif- gestion on empirical data from studies on cognitive develop- ically the notion of image schemas, provide a meaningful ment. In their approach the umbrella term ‘image schemas’ stepping stone to guide concept invention and conceptual is divided into three different levels: spatial primitives, im- blending. Image schemas can not only constitute the struc- age schemas and conceptual integrations. ture in the generic space but also provide heuristics for the blending process. As image schemas represent the concep- Related work on formalising image schemas tual building blocks, this dissertation hypothesize that guid- Prominent work in this field is the work by Kuhn (2007) ing CB with image schemas would result in cognitively more who argue that image schemas capture abstractions in order relevant information being transferred into the blend. to model affordances and formalises them using the formal programming language Haskell. Research goals and relevance Walton and Worboys (2009) build further on Kuhn’s work The main purpose of my research is to investigate the how by visualising and formalising the connections between dif- human concept invention takes place and to demonstrate ferent image schemas using bigraphs. Their method demon- how this understanding can be translated into a formal sys- strates how more complex dynamic image schemas such as tem of computational concept invention. BLOCKAGE could be generated using sequences of bigraph The primary goals are; 1. investigate image schemas as reaction rules on top of simpler static image schemas. conceptual building blocks from a cognitive and linguistic Bennett and Cialone (2014) performed a study in which point of view, 2. how to formalise the image schemas, and 3. eight different kinds of CONTAINMENT were distinguished provide a method to integrate them into a conceptual blend- from natural language using a method of sense clustering. ing system to test their role in concept invention. Up to date, The CONTAINMENT versions were formalised using the little research has been conducted on image schemas in con- GUM ontology and the RCC-8 topological relations in FOL. ceptual blending. The possible impact of the dissertation for the research field of computational concept invention has Related work on computational conceptual therefore great potential. blending The research is conducted under the believed that AI Conceptual blending has similarities with the more investi- and computational creativity systems could use this method gated phenomenon of analogical thinking. Analogy engines to generate novel concepts, blended ideas and possibly such as the structure mapping engine (SME) (Gentner, 1983) near a solution for computational understanding of image- and heuristic-driven theory projection (HDPT) (Schmidt et schematic conceptual metaphors and abstract concepts. al., 2014) search for common structure in the source and tar- get domain and use this information to perform information Research obstacles transfers. The undefined image schemas: Partly due to the interdis- Some formal approaches to conceptual blending is the ciplinary interest in image schemas, current image schema work by Goguen and Harrell (2010) and Mossakowski, research is inconsistent regarding terminology, definitions Maeder, and Luttich¨ (2007) who introduced Heterogeneous and borders between different