P088566-Prelims.qxd 7/11/05 5:59 PM Page i COGNITIVE SYSTEMS: INFORMATION PROCESSING MEETS BRAIN SCIENCE This page intentionally left blank P088566-Prelims.qxd 7/11/05 5:59 PM Page iii Cognitive Systems: Information Processing Meets Brain Science Scientific Coordinators RICHARD MORRIS FRS, FRSE Division of Neuroscience, University of Edinburgh, UK and LIONEL TARASSENKO FREng Department of Engineering Science University of Oxford, UK Editorial Consultant MICHAEL KENWARD OBE Grange Cottage, Staplefield, Haywards Heath, UK AMSTERDAM • BOSTON • HEIDELBERG • LONDON • NEW YORK • OXFORD PARIS •SAN DIEGO • SAN FRANCISCO • SINGAPORE • SYDNEY • TOKYO P088566-Prelims.qxd 7/11/05 5:59 PM Page iv This book is printed on acid-free paper Copyright © Queen’s Printer and Controller of HMSO, 2006. All rights reserved No part of this publication may be reproduced, stored in a retrieval system, or transmitted in any form or by any means electronic, mechanical, photocopying, recording or otherwise, without the prior written permission of the publisher Permissions may be sought directly from Elsevier’s Science & Technology Rights Department in Oxford, UK: phone: (ϩ44) 1865 843830, fax: (ϩ44) 1865 853333, e-mail: [email protected]. You may also complete your request on-line via the Elsevier homepage (http://www.elsevier.com), by selecting ‘Customer Support’ and then ‘Obtaining Permissions’ Elsevier Academic Press 525 B Street, Suite 1900, San Diego, California 92101-4495, USA http://www.elsevier.com Elsevier Academic Press 84 Theobald’s Road, London WC1X 8RR, UK http://www.elsevier.com British Library Cataloguing in Publication Data A catalogue record for this book is available from the British Library Library of Congress Catalog Number: 2005923102 ISBN 0-12-088566-2 Typeset by Charon Tec Pvt. Ltd, Chennai, India www.charontec.com Printed and bound in Great Britain 0506070809987654321 P088566-Prelims.qxd 7/11/05 5:59 PM Page v Contents Contributors vii 6 Action 121 Philip Barnard and Peter Redgrave Preface ix 7 Social Cognition 138 Lynn Nadel Uta Frith and Sarah-Jayne Blakemore 8 Motivation, Planning and Introduction xi Interaction 163 Sir John Taylor OBE, FRS, FREng Nicholas R. Jennings and Anthony G. Cohn with contributions from Section 1: How to Design a Cognitive Maria Fox, Derek Long, Michael System 1 Luck, Danius T. Michaelides, Steve Introduction 3 Munroe and Mark J. Weal Lionel Tarassenko and Richard Morris 1 Self-organization in the Nervous Section 4: Memory 189 System 5 Introduction 191 David Willshaw Richard Morris and Lionel Tarassenko 2 Large-scale, Small-scale 9 Learning and Memory 193 Systems 34 Richard Morris, Graham Hitch, Kim Jim Austin, Dave Cliff, Robert Graham and Tim Bussey Ghanea-Hercock and Andy Wright 10 Memory, Reasoning and Learning 236 Kieron O’Hara, Wendy Hall, Keith Section 2: Cognitive Systems in Touch with van Rijsbergen and Nigel Shadbolt the World 65 Introduction 67 Section 5: Science Applied 261 Lionel Tarassenko and Richard Morris 11 Advanced Neuroscience 3 Representation 70 Technologies 263 Vincent Walsh and Simon Laughlin Bashir Ahmed, Jon Driver, Karl 4 Sensory Processing 85 Friston, Andrew Matus, Richard Lionel Tarassenko and Mike Denham Morris and Edmund Rolls 5 Speech and Language 105 12 Applications and Impact 283 William D. Marslen-Wilson Bill Sharpe Section 3: Cognitive Systems in Action 117 Index 305 Introduction 119 Richard Morris and Lionel Tarassenko v This page intentionally left blank P088566-Prelims.qxd 7/11/05 5:59 PM Page vii Contributors Bashir Ahmed Maria Fox Department of Physiology Department of Computer Science and The University of Oxford, UK Information Systems University of Strathclyde Jim Austin Glasgow, UK Advanced Computer Architectures Group Department of Computer Science Karl Friston University of York, UK Functional Imaging Laboratory Welcome Department of Imaging Neuroscience Philip Barnard Institute of Neurology MRC Cognition and Brain Sciences Unit University College London, UK Cambridge, UK Uta Frith Sarah-Jayne Blakemore Institute of Cognitive Neuroscience Institute of Cognitive Neuroscience London, UK London, UK Robert Ghanea-Hercock Tim Bussey Future Technologies Group Department of Experimental Psychology BTexact Technologies University of Cambridge, UK Ipswich, UK Kim Graham Dave Cliff Memory and Knowledge Group MRC Semantic & Adaptive Systems Department Cognition and Brain Sciences Unit Hewlett-Packard Laboratories Cambridge, UK Bristol, UK Wendy Hall Anthony G. Cohn Intelligence Agents Multimedia Group School of Computing Department of Electronics and University of Leeds, UK Computer Science University of Southampton, UK Mike Denham Graham Hitch Centre for Theoretical and Computational Department of Psychology Neuroscience University of York, UK University of Plymouth, UK Nicholas R. Jennings Jon Driver Intelligence Agents Multimedia Group Institute for Cognitive Neuroscience School of Electronics and Computer Science University College London, UK University of Southampton, UK vii P088566-Prelims.qxd 7/11/05 5:59 PM Page viii viii CONTRIBUTORS Michael Kenward Peter Redgrave Grange Cottage, Staplefield Department of Psychology Haywards Heath, UK University of Sheffield, UK Simon Laughlin Edmund Rolls Department of Zoology Department of Experimental Psychology University of Cambridge, UK University of Oxford, UK Derek Long Nigel Shadbolt Department of Computer Science and Intelligence Agents Multimedia Group Information Systems Department of Electronics and Computer University of Strathclyde Science Glasgow, UK University of Southampton, UK Michael Luck Bill Sharpe Intelligence Agents Multimedia Group The Appliance Studio Ltd School of Electronics and Computer Science Bristol, UK University of Southampton, UK Lionel Tarassenko William D. Marslen-Wilson Department of Engineering Science MRC Cognition and Brain Sciences Unit University of Oxford, UK Cambridge, UK Sir John Taylor Andrew Matus Director of the Foresight Cognitive Systems Friedrich-Mischer Institute Project Basle, Switzerland UK Danius T. Michaelides Keith van Rijsbergen Intelligence Agents Multimedia Group Department of Computing Science School of Electronics and Computer Science University of Glasgow, UK University of Southampton, UK Vincent Walsh Richard Morris Institute of Cognitive Neuroscience Division of Neuroscience University College London, UK University of Edinburgh, UK Mark J. Weal Steve Munroe Intelligence Agents Multimedia Group Intelligence Agents Multimedia Group School of Electronics and Computer Science School of Electronics and Computer Science University of Southampton, UK University of Southampton, UK David Willshaw Lynn Nadel Institute for Adaptive and Neural Department of Psychology and Division of Computation Neural Systems and Aging School of Informatics University of Arizona, USA University of Edinburgh, UK Kieron O’Hara Andy Wright Intelligence Agents Multimedia Group BAE Systems Advanced Technology Centre Department of Electronics and Computer Filton, Bristol, UK Science University of Southampton, UK P088566-Prelims.qxd 7/11/05 5:59 PM Page ix Preface Lynn Nadel Department of Psychology and Division of Neural Systems, Memory and Aging, University of Arizona, Tucson Cognitive systems include both natural psychiatrists. A heady mix. During these and artificial information processing sys- years a number of critical advances in under- tems responsible for perception, learning, standing the brain emerged, along with the reasoning, communication, action and more. development of conceptual frameworks that Although we can trace the emergence of offered the promise of deep insights into a field of study concerned with such sys- how mental functions could be realized in tems back to the nineteenth century, its biological, and hence physical, form. modern focus on information processing is New methods in the study of the nervous more readily traced to a series of critical system such as the development of elec- advances in the twentieth century. Among troencephalographic (EEG) recording and these must be included work by Alan Turing intracellular recording in model systems, on computability, by Frederick Bartlett on such as the squid giant axon, were particu- the role of schemas, by Kenneth Craik on larly important. The former led to the dis- the importance of internal ‘models’, by covery of the ‘reticular activating system’ by Warren McCulloch and Walter Pitts on the Giuseppe Moruzzi and Horace Magoun, a use of idealized neurons as logical devices, key step in understanding the underlying by John von Neumann on game theory and patterns of activity in the brain, and how the development of computers, and by they are affected by arousal and attention. Warren Weaver and Claude Shannon on The latter led to the development of detailed information theory. models of axonal transmission, synaptic Much of this work unfolded in the con- communication and neuronal function that text of critical wartime needs, and reflected have shaped the neuroscientific research productive interactions between life scien- agenda for decades. tists, physical scientists and social scientists. On the conceptual front perhaps the As exemplified by a series of extraordinary most important contribution was that by meetings convened by the Josiah Macy Donald Hebb, whose neuropsychological Foundation from 1942 through to the early speculations about cell assemblies and phase 1950s, these interactions seemed destined to sequences provided the first serious attempt lead to rapid understanding of how natural at explaining,