Ruhr-Universität Bochum
Fakultät für Philosophie und Erziehungswissenschaft
THE PROBLEM OF PSYCHONEURAL ISOMORPHISM BETWEEN VISUAL OBJECTS AND THEIR NEURAL CORRELATES
Inaugural-Dissertation zur Erlangung des akademischen Grades einer Doktorin/eines Doktors der Philosophie
vorgelegt von ALFREDO VERNAZZANI aus NEAPEL (ITALIEN)
Referent/-in: Prof. Dr. Tobias Schlicht Koreferent/-in: Prof. Marcin Miłkowski
Dekanin: Prof. Dr. Corinna Mieth
Mündliche Prüfung BOCHUM, DEN 16. Mai 2018
Eidesstattliche Erklärung
Alfredo Vernazzani Vor- und Zuname: 30.07.1984 Geburtsdatum: Neapel (Italien) Geburtsort:
Hiermit versichere ich an Eides statt,
- dass ich die eingereichte Dissertation selbständig und ohne unzulässige fremde Hilfe verfasst, andere als die in ihr angegebene Literatur nicht benutzt und dass ich alle ganz oder annähernd übernommenen Textstellen sowie verwendete Gra- fiken, Tabellen und Auswertungsprogramme kenntlich gemacht habe. Außerdem versichere ich, dass die vorgelegte elektronische mit der schriftlichen Version der Dissertation übereinstimmt und die Abhandlung in dieser oder ähnlicher Form noch nicht anderweitig als Promotionsleistung vorgelegt und bewertet wurde.
[Unterschrift] ORT, DATUM DR. ALFREDO VERNAZZANI Curriculum Vitae — March 2019
EMPLOYMENT AND APPOINTMENTS
September 2019 - Visiting Scholar May 2020 HARVARD UNIVERSITY, GRADUATE SCHOOL OF EDUCATION (accepted) Sponsor: Prof. Catherine Elgin. April 2019 - Post-Doc Researcher (wissenschaftlicher Mitarbeiter) May 2020 RUHR-UNIVERSITÄT BOCHUM October 2018 - Research Fellow March 2019 RUHR-UNIVERSITÄT BOCHUM April - July 2018 Lehrbeauftragter (Lecturer) RUHR-UNIVERSITÄT BOCHUM October 2016 - Lehrbeauftragter (Lecturer) March 2017 RHEINISCHE-FRIEDRICH-WILHELMS-UNIVERSITÄT BONN
RESEARCH AREAS
AOS: Philosophy of Mind & Perception (Contents of Visual Experience, Structure of Visual Objects, Neural Correlates of Consciousness, Visual Aesthetics), Philosophy of Psychology & of Cognitive Science (Mechanistic Explanation, Intertheoretic Integration, Scientific Models). AOC:, Metaphysics; History of Philosophy; Aesthetics; Philosophy of AI.
EDUCATION
10.2016 - PHD IN PHILOSOPHY: RUHR-UNIVERSITÄT BOCHUM. May 16, 2018 Dissertation: «The Problem of Psychoneural Isomorphism Between Visual Objects and their Neural Correlates» Mark: Summa cum laude Primary Supervisor: Prof. Tobias Schlicht (Bochum). Secondary Supervisor: Prof. Marcin Miłkowski (Polish Academy of Sciences). 2015 - 2016 VISITING PHD STUDENT AT THE UNIVERSITY OF CAMBRIDGE October - March Faculty of Philosophy, University of Cambridge, UK Sponsor: Prof. Tim Crane
2013-2016 PHD STUDENT AT THE UNIVERSITÄT BONN (left for Bochum) Supervisor: Prof. Andreas Bartels.
2012 MA IN PHILOSOPHY: HUMBOLDT-UNIVERSITÄT ZU BERLIN Mark: Sehr gut
2009 BA IN PHILOSOPHY: UNIVERSITÀ DEGLI STUDI ‘FEDERICO II’ Mark: 110 cum laude /110 FURTHER EDUCATION
2017 Spring School in Social Cognition, Emotion, and Joint Action March 6-10 Ruhr-Universität Bochum, Germany 2017 Master Class: Three lectures by Prof. Jakob Hohwy on Predictive March 3-4 Coding and the Mind. Ruhr-Universität Bochum, Germany Curriculum Vitae, Alfredo Vernazzani, March 2019
2016 Neo-Aristotelian Approaches to the Metaphysics of the Mind Summer School September-October The Harry Wilks Study Center at the Villa Vergiliana, Bacoli, Italy, University of Oxford
2013 Summer School in Phenomenology and Philosophy of Mind August Center for Subjectivity Research, University of Copenhagen PUBLICATIONS • Articles and Book Chapters † = invited * = non-peer reviewed - “Do We See Facts?” Under review (Revisions) forth. “Psychoneural Isomorphism: From Metaphysics to Robustness.” † In F. Calzavarini & M. Viola (eds.) New Challenges in the Philosophy of Neuroscience, Springer. 2017 “The Structure of Sensorimotor Explanation.” «Synthese». DOI: 10.1007/s11229-017-1664-9 2016 “Fenomenologia naturalizzata nello studio dell’esperienza cosciente.” «Rivista di filosofia» 107(1): 27-48. DOI: 10.1413/82722. 2016 “Psychoneural Isomorphism and Content-NCCs.” † * «Gestalt Theory» 38 (2-3): 177-190. 2015 “Manipulating the Contents of Consciousness.” In Noelle, D. C., Dale, R., Warlaumont, A. S., Yoshimi, J., Matlock, T., Jennings, C. D., & Maglio, P. P. (Eds.). Proceedings of the 37th Annual Meeting of the Cognitive Science Society (pp. 2487-2492). Austin, TX: Cognitive Science Society. 2014 “Sensorimotor Laws, Mechanisms, and Representations.” In Bello P., Guarini M., McShane M. & Scassellati B. (Eds.) Proceedings of the 36th Annual Conference of the Cognitive Science Society (pp. 3038-3042). Austin TX: Cognitive Science Society. 2011 “Die europäische Identität / L’identità europea” [ITA/DE]. † * In: Gregor Vogt-Spira, Anke Fischer, & Luigi Galimberti-Faussone (eds.): Die Zukunft Europas. Il futuro dell’Europa (pp. 122-130). Stuttgart: Franz-Steiner Verlag. • Editor Forth. Guest editor for a Special Issue of «Synthese» on «The structure of perceptual objects» with Dr. Blazej Skrzypulec, and Prof. Tobias Schlicht. Accepted, in preparation. • Reviews 2013 Review of Marco Sgarbi’s (ed.): The Kant-Weymann Controversy: Two Polemical Writings on Optimism. Verona: Aemme Edizioni (2010). «Rivista di filosofia» 104(1). • Non-academic 2014 “Il mestiere di pensare.” Review of Diego Marconi: Il mestiere di pensare. Torino: Einaudi (2014) «Uncommons.it», http://www.uncommons.it/village/il-mestiere-di-pensare-535 • In preparation “Philosophy of Perception as Model-Building” “Seeing Things Aesthetically” “Visual Arts and the Aesthetic Depth of Seeing” “Visual Habits” with Flavia Felletti “Embodied Cognition: A Guide for the Perplexed” 2 Curriculum Vitae, Alfredo Vernazzani, March 2019
CONFERENCES • Keynote speaker 2018 “Visualizing Vision: Pictures and Visual Perception” June 30 – July 2 Philosophers’ Rally University of Łódź, Łódź, Poland. • Invited Speaker 2019 “Visual Arts and the Aesthetic Depth of Seeing” January 17 London Mind Group. Senate House, University of London, London, UK 2018 “The Structure of Sensorimotor Explanation.” April 6 Neural Mechanisms Online. Webinar on Neural Mechanisms, IUSS Pavia. With responses from Mazviita Chirimuuta (Pittsburgh), and Dan Burnston (Tulane University). 2017 “Embodied Cognition: A Guide for the Perplexed.” November 22 CEPERC-ILCB. Aix-Marseille Université, Aix-en-Provence. 2017 “Do We See Facts?” May 19-20 Second Bochum-Rutgers-Workshop in Philosophy. Ruhr-Universität Bochum, Bochum, Germany. 2016 “Perception and Speculative Materialism: Meillassoux on Primary and November 24-26 Secondary Qualities.” The New Faces of Realism. Bergische Universität Wuppertal, Germany. 2013 “Das Isomorphismusproblem zwischen personalem und March 27-28 subpersonalem Niveau in der visuellen Wahrnehmung.” Doktorandentagung Wissenschaftsphilosophie. Leibniz-Universität Hannover, Germany. • Refereed Talks
2019 “What Is Embodiment?” July 19–21 93rd Joint Session of the Aristotelian Society and Mind Association Durham University, Durham, UK 2019 “The Aesthetic Depth of Seeing.” May 22-24 AISC Midterm Conference IMT School of Advanced Studies, Lucca, Italy 2018 “A Mechanistic Framework for the Neural Correlates of Conscious October 5-6 Visual Object Perception.” Neural Mechanisms Online, Webconference. 2018 “The Structure of Sensorimotor Explanation” June 25-27 AISC Midterm Conference. Genoa, Italy. 2017 “Is There Scientific Evidence That We See Facts?” September 24-27 XXIV. Kongress der deutschen Gesellschaft für Philosophie. Humboldt-Universität, Berlin, Germany. 2017 “Philosophy of Perception as Model-Building.” September 21-23 Fourth Philosophy of Language and Mind Conference. Ruhr-Universität Bochum, Germany. 3 Curriculum Vitae, Alfredo Vernazzani, March 2019
2017 “The Structure of Sensorimotor Explanation.” August 21-26 9th European Congress of Analytic Philosophy. Ludwig-Maximilian-Universität, Munich, Germany. 2017 “Trope Representationalism and Mental Mechanisms.” August 21-26 9th European Congress of Analytic Philosophy. Ludwig-Maximilian-Universität, Munich, Germany. 2016 “Visual perception, Trope Similarity, and Intentional Mechanisms.” June 23-25 Mechanistic Integration and Unification in Cognitive Science. Polish Academy of Sciences, Warsaw, Poland. 2015 “The Neural Correlates of Conscious Content from a Mechanistic August 3-8 Standpoint.” 15th Congress of Logic, Methodology and Philosophy of Science. Helsinki, Finland. 2015 “Looking for the Mechanisms of the Contents of Consciousness” June 9-13 Toward a Science of Consciousness. Helsinki, Finland. 2015 “Psychoneural Isomorphism and Intentional Mechanisms.” May 21-23 19th Scientific GTA Convention ‘Body, Mind, Expression.’ University of Parma, Italy. 2015 “Mechanisms and the Intentional Content of Experience.” February 26-28 Rudolf-Carnap-Lecture 2015: John Campbell. Ruhr-Universität Bochum, Germany. 2014 “Representations and Sensorimotor Explanation.” September 4-6 SOPhiA2014. University of Salzburg, Austria. 2014 “Explaining Consciousness without Gaps.” August 28 – Sep. 2 8th European Congress of Analytic Philosophy. University of Bucharest, Romania. 2014 “Vividness and the Levels of Consciousness.” July 11-13 88th Joint Session of the Aristotelian Society and Mind Association. Fitzwilliam College, University of Cambridge, UK. 2014 “Mechanisms and First-Person Accounts of Consciousness.” April 24-26 12th Annual Meeting of the Nordic Society for Phenomenology. Helsinki, Finland. • Selected Non-Refereed Talks 2018 “Do We See Facts?” July 23 First Bochum Graduate Workshop in Philosophy of Mind and of Cognitive Science. Ruhr-Universität Bochum, Germany. 2017 “Philosophy of Perception as Model-Building.” October 20 Ockham Society. University of Oxford, UK. 2017 “Model Building in the Philosophy of Perception.” May 22-23 Naturalistic Approaches to Content and Consciousness. Polish Academy of Sciences. 2016 “Do We See Facts?” February 16 New Directions in the Study of the Mind. Peterhouse, University of Cambridge, UK.
4 Curriculum Vitae, Alfredo Vernazzani, March 2019
• Refereed Poster Presentations 2017 “Phenomenological Models of Perceptual Content.” June 27-29 The Human Mind Conference. The Møller Centre, University of Cambridge, UK. 2016 “Do We Perceive Facts?” August 10-13 24th Annual Meeting of the European Society of Philosophy and Psychology, St. Andrews, Scotland. 2015 “Manipulating the Contents of Consciousness.” July 22-25 CogSci 2015: 37th Annual Meeting of the Cognitive Science Society. Pasadena Convention Center, Pasadena, California, USA. 2014 “Sensorimotor Laws, Mechanisms, and Representations.” July 23-26 CogSci 2014: 36th Annual Meeting of the Cognitive Science Society. Québec City Convention Center, Québec City, Canada. • Comments (invited) 2019 Comment on Abel Wajnerman Paz “The Global Nueronal May 31 Workspace as an efficient broadcasting network.” Neural Mechanisms Online. Webinar on Neural Mechanisms, IUSS Pavia. 2018 Comment on Matteo Grasso’s “IIT vs Russellian Monism.” December 14 Neural Mechanisms Online. Webinar on Neural Mechanisms, IUSS Pavia. 2018 Comment on Lena Kästner’s “On the Mechanistic Triad.” June 1 Neural Mechanisms Online, Webconference. Webinar on Neural Mechanisms, IUSS Pavia. • Selected Attended Workshops and Conferences 2018 Workshop “True Enough” with Prof. Catherine Elgin. June 20 Organized by Prof. Catrin Misselhorn. Universität Stuttgart. 2016 “Mental Representation – Naturalistic Approaches.” May 20-21 Organized by Prof. Nicholas Shea (King’s College, London) Institute of Philosophy, School of Advanced Studies. 2015 “Mental Representations: The Foundations of Cognitive Science? September 21-23 Organized by Prof. Tobias Schlicht (Ruhr-Universität Bochum). Ruhr-Universität Bochum, Germany. 2014 “Workshop: Cognitive Science and the Arts.” July 23 Organized by B. Tversky, P. Healey, D.K. Kirsh. CogSci2014, Québec City, Canada. SCHOLARSHIPS, HONORS, AND GRANTS
• Honors 2011 INVITATION TO MEET THE ITALIAN AND THE GERMAN FEDERAL PRESIDENT July 6-7 Villa Vigoni, Deutsch-Italienisches Zentrum für europäische Exzellenz, Loveno di Menaggio, Italy. Personally invited to meet the German Federal president Christian Wulff and the Italian president Giorgio Napolitano, with 28 young researchers from Italy and Germany. The meeting was preceded by a workshop on European issues: ‘Il futuro dell’Europa’ / ‘Die Zukunft Europas’.
5 Curriculum Vitae, Alfredo Vernazzani, March 2019
• Scholarships 11/2016 – 09/2018 FELLOWSHIP (25,300€) – Ruhr-Universität Bochum. 11/2014 – 10/2016 PHD SCHOLARSHIP (26,400€) – Barbara-Wengeler Stiftung.
10/2010 – 12/2011 DAAD SCHOLARSHIP (12,000€) – DAAD: One-year scholarship for the MA at the Humboldt-Universität zu Berlin.
2/2009 – 3/2009 GOETHE-INSTITUT SCHOLARSHIP (free two-months intensive language course)– Goethe-Institut, Freiburg i.B.
• Conference Subsidies and Minor Scholarships 2019 Travel bursary for the invited talk at the London Mind Group – London Mind Group 2018 Travel and accommodation for the Philosophers’ Rally - University of Łódź. 2017 Travel and accommodation for the talk “Embodied cognition: A Guide for the Perplexed” - Aix-Marseille Université, Aix-en-Provence. 2016 Registration costs, conference dinner, and hotel accommodation covered for the conference “The New Faces of Realism” - Bergische Universität Wuppertal. 2016 Conference subsidy for “Mechanistic Integration and Unification in Cognitive Science” - Rheinische Friedrich-Wilhelms-Universität Bonn. 2016 Bursary for the conference “Mental Representation – Naturalistic Approaches” - Arts and Humanities Research Council (AHRC). 2015 Conference subsidy for CLMPS 2015 - Barbara-Wengeler Stiftung. 2015 Conference subsidy for CogSci2015 - Barbara-Wengeler Stiftung. 2015 Conference subsidy for Toward a Science of Consciousness –Rheinische Friedrich-Wilhelms-Universität Bonn. 2015 Conference subsidy for the 19th Scientific Gestalt Convention - Society for Gestalt Theory and Its Applications. 2015 Conference subsidy for the Carnap-Lecture 2015 - Ruhr-Universität Bochum. 2014 Conference subsidy for the 88th Joint Session - Aristotelian Society. 2011 Full costs (travel, accommodation, meals) for “Il futuro dell’Europa” – Villa Vigoni, Deutsch-Italienisches Zentrum für europäische Exzellenz. TEACHING EXPERIENCE (AS PRIMARY INSTRUCTOR) † = Taught in German. • Ruhr-Universität Bochum
WS 19/20 John McDowell’s «Mind and World». Postgraduate course (MA) Analytische Bewusstseinstheorien. † [“Analytic Theories of Consciousness”] Graduate course (BA) SS 2019 Philosophy of Attention: Sebatian Watzl’s «Structuring Mind». Postgraduate course (MA) 6 Curriculum Vitae, Alfredo Vernazzani, March 2019
Eine Einführung in die Wahrnehmungsphilosophie. † ["An Introduction to the Philosophy of Perception”] Graduate course (BA) SS 2018 Philosophische Probleme wissenschaftlicher Modelle. † [“Philosophical Problems of Scientific Models”] Graduate course (BA) Teleosemantics. Taught with Prof. Tobias Schlicht. Postgraduate course (MA) • Rheinische Friedrich-Wilhelms Universität Bonn 2017 Wahrnehmungsgehalt. † January 31 [“Perceptual Content”] Ringvorlesung “Einführung in die Philosophie” (BA, MA) WS 16/17 Philosophie der Wahrnehmung: Eine Einführung. † [“Philosophy of Perception: An Introduction”] Postgraduate course (MA) ACADEMIC MEMBERSHIPS • Societies Since 2014 Nordic Society for Phenomenology (NSoP) Since 2014 Aristotelian Society Since 2010 European Society for Early Modern Philosophy (ESEMP) 2014 – 2016 Cognitive Science Society (CogSci) Since 2015 Society for the Philosophy of Information (SPI) Since 2015 Socitété de philosophie analythique (SoPhA) 2015 – 2016 The Cambridge Moral Sciences Club Since 2015 Society for the Metaphysics of Science Since 2015 Society for Philosophy of Science in Practice (SPSP) Since 2016 European Society for Philosophy and Psychology (ESPP) Since 2019 Associazione Italiana di Scienze Cognitive (AISC)
• Research groups Since 2019 External member of «Aesthetics and Ethics» (AERG) REVIEWER • Conferences and Workshops 2019 «Carnap Lecture» with Frances Egan & Robert Matthews (Ruhr-Universität Bochum); «Philosophical Perspectives on Medical Knowledge» (University of Genoa); «Fiction, Imagination, and Epistemology» (Ruhr-Universität Bochum); EuroCogSci 2019 (Ruhr- Universität Bochum). 2018 «Carnap Lecture» with Thomas Metzinger (Ruhr-Universität Bochum); Scientific Committee «New Challenges in Philosophy of Neuroscience» (University of Pavia-Milano). 2017 «Carnap Lecture» with Patricia Churchland (Ruhr-Universität Bochum); 4th Philosophy of 7 Curriculum Vitae, Alfredo Vernazzani, March 2019
Language and Mind Conference (Ruhr-Universität Bochum); Workshop «Evolving Enactivism» (Ruhr-Universität Bochum) • Journals
Phenomenology and the Cognitive Sciences (2017); Philosophical Psychology (3x) (2016-2017); Philosophical Explorations (2018); Synthese (6x) (2018); Open Philosophy (2019).
• Publishers
Oxford University Press (2018); Springer (2019). • Other Project Reviewer for the Research School Plus (Ruhr-Universität Bochum)
CONFERENCES AND WORKSHOPS ORGANIZED 2019 Scientific Manager for EuroCogSci 2019 September 2-4 Main organizer: Prof. Albert Newen. Ruhr-Universität Bochum. 2019 Co-organizer of the Second Bochum Early Career Workshop in June 13-14 Philosophy of Mind and of Cognitive Science. Keynote speakers: Prof. Onur Güntürkün (RUB), Dr. Rebekka Hufendiek (Basel). Ruhr-Universität Bochum. 2018 Founder and Co-organizer of the 1st Bochum Graduate Workshop in July 23-24 Philosophy of Mind and of Cognitive Science. Keynote speakers: Prof. Jim Pryor (NYU), Dr. Eva Schmidt (UZH). Ruhr-Universität Bochum. 2015 Student Volunteer in the Organization of CogSci 2015. July 21-25 Pasadena Convention Center, Pasadena, California, USA.
LANGUAGES
• Languages spoken Italian (mother tongue) French (speaking: basics, reading: good) English (C2, fluent) Spanish (reading: good) German (C2, fluent) Latin (good) Ancient Greek (basics)
• Language courses 2011 Intensive Language Course: French June 6 – July 7 Alliance Française, Paris 2008-2009 Intensive Language Course: German September - March Goethe-Institut, Freiburg im Breisgau 2007 Intensive Language Course: German March 5 – April 8 Goethe-Institut, Berlin. ACADEMIC TRAINING 2016 Training on Lecturing Performance – Trainer: Stewart Theobald. March 18 University of Cambridge, UK.
8 Curriculum Vitae, Alfredo Vernazzani, March 2019
2016 Interview Technique Workshop – Trainer: Alan Fawcitt. January University of Cambridge, UK. 2015 Certificate on Teaching Skills – Instructor: Dr. Arif Ahmed. October University of Cambridge, UK. OTHER NON-ACADEMIC ACTIVITIES
• Prize 25/5/1998 Absolute first prize certificate 100/100 as a member of the orchestra S.M.S ‘Ruggiero’ of Caserta (classical guitarist). Musical Association ‘Eureka’: 5th National Competition of Musical Performance «Città di Melito».
• Non-Academic Memberships Member of ANPI Deutschland (since 2014) President of ANPI Deutschland (2016-2017) [ANPI: National Association of Italian Partisans; Italian antifascist organization]
• Public Outreach 17/4/2015 Interviewed on the importance of anti-fascism today, and the present role of A.N.P.I. during the celebration for the 70th Anniversay of Italian Liberation Interview by Agnese Franceschini (RadioColonia) http://www.funkhauseuropa.de/sendungen/radio_colonia/il_tema/partisan en100.html 9/6/2014 Interviewed on anti-fascism and the role of A.N.P.I. in Germany during the festival ‘Birlikte-Zusammenstehen’ (ten years after the Cologne bombing attack) Interview by Agnese Franceschini (RadioColonia) http://www.funkhauseuropa.de/sendungen/radio_colonia/il_tema/keupstra sse190.html 11/10/2013 “Alfredo fa ricerca in Germania: la locomotiva d’Europa raccontata da un campano” Interview by Giulio Pitroso (GenerazioneZero Sicilia) http://www.generazionezero.org/blog/2013/10/11/alfredo-fa-ricerca-in- germania-la-locomotiva-deuropa-raccontata-da-un-campano/ 10/2/2012 “Ich möchte wieder stolz sein auf das Bild Italiens in der Welt” Interview by Patricia Liberatore (Konrad Adenauer Stiftung) Konrad-Adenauer-Stiftung Aquädukt http://kas-aquaedukt.de/ich-mochte-wieder-stolz-sein-auf-das-bild- italiens- in-der-welt/ • Events Organized as Members of ANPI Deutschland 12/11/2016 Organization of the theatre piece «Canto dei deportati» written by Maria Filograsso, performed by Maria Filograsso and Giulio Bufo A.N.P.I. Deutschland — Interkulturelles Zentrum “offene Welt.” 31/5/2016 Organization of the celebrations for the 2nd of June (‘Festa della Repubblica’ – Republic Day), and the 70th anniversary of woman suffrage in Italy. In collaboration with the Italian Cultural Institute (IIC) and the Italian Consulate in Cologne. Invited speaker: Dr. Michela Ponzani, Archivio Storico del Senato (Senate of the Republic). Chairing: Alfredo Vernazzani. A.N.P.I. Deutschland - Italienisches Kulturinstitut Köln. 9 Curriculum Vitae, Alfredo Vernazzani, March 2019
17/4/2015 Organization of the celebrations for the 70th Anniversary of the Liberation from the Nazi and Fascist occupation of Italy. In collaboration with the Italian Cultural Institute (IIC) and the Italian Consulate in Cologne. Invited speakers: Tullio Montagna, Member of the national board of A.N.P.I.; Prof. Filippo Focardi, Historian, University of Padova; Prof. Rudolf Lill, Historian, Universität-Köln. Introduction: MP Laura Garavini, PD (Partito Democratico); Dr. Lucio Izzo, Chairman of the IIC; Dr. Emilio Lolli, Italian Consul General of Cologne. Chairing: Alfredo Vernazzani; Dr. Lucia Beccarelli. A.N.P.I. Deutschland - Italienisches Kulturinstitut Köln. 3/2015 Organization of an educational project with the high school Liceo Linguistico “Italo Svevo” in Cologne. The project consisted in reading and discussing with the students exemplary literary texts on the Resistenza and the nature of fascism. Alfredo Vernazzani: lecturing on Elio Vittorini’s «Uomini e no». Francesca Polistina: lecturing on Beppe Fenoglio’s «Il partigiano Johnny». Gabriele Rasi: lecturing on Italo Calvino’s «Il sentiero dei nidi di ragno». A.N.P.I. Deutschland - Liceo Linguistico Italo Svevo, Köln, Germany.
10
THE PROBLEM OF PSYCHONEURAL ISOMORPHISM
BETWEEN VISUAL OBJECTS AND THEIR NEURAL CORRELATES
Contents
List of Figures v Preface vi Acknowledgments viii
PART I THE PROBLEM
I. THE PROBLEM OF PSYCHONEURAL ISOMORPHISM 1 1. Filling-in, Cartesian Materialism, and Isomorphism 2 1.1 What Is Filling-in? 2 1.2 Dennett on Filling-in 5 1.3 Rejecting Analytic Isomorphism 8 2. Naturalizing Phenomenology and Isomorphism 15 2.1 Naturalizing Phenomenology 15 2.2 Mapping the Neural Correlates of Consciousness 19 2.3 From Matching to Isomorphism? 20 3. The Scope and Aims of this Work 23 3.1 The Relevance of Psychoneural Isomorphism 24 3.2 Focusing on Visual Objects 24
II. OUTLINING A RESEARCH STRATEGY 26 1. The Character of Isomorphism 26 1.1 Defining Isomorphism 27 1.2 What is Meant with “Psycho-Neural”? 29 1.3 PI and the Metaphysics of the Mind-Body Problem 30 2. A Short History of Psychoneural Isomorphism 34 2.1 Fechner, Mach, and Müller 34 2.2 Gestalt Isomorphism 38 2.3 From Second-Order Isomorphism to the Present Day 43 3. How To Study Psychoneural Isomorphism 47 3.1 Outlining A Research Strategy 47 3.2 Outline of the Next Chapters 49
PART II THE PHENOMENOLOGICAL DOMAIN
III. STATES OF SEEING 53 1. States of Seeing 53 1.1 States of Seeing and Visual Perception 53 1.2 Unity of Consciousness and the Visual Field 57 1.3 The Representational Character of Seeing 59 2. Content and Phenomenology 64 2.1.1 What Does “Consciousness” Mean? 64 2.1.2 Phenomenal and Access Consciousness 64 2.1.3 State Consciousness, Creature Consciousness, Background Consciousness 66 2.2 Accessibility and Phenomenal Overflow 68 2.3 Representational Content and Consciousness 69 2.3.1 Intentionalism 69 2.3.2 Varieties of Intentionalism 70
i
3. The Role of Consciousness in this Work 74 3.1 Consciousness and PI 74 3.2 An Overview of the Phenomenological Domain 76
IV. FACTS, SENSORY INDIVIDUALS, AND SENSORY REFERENCE 78 1. Seeing and the Ontology of Visual Objects 79 1.1 States of Seeing and Visual Properties 79 1.2 Facts 82 2. Factualism and Fish’s Argument 83 2.1 Factualism 83 2.2 William Fish’s Argument for Factualism 85 3. Sensory Individuals and Sensory Reference 87 3.1 Binding and Places 87 3.2 Sensory Individuals as Material Objects 88 3.2.1 Superimposed Objects 88 3.2.2 Dynamic Feature-Object Binding 89 3.3 Sensory Reference 90 4. Tracking and Seeing Facts? 92 4.1 Two Ontological Criteria 92 4.2 Material Objects as Particulars 93 4.2.1 Tracking Thin Particulars? 93 4.2.2 Tracking Thick Particulars? 95 4.3 Fish’s Argument Revisited 97 5. Visual Objects as Constellations of Properties 98 5.1 Material and Visual Objects 98 5.2 Tracking and Binding 99 5.3 Perceptual Content 101
PART III THE NEURAL DOMAIN
V. A MECHANISTIC STANDPOINT ON CONTENT-NCC RESEARCH 105 1. The Contents of Visual Perception 106 1.1 The Content View and Visual Accuracy Phenomena 106 1.1 Content and Consciousness 109 2. Goals and Aims of Content-NCC Research 110 3. The Standard Definition of Content-NCC 112 1.1 Chalmers’ Definition 112 1.1 Problems with the Standard Definition 115 4. A Mechanistic Approach to Content-NCCs 122 4.1 Mechanisms and Mechanistic Explanation 122 4.2 Decomposing Content-NCCs 126 4.2.1 Intentional Mechanisms 126 4.2.2 Selection Mechanisms 129 4.2.3 Proper-NCC 132 4.3 Manipulating the Contents of Consciousness 134 4.3.1 Prerequisite vs. Consequent Neural Activity 134 4.3.2 Manipulation and Mechanisms 137 4.4 A New View of Content-NCC Research 138 5. Schemas, Integration, and Content Ontology 139 5.1 Schema, Sketches and Strategies 140 5.2 Interfield Integration in Consciousness Studies 142 5.3 The Ontology of Visual Content 143
ii
VI. THE STRUCTURE OF SENSORIMOTOR EXPLANATION 144 1. An Outline of the Sensorimotor Theory 145 2. Dynamic System Theory and the Dynamical Hypothesis 149 3. The Explanatory Structure of the Standard SMT 152 3.1 A Nomothetic Explanation 152 3.2 The Mere Description Worry and the Role of Representations 156 4. Towards a Mechanistic SMT 158 4.1 Mechanizing the SMT 159 4.2 The SMT as a Complement to the Orthodoxy 164
PART IV THE ROAD TO STRUCTURE
VII. THE CONFIGURATION AND ONTOLOGY OF VISUAL OBJECTS 171 1. Objects, Universals, and Tropes 172 1.1 Two Constraints on Visual Objects 172 1.2 Against Type-Three Nominalism 173 1.3 Universals and Tropes 178 1.3.1 Universals 179 1.3.2 Tropes 180 2. The Ontology of Visual Objects and Properties 182 2.1 Configuration and Visual Objects 182 2.1.1 The Configuration Constraint 182 2.1.2 Facts and Bundles 186 2.1.2.1 Facts, Facts, and Facts 187 2.1.2.2 Configuration and Bundles 189 2.1.3 Interim Conclusion 190 2.2 The Particularity Constraint 191 2.2.1 Keeping Particularity Within Representationalism 191 2.2.1.1 Schellenberg’s Argument 193 2.2.1.2 Rescuing Particularity within Representationalism 194 2.2.2 Universals, Tropes, and the Particularity of Perception 197 2.2.3 Interim Conclusion 198 3. Tagging Things in the World 198 3.1 Three Trope Theories 198 3.1.1 Standard Trope Theory 199 3.1.2 Resemblance Class Trope Nominalism 200 3.1.3 Natural Class Trope Nominalism 201 3.2 Tropes and Perceptual Tagging 202 3.2.1 The Solution 202 3.2.2 Advantages of Tagged Tropes 205
VIII. TOWARDS PSYCHONEURAL ISOMORPHISM? 208 1. Setting the Stage 208 1.1 Varieties of Isomorphism 209 1.2 Visual Accuracy Phenomena 209 1.3 Intentional Mechanisms 210 1.4 The Broad Picture 211 2. Modeling Visual Objects 213 2.1 What Are Models? 213 2.2 Models of Visual Objects 217 2.2.1 Philosophical Models of Visual Objects 217 2.2.1.1 Justifying Philosophical Models 217 2.2.1.2 Families of Philosophical Models 222 iii
2.2.2 Scientific Models of Visual Objects 224 2.2.3 Models of Visual Objects as Phenomenological Models 227 2.3 Model Pluralism about Visual Objects 230 3. Connecting the Two Domains 232 3.1 The Matching Content Doctrine 233 3.2 Jean Petitot’s Neurogeometry of Vision 236 3.2.1 Neurogeometry and Psychoneural Isomorphism 237 3.2.2 The Limits of Neurogeometry 242 3.2.2.1 Intertheoretic Integration 242 3.2.2.2 The Explanatory Structure of Petitot’s Model 245 3.3 Connecting Morphological Explanations with Mechanisms 246
CONCLUSION 250
BIBLIOGRAPHY 251
iv
List of Figures and Tables
Fig. 1 “How to detect the Blind Spot.” Ch. 1, p. 3 Fig. 2 “Neon Color Spreading and Craik-O’Brien-Cornsweet Effect.” Ch. 1, p. 4 Fig. 3 “Kanizsa Triangle.” Ch. 1, p. 4 Fig. 4 “Perception of Surface Colors.” Ch. 1, p. 10 Fig. 5 “Petitot’s Scheme of Emergent Phenomenal Space.” Ch. 1, p. 22 Fig. 6 “The Two Domains of Psychoneural Isomorphism.” Ch. 2, p. 30 Fig. 7 “The Subsystems of Visual Perception.” Ch. 3, p. 56 Fig. 8 “Sets and Subsets of the Mind and the Brain.” Ch. 3, p. 75 Fig. 9 “Gabor patches.” Ch. 4, p. 89 Fig. 10 “Material and visual objects.” Ch. 4, p. 99 Fig. 11 “Chalmers’ content-NCCs.” Ch. 5, p. 115 Fig. 12 “Decomposition of a Visual Object.” Ch. 5, p. 127 Fig. 13 “Intentional Mechanisms Underlying a Visual Object.” Ch. 5, p. 128 Fig. 14 “Target Activity and Neural Confounds” Ch. 5, p. 136 Fig. 15 “Content-NCCs: A Schema” Ch. 5, p. 141 Fig. 16 “Fellman & Van Essen’s hierarchy of visual areas” Ch. 5, p. 142 Fig. 17 “Buhrmann et al.’s Minimal Agent Model.” Ch. 6, p. 161 Fig. 18 “A Simple Visual Object.” Ch. 7, p. 187 Fig. 19 “Configuration and Emergent Properties.” Ch. 7, p. 205 Fig. 20 “Dennett’s Parrot-Tagging.” Ch. 7, p. 205 Fig. 21 “The Two Domains Revisited.” Ch. 8, p. 211 Fig. 22 “Model, Model Description, and Target.” Ch. 8, p. 215 Fig. 23 “Families of MoPs.” Ch. 8, p. 223 Fig. 24 “The Threefold Modeling Relation Applied.” Ch. 8, p. 224 Fig. 25 “A Tree Hierarchical Structure.” Ch. 8, p. 225 Fig. 26 “A Tree Representation of Two Visual Objects.” Ch. 8, p. 226 Fig. 27 “A Tree Representation of a Natural Scene.” Ch. 8, p. 226 Fig. 28 “Multistable Material Objects.” Ch. 8, p. 227
Tab. 1 “Dynamical Hypothesis and SMT’s theses.” Ch. 6, p. 151 Tab. 2 “Three-types of Nominalism.” Ch. 7, p. 175 Tab. 3 “The Varieties of Class Nominalism.” Ch. 7, p. 176 Tab 4 “Conceptual and Geometrical Eidetics” Ch. 8, p. 238
v
0
PREFACE
This work offers a systematic analysis of the concept of psychoneural isomorphism. Roughly, it means that between something “psychological” and something “neural” there is an isomorphism, i.e. an invertible function that completely maps the relational structure of one domain onto its image. The concept was put forward by Gestalt psychologists in the late ‘20s, and his fiercest advocate was Wolfgang Köhler who coined the term “psychophysical isomorphism.” Part of the motivation that led some psychologists to endorse this concept was its potential heuristic value in the search for brain correlates of psychological phenomena. Today the concept is sometimes mentioned in debates about the neural correlates of our perceptual experience (cfr. Ch. 1). As I will show in this work, the concept has so far eluded a systematic characterization, such that it is unclear what is isomorphic to what, what kind of relational structures are the “psychological” and the neural domains, what kind of thesis is that of psychoneural isomorphism, and what role the concept may play in current debates in the philosophy of mind and cognitive science.
~
Some elucidations about the notation. This work is divided into eight Chapters. Reference to Chapters within this work are always capitalized and abbreviated, e.g. Ch. 1, Ch. 2, etc. Reference to chapters of other books is always written in full, e.g. Burge 2010, chapter 8. Each Chapter is divided into several sections. Reference to sections within the same Chapter is marked with the section number, preceded by the sign §, e.g. §1, §2, §3, etc. When reference is given to a specific section of another Chapter, it is first given reference to the Chapter and then to the section, e.g. Ch. 2, §2. Each section is divided into a number of paragraphs, and sometimes sub-paragraphs. In this case, reference within the Chapter is noted e.g. §2.2 or §3.1 for paragraphs or §2.2.2 and §3.1.2 for subparagraphs, whereas reference to some particular paragraph and subparagraph of other Chapters is marked like in the following example, Ch.3, §2.2 or §2.2.3. When referring to multiple sections, the following abbreviation is adopted, §§, e.g. Ch. 3, §§2-3.
Bibliographic references are given within the text in short form, and in full in the Bibliography at the end of this work. I have adopted the following convention (broadly following the Chicago Manual of Style, 16th Edition): short reference gives the surname of the author and the publication date, e.g. Burge 2010, Clark 2000. To disambiguate between works of the same author published in the same year, a letter is added at the end of the publication year and proceed in alphabetical order, starting with the first work cited, e.g. Palmer 1999a, 1999b. vi
Reference to multiple works of the same author mention the surname of the author only once, the publications years are separated by a comma, e.g. Chalmers 1996, 2004; references to multiple authors are demarcated by a semicolon, e.g. Chalmers 1996; Clark 1997. References to pages are given separating them with a comma from the publication year, e.g. Bechtel 2008, p. 18. Full reference is given in the footnotes only where I refer to works not listed in the Bibliography.
Parts of this work have already been published in journals and conference proceedings. The following list mentions the papers that have already been published and the Chapters to which they refer. Sometimes the following papers correspond almost entirely to whole Chapters (especially 4 and 6). In other cases, the published material has been re-used and adapted to fit in a Chapter.
[Chapters 1 and 8] “Fenomenologia naturalizzata nello studio dell’esperienza cosciente” Rivista di filosofia 107/1 (2016), pp. 27-48.
[Chapters 2 and 5] “Psychoneural Isomorphism and Content-NCCs” Gestalt Theory 38/2-3 (2016), pp. 177-190.
[Chapter 4] “Do We See Facts?” (under review)
[Chapter 5] “Manipulating the Contents of Consciousness” In Noelle, D. C., Dale, R., Warlaumont, A. S., Yoshimi, J., Matlock, T., Jennings, C. D., & Maglio, P. P. (Eds.). Proceedings of the 37th Annual Meeting of the Cognitive Science Society (pp. 2487-2492). Austin, TX: Cognitive Science Society, 2015.
[Chapter 6] “Sensorimotor Laws, Mechanisms, and Representations.” In Bello P., Guarini M., McShane M. & Scassellati B. (Eds.) Proceedings of the 36th Annual Conference of the Cognitive Science Society (pp. 3038-3042). Austin TX: Cognitive Science Society.
[Chapter 6] “The Structure of Sensorimotor Explanation” Synthese (2017)
[Chapter 8] “Philosophy as a Simulation of Nature: Modeling Perceptual Content” under review
vii
Acknowledgments
I have greatly benefited from discussions with various people in the last years of work on psychoneural isomorphism. I would like to thank the Barbara-Wengeler Stiftung for the generous financial support for the two years 2014-2016, and also the Ruhr-Universität Bochum who supported me financially from late 2016 until the thesis submission in 2017. Proceeding in chronological order, I would like to thank Dr. Alexander Staudacher, one of my former teachers when I was a graduate student at the Humboldt-Universität zu Berlin. He has provided over the years useful comments to my work and supported my applications for a Barbara- Wengeler-Stiftung scholarship and my research stay at the University of Cambridge. Many thanks also to Prof. Andreas Bartels from the Universität-Bonn, who was my first supervisor before I moved to the Ruhr-Universität Bochum, where I eventually completed the PhD thesis. A big thank to my supervisors, Prof. Marcin Milkowski and Prof. Tobias Schlicht, who supported in various ways this work, and provided many insightful and intelligent comments that dramatically improved the quality of this work. I have also greatly benefited from comments from other people working at the Ruhr-Universität Bochum, in particular: Prof. Albert Newen, Krys Dolega, Judith Martens, Sabrina Coninx, Dr. Beate Krickel, Prof. Markus Werning, Elmarie Venter, and Luke Roelofs. I also greatly benefited from a research stay at the University of Cambridge, sponsored by Prof. Tim Crane, who kindly invited me to attend his weekly seminars on philosophy of mind and perception. The research stay in Cambridge eventually culminated in Ch. 4—one of the most important parts of this work. I presented a first draft of this Chapter in a talk I have at Peterhouse, as part of Tim Crane’s weekely meetings of his project New Directions in the Study of the Mind. I greatly benefited from comments and discussions with Prof. Tim Crane, Prof. Craig French, Prof. Bence Nanay, Dr. Henry Taylor, Alex Moran. Thanks also to Dr. Joseph Neisser for his comments on my paper “Do We See Facts?” and for a stimulating discussion on the problem of isomorphism in Helsinki, 2015.
Many parts of this work have been presented at several conferences, I would like to collectively thanks the audiences and conference organizers of at least the following conferences: 12th Annual Meeting of the Nordic Society of Phenomenology, Helsinki 2014; 88th Joint Session of the Aristotelian Society and Mind Association, Cambridge 2014; 36th Meeting of the CogSci, Québec City 2014; Rudolf-Carnap Lecture, Bochum 2015; 19th Scientific GTA Convention, Parma 2015; 37th Meeting of the CogSci, Pasadena 2015; Mechanistic Integration and Unification in Cognitive Science, Warsaw 2016; The Human Mind Conference, Cambridge 2017. Thanks also to the Arts and Humanities Research Council (AHRC) for a generous bursary to attend the conference ‘Mental Representations—Naturalistic Approaches’ organized by Prof. Nicholas Shea in London, 2016; and thanks also to the Aristotelian Society for granting me a scholarship to attend the 88th Joint Session. A special thank for their comments or support viii
of my work to Prof. Fiorenza Toccafondi , Prof. Vittorio Gallese, and Prof. Achille Varzi, who made me better aware of the importance of the problem of the metaphysics of properties.
Finally, I would like to thank my parents, who supported me in an extremely difficult time of my life that unfortunately occurred during the early stages of writing this PhD thesis. Many thanks to my friends, who either encouraged me, or were the accidental victims of my obsession with the core problems of this thesis, or with whom I discussed the mathematical aspects of my thesis. In particular: Francesco Altiero, Chiara Rita Napolitano, Mariapia Dell’Omo, Antonio Bellotta, Giulio Capriglione, Laura Pennisi, Davide Manna, Daniela Longobardi, Elena Benicchi, Gabriele Rasi, Simona Wanda Conzales, Alessandro Bramucci.
ix
PART I
PSYCHONEURAL ISOMORPHISM
THE PROBLEM AND RESEARCH STRATEGY
1
THE PROBLEM OF PSYCHONEURAL ISOMORPHISM
When it comes to the task of theorizing about the relationship between what we experience and the underlying biological substrate or “neural correlate,” philosophers and scientists have sometimes mentioned the concept of “psychoneural isomorphism.” “Isomorphism” is a mathematical concept: it is a function or map that completely preserves the structure of a domain or object onto another domain or object (cfr. Ch. 2, §1). A “psychoneural” isomorphism is an isomorphism that holds between something “psychological” and something “neural.” Among the researchers who have mentioned or discussed this concept—from now on, “PI”—we can enumerate: Bridgeman (1983), Lehar (1999, 2003), Noë & Thompson (2004), O’Regan (1992, 2011), Palmer (1999a), Pessoa et al. (1998), Petitot (2008), Revonsuo (2000), and Thompson (2007). Yet, with the exception of Lehar (2003) (cfr. Ch. 2, §2.3), none of these researchers has provided a systematic analysis of PI. In this work, I set out to fill this gap and to shed light on the role of PI within contemporary research in the philosophy of perception and the cognitive sciences.
In this Chapter, my objective is to justify the present investigation and clarify the nature of my contribution to our understanding of the relationship between perceptual content and its biological substrate. To this end, I critically outline two recent debates where the concept of PI would (allegedly) play an important role. The first debate (§1) touches on the issue of filling-in or “perceptual completion.” The second one (§2) touches on the issue of the naturalization of Phenomenology, and the problem of mapping phenomenal states onto the underlying neuronal states. The first two Sections help us determine the proper philosophical context of our problem, and hence also elucidate the contribution of this work to the current debates (§3).
A caveat is in order. In the next pages, I will often mention concepts such as “contents” (or “perceptual content”), “neural correlate,” and “consciousness” without providing any clear definition. This is not an arbitrary choice. As it will turn out, much of the present work consists precisely in a clarification of these concepts (on “content,” cfr. Ch. 3, 4, and 7; on “neural correlate”, cfr. Ch. 5). For now, the following rough definitions are given. With “perceptual content” I refer to the conditions of accuracy of perceptual experience, i.e. the conditions under which a perceptual state is an accurate representation of a represented object. A “neural correlate” should be understood as a particular area of the central nervous system that is somehow related to a given psychological phenomenon. Thus, the neural correlates of visual perceptual contents are the brain regions whose activity is somehow related to the subject’s visual perceptual accuracy. Finally, with “consciousness,” I refer to a subject’s experience: the Chapter 1: The Problem of Psychoneural Isomorphism state a subject is in, when she is normally awake, in contrast with being unconscious (on “consciousness” cfr. Ch. 3).
1. Filling-in, Cartesian Materialism, and Isomorphism
After the publication of Dennett’s Consciousness Explained (1991), there was a sudden spurt of interest from philosophers for the family of phenomena known as “filling-in” or “perceptual completion” (Pessoa et al. 1998). In these phenomena, the brain seems to fabricate our perceived reality, creating the illusion of a continuous and richly detailed experience. Within the debate on filling-in, the concept of PI has sometimes been mentioned, especially in relation with the problem of explaining filling-in phenomena. In a nutshell, the relation between PI and filling-in can be summarized as follows. What we consciously experience is not a mere passive registration of the physical stimuli, and it is well known that the structure of the received physical stimuli does not correspond to what we see (as shown by filling-in phenomena). Since the perceptual content seems to be a complete representation of the visual scene, some researchers may suggest that visual perceptual content must correspond—perhaps up to the point of an isomorphism—to some kind of neural activity that fills the gaps of the physical information. Thus according to some researchers, PI would be a necessary requirement of any successful explanation of the percepts.
In order to lay bare the role of PI in the debate, I focus on Pessoa et al.’s (1998) study on filling- in. I first provide an overview and taxonomy of filling-in phenomena (§1.1). Later (§1.2), I introduce Dennett’s standpoint, since it plays a critical role in shaping the contribution of Pessoa and his collaborators. I finally (§1.3) dwell on Pessoa et al.’s account of filling-in and the role of PI, developing some critical remarks.
1.1 What is Filling-in?
The term “filling-in,” or “perceptual completion,” refers to several distinct perceptual phenomena that consist in the perception of features—such as colors and shapes, in the visual perceptual modality—although such features are not physically instantiated in the environment (Komatsu 2006, p. 220) (cfr. also Pessoa & De Weerd 2003). Cases of filling-in can be found in many perceptual modalities, but scientists have studied visual filling-in phenomena in some depth (Pessoa et al. 1998; Weil & Rees 2011). An example of non-visual filling-in is the familiar “proofreader effect.” To put it roughly, in the proofreader effect we do not sometimes notice mistakes and typos in a text because our minds tend to make “automatic corrections” in order to facilitate reading comprehension. To put it roughly, this happens because our mind “corrects” the mistakes in order to facilitate reading comprehension. Another interesting case of non-visual filling-in is the completion of acoustic information, especially parts of speech in contexts where noise would severely hamper the communication (Warren 1970). What is remarkable about these phenomena is that they nicely illustrate the active role of the brain in 2 Chapter 1: The Problem of Psychoneural Isomorphism constructing our perceptual experience of the world. In the next pages, I will dwell exclusively on visual filling-in phenomena.
There are several taxonomies of visual filling-in (Komatsu 2006; Myin & De Nul 2009; Pessoa et al. 1998; Weil & Rees 2011). Komatsu (2006, p. 221) categorizes these phenomena into three groups: (A) missing visual information; (B) cases of image stabilization on the retina or continuous identical visual input; (C) illusions. I will review them in this order.
(A). A paradigmatic example of this group is the case of the blind spot. In each human eye there is an area completely devoid of photoreceptors owed to the optic nerve that connects the eye with the optic chiasm. This region lies very close to the foveal area and extends in length ca. 6º and ca. 4,5º in breadth (Churchland & Ramachandran 1993, p. 28). Since this region is devoid of photoreceptors, one would expect the perceivers to experience a “blind spot” within their visual field, a “phenomenological blind spot.” Under normal conditions, we certainly do not notice anything suspicious, since we seemingly enjoy a rich and continuous visual phenomenology. That something interesting is going on, unbeknownst to us, is shown by a simple experiment that can reveal our visual blind spots, as shown by Fig. 1:
Fig. 1: How to detect the blind spot
If the observer looks at the black circle with the right eye closed from a distance of ca. 10-16 cm, after few seconds, she will notice the disappearance of the cross form the visual field. Something similar happens with scotomas. A scotoma is an area of the visual field that is blind due to some lesion or insult to th corresponding brain region. There are several different cases of scotoma, yet, if the damaged area is not too extended, some other brain areas may overtake its functions and “complete” the visual field (Pessoa et al. 1998, p. 731; Ramachandran & Gregory 1991).
(B). An excellent example of filling-in due to stabilization is the “Troxler effect,” named after the Swiss physician Ignaz Troxler who discovered it in 1804 (cfr. also Hamburger et al. 2006, pp. 1129-1138; Komatsu 2006, p. 221). When a subject stares at one specific object, without moving her eyes, she will notice after few seconds that items in the periphery of her visual field will disappear. The effect is soon dispelled as the subject moves her eyes, and items in the fringe of the visual field will “pop out” again. Hamburger et al. (2006) have also found evidence that when subjects are being shown figures with two or three colors, where one of the colors occupied a smaller surface, in case of the Troxler effect observers would see some particular color overflowing its region and covering other colors. In this way, Hamburger et al. (2006) 3 Chapter 1: The Problem of Psychoneural Isomorphism could bring evidence that some colors are filled-in more often—gray for example (ibid., third experiment)—whereas black is the strongest “inducer” (68,8% of the cases) that is never filled-in (ibid., pp. 1135-1136; cfr. also von der Heydt, Friedman & Zhou 2003).
(C). The third group of filling-in is that of visual illusions. Popular examples are the Neon- Color-Spreading—where bright colors seem to spread over a white background (Bressan et al. 1997; Pessoa et al. 1998, pp. 730-731; Todorović 1987) (Fig. 2 left)—, the Craik-O’Brien- Cornsweet effect, and cases of modal and amodal completion. The Craik-O’Brien-Cornsweet effect is illustrated by a figure that looks to be divided into two vertical gray regions, where the left-hand side looks darker than the right-hand side (Fig. 2 right). In reality, the figure the two sides have exactly the same luminance, except for a vertical abrupt discontinuity in the middle. Vision scientists take this phenomenon to show that our visual systems are more sensitive to abrupt discontinuities, rather than gradual ones (Komatsu 2006, p. 221).
Fig. 2: Neon color spreading (left), and the Craik-O’Brien-Cornsweet effect (right). The two sides of the figure have the same local luminance.
The most interesting instances of this group of filling-in phenomena, however, are cases by modal and amodal completion, and boundary and featural completion, which are nicely illustrated by Kanizsa figures such as Fig. 3.
Fig. 3: A Kanizsa triangle.
4 Chapter 1: The Problem of Psychoneural Isomorphism
Modal completion is shown by the fact that «the completed parts display the same type of attributes or “modes” […] as the rest of the figure» (Pessoa et al., 1998, p. 728); amodal completion refers «to the completion of an object that is not entirely visible because it is covered or occluded by something else» (ibid.). The observer apparently sees a white triangle in the foreground (modal completion), and another triangle in the background (amodal completion). Also, Fig. 3 illustrates a case of boundary completion (the boundaries of the triangle in the foreground), and featural completion (the illusory whiteness of the same triangle).
Much more could be added about filling-in phenomena, and what they reveal about the visual system (for detailed analyses, cfr. Pessoa & De Weerd, 2003). The real pivot point for the debate centers on the question of whether the brain actually “completes” the missing information or it simply “ignores” the absence of information in the afferent physical stimulus. Does the brain fill in the blind spot? Is the brain “painting” surfaces with colors from other regions of the visual field? Is the brain producing the visual impression of a white triangle in the foreground of a Kanizsa figure? It is in conjunction with these questions that filling-in phenomena are related with PI.
1.2 Dennett on Filling-in
In the eleventh chapter of Consciousness Explained, Dennett discusses the problem of filling-in as part of his attack against Cartesian Materialism, i.e. the position according to which there would be a central “stage” in the brain—a Cartesian theater—where representations converge to become conscious. Dennett’s contribution plays a critical role in shaping the subsequent debate on the problem of perceptual completion. As we will see in the next paragraph (§1.3), Pessoa et al. (1998) accept much of Dennett’s account, and only diverge from few (albeit important) details. It is therefore first necessary to briefly outline Dennett’s standpoint on filling-in. Dennett advances several considerations, but it is possible to articulate them into two steps: first, he casts doubt on the authority of first-person reports; second, he focuses on the relationship between consciousness and the brain.
Concerning the first step, much of Dennett’s work is a sophisticated attempt to demystify the presumption that we have some sort of privileged access to our own conscious experience. The subject’s phenomenological reports or “phenomenological descriptions”—i.e. utterances concerning the subject’s own conscious experiences—should be analyzed from a critical standpoint. Dennett calls this stance “heterophenomenology” (1982; 1991, p. 72, p. 98; 2005, pp. 35-46). Heterophenomenology demands us to handle phenomenological data just like data from any other field of scientific inquiry that require suitable interpretations. An analogy in this context might help. Heterophenomenology can be compared to the task of philologists who collate different versions of the same text in order to reconstruct a critical edition. It is only by comparing several sources, including, but not limiting to, the subject’s reports, that researchers
5 Chapter 1: The Problem of Psychoneural Isomorphism can fathom out what is really going on in the subject’s mind. In this respect, the heterophenomenological stance denies absolute authority to the subject about what is actually going on in her mind, whilst at the same time conferring «total, dictatorial authority over the account of how it seems to you, about what it is like to be you» (1991, p. 96; first emphasis added). Concerning the Kanizsa triangle, for instance, Dennett easily admits that for a perceiver it might seem as if there is a white triangle in the foreground, but this does not mean that an inexistent white triangle is presented in a ghostly subject’s phenomenological field. In other words, phenomenological descriptions are an insufficient source to rely on, and little, if anything, can be inferred from them without also taking into account additional sources. So, for instance, cases of filling-in do not provide conclusive evidence that something in the brain must actively complete the “missing” information. This leads us to the second step.
Dennett articulates this step in three distinct considerations about the relation between perceptual content and underlying brain processes. First, he contends that the brain does not need to produce a “final version” of the perceptual content. Second, he urges us to carefully distinguish between vehicle and content of perception. Third, he maintains that it is an empirical question to understand what happens in the brain in conjunction with our perceptual experience.
Turning to the first point, Dennett’s main lesson in his book (1991) is that philosophers and scientists should balk at the idea that the brain must produce a “rich” and detailed version of the conscious content (cfr. Ch. 3, §2.2) and that, once this version has finally been assembled, it could be manifested in consciousness thanks to some particular brain center. Dennett calls this idea “Cartesian Materialism,” and “Cartesian Theater” the supposed seat of consciousness in the brain. Instead, he proposes an alternative model, according to which the brain is described as a collection of highly competitive agents or “homunculi,” each of which produces its own “draft” or version of the perceptual content. According to Dennett, this Multiple Drafts or “Pandemonium” theory of consciousness would easily account for phenomena like the blind spot or cases of brain lesions whose functions are overtaken by other brain areas. Consider the blind spot. According to Dennett, since we are “naturally designed” with blind spots on our retinas, there is no reason to postulate in the brain some agents responsible for incoming information from the retinas’ blind spots. The absence of representation, as he reminds us, is not equivalent to the representation of absence. The perceivers simply do not notice the blind spots just like in cases of anosognosia, i.e. a condition in which a subject cannot detect a disability or impairment (1991, p. 355).
The second and third claims are strictly interwoven. Dennett operates a distinction between representational contents and their underlying vehicles (1978; 1991, chapter 4). The distinction can be cashed out in terms of what is represented, the content of a state, and the carrier of such content, the vehicle. For example, a painting might represent a landscape, the content being a 6 Chapter 1: The Problem of Psychoneural Isomorphism particular configuration of the oil colors, the figure and lines that can be more or less accurate with regard to the actual physical landscape being depicted (cfr. Ch. 3, §1.3). The vehicle of such a painting might be canvas and oil colors, the pencil’s graphite, and so on. Analogously, a digital picture realized by means of a software may represent something, perhaps the very same landscape of the painting. Dennett maintains that from the representational content alone very little can be inferred about the underlying vehicle (1991, p. 68). Take the case of the digital picture: from the digital image composed out of thousands of pixels very little can be inferred about how the computer generates it. If the representational content does not reveal much about the underlying vehicle, it follows that phenomenological descriptions, no matter how accurate, should be used very carefully in trying to infer or postulate the underlying agents in the brain that would be responsible for that content: «introspection provides us—the subject as well as the “outside” experimenter—only with the content of representation, not with features of the representational medium itself» (1991, p. 354). From this, he derives his third claim, that it is largely an empirical question to figure out what processes or brain structures lie behind the perceptual content (1991, pp. 353-354)1.
Let us pause to consolidate. On the one hand, we should not bestow an absolute authority on our phenomenological descriptions. Rather, phenomenological descriptions are but one important, yet, far from infallible, resource we can rely on to direct our research about how the brain generates the perceptual content. From the fact that we apparently see a richly detailed visual scene it does not follow that the brain is literally reproducing all the details of such a scene (cfr. Ch. 3, §2.2). On the other hand, Dennett suggests that there is no such thing as a single locus in the brain that realizes (or constitutes) our conscious experience. How the brain realizes our conscious experience is matter of empirical research, but Dennett clearly favors a multiple drafts model over the simplistic myth of a single locus that he calls the “Cartesian theater.” Since there is no single locus where representations converge only to be presented as if on an evanescent psychological scene for the amusement of an internal observer, there is also no need to suppose that the brain literally “completes” the representations.
What I have just described is but a sketch of Dennett’s framework, within which his considerations about filling-in ought to be embedded. It is striking to observe that Dennett holds an ambiguous stance towards filling-in phenomena. On the one hand, he explicitly suggests that the very idea of “filling-in” is but a leftover of Cartesian materialism: «This idea of filling in is common in the thinking of even sophisticated theorists, and it is a dead giveaway of vestigial Cartesian materialism» (1991, p. 344). The reasons that lead Dennett to this first
1 Dennett’s stance is very close to that expressed by Valentino Braitenberg: «But it is much more difficult to start from the outside and to try to guess internal structure just from the observation of behavior. It is actually impossible in theory to determine exactly what the hidden mechanism is without opening the box, since there are always many different mechanisms with identical behavior» (1984, p. 20). 7 Chapter 1: The Problem of Psychoneural Isomorphism conclusion root in the framework sketched out above: there is no need to think of perceptual content in terms of richly detailed representations that must be completed in order to appear on the stage of a Cartesian theater. Talk about “filling-in” would just be a metaphor that might easily lead us into thinking that there is something that needs to be completed, when in fact something is being ignored. Dennett’s positive interpretation of filling-in is that the brain “finds out” or “judges” that certain features are present, without the brain having to fill in any internally generated representation. On the other hand, Dennett is also of the opinion, as we have seen, that it is a matter of empirical investigation to find out whether the brain actually “completes” the missing information. This ambiguity becomes apparent in the following passages:
…it might turn out that somewhere in the brain there is a roughly continuous representation of colored regions […] This is an empirical possibility. We could devise experiments to confirm or disconfirm it. (1991, p. 353).
Now, is it possible that the brain takes on of its high-resolution foveal views […]? […] I suppose it is possible in principle, but the brain almost certainly does not go to the trouble of doing that filling in! (ibid., pp. 354-355; first emphasis added) (cfr. also Dennett 1992, pp. 42-43).
Hence, Dennett claims that talk about filling-in is but a relic of a vestigial Cartesian materialism, for there is no such thing as filling-in; but at the same time, he urges for caution in concluding how the neural system behaves in cases of filling-in, for the brain might actually complete the representational contents. Ultimately, only experiments, and not armchair reflection, will tell us whether there actually is a neural filling-in. This ambiguous stance toward filling-in shows up again in Pessoa et al.’s (1998) considerations about PI and filling-in.
1.3 Rejecting Analytic Isomorphism
We have seen that filling-in phenomena show that the structure of (visual) appearances does not correspond to the physical stimuli: we do not receive information from the blind spot, band stripes appear to be of different shades of gray in the Craik-O’Brien-Cornsweet effect, although they actually have the same luminance, and we seem to see a white triangle in the foreground in Fig.3. This leads us to the question: Does the brain actively represent this information or ignore it? Consider the case of the blind spot: Does the brain actively fill in the absent information from the blind region of the retina? If a positive answer is given, we are then led to the question: Must the neural activity be isomorphic to the structure of the percept? Some vision scientists respond in the affirmative.
Whatever happens at the neural level, what is at stake in the debate about filling-in is nothing less than the «proper form of explanation in cognitive neuroscience» (Pessoa et al. 1998, p. 726; emphasis added). Suppose one assumes that there is a brain region that forms the immediate 8 Chapter 1: The Problem of Psychoneural Isomorphism substrate of perceptual content, and that such a region must reflect the phenomenological discontinuities. One would then suppose that the proper explanation of a phenomenon such as, for example, the Craik-O’Brien-Cornsweet effect necessarily involves a neural discontinuity corresponding to the phenomenological difference in brightness: «the brain takes the local edge information and uses it to fill in the two adjacent regions so that the region with the luminance peak (left) becomes brighter than the region with the luminance trough (right)» (ibid., p. 726) (see Fig. 2). Pessoa et al. call such a thesis «analytic isomorphism». Analytic isomorphism is but one form of PI, and it results from the conjunction of the following theses:
(T1): Perceptual contents must have (a) neural correlate(s). (T2): Perceptual contents are realized in a specific brain region. (T3): Perceptual contents have the same structure of the underlying neural correlates.
Let’s call T1 the “neural correlate thesis;” T2 the “bridge locus thesis;” and T3 the “PI thesis.” T1-3 are conceptually distinct. Most scientists today accept some version of T1, but T1 does not entail T2, and whether it entails T3 remains an open question that will be examined in this work. Consider first T2. Some researchers believe that there must be one place in the brain that forms the immediate or direct substrate of perceptual experience. This doctrine goes under the name of “bridge locus.” A concise definition of this concept has been put forward by Teller & Pugh: «there exists a set of neurons with visual system input, whose activities form the immediate substrate of visual perception. We single out this one particular neural stage, with a name: the bridge locus» (1983, p. 581; cited in Teller 1984, p. 1235). The very idea of a bridge locus can be articulated in different ways. Teller and Pugh for example suggest that this locus might be a neural “stage,” assuming a hierarchical model of the neural activity. Such a stage could be a level of computation, viz. of information processing. Another way to interpret the bridge locus thesis is to state that there is one anatomical place in the brain, whose function is to realize or constitute the perceptual content. The bridge locus thesis (T2) entails the neural correlate thesis (T1), i.e. if the perceptual content is realized in a specific brain region the perceptual content has a neural correlate.
Consider now the “PI thesis.” According to some researchers (e.g. Fry 1948), a proper explanation of filling-in phenomena requires that, in addition to T1, there must be an «identity of shapes of spatial distributions of percepts and the underlying neural activities» (Todorović 1987, p. 548), i.e. there must be an isomorphism. In other words, PI would be a necessary explanatory requirement. In order to bring this claim into clearer view, we can focus on a specific study case: filling-in of colors. Filling-in of colors occurs in many of the three groups of filling-in phenomena examined in §1.1. We visually perceive uniform colors in the part of the visual field corresponding to the blind spot or to the lesion corresponding to scotomas (group A). It also occurs in stabilized stimuli, such as artificial stabilization of the retinal image. Artificial stabilization is achieved by mounting a small projector with a suction cap on the eye 9 Chapter 1: The Problem of Psychoneural Isomorphism
(e.g. Yarbus 1957, 1967, chapter 1; Tatler et al. 2010). In this case, the stabilized stimulus gradually fades away and assumes the color of the surrounding region (group B). Finally, another case of filling-in of colors occurs in the neon-color-spreading illusion, where we have the visual impression of a bluish patch of color spreading in the middle of the figure (see Fig. 2 left) (group C). Some researchers believe that perception is based on an image-like representation held in a two-dimensional array of neurons in which «color signals spread in all directions except across borders formed by contour activity» (Von der Heydt, Friedman, Zhou 2003, p. 107; Cohen & Grossberg 1984). These theories assume pointwise representations of visual information, where the activity of each element of the neural array represent either color or contour for one of the location of the visual field (Von der Heydt, Friedman, Zhou 2003, p. 107; Weil & Rees 2011, p. 41). In other words, these theories postulate a structural correspondence (an isomorphism) between the percept and the neural array. Isomorphic theories of color filling-in assume that color is represented by the activity of cells whose receptive fields point at the surface, but receive additional activation through horizontal connections. This is illustrated in Fig. 4:
Fig. 4: A (left), perception of the surface color results from the activity of the cells whose receptive fields point at the surface. A is disproven by filling-in phenomena such as the blind spot. B (right) is a representation of isomorphic color filling-in theories. Color features in this case are neutrally represented via horizontal connections (from Von der Heydt, Friedman, Zhou 2003, pp. 108-109).
The PI thesis has courted controversy. Some vision scientists think that only T1-2 are necessary philosophical assumptions about the nature of the neural correlates of perceptual content, but deny that T3 is required. Ratliff & Sirovich (1978) take this stance:
The neural activity which underlies appearance must reach a final stage eventually. It may well be that marked neural activity adjacent to the edges […] is, at some level of the visual system, that final stage and is itself the sought-for end process. Logically nothing more is required. Nevertheless, we cannot by any reasoning eliminate a priori some higher-order stage or filling-in process […] But parsimony demands that any such
10 Chapter 1: The Problem of Psychoneural Isomorphism
additional stage or process be considered only if neurophysiological evidence for it should appear. (p. 847)
Ratliff & Sirovich deny that any explanation of filling-in phenomena require a neural-perceptual isomorphism, joining the ranks of researchers who espouse non-isomorphistic explanations of filling-in phenomena like the Craik-O’Brien-Cornsweet effect (Bridgeman 1983; Foster 1983; Laming 1983; for a review, cfr. Todorović 1987, p. 548). More recently, Von Der Heydt, Friedman & Zhou (2003) consider an alternative, non-isomorphistic explanation, of color filling-in that requires a tentative association of features by low-level mechanisms (symbolic filling-in theory).
To deny T3 means to state that a proper explanation of a perceived phenomenological discontinuity does not need to be “mirrored” by a discontinuity of the underlying neural activity. Ratliff and Sirovich’s standpoint is similar to Dennett’s criticism of filling-in. A shared critique is that explanations of the phenomenological discontinuities do not need to postulate an equivalent discontinuity in neural activity. Also, they both believe that any such correspondence cannot be ruled out a priori, but requires experimental validation. Dennett, as we know (§1.2), goes one step further, denying credit to the very notion of a “final stage” that would form the immediate correlate of perceptual content. (I will return to this point below). As Todorović rightly observes, the point at stake touches on the issue of the nature of the relationship between neural activity and perceptual content. How should we understand this relationship? Todorović laments the lack of interest for this crucial issue («This relationship is crucial in physiological explanations of perceptual phenomena, but is seldom itself the focus of attention», p. 548), although the problem has a long and venerable history (cfr. Köhler 1929; Mach 1865; Müller 1896; Teller 1984; on the history of psychoneural isomorphism, see Ch. 2, §2). Yet, Todorović himself discusses the problem only briefly in his paper (pp. 548-549), taking side with the isomorphistic approaches, and espousing both T2 and T3: «the logical consequence of the isomorphistic approach is that a neural activity distribution not isomorphic with the percept cannot be its ultimate neural foundation» (1987, p. 549; my emphasis). In this passage, the “neural foundation” is clearly understood as the bridge locus thesis (T2), the neural location that makes a given content conscious. Howsoever T1-3 are interpreted, analytic isomorphism can be defined as the thesis according to which there is a single locus in the brain that is alone responsible for and is isomorphic with the perceptual content.
Todorović’s acceptance of what Pessoa and his collaborators call “analytic isomorphism” is clearly meant as an explanatory principle. This reading seems to find further support in the following passage:
If the question is, what is it about the neural substrate of vision that makes us see as we do, the only acceptable kind of answer is, we see X because elements of the substrate Y
11 Chapter 1: The Problem of Psychoneural Isomorphism
have the property Z or are in the state S (Teller 1990, p. 12; quoted in Pessoa et al. 1998, p. 728).
The patterns that hold between neural activities and visual phenomena would be codified by what Teller (1984) calls “linking propositions” (cfr. also Ch. 2, §2.3). Linking propositions, as the name suggests, are propositions linking statements about phenomenological states with statements about neural states2. Pessoa et al. (1998) clearly follow Todorović (1987, p. 548) in interpreting T3 as a particular instance of a specific family of linking propositions, the analogy family:
Φ looks like Ψ → Φ explains Ψ
The Greek letter Φ stands in for neural phenomena, whereas Ψ stands in for psychological phenomena. Pessoa et al. (1998, p. 728) contend that the arrow linking the two statements should not be read as the logical connective of material implication. Instead, it should be read as a heuristic:
…[It] is meant to guide the search for the major causal factors involved in a given perceptual phenomenon. Thus the term “explains” on the right-hand side is really too strong—the idea is that Φ is the major causal factor in the production of Ψ: “if psychophysical and physiological data can be manipulated in such a way that they can be plotted on meaningfully similar axes […] then the physiological phenomenon is a major causal factor in producing the psychophysical phenomenon” (Pessoa et al. 1998, p. 728; the quotation is drawn from Teller 1984, p. 1240).
As I have explained, T1 finds widespread consensus among researchers. Theses T2 and T3 are more problematic, and they do not entail one another, for certainly we can think of T3 without thereby espousing T2, and (perhaps) assume T2 without espousing T3. Taken together, they form the concept of “analytic isomorphism.” But what is exactly the role of analytic isomorphism? As we have seen, on the one hand, Pessoa et al. (1998) take it to be a specific doctrine that shapes the structure of explanation of perceptual phenomena, in line with Todorović and Teller. On the other hand, subsuming analytic isomorphism under the family of linking propositions, they explicitly deny that such isomorphism refers to an “explanation,” and contend that it would be instead a useful heuristic principle in individuating the relevant causal factors. I will return on this ambiguity in a moment; but before doing that, I will first present Pessoa et al.’s rejection of analytic isomorphism.
2 Notice that in this Chapter I am not espousing any particular ontological standpoint concerning the ontological status of the underlying neural correlates: terms like states, events or process should therefore be taken with a grain of salt. I will return on this issue in Ch. 5. 12 Chapter 1: The Problem of Psychoneural Isomorphism
On the face of analytic isomorphism, Pessoa et al. (1998) set out to show the following. Firstly, that analytic isomorphism is yet another manifestation of Dennett’s Cartesian theater, and as such, it must be rejected. Secondly, and contra Dennett, that there is plenty of evidence to show that filling in is a real phenomenon. Of the three theses that form analytic isomorphism, T2 bears a striking resemblance with Dennett’s Cartesian theater: the thesis according to which consciousness “occurs” in one specific locus of the brain. Pessoa et al. (1998, p. 742) argue that T2 is unwarranted for at least three reasons:
(a) Because brain regions are not independent stages or modules, they interact reciprocally (Zeki & Shipp 1988). Moreover, there is ample scientific evidence that shows that visual processing is highly interactive and context-dependent (Van Essen & DeYoe 1994). (b) Because cells in visual areas are not responsive to a single kind of features, but to many features (e.g. Martin 1988; Schiller 1996). Even at a larger scale than simple cells, more recently, some studies suggest that a strict compartmentalization paradigm is perhaps too simplistic (Grill-Spector & Malach 2004, p. 653; Malach 1994; for a review on the issue of cortical specialization, cfr. Kanwisher 2010). A good example is the controversy over the correct location of a color computation center. In the absence of a clear understanding of human color vision processing, Grill-Spector & Malach (2004, p. 654) suggest to speak of a «color-processing stream»—rather than a color processing area— that begins in the retina and passes through V1, V2, and through other areas until it reaches the V4/V8 complex. (c) Dennett & Kinsbourne (1992) have shown how postulating a centralized state hinders, rather than facilitates, our understanding of temporal perception.
Since analytic isomorphism consists of the conjunction of T1-3 (T1 ∧ T2 ∧ T3), it logically follows that rejecting T2 means rejecting analytic isomorphism altogether. It is this particular aspect of Pessoa et al.’s account that is manifestly inherited from Dennett, together with his skepticism about the role of phenomenological descriptions. However, in contrast with Dennett, who suspiciously regards filling-in phenomena as leftovers of Cartesian materialism, they contend that there is ample evidence supporting the existence of filling-in mechanisms in the brain (Pessoa et al. 1998, pp. 737-741).
We need not review the scientific literature discussing evidence for neural filling-in (cfr. Churchland & Ramachandran 1993; Matsumoto & Komatsu 2005; Pessoa & De Weerd 2003; Tong & Engel 2001; Weil & Rees 2011). It suffices here to draw attention to the fact that Pessoa et al. contend that, although there is evidence for neural filling-in, such phenomena do not entail any commitment to analytic isomorphism. However, as I said, the PI thesis (T3) is independent from T2, and hence it is still possible to defend some form of psychoneural isomorphism independently from analytic isomorphism. Although Pessoa et al. are aware of
13 Chapter 1: The Problem of Psychoneural Isomorphism this, they neither further discuss the role of T3, nor how we should construe it. Indeed, the very existence of such an isomorphism is left as an open empirical question:
Whether there are either spatial/topographic or topological/functional neural-perceptual isomorphisms in any given case is an empirical question for cognitive neuroscience to decide (1998, p. 742).
Before turning to some general problems, I would like to draw the reader’s attention to the following ambiguities. Firstly, as we have seen, Dennett does not want to prejudice the question of filling-in, and asserts that whether the brain completes the missing information is matter of empirical research. At the same time, he contends that most certainly, the brain does not fill in information, as thinking in this way would mean to espouse Cartesian materialism. Secondly, Pessoa et al. (1998) hold that isomorphism belongs to the family of linking propositions, and that the problem at stake is really that of the structure of explanation in cognitive neuroscience. Yet, at the same time, they are inclined to think that isomorphism is but a heuristic principle in identifying the relevant causal factors that underlie perceptual phenomena. Whether there is an isomorphism, disjoined from analytic isomorphism, so they claim, is an empirical question.
It seems that Dennett’s standpoint about filling-in phenomena hinges on the problem of what philosophers of science call stabilization. Roughly, the notion of stabilization refers to (a) the processes and methods whereby scientists empirically identify a given phenomenon, and (b) gradually come to agree that the phenomenon is a stable and robust feature of the world, rather than an artifact produced by any instrument, methodology or, in our case, some erroneous theoretic assumptions (on the notion of stabilization, cfr. Feest 2011, p. 59). Within the present context, Dennett contends that phenomenological descriptions alone are insufficient to determine the robustness of the filling-in phenomenon (this is sense (b) of stabilization). With a rough approximation, Dennett’s stance can be reformulated as the need for multiple determination in the identification of a given phenomenon (cfr. Culp 1994; Hacking 1981, 1983; Wimsatt 2007, pp. 37-74; for a dissenting voice, cfr. Hudson 2014). Concerning instead the problem of the relation between percept and underlying neural states, Dennett’s ambiguous stance results from his lack of any clear account of what it means to explain mental and perceptual phenomena. In other words, Dennett does not answer the following question: What is the proper form of explanation of visual phenomena?
The same ambiguity, as we have seen, can be found in Pessoa et al. (1998). Although they rightly point out that the concept of a PI has a long history in the philosophy of psychology and neuroscience, they do not ultimately clarify the role of a PI in vision science. The reason, again, is that they have neither thrown light on the relationship between perceptual content and underlying neural correlates, nor have they provided any clarification of what it means to
14 Chapter 1: The Problem of Psychoneural Isomorphism explain in cognitive neuroscience. Eventually, no clear conclusion is reached about PI, as they have not clarified what is or might be its role in the context of explanation in vision science.
In conclusion, I have shown that the problem of PI emerges in relation to the question of the proper form of explanation of psychological (perceptual) phenomena. As such, PI is an aspect of the search for the neural correlates of perceptual content. It is possible to hold PI, whilst, at the same time, denying analytic isomorphism. But if it is possible to hold PI without analytic isomorphism, what is exactly the role of PI, and what does it amount to? By now, we are left with a number of open questions that will be addressed in the next Chapters. For example:
− What are exactly the objects that stand in isomorphic relations? − What is the relation between PI and explanation of perceptual phenomena? − An isomorphism is a function or map that completely preserves the structure of one object onto another object, but what kind of structure is at stake in the present context?
It is not possible to fully understand PI without answering these questions.
2. Naturalizing Phenomenology and Isomorphism
In the previous Section, I have shown that the problem of PI emerges in relation to the problem of the search for the neural correlates of perceptual content. In this Section, I broach the issue of the naturalization of phenomenological descriptions and the problem of mapping perceptual states onto the cognitive system. In this debate, as in the previous one, the concept of PI seems to play a central, albeit obscure role. Many researchers maintain that rigorous phenomenological descriptions might guide the search for the neural correlates (e.g. Flanagan 1992; Horst 2005; Petitot et al. 1999; Thompson 2007; Varela et al. 1991; Varela & Shear 1999; Vernazzani 2016a). The advantages of such phenomenological descriptions in the search for the neural correlates is, however, dubious in the absence of a clear understanding of how we should map the phenomenal states onto the neural ones. Roy et al. (1999) have proposed a solution in the preface to the book Naturalizing Phenomenology that invokes the concept of PI.
I first describe the project of a naturalized Phenomenology in §2.1. I then move on to consider the problem of “matching” in the search for the neural correlates of consciousness §2.2, and finally discuss few instances of the concept of PI in the recent literature on the neural correlates of consciousness.
2.1 Naturalizing Phenomenology
Some proponents of phenomenological approaches to the study of the mind contend that adequate phenomenological descriptions are a necessary complement to third-personal investigation of the mind. Phenomenological descriptions are not equivalent to naïve phenomenal reports uttered by untrained perceivers. These researchers think that in order to 15 Chapter 1: The Problem of Psychoneural Isomorphism obtain accurate and helpful descriptions we need to rely on rigorous methods, that I will call “phenomenological methods” (Vernazzani 2016a, p. 28). Phenomenological methods are extremely heterogeneous, as they encompass Buddhist meditation techniques, introspectionism methods, and Husserlian Phenomenology (Varela & Shear 1999). Yet, even the most accurate phenomenological descriptions, if they have to guide our search of the underlying neural correlates, must be “naturalized.” Following Petitot et al. (1999), the problem of the naturalization of phenomenological methods will here be discussed only in relation to Husserlian Phenomenology. To prevent any possible confusion, I refer to the Husserlian method with a capital letter, Phenomenology, to distinguish it from other uses of the term.
There seemed to be mainly two motivations at the very heart of the phenomenological approaches (Vernazzani 2016a). The first motivation was the heuristic role of phenomenological descriptions. In the absence of any third-personal methods that could show the incontrovertible presence of conscious experience in a subject without relying on phenomenological reports, and without the means to exactly predict the texture and structure of a subject’s experience by merely observing the brain’s activity, rigorous phenomenological descriptions could provide a useful guide to neuroscience research (e.g. Gallagher 1997; Varela 1997). A nice exemplification of this problem is provided by a famous study-case discussed by Owen et al. (2006, 2007). The researchers studied a patient, a girl, in a vegetative state following a car accident, in order to understand whether she was consciously aware of external stimuli. In the course of two experimental sessions, the experimenter first read aloud few sentences, and then asked the patient to perform some motor acts, like playing tennis, or moving through her own house following a specific path. The patient’s neural activity was registered by means of fMRI, and later confronted with statistic parametric maps of some control subjects’ neural activity. The comparison showed that the patient’s neural activity was indistinguishable from that of the control subjects. This could suggest that the subject in vegetative state was, in some way, conscious of the external stimuli. However, as Naccache (2006) pointed out, from this outcome nothing can be inferred about the patient’s conscious activity3. At the present stage (Dehaene & Naccache 2001), the search for the neural correlates of consciousness must still rely on verbal or behavioral phenomenological reports.
Relatedly, it is sometimes argued that phenomenological descriptions might be helpful in theory construction as well as in theory confirmation (Roy et al. 1999, p. 12). The construction of theories about the neural activity that allegedly explains our conscious experience must take
3 It is noteworthy that recent developments in the neurosciences have now devised new methods to study the conscious activity from a third-personal viewpoint. For example, Jack Gallant and collaborators are now able to decode simple semantic contents from brain activity (e.g. Nishimoto et al., 2011; Huth et al. 2016). For more recent developments on neural correlates of different levels of consciousness, cfr. Boly et al. (2013). These new studies do not undermine the importance of verbal or behavioral reports, but they certainly weaken Naccache’s statement that nothing can be inferred from the brain activity alone. 16 Chapter 1: The Problem of Psychoneural Isomorphism descriptions of such an experience into account. In this way, we will be able to develop theories of specific mental phenomena according to reciprocal constraints (Varela 1997). A similar idea was at the heart of Owen Flanagan’s “natural method.” The method consists in balancing different perspectives in the construction of theories about conscious phenomena:
Tactically, what I have in mind is this. Start by treating three different lines of analysis with equal respect. Give phenomenology [i.e. conscious experience] its due. Listen carefully to what individuals have to say about how things seem. Also, let the psychologists and cognitive scientists have their say. Listen carefully to their descriptions about how mental life works and what jobs consciousness has, if any, in its overall economy. Finally, listen carefully to what the neuroscientists say about how conscious mental events of different sorts are realized, and examine the fit between their stories and the phenomenological and psychological stories.
The object of the natural method is to see whether and to what extent the three stories can be rendered coherent, meshed, and brought into reflective equilibrium. […] As theory develops, analyses at each level are subject to refinement, revision, or rejection. (Flanagan 1992, p. 11).
Enter the problem of naturalization. Roy et al (1999, p. 13) claim that we cannot make use of phenomenological descriptions in the absence of an explanatory link between the phenomenological level and the neural level. However, in spite of their programmatic declarations, Roy et al. in their contribution do not discuss the problem of what it would mean to scientifically explain consciousness, and no reference is made to the rich philosophical literature on scientific explanation. Instead, they believe that the central problem is that of naturalizing the phenomenological methods, and Phenomenology in particular. With “naturalizing” they mean: «integrated into an explanatory framework where every acceptable property is made continuous with the properties admitted by the natural sciences» (ibid., pp. 1- 2). Roy et al. then go on listing some possible ways to achieve the naturalization of the phenomenological descriptions: by reducing the phenomenological descriptions along the lines of an eliminativist standpoint (Churchland 1986); by adopting an “as if” strategy, according to which phenomenological descriptions refer to merely fictive entities postulated for pragmatic reasons; by enlarging our concept of nature to include also the “mental”; and finally by mutual constraining in theory construction. Of all these strategies, Roy et al. declare their preference for the third one.
Mutual constraining can be achieved in three different ways (Roy et al. 1999, pp. 66-68). The first one is by means of linking propositions (cfr. §1.3), the second one is by means of isomorphism, and the third one by means of generative passages. The former were already discussed in the previous section. Concerning PI, Roy et al. do not discuss in any detail what it
17 Chapter 1: The Problem of Psychoneural Isomorphism would mean to say that phenomenological descriptions might be isomorphic with the underlying neural correlates. In fact, they quickly dismiss PI with the following words:
But this isomorphic option makes the implicit assumption of keeping disciplinary boundaries: the job of [P]henomenology is to provide descriptions relevant to first- person phenomena. The job of natural science is to provide explanatory accounts in the third person. Both approaches are joined by a shared logical and epistemic accountability. But is this really possible or even productive? Is this not another form of psycho-neural identity? (Roy et al. 1999, p. 68).
With these words, the “isomorphic” way to naturalization is quickly dismissed. The passage is somewhat obscure, as remarks pertaining to different philosophical areas are confusedly brought together. On the one hand, Roy et al. seem to criticize PI on the ground that it would preserve disciplinary boundaries between Phenomenology and the sciences. Why exactly this would be a problem is unclear. Talk about integrating phenomenological perspectives with scientific theories seems to be a typical instance of the problem of interfield integration (e.g. Vernazzani 2016a)—i.e. the problem of understanding how different scientific fields interact—, but why disciplinary boundaries would be a problem in this context is far from clear. On the other hand, Roy et al. cast doubt on two yet different issues: the very coherence and usefulness of PI, and its alleged ontological implications. Concerning the former point, asking whether PI is «possible» is just another way to ask what PI means, what are its relata, etc. (see the questions at the end of §1.3). Since Roy et al. do not address these questions, it is unclear what motivates their rejection of PI. Concerning the latter point, Roy et al. seem to think that PI entails some form of identity theory, i.e. the philosophical position according to which the mind is the brain. This contention is echoed by a later contribution of Antti Revonsuo who, discussing the problem of the mapping relation between consciousness and its neural correlates, states:
…there must be isomorphism between one specific level of organization in the brain and phenomenal consciousness, simply because these boil down to one and the same thing. (2000, p. 67)
In other words, Revonsuo thinks that, if consciousness is identical to some level of organization in the brain, PI must be true. However, in his contribution Revonsuo does neither clarify what is the structure of «phenomenal consciousness», nor what is the structure of the «level of organization in the brain». Furthermore, neither Revonsuo nor Roy et al. spell out what kind of identity theory would be implied by PI. Without a detailed characterization of these issues, PI remains a vague and confused concept. (I will return on the relationship between PI and the metaphysics of the mind in Ch. 2, §1.3).
After rejecting PI, Roy et al. turn to the third way to achieve mutual constraining: the generative passages. Generative passages are described as the «passages» that allow the mutual constraints 18 Chapter 1: The Problem of Psychoneural Isomorphism to be «operationally generative» (Roy et al. 1999, p. 68). What this exactly means is unclear, but they seem to suggest that both sides—the phenomenological and the neural one—could be abstractly described mathematically so to belong to «both sides at the same time» (ibid.). Put in this way, generative passages closely resemble PI: there can only be an isomorphism if we mathematically describe the structures of the two domains, and the two domains turn out to have the same structure (cfr. also Bayne 2004). Whilst the link between the concepts of generative passages and PI remain obscure in Roy et al. (1999), the authors overtly prefer the former way to naturalize Phenomenology. What is clear, however, is that for these authors a central problem is that of finding a way to map phenomenological descriptions onto the underlying neural correlates. It is to this issue that I now turn.
2.2 Mapping the Neural Correlates of Consciousness
The idea of mapping perceptual contents onto their neural correlates is clearly expressed by David Chalmers in his classic contribution to the nature of the neural correlates (2000). In this paper, Chalmers argues that the perceptual content must correspond or “match” (the term is due to Noë & Thompson 2004) with the neural correlate. Chalmers motivates this contention via a reference to some important studies in the neuroscience of consciousness.
In several works, Crick & Koch (1995, 1998) have argued that the neural activity of the primary visual cortex V1 cannot be the direct correlate of conscious visual perception in virtue of a mismatch between conscious perception and the properties of the neurons’ receptive field in V1. The mismatch at stake can be shown by means of a phenomenon like the Land effect, i.e. a case of partial color constancy, where the perceived color at one particular location is influenced by wavelength of the light entering from the surrounding region of the eye (Land & McCann 1971). Interestingly, studies on anesthetized monkeys have shown that neurons in region V4, but not in V1, exhibit the Land effect (Schein & Desimone 1990; Zeki 1983), thus suggesting that V1 cannot be the correlate of this effect in virtue of a “mismatch.”
Another case that illustrates the matching relation is provided by experiments devised by Gur & Snodderly (1997). Alternating two isoluminant colors at a frequency beyond 10Hz in humans causes the perception of a single fused color. Yet, in spite of the color perception, color opponent cells in V1 of two alert macaque monkeys follow high-frequency flicker above heterochromatic fusion frequencies (Crick & Koch 1998, p. 102).
Beside these specific experiments, it is believed that a matching relation lies at the very heart of neuroscience research trying to uncover the functional specialization of some brain areas. One of the most popular cases that nicely illustrate the functional specialization of some brain areas is the syndrome of achromatopsia. Achromatopsia is a condition in which subjects loose the ability to see colors, although they still retain the ability to consciously visually perceive. Experiments on subjects affected by achromatopsia provide indirect evidence for the role of 19 Chapter 1: The Problem of Psychoneural Isomorphism areas V4 and V4α in color perception (Sacks et al. 1988; Zeki 1990)4. However, indirect proof can be deceiving, for it does not bring conclusive evidence of the direct functional role of a brain area for a specific function. Direct evidence correlating activity of V4 with color perception has been shown by Zeki et al. (1991) through color and gray stimulation, detecting a significant change of activity only in the region of the lingual and fusiform gyri: the areas we call V4 (see also McKeefry & Zeki, 1997).
These experiments suggest that this “matching” is a relation of co-occurrence between a psychological or phenomenological effect and a corresponding neural occurrence. This co- occurrence relation raises several questions. Firstly, whether this matching relation justifies talk about an isomorphism. I tackle this issue in the next paragraph (§2.3). Secondly, we should spell out the nature of the “vertical” relation holding between perceptual contents and the neural correlates. Crick (1996, p. 485) maintains that the notion of “correlation” embedded within the very concept of “neural correlate of consciousness” would enable us to sidestep a number of metaphysical issues about the consciousness-brain relation. This might be a useful strategy, if we want to put aside some technicalities, and focus instead on more pressing practical issues. Chalmers shares Crick’s standpoint, and states that the search for correlation «can be to a large extent theoretically neutral» (2000, p. 37). The first issue deserves few more comments here; the second issues will be addressed in a later Chapter (5, §§3-4).
2.3 From Matching to Isomorphism?
The correspondence, matching, or “co-occurrence” of perceptual content with neural activity is hardly a proof of an isomorphism. Some researchers, however, have taken a stance on whether there is a PI in this sense. We can individuate two camps. The first camp is championed by Noë & Thompson (2004) and by Thompson (2007). These philosophers deny that there is an isomorphism between perceptual content and underlying neural correlates. Defenders of the second camp, like Petitot (2008), hold the opposite view, according to which there actually is a PI, and that it plays a central role within the project of the Naturalization of Phenomenology.
Noë & Thompson (2004) in their contribution argue that there is no matching relation (§2.2) between perceptual content and the underlying neural activity. The neural activity that is supposed to match with the perceptual content would be the receptive field of single neurons. In short, a neuron’s receptive field is the area surrounding it where the presence of a stimulus will alter its firing rate. The “matching” relation is then clearly interpreted as a form of isomorphism. Hence, they deny that there is any PI. Their argument is based on three different
4 Similarly, Lashley argued that visual mechanisms do not extend beyond the striate cortex because lesions in the prestriate region of the monkey «has not been found to produce any disturbances in sensory or perceptual organization» (Lashley 1948, quoted in Mishkin, Ungerleider, Macko 1983, p. 199). As we now know (Grill-Spector & Malach 2004), Lashley was wrong: the visual system extends far beyond the striate cortex. 20 Chapter 1: The Problem of Psychoneural Isomorphism considerations (2004, p. 14). First, they contend that perceptual content exhibits structural coherence. This would mean that perceptual content has a peculiar structure described by figure-ground relations and other Gestalt phenomena (e.g. Bozzi 1989; Köhler 1929). Yet, a neuron’s receptive field certainly does not exhibit such structural coherence. Second, perceptual content is intrinsically experiential, or to borrow Nagel’s (1974) phrase, there is something it is like to experience a perceptual content (cfr. Ch. 3, §2). But, so Noë & Thompson argue, there is nothing it is like to experience a receptive field content. Third, perceptual content would be active and attentional. Perceptual content would be produced for the purpose of action and the exploration of the environment. The process of exploration would be crucially shaped by the role of attention. This would be clearly shown by examples of occluded objects. Take the example of a car seen from behind a fence. The car does not appear “complete,” i.e. the subject does not see the car in its entirety because it is occluded by another object. Yet, there is a sense in which we see the “whole” car whose presence is merely attentional (e.g. Kanizsa & Gerbino 1982). Again, a neuron’s receptive field does not exhibit any of these properties.
The lesson drawn from these considerations is that there is no matching or isomorphic relation between perceptual, experienced content and its underlying neural correlates. On the basis of these arguments, Thompson (2007, p. 350) suggests that the very idea that «neural systems described neurophysiologically could match conscious states and their content» is simply a category mistake. The three arguments presented above, from structural coherence, from experience, and from the perceptual content’s active and attentional character, would show that neural and perceptual contents would be different in kind. Thompson furthermore adds (ibidem) three more features that are common among conscious states but not neural states: they are intentional (or «world-presenting», i.e. they are directed at something in the world, for example like perceptual states present some particular item or feature of the world, cfr. Ch. 3, §1.3), they are holistic (they are constituted by interrelated perceptions, intentions, emotions and actions), and they are intransitively self-aware (or non-reflective subjective character). Still, in order to preserve some form of relation between perceptual content and neural activity, Noë & Thompson (2004, p. 15) argue that there is some form of content «agreement» (cfr. Thompson 2007, pp. 357-358). What this “content agreement” would be, however, is unfortunately left hanging in the air.
There are several highly controversial claims in Noë & Thompson (2004) (cfr. Ch. 8, §3.1). One in particular is the claim that the matching or isomorphic relation would hold between perceptual content and single neurons’ receptive fields. This criticism is taken up by Jean Petitot (especially in his 2008; cfr. also his 1992-1993; 1994; 1999; and Vernazzani 2016a) (cfr. also Ch. 8, §3). The French mathematician and philosopher argued that from the fact that receptive fields of single cells cannot be isomorphic with perceptual content it does not follow that there is no PI. On the contrary, he maintains that it can be mathematically shown that there 21 Chapter 1: The Problem of Psychoneural Isomorphism is an isomorphism holding between perceptual content and a macroscopic level of neural activity, i.e. if we take into consideration the activity of populations of neurons, rather than single cells. Petitot’s is a fascinating project that cannot be described in detail here. The principal claim is that accurate phenomenological descriptions produced by the conceptual tools of Husserlian Phenomenology represent the conceptual counterparts of geometrical descriptions that articulate in mathematical terms the neurophysiology of the functional architectures (2008, p. 396). Using sophisticated mathematical models, Petitot argues that «l’accord entre le macro-niveau géométrique (morphologique) émergent M […] et l’expérience phénoménale E […] est extrêmement fort, beaucoup plus fort qu’une simple corrélation. C’est même la forme la plus forte possible de matching de contenus puisque, à la limite, c’est un isomorphisme» (p. 367). Here, M represent the geometrical morphology of complex populations of neurons that would emerge from the micro neural physics of single neurons N. M is then shown to be isomorphic with the “phenomenal space” E, see Fig. 5:
Fig. 5: The relations between phenomenal space, micro neural physics, and global emerging geometry according to Petitot (2008, p. 370).
According to Petitot, the emergence of M upon N is not ontological: «Les morphologies émergentes sont des idéalités géométriques et ne possèdent par conséquent aucun contenu ontologique propre» (p. 372). What makes the problem of perceptual content so mysterious— the question about how the neural activities of single cells give rise to our conscious perceptual experience—would be the wrong attempt to deduce E from N. This wrong inference would also be the mistake made by Noë & Thompson, who were not able to identify any isomorphism between E and N. Petitot believes that it is possible to nomologically deduce («peut être nomologiquement déduite») the structure of E from the global geometry describing the dynamics of macro-populations of neurons. The identified isomorphism between E and M would hold in particular between the “pure immanent intuitions” of E and the mathematical idealization of M. From this, Petitot concludes that, although there is no “hard problem” (Chalmers 1996) of explaining the emergence of conscious perceptual content from M, there is a hard problem of explaining the relation between the geometrical space of M and the phenomenal space of E (pp. 370-371).
22 Chapter 1: The Problem of Psychoneural Isomorphism
Petitot finally concludes that the isomorphism between M and E—a form of PI—warrants a specific metaphysical conclusion about the very nature of conscious perceptual experience: the double-aspect theory. The double aspect theory is a form of identity theory, according to which although the mind is the brain, we have different kinds of access to them. In the words of Metzinger: «Scientifically describing [M] and phenomenally experiencing [E] are just two different ways of accessing one and the same underlying reality» (2000, p. 4). I will later show (Ch. 2, §1.3) that this metaphysical conclusion is unwarranted. Moreover, the double-aspect theory, on this formulation, seems also to express an epistemological thesis that does not simply follow from an identity statement.
Several issues are left unaddressed by Petitot. Firstly, although he has offered a mathematization of Husserlian Phenomenology, it is still unclear what kind of content is being mathematically described. Are they phenomenological descriptions? Or rather mathematical models of perceptual phenomena? Are the visual phenomena themselves isomorphic with the macro- neural activity? This is not very clear, and unfortunately, the issue is further complicated by its metaphysical interpretation. Why would PI lend support to a double aspect theory? Two things can be isomorphic, and yet be still two different items (cfr. Ch. 2, §1.1). Furthermore, why would an isomorphism help us bridging the explanatory gap between consciousness and the brain? Also, although the morphodynamical approach is supposed to help us explain consciousness, Petitot does not clarify what it means to scientifically explain perceptual content. In light of these considerations, we must still regard the problem of PI as open.
3. The Scope and Aims of this Work
In this Chapter, I have shown that despite the concept of PI comes up in several debates it remains an open problem. What is clear is that PI hinges around a problem that is of central interest to contemporary philosophy of mind and cognitive science, as well as to cognitive scientists, namely the search for the neural correlates of our perceptual experience. Given the centrality of this issue, it will be appropriate to keep this work within manageable limits. In other words, I will narrow down the scope of this analysis of PI to a specific issue. If the concept of PI shows any interesting implication, we might be justified in extending its application to other domains of research. Narrowing down the scope of this work is necessary but insufficient to tackle our issue. Another necessary step is that of articulating a research strategy that may guide us through the many issues that surround our concept.
I will discuss my research strategy in the next Chapter (Ch. 2). In the remainder of this Chapter, I first highlight the areas of philosophical investigations that may benefit from this work (§3.1); then, in compliance to the aforementioned recommendations, I circumscribe the scope of this work to visual objects (§3.2).
23 Chapter 1: The Problem of Psychoneural Isomorphism
3.1 The Relevance of Psychoneural Isomorphism
As I have said, the concept of PI is closely connected with the problem of the relation between conscious perceptual experience with its neural correlates. In this sense, in an ideal philosophical geography, we can place PI at the crossroad of the following questions: What are the neural correlates of consciousness? How are they related to perceptual content? How can we map perceptual content onto the neural correlates?
We have also seen that none of the previously examined accounts has clarified in any way what is meant with “psychoneural isomorphism,” merely mentioning the concept, or quickly dismissing it without any discussion. Pessoa et al. (1998) have mentioned the concept of PI, distinguishing it from «analytic isomorphism» but without going into any details. What is isomorphic to what, and what is the relevance of this concept for contemporary research still requires clarification. Within the debate about the naturalization of Phenomenology, the concept is sometimes mentioned with contrasting evaluations. Whereas Roy et al. (1999) quickly dismiss it on unclear grounds, and Noë & Thompson (2004) have provided some reasons to reject an isomorphism between perceptual content and single cells’ receptive fields, Petitot (2008) and Hohwy & Frith (2004) have rightly observed that these studies do not rule out PI as an option in research on the neural correlates of consciousness. Petitot goes even one step further, claiming that morphodynamical models of neural activity can be shown to be isomorphic with perceptual content, under some level of description, and bestow a central role to PI in his mathematization of Phenomenology. Yet, again, it is neither clear what would be the structure of the phenomenological domain, nor is it clear what would their neural correlates be.
An analysis of PI thus fills a gap in the existing literature. We can identify several domains of philosophical research that might benefit from the present work. Firstly, this work bears on the nature of the neural correlates of consciousness (Ch. 5). As we have seen, none of the researchers discussed above has made any attempt to shed light on this issue. Secondly, the work bears also on the structure of the perceptual content. Since PI is a relation of structural identity, we will have to explain what the structure of perceptual content consists in. This will require a detour into the current controversy about the contents of consciousness (Ch. 3, 4, 7). Finally, since the concept of PI emerges in conjunction with the problem of understanding the role of phenomenological descriptions in guiding the search for the neural correlates, this work will also provide some insights into the problem of the structural relations that hold between perceptual content and its neural correlates.
3.2 Focusing on Visual Objects
In the last twenty years, we have witnessed an exponential increase of publications in philosophy of mind and perception. Whilst until few decades ago it was still imaginable to study “the mind” and its faculties–from will to moods, from perceptual states to thoughts and beliefs (e.g. 24 Chapter 1: The Problem of Psychoneural Isomorphism
Armstrong 1968)— within one single philosophical book, today the degree of complexity and the amount of publications makes impossible to embrace such a broad variety of phenomena within one single work. Therefore, in order to keep this work within manageable limits, I will exclusively focus on visual perceptual content, and more specifically on visual objects. This choice requires a short explanation.
Firstly, the decision to restrict this work to visual objects is motivated by methodological reasons. Much of the current philosophy of perception focuses on visual perception, and studies in vision science are a pioneering field of scientific research, integrating perspectives from diverse disciplines, such as perceptual psychology, neuropsychology, and neurophysiology among others. Relying on these resources will be particularly helpful, as any study of PI must take into account two different domains (cfr. Ch. 2, §1), an “experienced” one of conscious visual perception, and a neural one pertaining to the neural correlates.
Secondly, despite the attention given to seeing over other sense modalities, philosophers of perception have relatively neglected the status of visual objects, i.e. the perceptual unities manifest in states of seeing such as «ordinary specimens of dry-goods» (Austin 1962, p. 8) like books, cars, lamps, chairs, persons, cats, etc., but also perceptual ephemera like shadows and rainbows (Casati 2015). Some philosophers of perception are satisfied in stating that we see objects beside properties (e.g. Siegel 2010a) without much commenting on what such objects are. As I will later explain (Ch. 4), determining the structure of visual objects has paramount implications for several issues in philosophy of mind and perception. Thus, my choice to focus on visual objects is meant to fill in (sic!) a gap in the existing philosophical literature on perception.
Thirdly, and finally, given the previous motivations, it is understandable that, if we can fruitfully analyze the concept of PI in the case of relatively well-understood phenomena such as visual objects and their underlying neural correlates, we will have made a case for PI. In other words, this work serves as a “test” for PI to assess whether it can play any useful role that might eventually justify its application to other sense modalities and mental phenomena, given the right sort of context and information.
25 2
OUTLINING A RESEARCH STRATEGY
In the previous Chapter, I have shown that the problem of PI is an aspect of the quest for the neural correlates of the contents of consciousness, and that in this work I will only focus on visual objects. The purpose of this Chapter is to clarify the concept of PI and set the agenda for the next Chapters.
So far, I have only provided a rough definition of our concept at the outset of the previous Chapter: a function or map that completely preserves sets and relations; but if we want to fully understand what “psychoneural isomorphism” is, we must first introduce a rigorous definition of “isomorphism” that might also help us to determine the correct application of our concept. I define the concept of isomorphism in the first Section (§1). By means of this definition, I will be able to determine the necessary requirements that any investigation must satisfy in order to justify an appropriate use of the concept of “isomorphism;” I call these criteria the “Character of Isomorphism.” Also, I discuss the place of PI within the mind-body problem in contemporary philosophy of mind (§1.3), and show that PI is independent from the metaphysical relation that holds between mind and brain. This raises the following question: What then is the correct interpretation of PI? The answer will be found at the end of a historical reconstruction of our concept (§2). This historical sketch plays two roles: it will give historical depth to the present work; and it will bring to the fore the heuristic role of PI. In §3, I briefly summarize the results of §§1-2 and Ch. 1, thereby setting the goals of this work, and outlining the agenda for the next Chapters.
1. The Character of Isomorphism
What is an isomorphism? In the Oxford English Dictionary, at the entry “isomorphic” we find: «corresponding or similar in form and relations»1. This ambiguously suggests two different meanings: “correspondence” and “similarity.” The Merriam Webster provides three definitions of isomorphism: 1. «similarity in organisms of different ancestry resulting from convergence»; 2. «similarity of crystalline form between chemical compounds»; 3. a «homomorphism that is one- to-one»2. Again, the first two definitions suggest a relation of “similarity,” whereas the third one suggests a relation of structural identity.
1 C. Soanes & A. Stevenson (Eds.) (2006)2. Oxford Dictionary of English. Lavis, TN: Oxford University Press. 2 Merriam-Webster, online edition, entry “Isomorphism”: http://www.merriam- webster.com/dictionary/isomorphism (retrieved 7.10.2016). Chapter 2: A Research Strategy
Etymologically, the word has a clear meaning: “identity” (iso) of “structure” or “form” (morphism). An isomorphism thus denotes some kind of structural identity. Besides more informal usages, “isomorphism” is a mathematical concept that is addressed by the third definition reported in the Merriam Webster. I will now elaborate on this definition.
1.1 Defining Isomorphism
An isomorphism is a bijective—i.e. both surjective and injective—morphism, a function that preserves sets and relations among elements (Weisstein 2009, p. 2027). A “morphism” or homomorphism in mathematics is a map between two objects or domains that partially preserve their structures. Let us assume two arbitrary domains A and B that are relational structures. A relational structure is a set A together with a family «Ri» of relations on A. Two relational structures A and B are said to be similar if they have the same type. (Here, I follow the convention of using a bold face—e.g. A—to refer to the relational structure, whereas I use the italics—e.g. A—to refer to the carrier set or domain). A homomorphism can be defined as follows:
Let A and B be similar relational structures, with relations «Ri» and «Si» respectively. A homomorphism from A to B is any function m from A into B satisfying the following
condition, for each i: If
The relational structure B can be defined as a homomorphic image of A if there exists a homomorphism from A to B (onto B). The relation of structural similarity admits different degrees. To put things in less technical terms, we can say that a homomorphic image B can be more or less similar to A.
The concept of isomorphism is but a specific version of homomorphism. Thus, every isomorphism is also a homomorphism. An isomorphism, however, is a relation of structural identity between two objects or domains. As stated at the outset of this paragraph, an isomorphism is a bijective homomorphism: a one-to-one correspondence relation between elements of the two domains. A formal definition of “isomorphism” can now be given:
A homomorphism h from A to B is said to be an isomorphism from A to B (between A and B) iff it satisfies the following conditions: (1) h is one-one; (2) h is onto. (Dunn & Hardegree 2001, p. 17)3
3 Dunn & Hardegree define isomorphism by means of the simple material implication “if.” I have slightly modified their definition, adding a biconditional. I thank Christian Straßer for pointing this out to me. 27 Chapter 2: A Research Strategy
We can clarify the definition with some examples. Consider the sequence of natural numbers
ℕ0 = {0, 1, 2, 3…+∞}. This sequence is isomorphic to the sequence of annual time segments from 0 to infinity, i.e. there is a function from the set of annual time segments to ℕ0 that is homomorphic and onto. Yet another example: two regular dice with six faces can also be isomorphic, it can be shown that there is a function that completely maps the structure of one die onto the other one.
Steven Lehar (2003, pp. 383-385) distinguishes between different kinds of isomorphism: structural and functional. The former is a «literal isomorphism in the physical structure». This can be nicely illustrated with the example of the two dice. Both dice have six faces, the numbers have the same arrangement, with number 1 being on the opposite side of number 6, etc. The latter concept, functional isomorphism, refers to the behavior of a system B as if it were physically isomorphic to A (Putnam 1973). Take again the dice example. Suppose John and Mary play dice. The chances of getting a result from 1 to 6 are the same with both dice (assuming that one of the two is not loaded!). However, suppose now that for some reason one of the two die disappears, and that John has a software installed on his computer that simulates the behavior of a die. All John has to do is to press “Enter” on his keyboard and the program will yield a number from 1 to 6 with the same probability as if it were an ordinary physical die. The computer simulation is a functional isomorph of the physical die.
These two examples highlight some important features of isomorphisms. The first feature is that an isomorphism does not require the numerical identity of the two objects, but only of their structures (cfr. §1.3). Two dice or French card sets can be isomorphic and yet not be the same die or card set, i.e. two distinct things can be isomorphic. All that is required is that their relational structures A and B must be the identical. An upshot of this feature is that two domains or objects can be isomorphic and still possess different features in so far as the relational structure is unaltered. Consider again the two dice: one die can be blue whilst the other one be red, there would still be an isomorphism. It is also conceptually possible to think of an isomorphism from A onto A (onto itself). In this case, we speak of an “automorphism.” It is however also possible to have a mere homomorphism from A to A. In this case, we talk about an “endomorphism.” (cfr. §1.3).
Another important feature is that, once we recognize two domains as isomorphic, we can potentially exploit this relation to infer something about one of the two domains. Let there be two isomorphic domains A and B. Suppose also that, for whatever reason, the image B is observable, whereas the domain A and its relational structure A are not accessible for direct observation. In this case, a researcher can still get some insights into the structure of A by studying the structure of its image B. Things of course might be complicated by the need of some axioms that govern the transformation rules, for example if B is a topological structural isomorphism of A (a topological isomorphism is also called a “homeomorphism”); hence, in 28 Chapter 2: A Research Strategy principle, one needs to know also the transformation rules in order to infer something about A from B.
For terminological clarity, in mathematics an isomorphism is a special case of homomorphism, whereas the converse is not necessarily true. In the remainder, whenever I will use the concept of “homomorphism” it will always be in the sense of something less than complete structural equivalence. In conclusion, given the definition of isomorphism, we can now easily identify the requirements that must be met in order to properly speak about an isomorphism in general, these are:
(1) We must identify two domains, A and B. (2) We must show that A and B contain elements and that they are relational structures A and B, and what kind of relational structure they are. (3) We must identify a function f that completely maps the structure of A onto B.
The foregoing points (1)-(3) also chart the problems that will be addressed in the next Chapters (§3.2). We can call these joint requirements the Character of Isomorphism, as they directly bear on the appropriateness of the use of the concept of “isomorphism.” Notice that the “Character of Isomorphism” is quite independent from the specific domains examined. Hence A and B may be, for example, my left and right hands, two buildings or chairs, two algebraic systems, and so on. If the two domains satisfy all the given prerequisites, we are entitled to talk about an “isomorphism.”
1.2 What is meant with “psycho-neural”?
Let us now turn to the two isomorphic domains. As I said, the choice of the domains is somewhat arbitrary. In principle, we can just pick whatever we wish as domains and try to show whether—under the right sort of description—they are isomorphic. So I can state for example that my Norton edition’s copy of Melville’s Moby Dick is isomorphic to another copy still on sale in a New York bookshop, or that Duchamp’s Fountain (1917) is isomorphic to every other porcelain urinal produced by the same company. In our case, the adjective “psychoneural” provides some additional information: it suggests that there is an isomorphic relation between a psychological domain Ψ’s relational structure Ψ and a neural domain ϕ’s relational structure ϕ. (Notice that I will continue to adopt the convention of using bold face and italics, cfr. §1.1). A terminological caveat: some researchers talk about a “psychological isomorphism” (e.g. Madden 1957). Madden’s “psychological isomorphism” however is a mere stylistic variation of our PI. In this work, I will continue to refer to “psychoneural isomorphism” as it makes explicit the reference to the domains.
Madden (1957), and Pribram (1984) mention different possible domains of PI. Pribram says that an isomorphism could hold between (a) the brain and experience, (b) between the brain 29 Chapter 2: A Research Strategy and the environment, or (c) being a three-fold relation between them all. Similarly, Madden contends that an isomorphism can hold between (a) stimuli and sensory responses, (b) between receptor events and afferent neural processes, and (c) between neural events and phenomenal events, where “phenomenal” should be understood as “conscious.” The latter is but a form of what Fechner (1860) called innere Psychophysik (internal psychophysics): the relation between the neural and our experience (Erleben). This is also the kind of isomorphism envisaged by Wolfgang Köhler (cfr. §2.2).
As I showed in Ch.1, the concept of PI is related to research on the neural correlates of the contents of consciousness. Hence, the proper subject area of this work will roughly be located within Fechner’s “internal psychophysics.” I will have nothing to say about a putative isomorphism between, say, retinal image and primary visual cortex—i.e. whether the retinotopic map of V1 is isomorphic to the retina, or merely homomorphic—, or between the environment and our visual representation of it. Let us call the first domain, that of the conscious contents, the “phenomenological domain,” and “neural domain” the second domain (cfr. Sekuler called them «perception» and «brain activity», 1966, p. 230). A graphic representation of PI is given in Fig. 6:
Fig. 6: PI i holds between the phenomenological domain Ψ and a neural domain ϕ.
With the “Character of Isomorphism” I have identified the problems that must be solved in order to justify any talk about PI. These problems will be addressed in the next Chapters. Before I move on to the next section, we must first discuss the relation between PI and the metaphysics of the mind-body problem.
1.3 PI and the Metaphysics of the Mind-Body Problem
Having identified the two domains, which will be properly spelled out in the later Chapters, we can raise the following question: What is the relation between PI and the Mind-Body metaphysics? The centrality of this issue is such that it will help us to bring into sharper focus
30 Chapter 2: A Research Strategy the role of PI within contemporary research. There are two possible ways to understand the relation of PI with the Mind-Body metaphysics. The first one is to examine the connection between PI and every single metaphysical option. This is the “long” way. A better and more effective way is it to analyze a particularly instructive case and draw some lessons that can be generalized to other metaphysical options. This is the option I prefer.
My starting point is the following claim put forward by Antti Revonsuo (cfr. Ch. 1, §2.3):
…there must be isomorphism between one specific level of organization in the brain and phenomenal consciousness, simply because these boil down to one and the same thing. (2000, p. 67; emphases in the original).
What makes this quotation particularly interesting is that it postulates a relation of entailment between PI and some version of the identity theory, i.e. the position according to which the mind is the brain. No reference is here made to any kind of structure—nor, indeed, is made in the rest of his chapter—, thus Revonsuo’s claim plainly fails to meet requirement (2) of the Character of Isomorphism; but for my purposes we can gloss over this specific issue, since my interest now is to explore the relation between PI and the Identity theory. Also, no reference or elucidation is to be found about what kind of identity theory is assumed in this context: type- identity—types of mental states are identical to types of brain states—or token-identity—token mental states are identical to token brain states. Again, we can skip this issue for now. In order to facilitate the analysis, we can break down Revonsuo’s claim into the following propositions:
P1: Phenomenal consciousness is identical with some level of organization in the brain. (Identity thesis). P2: Phenomenal consciousness is isomorphic to some level of organization in the brain.
Phenomenal consciousness and a given level of organization in the brain are our two domains. The identity thesis formulated in P1 is a typical instance of metaphysical necessity involving theoretical identity statements such as «Water is H2O». According to Revonsuo, it is P1 that grounds proposition P2. This confers modal character to the truth of P2 by suggesting that, necessarily («must»), if P1 is true then P2 is true as well:
◻ ︎ (P1→P2)
In the debate about the nature of modality, philosophers have explored different relations between the varieties of necessity. Some for example contend that mathematical and logical necessity, physical necessity, and other varieties all depend on metaphysical necessity (monism). Others argue that we should recognize a plurality of necessities without reducing them to one fundamental concept (pluralism) (the classic on metaphysical necessity is Kripke 1980; cfr. also Fine 1994, 2002; and Cameron 2010 for an overview). As I said, P1 is a metaphysical thesis,
31 Chapter 2: A Research Strategy whereas P2 is a mathematical function (§1.1). The point I want to stress is that it would be misleading to think that, in order to examine the correctness of Revonsuo’s claim, we should first try to settle the issue of the relationship between different kinds of modalities, and more specifically, between metaphysical identity statements and mathematical concepts. Rather, my strategy is the following: I will examine the relation between metaphysical identity and P2, and show that not just every function from a domain onto itself is an automorphism. If this is true, it follows that even identity statements do not exempt us from specifying the exact isomorphic function between a domain and itself. For expository reasons, we can abstract away from the specificity of the consciousness-brain relation. The claim’s structure is general enough to be paraphrased as follows: “If two domains A and B are identical (A=B), then they are necessarily isomorphic.”
What kind of identity is at stake in our case? A preliminary distinction can be drawn between qualitative and numerical identity (Noonan & Curtis 2014). Two entities are qualitatively identical in some respect if they share some property. For example, both Paul Nash’s «Totes Meer» (1940-41) and Max Ernst «L’Ange du Foyer» (1937) share the properties of being surrealist paintings, being realized with oil on canvas, etc. Extreme cases can be given of virtually indistinguishable entities. Talk about qualitative identity is of course complicated by our assumptions about the nature of properties (cfr. Allen 2016; Ch. 7). In the present context, however, we are assuming a stronger form of numerical identity. Numerical identity «requires absolute, or total, qualitative identity, and can only hold between a thing and itself» (Noonan & Curtis 2014).
Let’s consider A and a function from A to itself. The question is: Is every function from A to itself an isomorphism just in virtue of the identity of domain and image? Intuitively, we would respond in the affirmative: for A is obviously qualitatively, and therefore structurally, identical to itself. However, this would be a mistake. The mistake results from a confusion between identity relation A=A (and therefore qualitative identity) with an isomorphism. An isomorphism is a map or a function (requirement 3 from the “Character of Isomorphism”) from a domain onto another domain, or from a domain onto itself4. It is perfectly legitimate to talk about a mapping from A to itself—i.e. from A to A—that is not an isomorphism. Indeed, as I have explained in §1.1, a homomorphic function from A to A (to itself) is called an “endomorphism.” Analogously, we can determine an isomorphic function from A onto A (onto itself), such a function is customary called an “automorphism” (Cohn 1981, p. 49). Accordingly, what Revonsuo is claiming is that the consciousness-brain identity necessarily implies the truth of an automorphism (an isomorphism from A onto itself). We can now give P2 a more precise formulation:
4 Notice that although here I refer to functions, an isomorphism can also hold between algebraic systems, vector spaces, or categories in general. 32 Chapter 2: A Research Strategy
P2*: There is a homomorphic function h from M (phenomenal consciousness) to B (some level of neural organization), and M=B, that is one-one and onto, i.e. it is bijective.
Although every automorphism is, by definition, also an endomorphism—just like every isomorphism is by definition a homomorphism—the converse is not necessarily true: an endomorphism or homomorphism is not necessarily an automorphism or an isomorphism. To show this, it suffices to analyze an example. Consider a vector space V, an endomorphism from V to V is a linear map:
L: V → V
Now, an automorphism is an invertible endomorphism. However, if we assume a vector dimension dim V > 0, the endomorphism L: V → V, v ↦ 0 is not invertible, hence it is not an automorphism5. It follows that an endomorphism is not necessarily an automorphism. The same considerations apply in the case of P1 and P2 of Revonsuo’s formulation.
It can be argued that cases of identity of the two domains, A=A, determine that there must be at least an isomorphism, i.e. a homomorphic and bijective function. However, the lesson that we can draw from these considerations is that even an identity thesis does not exempt us from specifying under which level of description, what structures, are isomorphic, even in cases of identity. The example of the vector space shows just this. Although in this case there is only one vector space, not every function from V to itself is an automorphism. This is quite different from claims about qualitative identity. Failing to realize that isomorphism is a function or map— as requested by requirement 3 of the Character of Isomorphism—is just to misunderstand the very concept of isomorphism.
The foregoing discussion is particularly instructive, for it shows that PI is not a trivial thesis whose truth can be decided by simply reducing it to the metaphysics of the mind6. Indeed, the identity of the isomorphic domains, or their distinctness does not prejudice the question of whether they might be isomorphic or not. Consider the case of any non-identity thesis, such as Cartesian or properties dualisms. Within a paradigmatic Cartesian scenario, we would describe the mind as a substance distinct from the brain or body. We would therefore have two non- numerically identical domains, A and B. Under the assumption that we can describe their relational structures, nothing decides, a priori, to consider A and B as either homomorphic or isomorphic. In §1.1 I have discussed few examples of distinct, yet isomorphic items. Two dice can be isomorphic, and yet be numerically distinct, just like the sequence of natural numbers is
5 Thanks to Dr. Vincenzo DeMaio and Francesco Altiero for this particular example. 6 I am assuming here that the central ontological and metaphysical question concerning the nature of the mind centers on the reducibility of the mind to the body, or a part of it (e.g. the brain). This of course is not tantamount to say that there are no other metaphysical problems. 33 Chapter 2: A Research Strategy isomorphic to the annual time segments. Talk about PI is orthogonal to the broader metaphysical question of the metaphysics of consciousness, i.e. the problem of PI is distinct from the mind-body problem.
Such a conclusion licenses the following problem: if PI is independent from the mind-body problem—the question of whether the mind is the brain or not—, what is the purpose of talking about PI concerning perceptual content and its neural correlates? My answer in short will be that the relevance of PI is only motivated to the extent that the concept plays a heuristic role. I will show this by means of a short historical reconstruction of our concept.
2. A Short History of Psychoneural Isomorphism
The word “isomorphism” first appeared at the beginning of the 19th century. The very idea of an isomorphism was originally intimately connected with the work of Mitscherlich in crystallography and chemistry: isomorphs being «substances having the same crystal form but different compositions» (Melhado 1980; for an historical overview, cfr. Salvia 2013). In psychology, the concept of PI is inseparable from Gestalt psychology. The first occurrence of PI can be found in Wolfgang Köhler’s Gestalt Psychology (1929), but the fatherhood of our concept should probably be ascribed to Wertheimer (§2.2).
It is worth bearing in mind that the purpose of this work is systematic, not historical. Accordingly, this historical overview will deliberately be sketchy and incomplete. For the most part, I will rely on secondary literature on the history of psychology and of our concept (for the history of psychology, cfr.: Greenwood 2015; Legrenzi 2012; Smith 2013; Thomson 1972; Toccafondi 2000; on the history of PI, cfr: Lehar 1999; Luccio 2010; Luchins & Luchins 2015; Scheerer 1994).
2.1 Fechner, Mach, and Müller
The first printed occurrence of PI can be found in Köhler (1929). However, Köhler explicitly made reference to antecedent research that foreshadowed the concept of PI (1929, p. 58). In particular, he mentioned Hering’s assumption of parallelism, and Müller’s psychophysical axioms. Furthermore, both Scheerer (1994) and Luccio (2010) in their historical accounts of PI mention Ernest Mach and Gustav Fechner as forerunners of PI. Indeed, the 19th century psychophysicists played a crucial role in defining the philosophical background that was later to give rise to the concept of PI. In this paragraph, I will focus on three key figures, Fechner, Mach, and Müller.
Gustav Fechner is largely credited as one of the founding fathers of psychophysics. Trained as a scientist, he was later brought to studies on the relationship between the “psychological” and the “physical” by genuine philosophical and spiritual interests (Heidelberger 2003). In the course of
34 Chapter 2: A Research Strategy almost fifty years of work, Fechner articulated different views on the relation between the “physical” and the “psychological,” but they were all formulated within a form of psychophysical parallelism. Already in his dissertation Praemissae ad theoriam organismi generalem of 1823, Fechner stated:
Parallelismus strictus existit inter animam et corpus, ita ut ex uno, rite cognito, alterum construi possit. (quoted from Heidelberger 2000, p. 53)
In his works, Fechner never used the phrase “psychophysical parallelism,” whose authorship is still matter of controversy among historians (on this topic, and its relevance in the development of the mind-body problem in the analytic tradition, cfr. Heidelberger 2002). He adopted instead the term “Identitätsansicht” (identity perspective), a term that betrays the influence of Schelling’s thought—and therefore, indirectly, Spinoza’s (cfr. Luccio 2010)—, which he discovered through Lorenz Oken’s lectures, a follower of Schelling. The quoted passage does not offer much, but it certainly provides some little precious clues for the present historical Section. There, Fechner explicitly suggests that from a proper understanding («rite cognito») of the soul («anima») or of the body («corpus»), one can construct the other. In other words, attaining the right sort of knowledge about (in modern jargon) the mind or the body one could in principle deduce the other one. This thought constitutes the very heart of Fechner’s theory: the idea that one could map subjective sensations against objectively measured sensory stimuli (Smith 2013, p. 83). The philosophical foundation of this thought was a commitment to a form of parallelism according to which the soul and the body are but different perspectives or aspects of one and the same substance:
Es sind im Grunde nur dieselben Processe, die von der einen Seite als leiblich organische, von der anderen als geistige, psychische aufgefaßt werden können. Als leibliche Processe stellen sie sich Jemandem dar, der außerhalb dieser Processe selbst stehend, dieselben ansieht, oder aus Gesehenem unter Form des äußerlich Wahrnehmbaren erschließt, wie der Anatom, Physiolog, Physiker [es] thut. (Fechner 1851; quoted from Heidelberger 2000).
The exact formulation of this parallelism changed in the course of Fechner’s productive career, finally reaching an “objective idealism“ (objektiver Idealismus), according to which everything is ultimately spiritual in nature. Besides further developing the metaphysical aspects of his theory, Fechner also sought to find a mathematical formulation that could bridge soul and body, and therefore provide a way to express more precisely the intimate connection between the two “aspects” (Seite) of the same substance. This culminated in the formulation of what is today known as Weber-Fechner law, according to which a sensation is equal to the logarithm of the physical stimulus S = k log R + C (in his Elemente der Psychophysik, 1860).
35 Chapter 2: A Research Strategy
Fechner exerted a considerable influence on his contemporaries. With few exceptions—namely Helmholtz and his pupils, who adhered to a form of mind-body dualism—most psychologists in Germany and beyond adopted Fechner’s parallelism as a heuristic method. Particularly receptive to Fechner’s legacy was Ernst Mach. As Greenwood (2015, p. 326-327) points out, Mach was one of the anticipators of Gestalt psychologists, together with Christian von Ehrenfels. In his writings, Mach never adopted the concept of PI, but he advanced a “principle of equivalence” (Princip der Entsprechung) (Mach 1865) that may be considered an antecedent of PI. The principle is very simple: it merely states that for every psychological event, there must be a corresponding physical event, and that identical psychological events must correspond to identical physical events.
Few years later, Mach further developed his views. In the fourth chapter of his book Die Analyse der Empfindungen (1886), he asserted that the «guiding principle for the study of sensations» (leitender Grundsatz für die Untersuchung der Empfindungen) was the «principle of complete parallelism of the psychical and the physical» (Princip des vollständigen Parallelismus des Psychischen und Physischen). This principle was but a novel formulation of his “principle of equivalence.” In the revised 1900 edition, we find the following passage:
Nach unserer Grundanschauung, welche eine Kluft zwischen beiden Gebieten (des Psychischen und Physischen) gar nicht anerkennt, ist dieses Princip fast selbstverständlich, kann aber auch ohne Hilfe dieser Grundanschauung als heuristisches Princip aufgestellt werden, wie ich dies vor Jahren getan habe. Das hier verwendete Princip geht über die allgemeine Voraussetzung, daß jedem Psychischen ein Physisches entspricht und umgekehrt in seiner Specialisierung hinaus. Letztere allgemeine Annahme, die in vielen Fällen als richtig nachgewiesen ist, wird in allen Fällen als wahrscheinlich richtig festgehalten werden können, und bildet zudem die notwendige Voraussetzung der exakten Forschung (Mach 1886/1922, p. 50; quoted from Heidelberger 2000; cfr. Luccio 2010, p. 224).
There are two things that I wish to highlight. Firstly, Mach understands the principle as a heuristic (Scheerer 1994, p. 320). Secondly, the quotation does not make any explicit reference to isomorphism, nor are we allowed to talk about structures. In this sense, the 1865 formulation of the principle of equivalence cannot be interpreted as an isomorphism, since it fails to meet the second requirement of the Character of Isomorphism. However, in a later edition, published in 1906, Mach added the following sentence: «Ich suche nach Formähnlichkeit, Formverwandschaft zwischen dem Psychischen und dem entsprechenden Physischen, oder umgekehrt» (quoted in Heidelberger 2000; my emphasis). What these similarities of form are is unclear, and we can only tentatively compare this claim to some kind of morphism. Perhaps, the similarity of “forms” should be understood in terms of functions that preserve the structural relations among elements. 36 Chapter 2: A Research Strategy
Although, significantly, Köhler (1929) in the chapter dedicated to isomorphism does not discuss Mach’s principle of equivalence—Mach is merely mentioned twice in the whole book and never in relation to PI—he explicitly mentioned and discussed Georg E. Müller’s psychophysical axioms and Ewald Hering’s principle of parallelism. Interestingly, both Müller and Hering were connected to Fechner. Hering, professor of physiology in Prague, had studied in Leipzig with Fechner (Thomson 1972, p. 75); whereas Müller charted a different path, studying philosophy and history in Leipzig, before moving to Berlin in order to complete his studies with a dissertation about the possibility of a scientific philosophy (ibid., p. 80). During a long recovery period from a serious illness, Müller became interested in psychophysics and started a regular correspondence with Fechner. In spite of his earlier studies, Müller became a prolific researcher with an extraordinary reputation. It is not irrelevant, in the present context, to remind that Müller was also teacher and mentor of Friedrich Schumann, who later became collaborator of Carl Stumpf and one of Max Wertheimer’s teachers in Berlin. Schumann later moved to Frankfurt, where he hired Wolfgang Köhler and Kurt Koffka as assistants. A fervent follower of Fechner, Müller plays an important role in this historical overview for his famous five psychophysical axioms (1896). Of the five axioms, only the first three are relevant here:
I. The ground of every state of consciousness (Zustand des Bewußtseins) is a material psychophysical process. The states of consciousness occur (Vorhandensein) in conjunction with such psychophysical processes, and every psychophysical process corresponds to a state of consciousness. (Müller 1896, p. 1). II. To every equality (Gleichheit), similarity (Ähnlichkeit), and difference (Verschiedenheit) of the composition (Beschaffenheit) of a sensation (Empfindung) corresponds an equality, similarity, and difference of the constitution of a psychophysical process, and vice versa (umgekehrt). More specifically, degrees of variations across these dimensions have a psychophysical correspondence, and vice versa. (ibid., pp. 2-3). III. If the variations (Änderungen) or differences (Unterschiede) of the sensations have the same direction (Richtung), so will the underlying psychophysical processes. And if a sensation is variable in n-directions («in n-facher Richtung variabel») so must also be the psychophysical process, and vice versa. (ibid., p. 2).
The scope of the neural or psychophysical processes covered by the axioms is not always clear. Köhler (cfr. §2.2) interpreted Müller as saying that the psychophysical processes also include retinal processes, thus extending far beyond the direct correlates of visual perception.
Müller was well aware that such axioms were similar to principles already discussed by other researchers, among them Lotze, Fechner (1860), Mach (1865), and Hering (Müller 1896, p. 5). The axioms were meant to replace the vague notion of “psychophysical parallelism”: «Denn der Ausdruck “psychophysischer Parallelismus” ist viel zu unbestimmt […]» (ibid., p. 4). Also, he conferred them a heuristic character in the search for the neural processes underlying the 37 Chapter 2: A Research Strategy corresponding states of consciousness, i.e. the neural correlates of consciousness (cfr. also Scheerer 1994, p. 185). These three axioms, together with Hering’s doctrine of psychophysical correspondence—according to which a psychophysical parallelism was the «conditio sine qua non of all psychophysical research» (quoted in Scheerer 1994, p. 185)—, lay the ground for Köhler’s psychoneural isomorphism (Luccio 2010, p. 223).
2.2 Gestalt Isomorphism
The concept of PI was first explicitly put forward by Wolfgang Köhler (1929), and was subsequently further developed by other prominent members of the Gestalt school. Yet, Gestalt psychologists did not agree on a single definition of PI. On the contrary, even among the most prominent members of the Gestalt school we find little agreement about fundamental concepts. The «inaccuracy of some definitions, the scarcely scrupulous use of some terms, or the ambiguity of some fundamental concepts» (Kanizsa 1994, p. 149) was the main source of confusion and misunderstandings that later surrounded Gestalt psychology, and eventually led to its marginalization within scientific community. I will primarily discuss Wolfgang Köhler’s contribution, as he was the key figure in the development of PI, but I will also occasionally make reference to other Gestaltists as well.
In the second chapter of his book, “Psychology as a Young Science,” Köhler develops his attack against Behaviorism and stresses the importance of first-person descriptions of the phenomenological field in the study of the mind, anticipating by decades the claims advanced by defenders of phenomenological methods (cfr. Ch. 1, §2.1). In that chapter, Köhler pointed out that little is known of what happens in the «terra incognita» between sensory stimulation and overt behavior. This generates the problem of how to investigate the internal states and processes of an organism:
To the degree to which the interior of the living system is not yet accessible to observation, it will be our task to invent hypotheses about the events which here take place. For much is bound to happen between stimulation and response. (Köhler 1929, p. 51).
Köhler was well aware of the intrinsic limitations of early 20th century brain investigation methodologies. On a later page, he stated that, since our present views about the functions of the brain are «about as speculative as our own guesses», it will be «advisable to make full use of the chance which inference from direct experience offers to the psychologist» (ibid., p. 57). In other words, Köhler sought a way to infer the physiological processes from conscious experience. This was possible, in his view, because at least under normal conditions objective experience «depends upon physical events». The nature of such dependence is unclear; Luccio (2010) suggests that Gestalt psychology, and in particular Köhler’s approach, seems rooted in the monistic tradition that via 19th century psychophysics links these psychologists to Goethe, 38 Chapter 2: A Research Strategy
Schelling, and even earlier to Spinoza and Maimonides. What is clear, is that Köhler thought that researchers could exploit this dependence relation to infer something about the physiological processes:
…since experience depends upon physiological events in the brain, such experience ought to contain hints as to the nature of these processes. In other words, we argue that if objective experience allows us to draw a picture of the physical world, it must also allow us to draw a picture of the physiological world to which it is much more closely related. (ibid., p. 57).
Köhler then introduces the need for a clear «principle» that may govern the transition from direct experience to physiological processes. Such a principle, he says, should be one of «equality of structure» (ibid., p. 59). Both Hering and Müller worked under a similar assumption, but, in contrast with the proposed principle, they were guilty of referring to the mere «logical order» of experiences, rather than to the experiences themselves (ibid., p. 60). Furthermore, whereas Müller thought the axioms would hold between experiences and even retinal processes, Köhler thought that there was a closer physiological direct correlate of visual experience, and that this constituted the other domain. These remarks further narrow down the scope of the proposed principle, whose nature is clarified by means of the following example:
… I have before me three white dots on a black surface, one in the middle of the field and the others in symmetrical positions on both sides of the former. This is also an order; but, instead of being of the merely logical kind, it is concrete and belongs to the very facts of experience. This order, too, we assume to depend upon physiological events in the brain. And our principle refers to the relation between concrete experienced order and the underlying physiological processes. When applied to the present example, the principle claims, first, that these processes are distributed in a certain order, and secondly, that this distribution is just as symmetrical in functional terms as the group of dots is in visual terms. In the same example, one dot is seen between the two others; and this relation is just as much a part of the experience as the white of the dots is. Our principle says that something in the underlying processes must correspond to what we call “between” in vision. […] the experience “between” goes with a functional “between” in the dynamic interrelations of accompanying brain events (ibid., p. 61).
Köhler’s principle receives the following definition: «Experienced order in space is always structurally identical with a functional order in the distribution of the underlying brain processes»; he then gives it the name of «psychophysical isomorphism» (ibid., pp. 61-62). Such principle, it is then said, «covers practically the whole field of psychology» (ibid., p. 63), and is given a central place in the development of Gestalt psychology.
39 Chapter 2: A Research Strategy
A whole chapter is dedicated to our principle in his The Place of Values in a World of Facts (1938), where Köhler reiterates his contention that «vision and its cortical correlate are isomorphic», and remarked that perceptual organization does not agree with the facts within the physical space, but cortical organization «seems to agree with perception, rather than with physics» (quoted from Luchins & Luchins 2015, p. 74). This means that whereas perceptual content does not straightforwardly map onto the physical environment—as shown for example by cases of filling-in (Ch. 1, §1)—it should map up to isomorphism onto the cortical organization. However, Köhler also added few important remarks about PI.
Firstly, and with some ambiguity, Köhler described PI as a “postulate”: «Isomorphism is a postulate» (1938, p. 224; quoted from Luccio 2010, p. 228). Now, as Luccio correctly observes, the word “postulate” does not appear an appropriate choice, as a “postulate” is roughly equivalent to “axiom,” i.e. a proposition that is simply assumed within a given deductive system, rather than deduced as the theorems. However, this was most certainly not what Köhler had in mind, when he further described the role of PI as useful in forming «hypotheses» that need empirical validation (ibid.). If this reading is correct, then PI is properly understood as a heuristic principle. This interpretation finds further support in the passages discussed above from his 1929’s book, as well as in a later paper where he defined isomorphism not an a priori postulate, but «an hypothesis which has to undergo one empirical test after the other» (Köhler 1960; quoted from Scheerer 1994, p. 188). At the same time, however, in the latter work Köhler also seemed to endorse PI for the sake of a monistic metaphysics:
For instance, if the comparison were to show that, say, in perception, brain processes with a certain functional structure give rise to psychological facts with a different structure, such a discrepancy would prove that the mental world reacts to those brain processes as a realm with properties of its own—and this would mean dualism. (Köhler 1960, quoted from Luccio 2010, p. 241)
…monism “would become sensible precisely to the extent that isomorphism can be shown to constitute scientific truth” (Köhler 1960, quoted from Scheerer 1994, p. 189)
In other words, seeing the issue from a diachronic standpoint, Köhler initially introduced PI as a heuristic principle to be exploited in the search for the neural correlates of psychological processes. Later, whilst still retaining this interpretation as a firm acquisition, he embedded PI within a monistic metaphysics. It is sufficient, for now, to remember that—as shown in §1.3—PI is quite independent from the metaphysics of mind-brain, and that talk about PI is no more justified in the case of a monistic metaphysics than it is in a dualistic one (cfr. also §3.1).
Secondly, Köhler thought that PI applied only to systematic properties (Systemeigenschaften) excluding material properties (Materialeigenschaften) of both domains. This observation is important, for it helps us ruling out some potential misinterpretations of PI. The material 40 Chapter 2: A Research Strategy properties of the phenomenal domains are, as Scheerer explains (1994, p. 189), the “qualitative aspects” of sensorial experience; whereas the material properties of the neural domain would be chemical reactions—in the case of color experience—and forces in the cortex that could be described by means of dynamic models (Köhler 1929, chapter 4). According to neural field theory, which Köhler developed in his earlier Die physischen Gestalten in Ruhe und stationären Zustand (1920), there would be force fields in the brain that tend to seek equilibrium and remain in equilibrium until some external force disturbs them (Greenwood 2015, p. 333). The few attempts at establishing the truth of neural field theory or “brain-field patterns,” that Köhler performed in researchers conducted in the USA—mainly at Princeton, Dartmouth and MIT—, were all unsuccessful. Nonetheless, Köhler’s thought that only structural properties were mirrored at the neural level meant that the isomorphic neural counterparts of direct experience should not share exactly all the same properties of the latter. This is summarized in a statement that is rightly often quoted in the Gestalt literature: «The cortical correlate of blue is not blue» (Köhler 1938, quoted from Scheerer 1994, p. 189). However, the exact nature of the neural domain was unclear to Köhler due to the obvious limitations of the early 20th-century neuroscience.
Whilst Köhler developed PI and gave it the name we know today, the direct antecedent was probably Max Wertheimer, whose debt is fully acknowledged by Köhler in several publications (1920, 1929). Wertheimer had first the idea that a piecemeal and summative approach—as envisaged by associationism in psychology—was not able to capture the nature of perceptual experience, and that the neural correlates should be understood as fields of activity among cells (Luchins & Luchins 2015, p. 76). The gist of the concept of PI was formulated by Wertheimer after a series of experiments that led to the discovery of the so called “phi phenomenon” (cfr. also Ch. 4). The concept of “isomorphism” according to Wertheimer is mainly deduced from anecdotal evidence, rather than longer written elaborations. Indeed, Wertheimer mainly worked under the assumption of his understanding of PI, which he thought to hold not between phenomenal experience and underlying neural states, but between perceptual sphere or “phenomenal” field and the “geographical” field. In other words, according to Wertheimer PI would guarantee a relation of structural continuity between what we perceive and what there is in front of us (Luchins & Luchins 2015).
Finally, another figure worth mentioning in this brief reconstruction of PI within Gestalt psychology is Rudolf Arnheim. Arnheim’s understanding of PI deviates significantly from the trail blazed by Köhler, and comes closer to an integration of Köhler’s account with Wertheimer’s perspective. A brief analysis of our concept is offered in his study on the “Gestalt Theory of Expression” (1949). The term “expression” refers primarily to «external manifestations of the human personality», but more extensively, also to a variety of aspects such as the way a person dresses, handles the language, a pen, the occupation he prefers, just to mention few examples (ibid., pp. 51-52). After discussing few theories—in particular, Lipps’ and 41 Chapter 2: A Research Strategy
Darwin’s theories about emotion and expression perception—Arnheim sketches out a Gestalt theory of expression based on the «principle of isomorphism» (ibid., p. 58ff). Arnheim defines our principle as follows: «processes that take place in different media may be nevertheless similar in their structural organization» (ibid., p. 58; my emphasis). As is now known (§1.1), similarity of structure falls short of isomorphism, which demands structural identity; hence it may be argued that Arnheim’s understanding of our concept is only loosely related with PI. But this is not the only divergence. Arnheim asks himself how could we explain, within Gestalt theory, an expression. For instance, a subject A could perform a “gentle” gesture, which «is experienced as such by an observer B» (ibid., p. 59). Such an explanation is achieved by means of the principle of isomorphism. In other words, in this context, the concept plays an explanatory role. The explanatory structure of how a subject B could see and experience a gentle gesture by A as such is delivered by extending the isomorphic levels. Firstly, Arnheim distinguishes between five different isomorphic levels within the observed person, these are:
I. State of mind [psychological] II. Neural Correlate of I [electrochemical] III. Muscular forces [mechanical] IV. Kinesthetic correlate of III [psychological] V. Shape and movement of the body [geometrical]
To simplify, subject’s A state of mind—the «tenderness of A’s feeling» (ibid., p. 59)—would correspond to an underlying isomorphic neural correlate. However, the physiological electrochemical activity of II would be structurally correspondent also to III, and so on in a cascade of isomorphic activities. Whereas I-V describe A’s action, the next three steps describe B’s perception of A’s gesture:
VI. Retinal projection of V [geometrical] VII. Cortical projection of VI [electrochemical] VIII. Perceptual correlate of VII [psychological]
Again, to put it very simply, the retinal projection is described as isomorphic to I-V, and in turn VI is isomorphic to VII-VIII. This leads Arnheim to the conclusion that subjects perceive expressions in virtue of a number of dynamical processes that result in the organization of perceptual stimuli (ibid., p. 62).
There are a number of issues that make Arnheim’s concept of PI obscure and unhelpful. Firstly, as observed, his definition of “isomorphism” is very informal and not thoroughly articulated. Secondly, the lack of any clarification of the relevant structures: what is the structure of the “tenderness feeling” felt by A in performing the gesture? Thirdly, it is unclear under what descriptions levels as diverse as the ones mentioned could be interpreted as isomorphic. Fourthly, and finally, even though an isomorphism is here invoked to serve as explanatory 42 Chapter 2: A Research Strategy principle, it is unclear what kind of explanatory structure is here assumed. Nonetheless, Arnheim’s concept is interesting within the context of this brief historical overview, as it helps us to bring into sharper focus the alleged connection between PI and the problem of explanation.
2.3 From Second-Order Isomorphism to the Present Day
The conceptual landscape after the 60s is much more fragmented, and it is difficult to bring different streams of research into a single coherent whole. Again, I will focus only on few key protagonists, mainly among psychologists.
Parallel to the advancements of Gestalt psychologists, critics targeted the concept of Gestalt PI from different standpoints. These researchers did not share the same background assumptions about scientific psychology and how best to study the human mind, yet, their rejection of PI is symptomatic of general stance about how perceptual reports, and inferences from the structure of visual objects, ought to be used in our search for the physiological correlates of the human mind. Thus for example, Skinner (1963) argued that the Gestalt concept of PI is nothing less than a commitment to the “picture-in-the-head” theory, a dead-end research program that seeks to find out neural replica of perceptual contents in the subject’s brain. Yet, in a Dennettian style, Skinner claimed that, even if we were able to find such isomorphic pictures in the head: «we should have to start all over again and ask how the organism sees a picture in its occipital cortex, and we should now have much less of the brain available in which to seek an answer» (1963, p. 954). Skinner was, of course, writing from a thoroughly behaviorist standpoint that regarded with suspicion the study of the internal processing of the human mind.
When Roger Shepard criticized Köhler’s isomorphism, again as a form of “picture-in-the- head,” he did so from a completely different standpoint than that of Skinner. Indeed, in his groundbreaking paper on mental rotation, written in collaboration with his student Metzler, the experiments required the subjects to imagine performing a mental rotation of the presented items (Shepard & Metzler 1971, p. 701). Shepard famously proposed what he called a “second- order isomorphism:”
[The] isomorphism should be sought—not in the first order relation between (a) an individual object, and (b) its corresponding internal representation—but in the second order relation between (a) the relation among alternative external objects, and (b) the relations among their corresponding internal representations. Thus, although the internal representation for a square need not itself be a square, it should (whatever it is) at least have a closer functional relation to the internal representation for a rectangle than to that, say, for a green flash or the taste of persimmon. (Shepard & Chipman 1970, p. 2).
43 Chapter 2: A Research Strategy
In other words, Shepard operated a shift in perspective from the Gestalt isomorphism between the perceptual content and the physiological level, to a relation between distal objects and brain processes. Needless to say, whatever this isomorphism is, it is very different from the psychoneural isomorphism that supposedly holds between visual objects and their underlying neural correlates. Both Skinner and Shepard, as we have seen, thought of Gestalt’s PI in the same terms as of a picture in the head theory. Taking stock of these critiques, Mary Henle remarked that they do not really address the problem of PI and stated: «…the question of isomorphism remains. It is a heuristic not to be ignored. It involves finding cortical processes that will account for the specific functional properties of psychological facts.» (1984, p. 325, emphasis added).
Shepard’s critique of Gestalt’s PI missed the point, but the problem of formulating more rigorously the relation between the phenomenal and the neural level was still open. Visual physiologist Brindley reintroduced the issue of the relation between phenomenal terms and physiological terms (Teller 1984, p. 1234). Recognizing that they belong to different realms of discourse, and that often in vision science the “subject’s reports” are an essential part of the experiments, he felt the necessity of psychophysical linking hypotheses. He was, however, able to individuate only one of such hypotheses:
…whenever two stimuli cause physically indistinguishable signals to be sent from the sense organs to the brain, the sensations produced by those stimuli, as reported by the subject in words, symbols or actions, must also be indistinguishable. (quoted from ibid., p. 1234).
As we see, Brindley’s hypothesis—which he thought might well be a truism—follows the thread of 19th-century psyhophysicists and later Gestaltists in trying to pin down a strict formula that described the psycho-physical relation. The development of the linking propositions theory (cfr. Ch. 1, §1.3) is an explicit resumption of this endeavor. Introduced by Teller and Pugh, and refined by Teller (1984), a linking proposition is «a claim that a particular mapping occurs, or a particular mapping principle applies, between perceptual and physiological states» (Teller & Pugh 1983, p. 581; quoted in Teller 1984, p. 1235). There are several linking propositions, but as mentioned in Ch.1, only the “analogy family” is relevant here, since it addresses the issue of similarity relation. The passage, already quoted in the previous Chapter, is worth repeating here in order to highlight a yet different aspect:
…if psychophysical and physiological data can be manipulated in such a way that they can be plotted on meaningfully similar axes, such that the two graphs have similar shapes, then the physiological phenomenon is a major causal factor in producing that psychophysical phenomenon. (Teller 1984, p. 1240).
44 Chapter 2: A Research Strategy
On the basis of this passage, it seems that the similarity relation actually seems to be not between phenomena, e.g. a specific visual phenomenon and its neural correlates, but their graphs. In other words, putting the data in formal-graphical form a similarity of shape is revealed. But what kind of similarity is here at stake? Prima facie, it seems that the similarity is one of visual similarity in the form similar graphs, rather than a mathematically-formally specified similarity. No formal definition is here introduced, and Teller admits that «additional analytical work is badly needed» (ibid., p. 1241). The issue, to be explored later in this work (Ch. 8), is: Is there an isomorphism between graphical representations of visual objects and the underlying neural correlates? Or, more precisely, are graphical representations of visual objects isomorphic with graphical representations of the underlying neural correlates? What emerges from the linking proposition theory is surely that Teller thought it related both to the issue of scientific explanation of perceptual content, and to the heuristic of finding the underlying causes of perceptual content (ibid., p. 1240; cfr. also Ch. 1, §1.3).
Lehar’s works (2003) on Gestalt isomorphism in visual perception is perhaps today the most advanced and sophisticated attempt to provide a systematic analysis of our problem. Lehar’s analysis starts off with the observation that modern neuroscience seems unable to account for conscious experience. After reviewing a number of contrasting philosophical options about the nature of perceptual experience, contrasting direct with indirect realism, he suggests a solution to the problem of explaining how the brain engenders our conscious perceptual experience. Lehar’s solution is that of quantifying «the structural features of the subjective experience» (2003, p. 382). Lehar likens this idea with Chalmers’ principle of structural coherence (1996, pp. 222-225), according to which: «various structural features of consciousness correspond directly to structural features that are represented in awareness» (ibid., p. 223). Chalmers’ principle is meant to show that our conscious experience is not a chaotic blob, but a coherent whole with a specific structure. What this structure would be, is not specified by Chalmers. But Lehar interprets Chalmers’ principle as a restatement of the Gestalt’s concept of isomorphism: «to reflect the central fact that consciousness and physiology do not float free of one another but cohere in an intimate way» (2003, p. 382). From this he infers that «The connecting link between mind and brain therefore is information in information theoretic-terms» (ibidem). Lehar’s isomorphism is a form of functional isomorphism, and in this light he interprets Köhler’s concept of isomorphism. This functional PI between perceptual experience and the underlying physiological correlates would then be grounded in a rejection of dualism:
…the principle [of structural coherence] is actually solidly grounded epistemologically because the alternative is untenable. If we accept the fact that physical states of the brain correlate directly with conscious experience, then the claim that conscious experience contains more explicit information than does the physiological state on which it was based amounts to a kind of dualism that would necessarily involve some kind of nonphysical
45 Chapter 2: A Research Strategy
“mind stuff” to encode the excess of information observed in experience that is not encoded by the physical state. (2003, pp. 382-383).
Hence, again, PI is used to argue for some kind of monistic mind-brain metaphysics, which Lehar thinks constitutes the current orthodoxy: «The modern view is that mind and brain are different aspects of the same physical mechanism» (ibid., p. 376). Here, again it is worth notice that an isomorphism does not support any particular metaphysical standpoint about the nature of conscious experience or the mind. As already observed, two distinct things may be isomorphic, just like the two dice. So for example our conscious perceptual experience may be isomorphic to some physiological processes without being identical with them, or even being made of some Cartesian “mind stuff.”
Lehar’s paper is an instructive and lucid attempt to dispel the fog of mystery that surrounds our concept, but it fails to shed light on a number of issues. In particular, it is not clear what the perceptual content is. Lehar seems to think of it as composed by sense-data (ibid., pp. 377-382), although he also explicitly talks about representational content; for example, he states that «no aspect of the external world can possibly appear in consciousness except by being represented explicitly in the brain» (ibid., p. 377, emphasis added). From a philosophical standpoint, it is not clear whether we should interpret the sense-data as having representational content, or as being themselves representations. Furthermore, it is neither clear what is the relation between perceptual content and consciousness (cfr. Ch. 3, §2.3), nor whether the isomorphism holds between token or types of contents. Once again, however, PI is understood as some kind of heuristic, a helpful concept that may help us bridge the divide between conscious experience and the objective sciences of the mind: «…it should be possible by direct phenomenological observation to determine the dimensions of conscious experience, and thereby to infer the dimensions of the information encoded neurophysiologically in the brain» (ibid., p. 376).
In this section I have not aimed at historical comprehensiveness, my purpose was to provide an overview of the historical development of our concept, especially among psychologists. What clearly emerges from this reconstruction is that PI seems to have played three distinct roles: as metaphysical principle, as explanatory principle, and as heuristic principle. I have ruled out the former one, as PI is compatible with different metaphysical options. Regarding its explanatory role, the only way to assess its validity is by embedding it within a sound explanatory framework. Hence the question: What kind of explanatory framework sustains research on the neural correlates of visual objects? Is PI a fundamental component of psychological explanation? But most importantly, it is meant to play an heuristic role.
46 Chapter 2: A Research Strategy
3. How To Study Psychoneural Isomorphism
At the end of this Chapter, it is now time to put together the different results and outline a strategy to study the concept of PI. In the next section (§3.1), I will outline such a strategy. Later (§3.2), I will briefly introduce the next Chapters, presenting an overview that might help the reader to navigate the next Parts of this work.
3.1 Outlining a Research Strategy
In the first Chapter, I have shown that the proper conceptual location of the problem of PI is the quest for neural correlates of the contents of consciousness (Ch. 1, §§1-2). An examination of the use of the concept of PI within the recent literature also illustrates the contribution of this work to the current philosophical debate (Ch. 1, §3.1). To keep the work within manageable limits, I have narrowed down the focus of this study to visual objects and their neural correlates (Ch. 1, §3.2).
In this Chapter, I have first clarified what is meant with “isomorphism,” identifying three requirements that must be met in order to justify the correct use of the concept of “isomorphism.” I have called these requirements the “Character of Isomorphism” (§1.1). I have then fixed the two domains of our research as the “phenomenological” and the “neural” domain (§1.2). Later (§1.3), I have discussed the relation of PI with the metaphysics of the mind-body problem, arguing that the question of PI is orthogonal to the metaphysics of the mind. This opened the problem of what the significance of PI is, what role this concept is meant to play within contemporary research. I have tried to provide an answer to that question in §2 with an historical reconstruction of PI.
Whether two domains (or a function from a domain onto itself) are isomorphic or not, is not a question that can be abstractly decided. This means that in order to further explore PI we must take a concrete example and develop it up to the point where we can meaningfully conclude whether it is a PI or not. The chosen example is that of consciously perceived visual objects. Following the indications provided by the “Character of Isomorphism,” we can now outline a concrete research strategy:
1. The first step is that of identifying the domains. I have called such domains Ψ—the phenomenological domain—and ϕ—the neural domain. The identification of the domains is easy, and even, to some extent, arbitrary. In our case, the subject of this work being the neural correlates of the contents of visual consciousness, the choice of the domains is fixed by the very nature of our subject. Still, this leaves us with the task of clarifying what are these two domains. 2. We must show that Ψ and ϕ contain elements and that they are relational structures, Ψ and ϕ. Once we will have identified the elements, we will also need to show what kind 47 Chapter 2: A Research Strategy
of relational structures the two domains are. Focusing on visual objects, we will have to articulate at least a general account as to what kind of structure they have, and what philosophical theory of objects is able to capture this structure. At the same time, we will need to show what are the elements that populate the neural domain, and in what sense they can be said to be “structured.” 3. Finally, we will have to identify a function f that completely maps the relational structure Ψ onto the relational structure ϕ.
Each step presupposes a clarification of the former ones; so we cannot properly analyze step 2 without having first analyzed step 1, and step 3 without first analyzing steps 1-2.
Notwithstanding the foregoing, this work would be incomplete without a clarification of what PI is for. One could show that indeed, there is a PI, but that it is a fruitless and empty concept. In light of the historical reconstruction and the discussion of the two debates in Ch.1 §§1-2, we now know that PI is intimately connected with two further notions: that of explanation, and that of a heuristic. Pessoa et al. (1998) as we have seen (Ch. 1, §1.3), described isomorphism—in its various forms, of analytic isomorphism and as a subspecies of linking propositions—as an aspect of the problem of explaining filling-in phenomena, and therefore more generally the problem of explanation in psychology. This aspect also emerged clearly in our discussion of the explanatory framework requested for phenomenological methods (Ch. 1, §2.1), and in the discussion of Arnheim’s eight-isomorphic-levels as postulates introduced for the explanation of the perception of expressions.
The other aspect, the heuristic value of isomorphism, instead, emerged from the historical reconstruction outlined in §2. The need for some principle that could guide the search for the relevant explanatory units in the brain was foreshadowed by Fechner, Mach, and Müller in the XIXth century, and was later taken up by Gestalt psychology. As shown, Köhler bestowed a central role to PI as a conceptual bridge between the phenomenal and neural domains. Other Gestalt psychologists, like Solomon Asch, also described the role of isomorphism as a heuristic principle. In the entry “Gestalt Theory,” for the International Encyclopedia of the Social Sciences, Asch said, under the heading “Nativism” that «there is as yet little understanding of the physiological foundations that gestalt theory sought for psychology, and the postulate of isomorphism remains a heuristic principle» (1968, p. 173, emphasis added). Interestingly, earlier in the same entry he states that: «The postulate of isomorphism is intended as a heuristic guide to investigation. In this manner Köhler sought a unified explanation for facts in neurophysiology and psychology among certain facts of physics» (1968, p. 161). The heuristic and explanatory aspects of PI, therefore, are not mutually exclusive. On the contrary, PI was meant as a way for identifying the processes or parts of the brain that are explanatory relevant to specific structural aspects of the phenomenal domain, i.e. in our case of the visual objects.
48 Chapter 2: A Research Strategy
This set a clear goal for our work: for there being a PI our analysis must satisfy the three requirements of the Character of Isomorphism, but for justifying the role of PI within contemporary research, we need to show that PI plays a heuristic role within the contemporary research for the neural correlates of the contents of consciousness. The rationale of PI stands and falls with this role. We can capture this feature, that we may call the “Interpretation of PI,” in the following thesis:
Talk about psychoneural isomorphism is only justified in so far as it plays a heuristic role in the search for the neural correlates of the contents of consciousness.
An assessment of this thesis will only be possible at the end of this investigation, when steps 1-3 of the Character of Isomorphism will have been analyzed.
3.2 Outline of the Next Chapters
Now that my strategy has been outlined, it remains to be seen how it will be partitioned in this work. Here, I provide a short guide to the next Chapters.
The definition of the two domains is—as I said—little more than matter of stipulation. What is exactly meant with the “phenomenological” and “neural” domain will be object of an extended analysis. Part II of this work comprises Chapters 3 and 4. The central task of Part II is that of clarifying the nature of the phenomenological domain and its elements. Chapter 3 has two objectives. The first one is that of introducing and defining the concept of a “state of seeing” within a broad intentionalist or representationalist framework, according to which states of seeing possess a content, i.e. conditions of accuracy. It is the content of states of seeing that composes the elements of the phenomenological domains. The second objective is to clarify the role of consciousness within this work. As I will argue, my aim is not that of explaining consciousness, but to exploit consciousness in order to identify the relevant contents. In Chapter 4 I focus on visual objects. My central task will be to clarify the nature of the ontological elements that populate the phenomenological domains. After presenting two different views about the nature of visual objects—as bundle of properties and as facts—I will argue against the latter view, providing the basis for a theory of visual objects that will be developed in a later Chapter.
Part III focuses on the neural domain and its elements, and it comprises Chapters 5 and 6. In Chapter 5, I clarify the concept of a “neural correlates of the contents of consciousness” taking a stance against Chalmers’s (2000) approach. I will introduce a mechanistic-manipulationist stance on content-NCCs. My main contention will be that content-NCCs are better understood as a cluster of distinct mechanisms subserving different roles: intentional mechanisms, selection mechanisms, and the proper NCCs. This view will be substantiated by a vast scientific literature. I conclude the Chapter by showing further advantages of my view over Chalmers’ mainstream 49 Chapter 2: A Research Strategy definition. In Chapter 6 I will consider a potential challenge to my interpretation. According to the sensorimotor theory, visual perception can be explained by means of sensorimotor laws that govern the exercise of sensorimotor contingencies. I will advance a novel argument against the sensorimotor theory. I will provide some considerations in favor of a mechanization of the sensorimotor theory. In doing so, the sensorimotor theory can be shown to be compatible with my intentional mechanisms’ approach.
Part IV is more heterogeneous and comprises Chapters 7 and 8. The objective of Part IV is that of clarifying the structure of the phenomenological domain and to examine whether there effectively is room for a psychoneural isomorphism. Chapter 7 returns to the problem of the ontology of visual objects. Here, I will defend the claim that visual objects are better understood as spatial-mereological trope bundles. The first part of the Chapter provides an inference to the best explanation to the conclusion that the properties given in states of seeing are tropes. The second part is a defense of natural class trope nominalism, circumscribed to visual tropes. Chapter 8 deals finally with the central question of this work: how we should understand PI and whether it plays any heuristic role. In particularly, I will return Jean Petitot’s morphological model of neural activity corresponding to perceptual content, and show how to reconcile morphological explanations with mechanisms. It will be shown that PI does not play a heuristically useful role, but that it can serve as a check for correct explanations.
I will briefly sum up the main claims of this work and outline prospects for future researches in the Conclusion.
50
PART II
THE PHENOMENOLOGICAL DOMAIN
STATES OF SEEING AND VISUAL OBJECTS
3
STATES OF SEEING
In the first Part of this work, I have introduced the central issue and outlined a research strategy. In this second Part, I focus on the Phenomenological Domain, Ψ. As I have clarified (Ch. 1, §3), I narrow down the Phenomenological Domain to visual objects, which belong to the sphere of conscious experience (Ch. 2, §1). Accordingly, this Part has two main goals. The first goal is to shed light on the “Phenomenological Domain;” the second one is to specify what are the elements that populate it. I pursue these two goals in this and the next Chapter. In this Chapter, I elucidate the notion of “states of seeing.” This provides the general framework in which I embed the problem of visual objects. I tackle the issue of the nature of visual objects in the next Chapter. By the end of this Part, I will have defined, in compliance with the “Character of Isomorphism,” what is the Phenomenological Domain, and what are its elements. I will return on the issue of the structure of visual objects in Chapter 7.
This Chapter has the following structure. In the first Section (§1), I introduce the notion of “state of seeing” and segment it from the broader and more complex capacity of visual perception. I cast states of seeing in terms of a representational theory of visual perception. This creates the problem of understanding what is the relation between the content of states of seeing and consciousness. I outline the issue in terms of intentionalism in the second Section (§2). Finally, in the third Section (§3), I sum up the results achieved so far, and spell out the role of consciousness in this work.
1. States of Seeing 1.1 States of Seeing and Visual Perception
In this work, the Phenomenological Domain will be restricted to what I call states of seeing. For merely stylistic reasons, I will sometimes use cognate words, such as “seeing” and “see.” States of seeing are mental states that belong to—but do not exhaust—the complex capacity of visual perception, or simply “vision.” The cognitive machinery that is responsible for visual perception in general will be called the visual system. As we will see, the visual system can be decomposed into three sub-systems with different functions, and states of seeing are carried out by one of these sub-systems.
The relevant category of mental phenomena under scrutiny is that of perceptual phenomena. To get a grasp on the notion of perception, it might be useful to start with McDowell’s notion of “openness” to reality, in his words: Chapter 3: States of Seeing
This image of openness to reality is at our disposal because of how we place the reality that makes its impression on a subject in experience. (McDowell 1994, p. 26)
We can flesh out the notion of impression that reality makes on a perceiver as information. In this sense, the impact of reality on the perceiving organism can be cast in terms of informational states about the items that populate the environment. The information retrieved via one of the accredited sense modalities—in our case, the visual system—is processed by the cognitive machinery in a way that does not necessarily require conscious experience. Thus, the word “perception” has a broader scope than mere “conscious perception.” Visual perception is not necessarily, or not entirely, conscious. My usage of the word “perception” is similar to Dretske’s understanding of perception:
The word “perception” is often used more inclusively in cognitive studies. One perceives x if one gets information about x via an accredited sensory system whether or not this information is embodied in a conscious experience. (Dretske 2010, p. 54)
Part of the task of the visual system is that of providing suitable descriptions (or “representations,” cfr. §1.3) of the external environment that might be exploited for purpose of action and behavioral control. This is the descriptive function of the visual system, and the part of the visual system that carries out such a function is the descriptive subsystem. Besides the descriptive subsystem, studies show that another subcomponent of the visual system is the deictic subsystem that governs our sensory-motor capacities and guides action as a response to visual stimuli (e.g. Goodale 2001; Matthen 2005). (I will briefly return on the role of this subsystem in Ch. 6, where I will discuss the sensorimotor theory of vision and visual perception). Finally, there is also a third sensory subsystem, whose function is perhaps more primitive and phylogenetically more ancient than the descriptive subsystem. The function of this subsystem is to govern basic sensory reactions to external stimuli, such as tracking or index mechanisms (cfr. Ch. 4, §3)1. States of seeing belong to the descriptive subsystem.
1 As I understand it, the sensory capacity is a sub-capacity of visual perception. Some philosophers, e.g. Burge (2010) sharply distinguish between “perception” and “sensation” on the ground that only the former, but not the latter, delivers representations of the environments, and therefore states that are assessable for veridicality or accuracy (cfr. §1.3). An example of sensory capacity in primitive organisms is the Schwabe organ present in all genera within the Lepidopleurida, an anatomical synapomorphy of the clade. In a study conducted on Polyplacophora–primitive molluscs without cephalization–the Schwabe organ is located within the pallial cavity. Speculations about its function range from chemeosensitivity to preventing sediment overloading (Sigwart et al. 2014). Another example is the Paramecium caudatum’s sensitivity to temperature change to induce thermotaxis (Tawada & Miyamoto 1973). These functions do neither require complex representational capacities, nor an evolved cognitive system. (Continues on the next page).
54 Chapter 3: States of Seeing
The purpose of the descriptive subsystem is to provide accurate representations of what obtains in the perceiver’s environment. What “obtains” is simply what is present or, more informally, what is the case. We can clarify this by means of an example. Right now, I sit on my desk and write on my laptop. What is the case or what obtains before my eyes are the objects that populate this tract of the world in this very moment. “Obtain” thus contrasts with the notion of merely possible presence: some items might have been present here in this tract of the environment. Perception tells us only what is given or obtains in the environment at a given time (cfr. Ch. 7, §2.2). I will call “material objects” (Matthen 2005, p. 281; cfr. Ch. 4, §§2-3) the items in the environment, whether they are persons, familiar items such as chairs and books, non-human animals, or else. Perception can only capture items of a certain magnitude that fall within the reach of the sensory subsystem. In normal conditions, the exercise of the perceptual faculties of the descriptive subsystem informs the subject about mind-independent items (Strawson 1979, p. 97). In this work I will assume a form of realism about material objects—in contrast, for example, with Phenomenalism, i.e. the claim according to which there are no mind-independent objects (Staudacher 2011, p. 20)—and that these items stand in a causal relation with the perceiver via the sensory subsystem (Grice 1961; Snowdon 1981; cfr. Ch. 4).
Descriptive states are the exercise of descriptive capacities. Some, but not all, descriptive states are conscious. We can distinguish between non-conscious descriptive states and conscious descriptive states. I call the latter “states of seeing” or “seeing” (SoS). More precisely, we can put forward the following definition:
SoS’=df A mental state that has conscious visual descriptive character.
In order to demarcate the descriptive character of states of seeing from the descriptive character of non-conscious descriptive visual states, I will refer to the presentational character of states of seeing, thus:
SoS = df A mental state that has visual presentational character.
This is the benchmark definition of states of seeing that I will employ in this work. The “presentational character” of states of seeing is simply an abbreviated way to refer to their conscious descriptive character. In the next pages, for stylistic reasons I will sometimes refer to
In my jargon, Burge’s “perception” is akin to my “states of seeing” and “visual states.” They are both descriptive mental states, i.e. states that have veridicality conditions except that the former are conscious, whilst the latters are not. The reason why I differ from Burge’s terminology is that I want to stress the continuity between sensory and descriptive states, and therefore between the sensory subsystem and the descriptive subsystem. It is in virtue of this continuity that I base my argument against factualism in Ch. 4. 55 Chapter 3: States of Seeing the presentational character of states of seeing with expressions like “to make manifest” and “to manifest.2”
To sum up some of the key distinctions discussed in this paragraph, we can visualize them in the following chart (Fig. 7).
Visual Perception
Deictic Descriptive Sensory Subsystem Subsystem Subsystem
Descriptive Visual States
DescriptiveStates ofStates of
visual statesSeeing seeing
Fig. 7: The different subsystems of visual perception. The arrows denote the interaction between the subsystems.
I called visual perception the capacity of human beings to visually perceive the environment. Visual perception is a complex capacity that can be decomposed into at least three subsystems. These subsystems are: the sensory, the descriptive, and the deictic. The descriptive visual subsystem is responsible for descriptive visual perceptual states. Descriptive visual states and states of seeing are the outputs of the descriptive subsystem. Every descriptive visual state is a representation of the external environment but not all descriptive visual states are conscious. Some descriptive visual states are unconscious, while some others are conscious. I call the latter “states of seeing.” States of seeing are therefore by definition conscious. I refer to the descriptive conscious character of states of seeing as their “presentational character” to demarcate them from merely descriptive visual states. Both conscious and unconscious states will be called
2 The notion of presentational character is somewhat similar to the phenomenal sense of look- verbs (e.g. Pautz 2011, p. 116). Traditionally, the semantic analysis of look verbs distinguishes between three senses: the comparative, the epistemic, and the phenomenal sense (the locus classicus here is Jackson 1977a, pp. 30-49; cfr. also Chisholm 1957, chapter 4). The latter concept purports to show what is simply visually given at any time to a subject, as in the sentence “This pineapple looks yellow,” and in general, sentences of the form “X looks F to S.” Some philosophers have made reference to the phenomenal sense to support some form of sense-datum or representational theory of perception (Jackson 1977a). However, the semantic analysis of look verbs is not unproblematic. Martin (2010) casts doubt on the very existence of the phenomenal sense of look. Pautz (2010, p. 255) says that it is uncertain whether the phenomenal sense of look captures the perceptual state or rather doxastic states, to the measure that they describe the visual evidence exploited in belief formation. For these reasons, I do not embrace the semantic approach to look verbs. 56 Chapter 3: States of Seeing
“mental states.” Following a widespread consensus, and in order not to prejudice the question of their ontological status, I use the term “state” as an ontologically neutral concept that covers processes, events, or states. Only later in this work (Ch. 5) I will return on the ontology of states of seeing, where I will suggest that they are best understood as processes or events.
We have now two tasks ahead: to clarify the nature of the “descriptive character” of states of seeing (§1.3), and to elucidate the relation between description and consciousness (§2). Before doing that, I first locate states of seeing within other mental states that compose our conscious and unconscious mental lives. As I will now show, states of seeing are a part of our conscious mental lives.
1.2 Unity of Consciousness and the Visual Field
In the foregoing paragraph, I have made the claim that some states are conscious, whilst others are unconscious. This is obviously true not only for visual perception, but also for other sense modalities and cognitive states as well. At any given time, a subject S has many mental states. The sum of all these mental states is the overall state M of S’s mind at that given time. M is the mereological sum of all of S’s mental states at t. M can also be described as an abstract set made of all S’s mental states, such that:
M = {m1, m2, m3, …mn}
That is to say that M is the set composed by all of a subject’s mental states. Some of these mental states, as we have seen, are conscious. We can thus draw from M a proper subset C of all conscious mental states, such that:
C ⊂ M; C = {c1, c2, c3, …cn}
I will call the totality of all conscious mental states at a time t the “phenomenal unity of consciousness” (cfr. Bayne 2010; Bayne & Chalmers 2003) 3 . The various elements that compose C will be conscious mental states of different characters. For example, some of these states will be auditory experiences, some others will be emotional states, and yet others will be cognitive states. Together, they determine “what it’s like” (cfr. §2.1) to be S at a specific time t.
The “phenomenal unity of consciousness” is the mereological sum of all S’s conscious mental states at a given time, without making any particular assumption about the nature of our
3 I borrow the phrase “phenomenal unity of consciousness” from Bayne (2010), but I give it a slightly different meaning. According to Bayne, we can distinguish between a representational unity and a phenomenal unity of consciousness, accepting that consciousness is not identical with the representational content. This however has the drawback of creating a new set of “spooky” phenomenal contents that stand in some relation with the representational contents. I return on the relation between representational content and consciousness in §2. 57 Chapter 3: States of Seeing
conscious experience (cfr. §2). The single conscious mental states c1, c2, etc. are proper parts of a subject’s conscious experience at a given time. There is no agreement about the definition of the notion of “proper part” in mereology. One intuitive way to spell it out is as follows:
PPxy=df Pxy ∧ ¬Pyx
That is to say: x is a proper part of y means that x is a part of y and y is not a part of x. Notice however that some philosophers find more plausible to strengthen the claim and argue that the very notion of a proper part implies that every proper part must be supplemented by another disjoint part in order to constitute a whole (Casati & Varzi 1999, p. 39). In addition, one could refine the definition with modal operators. We do not need to delve deeper into these mereological issues. For our purposes, it suffices to point out that the single conscious mental states of a subject S are proper parts, i.e. non exhaustive-parts, of the mereological sum of all conscious mental states.
The mereological sum C (as well as M) can be studied from two distinct perspectives. The first perspective is a diachronic one. Consider a span of time that ranges from t1 to t2, where t1 and t2 are any two distinct moments in time. However we fix t1 and t2, the diachronic unity of consciousness will be the mereological sum of all conscious mental states of a subject S from t1 to t2 (Rashbrook 2012). Any account of the diachronic unity of consciousness must explain how such a unity holds over time. The second perspective is a synchronic one. This perspective consists in focusing on a subject which is “frozen” at a given time t. In this case, C will be the mereological sum of all of the subject’s conscious mental states at the time t. To account for the synchronic unity of consciousness means to show how different conscious mental states—among them states of seeing, acoustic states, and so on—hold together synchronically. The problem of psychoneural isomorphism can be studied under both perspectives. On the diachronic perspective, PI will be a function that maps out the process of conscious mental states and their relations with the underlying dynamic of brain states and relations. On the synchronic perspective, one will have to find out how C maps onto a neural domain ϕ (cfr. Ch. 2, §1.2). In this study, I will exclusively focus on the synchronic perspective, thus I will frequently make reference to an ideally static perceiver.
Let us now return to states of seeing. States of seeing, as I have said, are conscious mental states. We can therefore extrapolate them from the mereological sum C of all conscious mental states, and compose a subset of C of all and only states of seeing. The mereological sum of all states of seeing of a subject S at a given time t will be the visual field, V (Clark 1996, 2000), we thus have:
V ⊂ C ⊂ M; V = {v1, v2, v3, …vn}
(Notice that, from the above notation it follows that V is also a proper subset of M). The subject’s visual field is composed of all the subject’s states of seeing v1, v2, and so on at a given 58 Chapter 3: States of Seeing time t. V only represents a subject’s visual field within the synchronic perspective of the unity of consciousness. Finally, from V, I will only focus on those states of seeing that represent visual objects (cfr. Ch. 4). This subset of V is our Phenomenological Domain, or ψ, such that:
ψ ⊂ V
In the remainder of this work, assuming a synchronic perspective, I will frequently employ some more specific examples to throw light on the most abstract passages. We can thus introduce an ideal state of seeing v0 as a state of seeing for example this red apple on my desk, or this book.
1.3 The Representational Character of Seeing
I have introduced states of seeing and specified where they are placed with respect to other mental states. States of seeing have a presentational character: they make manifest or present things in the world to the perceiver. The nature of the items manifest in states of seeing is controversial. The contemporary landscape can be divided into two camps: representationalists and naïve realists or relationists (Campbell 2002, pp. 116-120) 4 . As I hinted above, the descriptive or presentational character of a mental state should be understood in representational terms. Hence, I am explicitly espousing a representational theory of states of seeing. In this work, I will simply assume a representationalist framework. I make this assumption for the following reasons: firstly, because it is the current orthodoxy in the philosophy of perception, and it is not my purpose to challenge it in this work (for two arguments in favor of representationalism in the philosophy of mind, cfr. Burge 2005, Pautz 2010); secondly, because it has been shown to cohere well with our scientific theories of the mind, where the notion of representation is ubiquitous (e.g. Bechtel 2001a; Miłkowski 2013, chapter 4); thirdly, proponents of naïve realism have not yet clarified the role of the cognitive machinery in visual perception, which will play a prominent role in the subsequent Chapters. (A notable exception from the relationist camp may be the sensorimotor theory, which will be
4 “Relationist” are sometimes also called views that do not fall squarely within this dichotomy. The sensorimotor theory of visual consciousness is a case in point (O’Regan & Noë 2001; see Ch. 6). The sensorimotor theorist denies that perceptual experiences are representational, although at the same time does not reject representations altogether, or even representational content (e.g. Noë 2002, p. 67; 2004, p. 22). Perhaps, it would be better to cast the distinction in terms of common factor views and disjunctive views (Pautz 2010, pp. 255-265). The former views hold that genuine perceptual states, illusions, and hallucinations have in common nondisjunctive properties, whereas the disjunctive views hold that these states exhibits disjunctive properties (cfr. Hinton 1967). However, this would enlarge the common factor views to encompass not only representationalism, but also the sense-data theory and Peacocke’s “sensationalist view” (Peacoke 2008). The latter philosophical options will not be further discussed in this work. 59 Chapter 3: States of Seeing object of study in Ch. 6). I will now spell out the nature of representationalism by means of a contrast with naïve realism.
Naïve realists contend that veridical perceptions involve a primitive, unanalyzable metaphysical relation to external items. The nature of this relation can be spelled out in different ways. For example, if it is interpreted as a causal relation, then naïve realism may be compatible with representationalism. Indeed, some philosophers take perceptual experiences to be both contentful (i.e. representational) and relational (e.g. McDowell 2013). The naïve realist standpoint that I want to briefly sketch out here, however, stands in opposition to representationalism in that it discards the key notion of content as explanatory unnecessary (e.g. Travis 2004), or as obscuring the nature of veridical perception (e.g. Brewer 2011). This radical form of relationism takes perceptual states (or my “states of seeing”) to be at least partially constituted by the worldly items, these items would «shape the contours of the subject’s conscious experience» (Martin 2004, p. 64), where the concept of “shape” should be read in an ontological, constitutive sense (Fish 2009, p. 6). As Campbell explicitly suggests: «[w]e have to think of the external object, in cases of veridical perception, as a constituent of the experience» (2002, p. 118). So, for example, when S sees a red apple, the properties the subject is acquainted with are intrinsic properties of the object itself, the color and shape of the apple are constituents of states of seeing (Campbell 2002, p. 116; 2010, p. 206). A subject’s conscious experience is then read off from the presentational character of a conscious mental state: what is presented to the subject determines what it is like to enjoy that particular experience (Brewer 2011, p. 92; Martin 1998, p. 174; cfr. §2). Accepting naïve realism means therefore to deny that states of seeing have a representational character (Travis 2004, p. 93)5.
Unlike naïve realists, representationalists maintain that a subject’s perceptual states have a representational character. On some versions of representationalism, states of seeing may have a relational character too, i.e. claim that a state of seeing constitutively is in causal relation with an external, mind-independent item, besides having a representational character (cfr. Ch. 7, §2.2). But representationalists deny the core idea of any naïve realist theory, i.e. that the external, mind-independent items are constituents of states of seeing. In the remainder of this
5 To what degree naïve realism is incompatible with representationalism and intentionality is still matter of controversy. For example, Searle overtly defines himself as a naïve realist (1983, p. 57), and later says that visual states are not “representations” but “presentations” of reality (2015, p. 68). Searle’s terminology differs from mine, however. Whereas I prefer to talk about “representational” states, Searle opts for “presentational” states, although his theory is canvassed within the framework of intentionality just as mine. Although I employ the representational terminology, I only offer a minimal account of the representational character of states of seeing. A fully articulated theory would require us to take a stance about the controversial problem of intentional inexistence, which focuses on the relation between the representational or intentional state and the item(s) it is about (cfr. Crane 2013). This task however exceeds the scope of this work. 60 Chapter 3: States of Seeing work, I will accept that states of seeing involve a genuine causal relation with worldly items (cfr. Ch. 4, §3), but I remain agnostic about whether this causal relation is compatible with some form of naïve realism or of anti-individualism (e.g. Burge 2010)6.
The claim that states of seeing have representational (or descriptive) character is tantamount to saying that they have contents. The term “content” can be used in different senses. In one sense that I call “trivial,” the content of a state of seeing is identical with its presentational character, where this character trivially specifies what the subject sees at a given moment. Arguably, this is the sense that Macpherson (2011) has in mind when she states that «there is always at least a minimal sense in which perceptual states are representational» (p. 130). In this trivial sense, the content of a state of seeing v0 is simply this red apple or that particular copy of the book. (This claim should not be confused with the naïve realist’s contention that the object itself is a constituent of the perceptual state). It is relatively easy to establish that perceptual states have contents in this trivial sense. To a rough approximation, the trivial sense is simply identical with the claim according to which we see items and their properties (Siegel 2010a, p. 45; cfr. also Byrne 2001 for a somewhat similar argument). However, as it stands, the trivial sense can be broadly accepted by virtually every philosopher of perception, for one thing, every philosopher of perception is committed to the view that states of seeing constitutively present properties to the subject7. Sense-data theorists, for instance, maintain that colors are sense-data, or properties of sense-data (e.g. Moore 1953, pp. 40ff). Similarly, Campbell (2002, p. 116) defines the properties that are «revealed» (p. 118) in states of seeing as intrinsic properties of the objects.
In contrast with the “trivial” concept of content, I shall here use the term “content” in a technical sense. I provide a more exact clarification of this notion below, but very roughly, we can say that the content of a mental state is its conditions of accuracy8. The technical sense of “content” is drawn from the theory of intentionality. The concept of intentionality is the
6 The view that I advocate here is fairly innocent: most philosophers are committed to some version of the causal theory of perception, although controversy ensues about both the exact causal patterns that hold between worldly items and states of seeing, and about whether the causal theory is a conceptual truth or rather an empirical truth (e.g. Snowdon 1981). 7 In defending Resemblance Nominalism, Rodriguez-Pereyra introduces an innocuous use of the term “property” that does not postulate universals or tropes. Take for example a set of red roses: «whatever it is that makes all red particulars red need not be an entity, like a universal or trope» (2002b, p. 17). For now, I will use the term “property” in this neutral sense. I will show the relevance of the problem of properties for the present investigation in Ch. 4, §1, and return at length on it in Ch. 7. 8 In the literature, the following expressions are used interchangeably: conditions of accuracy, of veridicality, or conditions of satisfaction (Searle 1983, p. 48; 2015, p. 57). I prefer the term “accuracy” for merely stylistic reasons. I suspect that these concepts should actually be sharply distinguished. For reasons of space, I will not further elaborate on their distinctness, as in this work I am exclusively concerned with the “internal psychophysics” rather than the relation of perceptual content with the environment (cfr. Ch. 2, §1.2).
61 Chapter 3: States of Seeing capacity of the mind to refer to or be about something else (Crane 2001, chapter 1; Searle 1983). A mental state that exhibits intentionality is said to have intentional character. For example, thoughts are always thoughts about something: we think about a particular object that we have seen, about a friend that lives far away, and so on. Similarly, memories are always memories of something, like the memory of our last holiday, or of our schooldays. The purview of intentionality is disputed among philosophers (Byrne 2001, p. 205). Some philosophers contend that all mental states are intentional, including bodily sensations like itches, physical pain, emotions, moods, and feelings. Representationalism about perceptual experience is the claim that perceptual states, in our case, descriptive visual states, both conscious (states of seeing) and non-conscious descriptive visual states have an intentional character: they are mental states that refer to something else (e.g. Byrne 2001, 2011; Chalmers 2010a, 2010b; Crane 2001, 2003; Dretske 1995; Pautz 2010, 2011; Searle 1983, 2015; Siegel 2010a; Tye 1995, 2000)9. Whenever we see, we see something; states of seeing and visual descriptive states are about something.
Following Twardowski, Crane (2001, p. 29) distinguishes between the object and the content of an intentional state. The object of a representational state is what the state refers to. So, for example, the state of seeing a red apple refers to a mind-independent object, the apple itself; a thought about my friend in Japan refers to a particular individual, and so on. It is not always clear what the object of a representational state is, or might be. In cases where the direction of fit is toward the environment, it is fairly easy to specify the individual or the individual item(s) a representational state refers to. States of seeing present or make manifest items in the world. My state of seeing the book with a red cover is directed to or about that red book on my desk. Yet, it is not easy to specify the objects of states directed to non-existent items. Thoughts directed towards non-existent objects actually abound in our lives. We can think about fictional characters, like Medea from Euripides’s tragedy. Descriptive perceptual experience, too, might be directed toward non-existent objects. A popular example among philosophers of perception is Macbeth’s hallucinating a dagger. Hallucinatory experiences fail to refer in that they are about objects that do not exist. Representationalism about perceptual experience should therefore articulate an explanation of hallucinatory experiences, i.e. of how some states might be about something that does not exist. For my purposes, it will suffice to focus on states of seeing, thus I will set the problem of hallucinations to one side10. Also, in order not to confuse between
9 The terms “intentionalism” and “representationalism” are sometimes used synonymously, whilst some other philosophers call “representationalism” the view according to which conscious experience is identical to representational content (or “strong representationalism,” cfr. §2.2). In this work, the term “representationalism” refers to the claim that visual perceptual states have descriptive character, i.e. are assessable for accuracy. The term intentionalism will be used to refer to the claim that the phenomenal character depends on content. 10 Recall that I take states of seeing to be genuine perceptual states, in contrast with hallucinations. The problem of hallucination will only play a marginal role in this work, though few remarks on it will be found in several Chapters. Of course, in line with the assumed 62 Chapter 3: States of Seeing different meanings of the word “object,” I will substitute Crane’s notion of object with “material object” (cfr. Ch. 4, §3). Material objects are always mind-independent items.
The second concept is that of “content.” As I have anticipated, the content of a representational state is its conditions of accuracy, i.e. the conditions under which the intentional state accurately represents the object it is about. Consider the case of photographs or portraits. A portrait might be more or less accurate with regard to the portrayed subject. Thus, accuracy comes in degrees. Where there is no object, such as in the case of hallucinations, the state of seeing will be inaccurate or misrepresent the object. How exactly accuracy might be further specified depends on what format the representational content takes. Concerning perceptual states, according to some philosophers the content of a state of seeing is a proposition (e.g. Byrne 2001; Chalmers 2010a; McDowell 1994; Schellenberg 2010, 2016; Searle 1983; Thompson 2009; Tye 1995, 2000), whereas others might opt for a non-propositional account of perceptual content, such as a scenario content (Peacocke 1992, pp. 61-98) or a property-complex view (Pautz 2007, pp. 498-499). I will leave open the problem of the nature of perceptual content for the time being, and return to it in Chapters 4 and 7.
The content of a mental state refers to a specific object from a given perspective or point of view. Suppose for example that Peter sees his cat Tibbles sitting on the mat11. Tibbles will be the material object of the state of seeing. But of course, Peter does not see the object, Tibbles, as such, instead he sees Tibbles from a particular viewpoint. So, perhaps Peter is in front of Tibbles thus representing only some of Tibbles’ properties (Ch. 4). The concept of a perspective or aspectual shape (Crane 2001, p. 18) captures the intuitive idea that a state of seeing presents a material object as being some way from a particular viewpoint.
A further element must be described in order to have a clear picture of the basic structure of intentionality: the mode. The “mode” of an intentional state refers to the modality in which a particular object is represented. For instance, in the case of states of seeing, the mode will be “visual perception.” The same object, say, Tibbles, might be represented by intentional state with different modalities. For example, Peter may remember his cat Tibbles or think about him. In every case, there is a material object, a real-world item, a cat, and a content that fixes the accuracy conditions of the representational state. Mode, content, and (material) object are the three defining features of intentional states. Each intentional state is then ascribed to a particular subject, such that S has an intentional state v0 that is directed at an object, say a red apple, represented through the mode “visual perception,” and having some degree of accuracy. representationalism, I take hallucinations to have a (mis)representational character (cfr. Miłkowski forth.). Naïve realists, and philosophers who reject representationalism altogether, have different options to cope with hallucinatory experiences, but the standard move is to take such experiences to be misjudgments of what is the case (e.g. Fish 2009, pp. 80-115). 11 The example is inspired from Peter Geach, Reference and Generality, Ithaca, NY: Cornell University Press, 1980, p. 215. 63 Chapter 3: States of Seeing
The purpose of this paragraph was to shed light on the concept of states of seeing. There are still a number of open issues that must be addressed: the relation between representational content and consciousness, defining what is exactly presented to the subject in states of seeing, and elaborate on how the visual system may generate conscious content. I broach the first issue in the next Section, and the second one in Ch. 4 and 7. The latter issue will be introduced and discussed in Ch. 5. Later (Ch. 8, §2), I will argue that philosophers may provide phenomenological models of perceptual content, i.e. merely descriptive, and non-explanatory models.
2. Content and Phenomenology
States of seeing are conscious mental states, and the presentational character of such states is what differentiates them from unconscious descriptive visual states. In the previous Chapters, I have often employed the concept of consciousness assuming some pre-theoretical understanding of the concept—after all, we all have some intuitive idea of what we talk about when we talk about consciousness. However, if the problem of PI is inextricably related to the problem of the neural correlates of conscious visual content, the concept of consciousness must be set on a consistent and intelligible footing (besides the specific works cited below, on consciousness cfr. also Bayne et al. 2009; Rose 2006; Seager 1999; Velmans & Schneider 2007; Zelazo et al. 2007).
In §2.1, I introduce the concepts of phenomenal and access consciousness. Some philosophers, most notably Block (2007), have argued that the two concepts denote not just two aspects of the same phenomenon, but two different, although closely related phenomena that may, under some condition, part from each other. The thesis is known as the “overflow” argument and endorsing or rejecting it has significant consequences for any account of the neural correlates of conscious content. The overflow thesis will briefly be discussed in §2.2; and than later in Ch. 5. Finally, in §2.3 I will introduce intentionalism, i.e. the claim according to which our conscious experience depends somehow on the representational content. The aim of this paragraph is to shed light on the notion of consciousness and, most importantly, to bring into clearer view the role of consciousness in this work.
2.1 What Does “Consciousness” Mean? 2.1.1 Phenomenal and Access Consciousness
Over more than fifty years, philosophers have introduced many concepts in the attempt to clarify the nature of our conscious experience (cfr. Rose 2006; Van Gulick 2009). The single most widely discussed notion of “consciousness” is that of phenomenal consciousness. Phenomenal consciousness, or simply p-consciousness, refers to the particular qualitative character of conscious states in contrast with unconscious states (e.g. Burge 1997, p. 427, 2006; Searle 2004, p. 134), or as Chalmers puts it, «the way it feels» (1996, p. 11). This “way of 64 Chapter 3: States of Seeing feeling” is nicely captured by Thomas Nagel’s (1974) famous “what-is-it-like-to-be” (cfr. also Farrell 1950). For instance, Ned Block says that «what makes a state phenomenally conscious is that there is something ‘it is like’ to be in that state» (1995, p. 377); whilst Chalmers glosses the concept as follows: «what it means for a state to be phenomenal is for it to feel a certain way […] in general a phenomenal feature of mind is characterized by what it’s like for a subject to have that feature» (1996, p. 12). As I hinted above, philosophers have introduced a great deal of concepts in the debate: few more examples include Shoemaker (1994, p. 22) who talks about «qualitative character», or «subjective character», endorsed by Metzinger (1995, p. 9) and Schlicht (2011). To avoid confusion, I hold the following concepts as synonym of p- consciousness: “phenomenality,” “conscious,” “experience,” and cognate constructions. The term “phenomenology” although sometimes used in the sense of “phenomenal consciousness”—e.g. the phenomenology of a state of seeing is what it is like to enjoy that state of seeing—will also be used in the sense of the field of study whose objective is the analysis of conscious experience.
Another popular concept of consciousness is that of access consciousness or a-consciousness (Block 1995). Ned Block introduced this concept in a classical study:
A state is access-conscious (A-conscious) if, in virtue of one’s having the state, a representation of its content is (1) inferentially promiscuous […], that is, poised for use as a premise in reasoning, (2) poised for rational control of action, and (3) poised for rational control of speech. (Block 1995, p. 231)
Put crudely, the idea is that a representational content is access-conscious if that content is available to other cognitive modules (Block 2007). A somewhat similar concept is that of psychological consciousness (Chalmers 1996, p. 25-31). Chalmers’ psychological consciousness is a catch-all concept that refers to a number of ways in which consciousness is operationalized, these include introspection, reportability, self-consciousness, attention, and more (ibid., pp. 26- 27). The «most general brand of psychological consciousness» according to Chalmers is awareness: «a state wherein we have access to some information, and can use that information in the control of behavior» (ibid., p. 28).
Block identifies three differences between p- and a-consciousness (1995, p. 170). The first difference is that p-consciousness is phenomenal, whereas a-consciousness is representational. A-consciousness presupposes a representational state, i.e. a mental state that refers to or is about something. Phenomenal consciousness is, on the contrary, a purely qualitative concept12. Another way to spell out this point is to say that a-consciousness is transitive, it is always consciousness of something; whilst p-consciousness is intransitive, i.e. it is not consciousness of
12 It must be noted that Block slightly altered his concepts over the years and the distinction between the two is not so clear-cut (cfr. Schlicht 2012). 65 Chapter 3: States of Seeing something. The second difference is that a-consciousness is a broadly functional notion, whereas p-consciousness is not functional. The third difference is an asymmetry between the two. P-consciousness divides in kinds: the feel of pain is a conscious kind of which this particular pain experience is a token, i.e. every token pain will be an instance of a particular type of p-consciousness. On the contrary, a particular a-conscious state need not be accessible at some other time. Whether these differences are merely conceptual distinctions operated on the same phenomenon, or rather are signs of a deeper ontological divide is a claim that will be discussed in §2.2.
2.1.2 State Consciousness, Creature Consciousness, Background Consciousness
Most of my examples so far are specific mental states being conscious, for instance, the state of seeing a red apple. In these cases, the adjective “conscious” is predicated of a token mental state. It is also possible to enlarge our perspective and apply the adjective “conscious” to organisms. Most of us take as uncontroversial that some non-human animals are conscious, whilst other entities are clearly non-conscious13. For instance, stones, corkscrews, and CDs are not conscious, whereas human beings, and in all likelihood cats, chimps, and other non-human animals are conscious (Allen & Bekoff 2007). The assertion that the latter entities are conscious does not imply that they are necessarily always conscious14. All it is required is to say that human beings and other non-human animals have the capacity of being conscious. This notion of consciousness is sometimes called creature consciousness (Rosenthal 1986). If we accept the distinction between p- and a-consciousness, we can further distinguish between creature p- consciousness and creature a-consciousness. The former refers to the capacity of an organism to have p-consciousness, and the latter to the capacity of an organism to have a-consciousness. If, as some researchers contend, there is a real distinction between p- and a-consciousness, we may conceive organisms that possess creature p-consciousness in the absence of creature a- consciousness, and vice versa (cfr. §2.2).
13 Perhaps this is an overstatement. Panpsychists contend that consciousness is literally everywhere: every causal process in the universe, from the complex operations of the brain to micro-physical interactions have a phenomenal aspect (Seager 2007). Panpsychists usually argue that whilst consciousness or proto-consciousness is literally everywhere, a complex and rich conscious life is only possible within highly complex systems, such as the human brain. If panpsychism is true, it follows that there are no neural correlates of consciousness, as every causal or functional process has an intrinsic conscious or proto-conscious side. This, however, does not rule out the neural correlates of conscious content that are the object of study in this work. 14 Whether for example human beings are conscious in every moment of their lives is matter of controversy. One obvious objection could be for example to show that patient in a vegetative state, in coma, or simply asleep are not conscious. However, we currently have no clear evidence that patient in vegetative state or coma lack consciousness altogether, cfr. Ch. 1, §2.1; concerning sleep, dreams are usually conceived as conscious states. 66 Chapter 3: States of Seeing
Most cognitive scientists assume that our capacity of being conscious is the actual exercise of some specific kind of brain activity. The search for the biological and computational correlates of conscious experience is the aim of the research program on the neural correlates of consciousness or NCC (Bayne 2007; Chalmers 2000; Crick & Koch 1990; Hohwy 2007, 2009; cfr. Ch. 5). In the scientific literature, Rosenthal’s concept of creature consciousness is often identified with the concept of state consciousness. State consciousness refers to an organism’s overall mental state of being conscious. For instance, right now I am in an overall conscious state, independently from the specific conscious mental states I enjoy. As I am using the terms here, however, state consciousness is not equivalent to creature consciousness. The difference is roughly this: creature consciousness refers to the entity’s capacity of being conscious (p- or a- conscious), whilst state consciousness refers to the organism’s overall condition of being conscious at a particular moment in time. We can clarify this by means of an example. Suppose that the (blind) neuroscientist Mary has a tragic accident and falls in a potentially reversible coma. While in coma, we would still say that Mary is creature conscious, i.e. she is a being that has the capacity of being conscious, although this capacity is not actually exercised. Yet, Mary is arguably not in a state of consciousness, as coma may be an entirely unconscious condition. Research on the content-NCCs assumes that the subjects are already in a state of consciousness (cfr. Ch. 5).
Being in a state of consciousness, at least in humans, implies that the subject is always in a specific background state of consciousness (Chalmers 2000, pp. 18-19). The notion of background state of consciousness is still controversial like the notion of “levels of consciousness” (e.g. Bayne 2007; Laureys 2005; Overgaard & Overgaard 2010). It is difficult to explain the notion of a background state without recurring to some examples. Typical forms of background states include: normal conscious wakefulness, mind-wandering, different stages of sleep like N-REM 1 or REM sleep (e.g. Flanagan 2000; Mancia 2006) or forms of detachment like derealization or depersonalization, whereby the subject feels, respectively, reality as “dream- like” (whence the name “oniroid states”), or her own mental states as “alien” (e.g. Liotti 2008; Simeon & Abugel 2006; cfr. also Hobson 2007). Alterations of the background state of consciousness might be induced by endogenous or exogenous factors. Endogenous factors include circadian rhythms of wakefulness and sleep; exogenous factors include traumatic events or ingestion of psychotropic substances. There is little doubt that these background states make for a different overall phenomenal experience. Being conscious and drunk is different from a state of normal conscious wakefulness, or of dreaming. What exactly accounts for these differences is far from clear15 . In this work, I follow the implicit assumption of much of
15 I have done some spadework towards an account of background states in terms of restructuring of the overall accessibility of the conscious contents (Vernazzani ms). In short, the proposal is that, for instance, in a state of derealization the subject will have a particular access- profile to her own mental contents, whereas the access-profile to her own mental contents will be different in a state of normal conscious wakefulness; i.e. some mental content might be 67 Chapter 3: States of Seeing contemporary philosophy of mind, and assume that states of seeing are of a subject in normal conscious wakefulness.
Let us now return to the mental states. As we have seen, some mental states are conscious, whilst others are not. Enjoying a conscious mental state entails being in a state of consciousness, having a particular background state, and being creature conscious. The identification of the neural machinery that makes a particular content conscious goes under the name of the search for the neural correlates of conscious content, or “content-NCC” (Bayne 2007; Chalmers 2000; Crick & Koch 1990; Hohwy 2007, 2009). In the case of states of seeing, the driving research question underlying this program is: In virtue of what do we enjoy states of seeing? The question may admit different theoretical and experimental answers, pending also on our assumptions about the divide between p- and a-consciousness (cfr. Ch. 5). If the two phenomena are ontologically and empirically dissociable, one could argue that state of seeing might be p-conscious without being a-conscious, and therefore that two different kinds of mental machineries are involved in making states of seeing both p- and a-conscious. Our philosophical assumptions about the nature of consciousness thus bear on the way we model the underlying mechanisms responsible for a subject’s conscious experience. I will now turn to the debate about the relation between p- and a-consciousness.
2.2 Accessibility and Phenomenal Overflow
In the last decade, Block has marshaled the argument that p- and a-consciousness are not mere conceptual distinctions, but rather two distinct phenomena that may be dissociated under some particular circumstances (Block 2007, 2008, 2011). In his (2008) contribution, Block illustrate this point by means of a simple case. It has been shown by a number of experiments now, that an area at the bottom of the temporal lobe is strongly correlated with experience of faces (e.g. Kanwisher 2010; Kanwisher et al. 1997) (cfr. also Ch. 5, §4.2.1). The area is now widely known as FFA, or fusiform-face area. Many experimental settings showing the correlation of FFA with face experience have involved binocular rivalry: cases of dichoptic presentation, where subjects report experiencing either the left eye content, or the right eye content—say, a house, or a face (e.g. Blake et al. 2014; cfr. also Ch. 5, §4.2.2). Now, when subjects report seeing a face, a much stronger correlation is observed in the FFA, leading to the suggestion that this area may be specialized in face experience.
No one thinks that activation of FFA alone is sufficient for producing a face experience. A whole number of other processes and supporting factors are required for a subject to experience a face (cfr. Ch. 5, §3.1, §4). Yet, the question is: given that all these additional
accessible to a number of higher cognitive functions in a state of normal conscious wakefulness, whereas the very same content might only be partially accessible in an altered state of consciousness, or even accessible to different cognitive functions 68 Chapter 3: States of Seeing processes occur, what is the FFA responsible for? Being phenomenally conscious of a face, or having access to the experience of a face? According to Block, there might be some evidence that the FFA—and this is merely one example among others—is but a neural correlate of phenomenal consciousness. Here’s how the story goes. Some patients, in particular, those affected by visuo-spatial extinction, are perfectly able to see a single object in their visual field. However, if two objects are presented, the patients claim that they can only identify the ones on the right side of their visual field, and not see the object on the left side (Aimola Davies 2004). Suppose that a subject is presented with an ordinary object on the right side, and a face on the left side. Now, since patients suffering from visuo-spatial neglect report not to be able to see the items presented on the left, in this case, a face, it would naturally follow that we should not detect any activity on the FFA. Yet, as Rees has shown in a series of experiments (Rees et al. 2000) on a patient known as ‘GK’ the FFA seems to light up even when a face is presented in the invisible hemisphere of GK’s visual field.
As Block acknowledges (2008, p. 291), this bizarre result may have multiple explanations. For example, it may be the case that the FFA is not alone responsible for face experiences (A possibility I briefly discuss in Ch. 5, §4.2.1, ft. 16). However, the solution Block prefers is that, although FFA is the «core neural base» for face experience, it is so only in the phenomenal sense of consciousness, and not in the access-sense. In other words, what happens in cases like those of patient GK is that a brain lesion has damaged the machinery responsible for a- consciousness, rather than p-consciousness. On this interpretation, therefore, GK does have p- consciousness of a face, but he cannot report it because that information does not make it within the machinery of higher cognitive areas16. Hence, phenomenal and access consciousness would have two distinct neural correlates and would be two distinct phenomena.
2.3 Representational Content and Consciousness 2.3.1 Intentionalism
States of seeing have a presentational character, i.e. they are descriptive or representational states and they are conscious. This leads us to the following question: What is the relation between content and consciousness? Most representationalists have claimed that consciousness is somehow related to content. This relation can be one of supervenience (nomological or not), or assume some stronger form, like identity. I call the position according to which the phenomenal character of a subject’s perceptual state depends completely or partly on its content intentionalism. This position can be articulated in several ways, for example claiming that phenomenology is just identical with a particular kind of content, or that it supervenes on content when some conditions are met. Notice that representationalism—as I have defined it—
16 In Ch. 5, §4.2.1-2, I will briefly return on this example, and show that my account offers a straightforward interpretation that does not require a distinction between a- and p- consciousness. 69 Chapter 3: States of Seeing does not entail intentionalism. One can be a representationalist about mental states in general, whilst claiming at the same time that phenomenology does not exclusively depend on content17.
Most contemporary analytic philosophers endorse a form of separatism. Separatism is the claim that consciousness and intentionality are two distinct phenomena. Separatism is the current orthodoxy among philosophers of mind and finds wide support in the cognitive sciences: a mental representation does not need to be conscious, it is only in virtue of something else, an additional ingredient, that that representation becomes conscious. Separatism is opposed to inseparatism, the claim that consciousness and intentionality cannot be separated, but today this option has largely slipped from prominence and is no longer discussed in contemporary debates18.
2.3.2 Varieties of intentionalism
Schlicht (2011) contrasts two groups of theories of consciousness: physicalist and functionalist theories (cfr. also Rose 2006). The former theories seek to provide thoroughly empirical solutions to the problem of consciousness, such as for example the 40Hz oscillations hypothesis (e.g. Crick & Koch 1990; Engel & Singer 2001) or recurrent processing (Lamme 2006) (cfr. also Ch. 5). The latter theories seek to characterize conscious states in terms of representations with specific functional profiles. As it stands, I think that the dichotomy is only apparent, as most theories of the latter group can be seen as providing only abstract models (cfr. Ch. 5, §1) of the relation between consciousness and representations, and that such models may be logically compatible with one or more empirical hypotheses of the physicalist camp19. Consequently, here I will briefly sketch out the major intentionalist theories of consciousness. According to some intentional theories, consciousness is a property of some mental states, whereas according to other theories, consciousness would be a specific kind of content. Another way to map the conceptual geography of intentionalism is between same-order and higher-order theories. But
17 A case in point is Noë’s (2002) claim that although perceptual states have representational content, their phenomenology is constituted by the active exercise of our sensorimotor capacities (p. 67) (cfr. Ch. 6). Other philosophers posit irreducible qualitative properties, sometimes called “qualia,” that either totally (e.g. Block 2010) or in part (e.g. Shoemaker 1990) determine the phenomenal character of a state of seeing. 18 A further distinction can be drawn between intentionalism and prioritism (cfr. Pautz 2013). The former is the view that consciousness is grounded in intentionality, whereas the latter is the view that intentionality is grounded in consciousness. To the extent that both accept representationalism, they only diverge about how to account for p-consciousness. Since in this work I mainly focus on the content of states of seeing, I take my views to be broadly compatible with both intentionalism and prioritism. I will however assume intentionalism, as it is the mainstream view of representationalism. 19 In addition, Schlicht’s (2011) list can be upgraded with the group of cognitive (McGovern & Baars 2007) and computational theories of consciousness (Sun & Franklin 2007). 70 Chapter 3: States of Seeing for expository reasons, I settle for the widely accepted distinction between weak and strong intentionalism.
Weak intentionalism is sometimes defined as the claim that «phenomenal experiences (of a given class) always have representational content» (Chalmers 2010b, p. 344). As Chalmers observes, this claim is rarely denied, and as it stands it is broadly compatible with most standpoints about perceptual experience. Crane (2001, p. 83-84) gives several definitions of weak intentionalism, among them: «all mental states are intentional, but some have non- intentional conscious properties or qualia». Qualia are supposed to be intrinsic properties of experience, properties that in many (but not all) philosophical accounts are deemed irreducible to representational properties. Crane’s definition assumes that qualia are higher-order properties, or properties of properties. Exactly in virtue of what some representational properties have qualia depends on a number of other assumptions about the ontology of p- consciousness. Another definition of weak intentionalism put forward by Crane is that not every phenomenal difference is mirrored by a representational difference (p. 84). Weak intentionalism, as I understand it, differs slightly from both Chalmers’ and Crane’s use. Weak intentionalism here will be defined as the claim that although consciousness relates to representational content, it is not reducible to it, i.e. weak intentionalism is non-reductive intentionalism.
One way to spell out weak intentionalism is by means of the notion of supervenience (Kim 1993). P-consciousness supervenes on representational content if variations in content produce variations in p-consciousness. The supervenience relation may be one of nomological supervenience (Chalmers 1996). On this view, p-consciousness supervenes on content in virtue of some law of nature that fixes the relation between p-consciousness and content. Weak intentionalism can be formulated in many ways. One way, following Byrne has it that:
For any two possible experiences e and e*, if they differ in phenomenal character, then they differ in content. (Byrne 2001, p. 217).
Fish calls this the “Mirroring Thesis” (2010, p. 67) (Seager & Bourget 2007 express a similar view called the “exhaustion thesis”). The mirroring thesis is a biconditional, and states that every phenomenological variation necessitates a variation in content, and every variation in content necessitates a variation in phenomenology. It is therefore possible to read off the content of a state of seeing from its phenomenal character, and vice versa, it is possible to read off the phenomenal character from the state’s content. We can also cash out the mirroring thesis in a mathematical form, and, say, that given two domains of a state’s content and of phenomenology there is a bijective function such that every element of content is associated to one and only one element of phenomenology, and vice versa. If structure is included, the mirroring thesis can be described as a form of morphism, or better an isomorphism, between the two domains.
71 Chapter 3: States of Seeing
Not every weak intentionalist accepts the mirroring thesis. Some philosophers argue that whilst p-consciousness is at least partially dependent on content, not every phenomenological variation is mirrored by a variation in content. Chalmers for example states that «the most plausible potential cases of phenomenally distinct visual experiences with the same representational content involve differences in attention» (2010a, p. 348), although he does not delve deeper into this proposal. Searle is another defender of this variety of weak intentionalism. On his account, a subject may have two phenomenologically identical experiences that have different conditions of accuracy because each experience is «self-referential» (1983, p. 50). Searle’s example bears on the problem of the particularity of perceptual experience (cfr. Ch. 4, §1; Ch. 7, §2.1), i.e. the problem of explaining how phenomenology seemingly informs us about particulars (cfr. Schellenberg 2016). Searle’s example goes as follows. Suppose two identical twins have type-identical visual experiences of two different but type-identical cars at the same time in type-identical background conditions. According to Searle, the twins will enjoy the same, type-identical phenomenology, but the conditions of accuracy of their states of seeing would be different since they are of two numerically distinct cars. Hence, he concludes: «Same phenomenology; different contents» (Searle 1983, p. 50). Both Chalmers and Searle are intentionalist, i.e. they believe that there is a close relation between content and phenomenal character, but they both deny that the latter is uniquely determined by content20.
Let us now turn to strong intentionalism. I call “strong intentionalism” every view that somehow reduces p-consciousness to content (cfr. Seager & Bourget 2007). There are two main groups of theories: same-order theorists maintain that states of seeing are conscious in virtue of their possessing a particular kind of representational content or functional profile; higher-order theorists, on the contrary, maintain that states of seeing are conscious thanks to some higher- order state that is directed at the first-order state. I will consider them in this order.
Perhaps the best-known examples of first-order theories are Michael Tye’s PANIC theory (1995, 2000) and Dretske’s teleological representationalism (1995, pp. 65-95). I will focus exclusively on Tye’s account. According to Chalmers and Byrne consciousness is a property that some mental states have: «[…] the phenomenal character of an experience is a property of the experience» (Byrne 2001, p. 201). Tye rejects this view: «[…] the phenomenal character itself is not a quality of your experience to which you have direct access» (2000, p. 47), and «Phenomenal content […] is not a feature of any of the representations occurring within the sensory modules» (1995, p. 137). Tye contends that a mental representation is conscious only
20 Searle develops his intentional account of perceptual experience adding further ingredients to the content. More specifically, he thinks that the Network of intentional states as well as the Background of non-representational mental capacities affect perception and therefore its conditions of accuracy (Searle 1983, p. 54ff). Other putative cases of phenomenology not uniquely determined by content may be the inverted spectrum scenario, where representation of colors does not match their subjective experience (e.g. Fish 2010, pp. 70-71). 72 Chapter 3: States of Seeing when it meets some specific criteria, namely, if mental representations are Poised, Abstract, Non-Conceptual, Intentional Contents. “Intentional content” requires no further clarification, it simply refers to the fact that such states exhibit intentionality or aboutness. That states must be “poised” means simply that their contents must «[…] attach to the […] maplike output representations of the relevant sensory modules and stand ready and in position to make a direct impact on the belief/desire system» (ibid., p. 138). The content is furthermore “abstract” meaning that it does not demand any particular object «enter into these contents», since experiences caused by different material objects can look and feel phenomenally exactly alike. (Again, here Tye’s remarks bear on the issue of the particularity of perception, cfr. Ch. 7, §2.1). Finally, the content must be “non-conceptual” meaning that the features (cfr. Ch. 4, §1) entering into the contents of states of seeing need not «be ones for which their subjects possess matching concepts» (ibid., p. 139)21.
In contrast with same-order theories, higher-order theories claim that the content of some mental states become conscious thanks to a further or higher-order state that is directed at its content (Carruthers 2007). An initial distinction can be made between higher-order thought theories, and the inner-sense theory or higher-order perception theory. According to the latter the content of a state of seeing is conscious thanks to a higher-order perceptual state or “inner perception” that scans or is directed at that content (e.g. Lycan 1996). In contrast with the inner sense theory, higher-order thought theories come in at least two varieties: actualist higher-order thought theories, and dispositionalist higher-order thought theories. The former predicts that the content of states of seeing are made available to the conceptual system that classifies them and form judgments. The higher-order awareness is conceptual or propositional in nature, so that, roughly, my state of seeing a red apple is conscious in virtue of a higher-order state that make me come to believe that I am undergoing an experience of a red apple. For some actualist higher-order theorists a merely occurrent higher-order belief is sufficient for phenomenal consciousness (e.g. Rosenthal 1997), whereas for other theorists the belief must be justified and hence count as knowledge (e.g. Gennaro 1996; at least, if knowledge is a justified
21 One of the most debated issues in the philosophy of mind is the problem of conceptual content. Roughly, the question is whether the contents of mental representations are constituted by concepts or not. The issue was famously raised by Evans (1982, §§5.1-2, §7.4), who claimed that the operations of the information-gathering system are less sophisticated than those connected with the formation of belief states, which are connected with the notion of reason (ibid., p. 124). McDowell (1994) famously argued, contra Evans, that perception is indeed conceptual in order to include it within the “space of reasons” (cfr. also Heck 2000). I will have very little to say on this issue, partly because much of my account of visual objects is largely compatible with some form of conceptualism (cfr. Ch. 4, 7; also Pylyshyn 2007), and partly because every work on this issue must preliminary clarify the nature of concepts. Positions about this issue differ significantly (e.g. Newen & Bartels 2007), some philosophers take concepts to be linguistic or linguistic-like entities (arguably Textor 2009), or demonstrative concepts (McDowell 1994), or the exercise of sensorimotor skills (Noë 2004, chapter 6; 2012, chapter 3). 73 Chapter 3: States of Seeing belief). The dispositionalist higher-order thought theory assumes instead that mental states have a dual analog-non-conceptual content both first-order and higher-order, such that a content, in addition to the analog-non-conceptual content “red apple” (first-order), also has the analog-non- conceptual content “seems a red apple” or “experience of a red apple” (higher-order). In other words, such contents present themselves to us «via their higher-order analog contents» and at the same time they present «properties of the world or of our own bodies» (Carruthers 2007, p. 283).
This brief overview of the varieties of intentionalism is not meant to be exhaustive. I have omitted several options, such as for example Brown’s HOROR theory (2014), or Van Gulick’s HOGS theory (2004, 2006). Also, I have glossed over issues such as the divide between phenomenal externalism and phenomenal internalism, i.e. the claims according to which consciousness is either a relation between the perceiver and the environment, or an internally generated state (Veldeman 2009). The take-home lesson of this Section is that, if we accept separatism—as most current philosophers do—many options stand on the floor about how to spell out the relation between content and consciousness. Since I wish to remain neutral on the issue of phenomenal consciousness in this work, the theory that I will develop in the next Chapters will largely be compatible with multiple options, though I will make appropriate remark whenever my account of intentional mechanisms (Ch. 5) seems to conflate with some extant philosophical theory of consciousness.
3. The Role of Consciousness in this Work
In the first Section, I have clarified the notion of a state of seeing and its relation to visual perception and other conscious states. In the second Section, I have elaborated on the relation between content and consciousness. In this final Section, I will first explain the role of consciousness in this work (§3.1), and then offer an overview of the Phenomenological Domain (§3.2).
3.1 Consciousness and PI
In this work I will not espouse a particular theory of consciousness and I do not set out to explain consciousness. Instead, consciousness in this work is used to specify the relevant contents, whose neural correlates form the Neural Domain of PI. To appreciate this, let us recall that in Ch. 2, §1.2 I claimed that PI should be understood as part and parcel of the program of innere Psychophysik, i.e. it is a function between the “psychological” and the “neural.” Furthermore, I have specified that the former domain is restricted to the domain of conscious contents, and in particular the contents of states of seeing visual objects (cfr. also Ch. 1).
74 Chapter 3: States of Seeing
Now, states of seeing visual objects are individuated in virtue of their being conscious. In contrast with other descriptive or representational states, states of seeing have a presentational character, i.e. they are conscious. There is something it is like for the subject to see this or that object. On the (uncontroversial) assumption that states of seeing have some corresponding neural correlates, restricting the Phenomenological Domain to a particular sub-set of mental states has the effect of restricting the scope of the Neural Domain. I will illustrate my point with the aid of Fig. 8.
M C M V C V
i
! Vn Vn Cn Cn N N
Fig. 8: Relationship between different domains. M is the set of all mental states, whilst N is its corresponding neural correlate. C, V and Ψ are, respectively, the set of all conscious states at a time t, the conscious visual field, and the state of seeing a visual object. Each of these domains has a corresponding neural counterpart.
Let me start from M, the set of all mental states. Arguably, M has a corresponding set N of all neural states correlated with M. As we have seen, M is an extremely heterogeneous set that encompasses very different kinds of states, including non-conscious and unconscious mental states, such as mental states postulated by psychodynamics. From M, we identify a proper subset of all conscious mental states. Again, we can extrapolate from N a proper subset Cn all neural states somehow correlated with C. Notice that just like C is a proper subset of M, so is Cn a proper subset of N. The visual field V is the proper subset of C, so, correspondingly, we can identify a subset of neural states Vn that is a proper subset of Cn. From V we finally extrapolate the set of states of seeing visual objects, that is our Phenomenological Domain Ψ. The Phenomenological Domain has, again, a corresponding image—in a mathematical sense—or domain that is the proper subset of Vn, i.e. the Neural Domain ϕ.
75 Chapter 3: States of Seeing
As I have said, the thesis under examination in this work is whether it is heuristically useful to identify a homomorphic bijective function between ϕ and Ψ, i.e. a psychoneural isomorphism i. Importantly, my set-theoretic vocabulary is neutral regarding the nature of both the neural and the mental domains. So, for example, to say that N is the set of the neural or physical states correlated with M is silent about the nature of such neural or physical states. This also implies that different neural states need not be locally connected or even be of the same kind.
To reiterate, the Phenomenological Domain consists of the content of states of seeing directed at visual objects, where “content” is understood in a technical sense, as the conditions of accuracy of the state of seeing. This means that I will not discuss the relation between different states of seeing visual objects. Instead, I will analyze the structure of visual objects and explore whether such a structure is isomorphic in any relevant sense with the underlying Neural Domain. The Phenomenological Domain is the carrier set of the elements that form the relational structure. Following the convention introduced in Ch.2, §1, Ψ refers to the Phenomenological Domain understood as a carrier set, whereas Ψ refers to the relational structure of the Phenomenological Domain. In order to elucidate the nature of this relational structure, I broach in the next Chapter the issue of what are the elements that constitute visual objects.
3.2 An Overview of the Phenomenological Domain
Before I conclude this section, it will be helpful to pause to consolidate what has been said so far. As I have explained in Ch.2, §1, in order to talk about PI, we need to meet the requirements defined by the “Character of Isomorphism.” The Character of Isomorphism dictates that we need to identify two domains, show that they contain elements that stand in some relations, and finally show that there is a function that completely maps the relations of one domain onto the other one. In this Chapter, I have clarified the nature of the Phenomenological Domain. I will return on the Neural Domain in Part III (Ch.5-6).
The Phenomenological Domain under examination in this work belongs to the broader domain of the Phenomenal Unity of Consciousness. In this work, I will only focus on states of seeing. States of seeing have been defined as follows:
SoS = df A mental state that has visual presentational character.
Where the presentational character means that the state has a conscious content. States of seeing are part of the descriptive subsystem of visual perception, which in turn is closely linked to the sensory and the deictic subsystem. The “content” of a state of seeing is defined as its conditions of accuracy, i.e. the conditions under which the state will be an accurate representation of the external object. The content of a state of seeing is our Phenomenological Domain ψ, and as I have argued, consciousness merely has the role of helping us detecting the 76 Chapter 3: States of Seeing relevant content. This urges us to tackle the following issue: What kinds of elements then compose the contents of states of seeing?
77 4
FACTS, SENSORY INDIVIDUALS, AND SENSORY REFERENCE
By now, we know what states of seeing are, but we must still specify what elements compose this domain. In compliance with the “Character of Isomorphism,” we must also specify the relational structure of these elements. As I said in Ch.1 §3, in this work, I will exclusively focus on visual objects. This leads us to the question: What are visual objects? In the literature, there are two mutually inconsistent accounts of visual objects. I will call them factualism and the bundle view (§1.1). According to the former, what we see are facts—i.e. actual states of affairs. According to the latter, visual objects are bundles of compresent properties.
In this Chapter, I argue for the bundle view. My argument has a simple form, I construct a disjunction: either visual objects are facts or they are bundles of properties, but not both. Since I argue that they cannot be facts, they are bundles of properties. Arguing for the negation of the first disjunct will require, however, some work. In contrast with leading philosophical works, such as that of Armstrong, McDowell, Tye, and Textor, I will not settle the issue of the ontology of visual objects on mere phenomenological ground, or by means of conceptual or semantic analysis. The argument instead requires us to take into consideration current scientific accounts of the problem of sensory reference and object tracking. This will involve making a quick detour to the sensory subsystem (cfr. Ch. 3, §1.1).
I take as my foil Fish’s (2009) argument for factualism: «[…] I claim that we perceive facts (metaphysically understood), such as the fact of a’s being F» (p. 22). Fish’s argument for FT rests on two claims: a phenomenological and a scientific claim. The former claim is that we see visual properties as properties of some object. The latter claim purports to give scientific support to FT with an interpretation of some experiments on object perception (Blaser et al. 2000; Cohen 2004; Matthen 2005). More specifically, these studies show that visual sensory individuals are objects, rather than places. This feature makes Fish’s claim particularly interesting, as it would provide scientific support to factualism.
The Chapter has the following structure. In §1 I introduce the problem of the ontology of visual objects, the concept of “fact,” and define the notion of “factualism.” In §2 I will briefly discus the work of several factualist philosophes, and finally identify my target in William Fish’s argument for factualism. What makes Fish’s argument so interesting is that it apparently justifies factualism on the ground that it would be supported by experimental evidence on object perception. I will reconstruct the scientific background of Fish’s argument in §3. This will provide the frame within which I will articulate my rebuttal in §4. Finally, I will discuss some consequences of my conclusion in §5. Chapter 4: Facts, Sensory Individuals, and Sensory Reference
1. Seeing and the Ontology of Visual Objects 1.1 States of Seeing and Visual Properties
According to some philosophers, we see actual states of affairs or facts (e.g. Fish 2009; McDowell 1994; Johnston 2006). Facts are entities composed of two kinds of constituents that stand in a non-mereological relation: particulars and properties or relations (§1.2). I will call factualism the thesis according to which we see facts. On this view, we either visually represent facts (representationalism), or we are directly visually acquainted with facts (naïve realism). Factualism has several deep implications for any philosophical theory of perception. Firstly, since facts have a non-mereological composition, it implies that the objects we see do not have an internal mereological structure (though mereological relations may be construed as external to different facts; cfr. Armstrong 1997). Secondly, if we take facts as the «basic units» of visual perception (Fish 2009 p. 52), such units will then be individuated by two kinds of elements: properties (or relations) and particulars. Finally, although facts are worldly items, their structure «mimic[s]» (Johnston, 2006, p. 290) the structure of judgments like “a’s being F” (§1.2), hence espousing factualism entails that visual objects have a sentence-like structure (Armstrong 1997, p. 96; Textor 2009; cfr. §5.3).
Since factualism is the thesis according to which we see facts, I will elaborate on the concept of “seeing” in this paragraph, and on the concept of ‘fact’ in the next one. I have already elucidated the notion of state of seeing (Ch. 3). Two caveats are in order. The first is that I only focus on cases of genuine or veridical perception, in contrast with hallucinations. I leave to defenders of factualism to explain whether we might hallucinate facts or not. The second caveat is that, although in this work I explicitly espouse representationalism and intentionalism about consciousness, much of what I am going to say in this Chapter is compatible with both naïve realism and representationalism (cfr. Ch. 3, §1.3).
The concept of “seeing” or “state of seeing” has already been defined (Ch. 3, §1): a mental state that has conscious visual presentational character. A mental state has presentational character when it conveys or presents something consciously to the subject. However, in the previous Chapter, I did not specify what exactly is presented to the subject, and hence, what determines the conditions of accuracy of perceptual experience. I will call the “phenomenologically manifest” what fixes the conditions of accuracy of a state of seeing. Determining what is phenomenologically manifest is one of the central tasks of any phenomenology, understood as the study of what is phenomenologically manifest.
That states of seeing make manifest to the perceiver a cluster of visual properties or “features”— as vision scientists usually call them (e.g. Wolfe 1998)—is uncontroversial. Typical examples of these properties include colors and forms: we see things having colors and shapes. In seeing this car in front of me, I am seeing that it has a color, say, red, a particular shape, and so on. Visual
79 Chapter 4: Facts, Sensory Individuals, and Sensory Reference properties are constitutive of states of seeing: nothing can be seen in the absence of visual properties (Siegel 2010a, p. 45). This can be formulated in the following “Phenomenal Principle” (PP):
PP: States of seeing make manifest a cluster of visual properties as instantiated1.
(I assume that states of seeing are states of a perceiver, I will, however, omit reference to the subject in PP and OP, see below). No philosopher or psychologist would take PP as an exhaustive description of states of seeing. From an everyday perspective, our visual experience can be broken up into a number of objects (Rosch et al. 1976). Ask any observer what she is seeing, and she will mention chairs, cars, persons, etc. Following the psychological literature, I call these items “visual objects” (cfr. Ch. 1, §3.2). Visual objects can be defined as coherent unities of visual properties (Feldman 2003), or «elements in the visual scene organized by Gestalt factors into a coherent unit» (Kimchi et al. 2016, p. 35). Typical examples of visual objects include what Austin called «moderate-sized specimens of dry goods» (1962, p. 8) like books or chairs, but also perceptual ephemera such as waves, rainbows, and shadows (e.g. Casati 2015; Cohen 2004). It is uncontroversial that we see visual objects in the sense specified. We can thus put forward the following “Object Principle” (OP):
OP: States of seeing make manifest visual objects as instantiated.
What is controversial about OP is the ontological and metaphysical status of visual objects. A phenomenological theory worth its salt should clarify what visual objects are. The development of such a theory must meet some requirements. One requirement is the particularity of visual objects (e.g. Aristotle 1933, pp. 5-7; Burge 2010, p. 84; Schellenberg 2010, 2016; Soteriou 2000) (cfr also Chapter 7, §2). This requirement captures the idea that states of seeing make manifest unrepeatable entities within more or less clear spatio-temporal coordinates. If I turn my head to the desk, I will see this copy of Stendhal’s The Charterhouse of Parma, having this particular shade of red, and this particular form (cfr. also Moore 1953, p. 30). The particularity of perception comes in two variants. On the one hand, the relational particularity states that particular items in the world—whatever they are—trigger our sensory and perceptual systems. It is the book on my desk that is causing my state of seeing it. On the other hand, phenomenological particularity states that we seemingly have a conscious perception as of particular items in the environment. (The distinction is due to Schellenberg 2016). A second requirement is that visual objects have a spatial-mereological structure (e.g. Mulligan 1999; Pinna & Deiana 2015). This character emerges clearly in the scientific literature, where visual objects are often said to be “complex wholes” (Treisman 1986) or «coherent, unified wholes»
1 Siegel (2010a, p. 71) puts forward a ‘Property View’, but she explicitly links it with the accuracy conditions of experience. In contrast with Siegel, and although I assume a representationalist framework in this work, I do not think that the content view can be derived only from the fact that we see properties. 80 Chapter 4: Facts, Sensory Individuals, and Sensory Reference
(Di Lollo 2012, p. 317). None of these two requirements is strong enough to uniquely identify the ontology of visual objects, as different and mutually inconsistent theories of objects can meet these two requirements.
In the remainder of this Chapter, I will use the terms “substance” and “object” as ontologically neutral between different theories. If we accept that there are properties—universals or tropes (cfr. Ch. 7)2—there are two groups of theories of objects: substance-attribute theories and bundle theories. According to the former theories, an object is an entity made by elements that belong to two different ontological categories, a substratum or “property bearer” and one or more properties (e.g. Armstrong 1997; Martin 1980). According to bundle theories, an object is fully analyzed by its properties structured in a compresence relation. Such properties might be universals (Russell 1940)—i.e. entities which are capable of being instantiated at multiple places at the same time—, or tropes (e.g. Campbell 1990; Ehring 2011, pp. 98-135; Maurin 2002; Robb 2005; Simons 1994; Stout 1921; Williams 1953)—abstract particulars, logically incapable of multiple instantiations (cfr. Ch. 7, §1.3)3. Facts are a paradigmatic example of the former view, whilst friends of tropes usually adopt a bundle view.
The psychological literature presents us with a striking lack of agreement on the question of what is a visual object. A first glance at the debate (for an excellent overview, see Skrzypulec 2015) will identify two camps that basically mirror the foregoing distinction between substance- attribute theories and bundle theories. Psychological models of vision focused on perceptual organization (e.g. Palmer 1999a, pp. 255-309) often define visual objects as bundles of features. Consider the following examples: Blaser et al. say that visual objects are «composed of constellation of visual features» (2000, p. 196); Pinna & Deiana (2015, p. 280) define a visual object as a «structured holder […] an organized set of multiple properties, some of which are explicit, some other implicit, some become explicit or, on the contrary, implicit or invisible after a while». These models usually focus on stationary phenomena (Skrzypulec 2015, p. 29), whereas models of visual objects that seek to explain their persistence and tracking within a dynamic context often embrace a substance-attribute ontology. This is for example the case of studies on tracking mechanisms—such as Pylyshyn’s (2007) FINST theory (see also §3.3). In these studies, reference to a substratum is justified in order to account for tracking of visual objects in spite of featural change.
2 It is perhaps worth emphasizing that, in the philosophical literature, the term “property” is often taken as synonym of “universal.” However, in this work I prefer a more neutral connotation: properties can either be universals or tropes. 3 Bundle theorists can spell out the relation between objects and properties in different ways. An object might just be identical with the bundle or supervene on it. Eliminativists argue that there are no objects, but only bundles of properties. All these options suggest that an object is somehow completely described by its properties. 81 Chapter 4: Facts, Sensory Individuals, and Sensory Reference
The two theories of visual objects provide a different articulation of the relation between PP and OP. Defenders of the bundle view will say that visual objects are structured wholes of properties. Defenders of substance-attribute theories will say that visual objects are composed of both a substratum and visual properties.
1.2 Facts
In the philosophical literature, “fact” is a term of art (Betti, 2015; Mulligan & Correia, 2013; Olson, 1987). Following Betti (2015), we can single out two concepts of facts: propositional facts and compositional facts. Propositional facts are true propositions (e.g. Frege, 1918). It is matter of debate whether in the case of seeing, propositional facts express a genuine perceptual state or rather a form of knowledge (e.g. Williamson 2000, pp. 33-41). Some philosophes maintain, however, that we see facts in this sense. A case in point would be Dretske who argued that there is a sense of seeing that requires a factive complement. He called this “seeing that” or “epistemic seeing” (Dretske 1969, 1979, 1993, 2010). In his words: «Facts are what we express in making true statements about things» (1993, p. 264). Compositional facts are not propositions but building blocks of reality, they are actual states of affairs (e.g. Armstrong 1997; Reicher 2009). In what follows, I will exclusively focus on compositional facts.
Understood in this sense, facts are sometimes contrasted with states of affairs, which are sometimes conceived as merely possible entities (Meixner 2009, p. 57). We can classify facts into two types (Armstrong 1997, pp. 28-29). They can either be particulars exemplifying properties—such as “a’s being F”—, or two particulars exemplifying a relation—as in “a’s having R to b” (Mulligan et al., 1984). In the remainder of this Chapter, I will mainly focus on facts of the former type (cfr. Ch. 7, §2.2). Fact’s particulars play many roles: they individuate objects if the properties are universals; they combine multiple properties into one object; they provide a basis for the existence of universals (at least within Armstrong’s ontology); and they preserve the object’s unity through property change. Sometimes, the particulars are called “substances” (Garcia, 2014) or “objects” (Fish, 2009). Since, as I specified in the foregoing, I take the terms “object” and “substance” as neutral between different theories, I will prefer the term “particular” in the case of facts.
Facts understood in this way are a sui generis kind of entity: they form a non-mereological unity over and above their simple constituents (Armstrong 1989, p. 88). The properties and relations that constitute a fact are usually understood as universals, at least according to the standard notion of facts (Armstrong 1997). This leads us to the problem of understanding how properties and particulars are glued together in a fact. Armstrong rejects a relational interpretation of the property-particular tie, on the ground that this would ensue an infinite regress. If a property is related R to the object, then the instantiation relation itself would need to be instantiated by another relation R2, and so on: in the philosophical literature, this is
82 Chapter 4: Facts, Sensory Individuals, and Sensory Reference known as Bradley’s regress. Armstrong contends that the regress can be stopped if there is some non-relational tie that holds between particulars and properties, he calls this non- relational relation “exemplification.” There is, in other words, an intimate (and «mysterious», Devitt, 1997, p. 98) connection between particulars and their properties. (Unsurprisingly, it is precisely this odd and apparently preposterous notion of non-relational relation, and the problem of accounting for the unity of facts that has courted the most controversies (Betti 2015; Vallicella 2000). The unity of facts is made by two constituents. It is only by means of a process of intellectual abstraction (Armstrong, 1997, p. 29) that we might obtain a particular without its properties—what is called a “thin particular”—, whereas particulars clothed with their properties are called “thick,” i.e. facts (Armstrong, 1989, p. 88; 1997, pp. 123-126; cfr. §4).
2. Factualism and Fish’s Argument 2.1 Factualism
A more precise formulation of factualism (FT) can now be given:
FT: States of seeing make manifest complex entities, i.e. facts, whose ontological constituents are particulars and properties.
Factualism articulates the relation between PP and OP in the following way: visual objects, i.e. the coherent clusters of visual properties, are facts. Since facts are composed by two kinds of entities, accepting factualism entails that the domain of the phenomenologically manifest embraces both visual properties and particulars. We can clarify this with an example, if FT is true, seeing a book being red means to see a unity composed of a particular (the book) and a property, being red.
At first glance, FT offers a plausible answer to the problem of visual objects. Facts meet the two phenomenological requirements (§1.1). Armstrong contends that facts are particulars—what he pompously calls the “victory of particularity” (1978, pp. 115-116; 1997, pp. 126ff)—, accordingly, facts can account for the particularity of perception, both relational and phenomenological (cfr. Ch. 7, §2). Moreover, although facts have a non-mereological structure, and the properties cannot stand in spatial relations, mereological relations can still obtain as external relations between facts (Armstrong, 1997, pp. 119-123). This means that even simple visual objects like a red apple would actually be composed by sets of multiple facts tied together by means of some spatial-mereotopological relation. Furthermore, in virtue of the non- relational tie (cfr. §1.2) none of these facts’ properties could be “related” to their particulars. Factualism is by no means the only alternative, and a trope bundle theory, to mention but one example, coheres equally well with the two phenomenological requirements. Tropes are unrepeatable qualities, logically incapable of being in multiple places at the same time unlike universals. In this sense, tropes can account for the particularity requirement. Moreover, bundles of tropes are often described as mereological sums (e.g. Ehring, 2011, p. 98ff). This 83 Chapter 4: Facts, Sensory Individuals, and Sensory Reference shows that we are not forced to accept factualism on the basis of the phenomenological requirements alone. Given that there are multiple accounts of visual objects, friends of factualism must ground their standpoint with a suitable argument.
Many philosophers take side with factualism, but very few, if any, have actually argued for this position. David Armstrong for example states that «[…] I think that they [facts] are the true objects of perception» (2009, p. 40), but he hardly provides any reason to think that it must be so besides laconically commenting that perception is an «information-gathering apparatus and it tells us about the current state of our environment and our body» (ibid., pp. 40-41). Of course, Armstrong’s words must be embedded within his broader project of constructing a fact ontology; after all, according to him, we live in a world of states of affairs. But notice that there is no obvious reason for thinking that, even if we actually live in a world of states of affairs, we must be able to see facts. Tye and Loux have suggested some kind of flimsy arguments for factualism. Michael Tye states that he has been «transfixed by the intense blue of the Pacific Ocean» (1992, p. 160), whereas Michael Loux says that when focusing on «the colour of the Taj Mahal, I am not only thinking of pinkness in general, but of that unique pinkness, the pinkness that only Taj Mahal has» (2002, p. 86). William Fish interprets these passages as suggesting that when we see objects, we see both the objects and their specific property instances (2009, p. 22). Tye’s and Loux’s claims apparently have no other motivation than mere phenomenological or introspective observation, and while this may appear plausible on a first reading, it rests on dubious evidential support (see below).
Arguably, another defender of FT is McDowell:
That things are thus and so is the conceptual content of an experience, but if the subject is not misled, that very same thing, that things are thus and so, is also a perceptible fact, an aspect of the perceptible world (1994, p. 26).
The correct interpretation of McDowell’s commitment to facts is under dispute. The source of the controversy consists in McDowell’s identity conception of truth. According to the identity conception, a proposition is true iff it is identical with a fact (McDowell 2001). This is in contrast with correspondence theories of truth according to which facts are extralinguistic items that make propositions true, i.e. they are truthmakers. It has been argued (Dodd 1995) that McDowell in his work conflates different versions of the identity theory of truths, a robust theory—according to which facts are conceived as compositional facts—and a modest theory— according to which facts are conceived as Fregean Thoughts that have senses, rather than objects and properties, and therefore are not part of the world. Suhm et al. (2000) starting from Dodd’s remarks, have articulated a criticism of McDowell’s conception as ontologically unstable between different notions of facts, rather than identity theories of truths. I will not dwell on an exegesis of McDowell’s stance. It suffices to observe that if McDowell’s understanding of facts is
84 Chapter 4: Facts, Sensory Individuals, and Sensory Reference closer to the Fregean reading, then it does not bear on our present concern, since my purpose is to determine the ontology of visual objects. Things, however, are different if we interpret the «perceptible fact» in the Russellian or Tractarian sense: as a compositional fact. But if this is the correct reading, then nothing in McDowell’s passage, or in the whole work, supports the claim that facts are perceptible, unless one interprets it as espousing the same thought at the base of the truthmaker argument for facts (Armstrong 1997).
According to the truthmaker argument, facts are introduced in our ontological inventory in order to serve as truthmakers of our propositions, i.e. the things in virtue of what a proposition is true. Within the identity conception of truth, however, there are no truthmakers, as the truth- bearers, the propositions or Fregean Thoughts, are simply identical with the thing itself. This suggests that, if McDowell interprets facts in the compositional sense, he may be simply translating compositional facts within his identity conception. Notice, however, that the truthmaker argument for facts is hardly conclusive of their existence, as shown by Betti (2014, 2015). Strictly speaking, there is no reason as for why facts should be the unique truthmakers of our propositions, or even whether there must be truthmakers at all, given that one could opt for some version of the correspondence theory of truth. Finally, let me observe that even accepting the truthmaker argument for facts it does not obviously (or trivially) force us to think that visual objects are facts, for the only way to determine the ontological status of visual objects is to observe more closely the nature of perception and the capacities of our perceptual system.
2.2 William Fish’s Argument for Factualism
Perhaps, the most interesting argument for factualism has been put forward by William Fish in his 2009 book: «[…] the basic units that feature in presentational character are not properties and objects simpliciter, but rather object-properties couples» (2009, p. 52). He then calls such couples ‘facts’: «[…] I prefer the more metaphysical term ‘facts’» (ibid.). (Here, the term ‘object’ stands in for ‘particular’). Fish’s argument for factualism consists of two steps. The first step is phenomenological. Fish mentions Firth’s observation that «[…] the qualities of which we are conscious in perception are […] presented to us […] as the qualities of physical objects» (1965, p. 222; quoted in Fish, 2009, p. 51; cfr. also Shoemaker, 1990, p. 109). Call this the phenomenological claim. In addition, he maintains that experimental studies on object perception would support factualism. More specifically, he makes reference to studies on multiple object tracking (Blaser et al., 2000), and to Matthen’s (2005) comments on dynamic feature-object integration: «Mohan Matthen has also argued that certain empirical results are adequately explained only on the assumption that we do not see properties or qualities simpliciter, but rather see objects bearing properties» (Fish 2009, p. 51), and «[…] these empirical considerations are adduced as further support of the idea that the basic constituents of presentational character are not objects or properties per se. Instead, they provide additional
85 Chapter 4: Facts, Sensory Individuals, and Sensory Reference reasons to think that to see a property is to see it as inhering in some object or other» (p. 52). Call this the scientific claim. Fish’s argument can be schematized as follows:
(S1) Phenomenological claim: States of seeing make manifest visual properties attributed to objects.
(S2) Scientific claim: Experimental evidence suggests that we see objects having properties.
(C) FT: States of seeing make manifest facts to the perceiver.
(Recall that Fish uses the term “object” whereas I prefer the term “particular”). The argument assumes that we see properties (PP), and that we see visual objects (OP). I have not regimented the steps within a rigorous logical structure. It is possible to rearrange the steps, perhaps adding additional premises to construct a formal argument. My purpose however is not to attack the logical construction of Fish’s argument. Instead, I will address the argument from a different standpoint. In the remainder of this section, I will briefly discuss S1, showing that Fish’s use of the term “object” in the sense of “facts’ particulars” is merely stipulative. In the next sections (§§3-4), I will show that Fish’s scientific claim is false.
Concerning S1, Fish’s claim is not different from the apparent justification for factualism put forward by Tye and Loux. However, upon closer inspection, it can be easily shown that S1 merely expresses our problem, for it does not determine a specific theory of visual objects, but merely states that there is a relation between PP and OP. In other words, the term “object” in S1 is far too vague to support factualism or any other theory of visual objects (Ayers 2004, p. 255). There are at least two possible readings of “object” as I have explained in §1.1. On one reading, an object is just a bundle of features. The alternative reading is that an object is a particular in the fact’s sense (§4). Clearly, Fish seems to take the second reading as obvious. However, visual phenomenology can hardly be taken as an unmistakable source of evidence, as an extensive literature shows (e.g. Dennett, 1991; Schwitzgebel 2011). Moreover, philosophers have found both readings plausible on purely phenomenological grounds. For instance, Mark Textor maintains that: «Seeing x [a visual object] is constituted by seeing features, states or changes of x and additional factors» (2009, p. 141). In other words, there are multiple ways to carve up and describe the phenomenologically manifest. Fish’s use of the term “object” in S1 is therefore merely stipulative.
The fact that there are different ways to describe the phenomenologically manifest brings to the forefront the worry that the different phenomenological readings of S1 might just be a clash between irreducible intuitions. Fish’s argument, however, gives us an interesting perspective on our issue, since the scientific claim provides a non-phenomenological way to examine the ontology of visual objects.
86 Chapter 4: Facts, Sensory Individuals, and Sensory Reference
3. Sensory Individuals and Sensory Reference 3.1 Binding and Places
The experimental evidence that, according to Fish, would support FT is drawn from the literature on the problem of feature-object binding. The problem is that of understanding how different visual properties are attached to the same individual (Clark, 2000; Treisman, 1996; cfr. also Jackson’s “many properties problem,” 1977, pp. 64ff). The assumption is precisely that we see visual objects in the sense defined above (§1.1), independently from the more specific question of their ontological character. In other words, visual objects are the explanandum of the feature-object binding problem.
Every philosopher interested in perception should provide an account of the (re-)presentational binding problem, i.e. explain how visual properties are clustered around visual objects. This is quite a different thing from providing a neural solution of the problem, i.e. to explain how the brain actually implements the binding of different features into one single individual (O’Callaghan, 2008; Plate, 2007; Revonsuo, 1999; Tacca, 2010, pp. 57-66; Treisman, 1996). Here I will focus on the theoretical solutions, and not on their effective neural implementation. To bring the problem into sharper focus, consider the following:
(1) S sees something red. (2) S sees something triangular. (3) S sees something both red and triangular (a red triangle).
Clark (2000) observes that (3) does not follow from (1) and (2). And the problem becomes even more pressing if we introduce in this scenario yet another object being, say, blue and circular. How could then S tell that the circle is blue and the triangle is red? To explain how (1) and (2) are bounded together to form S’s state of seeing a red triangle, Clark proposes a theory of sensory individuals (the term is due to Cohen, 2004). On this theory, solving the binding problem requires that the extracted distal features must be ‘attached’ to one and the same entity, i.e. a sensory individual.
What are sensory individuals? According to Clark (2000, pp. 164ff), sensory features are predicated of specific places (cfr. also Strawson, 1959). S is seeing redness and triangularity here, and blue and circularity there. To borrow Evans’ terminology, location in space would provide the «fundamental ground of difference» (1982, p. 107) that attributes the features to the same individual (Clark 2004, pp. 136-144). Binding sensory features to places seems an attractive solution, for it apparently accounts well also for the spatial location of visual objects. Yet, Clark’s feature-placing theory is at odd with the experimental evidence (Cohen 2004; Matthen 2004, 2005; Pylyshyn 2007; Siegel 2002; for an overview, see also Nanay 2013, pp. 50- 52). As we have seen, in his argument, Fish makes reference to two fatal issues for the feature- 87 Chapter 4: Facts, Sensory Individuals, and Sensory Reference placing hypothesis: the theory cannot account for binding of co-located objects (Blaser et al. 2000), and it cannot account for dynamic feature-object binding (Matthen 2005). These two issues ultimately led philosophers and psychologists into thinking that sensory individuals must be objects, rather than places (Cohen 2004, p. 480).
3.2 Sensory Individuals as Material Objects
I will now briefly discuss the two challenges for the feature-placing theory. I begin with superimposed objects (§2.2.1), and then turn to dynamic feature-object integration (§2.2.2). Fish mentions both experiments as part of his scientific claim.
3.2.1 Superimposed Objects
A problem for Clark’s feature-placing theory is that it is unable to account for feature-object binding when two objects have the same location. This is shown in a series of important experiments by Blaser, Pylyshyn and Holcombe (2000) on multiple object tracking (see also Cohen 2004; Matthen 2005, pp. 278ff; Pylyshyn 2004).
Blaser and collaborators have investigated the visual system’s ability to track distinct visual objects within the same spatio-temporal trajectories. In the experiments, subjects observed two superimposed circular striped “Gabor” patches transparently layered on one another, without noticeable separation in depth (2000, p. 196). (Fig. 9). The Gabors underwent different changes, for example spinning clockwise and then counter-clockwise, or changed saturation, from gray and black stripes to red and black stripes. The featural changes occurred without any change in location, thus testing whether object perception essentially involves the location of features. Blaser and colleagues found that the observers reported that the Gabors were perceptually segregated, in a way similar to figure-ground segmentation. The attended Gabor stood out in the foreground, whereas the distractor Gabor receded in the background. Moreover, the experimenters found that featural attention enhanced processing of the Gabor’s features as a whole. From this, Matthen infers that the observers «were attending to features by attending to the objects to which these features were attributed, and not by attending to the features directly» (2005, p. 281).
Since subjects were able to discriminate two superimposed but distinct Gabor patches, some philosophers conclude that sensory individuals cannot be places (Matthen 2005). The binding of features seems to be object- rather than place-centered.
88 Chapter 4: Facts, Sensory Individuals, and Sensory Reference
Fig. 9: Two Gabor patches. In Blaser et al.’s (2000) experiment, the two Gabors were superimposed.
3.2.2 Dynamic Feature-Object Binding
Apparently, the feature-placing hypothesis is also unable to account for dynamic feature-object binding. Matthen (2005, p. 282) states that the perception of change or of motion demands an identity that underlies change, and locations cannot provide such an identity (Siegel 2002). He illustrates this point by means of the φ-phenomenon.
The φ-phenomenon is a paradigmatic example of illusory movement (Dennett 1991, pp. 114ff; Goodman 1978; Wertheimer 1912). In this experiment, a subject observes a screen upon which an image—say, a white dot—is shown on the left side. A second image—say, an identical white dot—is then shown on the opposite side of the screen. In two different experiments, the researchers change the interstimulus interval between the offset and onset of the two dots. The suitable interstimulus interval depends on the spatial separation of the two items, but the phenomenon is often tested between 50 and 200 msec. (Arstila 2016). In a first experiment, with an interval of c.50 msec. subjects will likely see two flashing dots. However, if the interstimulus interval is increased to c.150 msec., subjects will likely see illusory motion, where one white dot appears to be moving from left to right. Kolers & Von Grünau (1976) devised an interesting variation of this experiment by changing the color of the second dot. If the interstimulus interval is c.150 msec., subjects will see one single dot, moving from left to right and changing color halfway, say, from white to red.
Matthen contends that this phenomenon brings evidence against Clark’s feature placing theory. Our visual systems are sensitive to motion, but motion cannot be attributed to places. Suppose that features are place-indexed, like “red and circular here,” where “here” is the sensory individual: What does it mean to say that “here” moves? Regions of space do not move, and therefore cannot be sensory individuals. Matthen takes this to show that vision is committed «to an ontology of material objects» (2005, p. 281)4. He defines a material object as a «spatio- temporally confined and continuous entity that can move while taking its features with it» (2005, p. 281). Vision thus «attributes features to material objects» (Matthen, 2005, p. 280). Furthermore, he maintains that if material objects can undergo a qualitative change—like
4 Calling such items ‘material’ objects may cause confusion, since we also see shadows, rainbows, etc. (cfr. §1.1). However, Matthen’s definition of material objects is broad enough to include perceptual ephemera (cfr. O’Callaghan, 2008, p. 816). 89 Chapter 4: Facts, Sensory Individuals, and Sensory Reference changing color—and yet they can be tracked, then sensory individuals must be something like substances as defined by Aristotle:
It seems most distinctive of substance that what is numerically one and the same is able to receive contraries. In no other case could one bring forward anything, numerically one, which is able to receive contraries. For example, a color which is numerically one and the same will not be black and white […]. A substance, however, numerically one and the same, is able to receive contraries. (Categoriae 5, 4a10) (Aristotle 1963, p. 11; Matthen 2005, p. 281).
This suggestion is not meant to define the ontology and metaphysics of visual objects. Matthen simply wants to show that properties are attributed to objects, rather than to places. Notice however that it is far from clear whether the visual system attributes or predicates properties of objects. I will explore this issue in the next sections (§4.2.2, §5.1-2).
3.3 Sensory Reference
The experiments selected by Fish and their interpretations reflect a particular conception of visual experience that finds many adherents among philosophers (e.g. Cohen 2004; Matthen 2005; Pylyshyn 2007). According to this conception, vision would be a two-layered process. At a basic level, we find mechanisms that track material objects. At later stages we find mechanisms responsible for (re-)presenting the object’s features and thus make visual objects consciously manifest (§1.1). It is this picture that arguably fuels Fish’s scientific claim: first, some mechanism identifies an object in the world, and then some mechanisms attribute properties to it (§2). The result is that we see «object-properties couples», i.e. facts. Given its relevance in the present context, I will describe this “two-layers” conception in more details by focusing on its paradigmatic incarnation: Pylyshyn’s FINST theory.
Pylyshyn (2007) has developed a theory of tracking mechanisms that he calls “FINST”—from “FINgers of INSTantiation”—or “visual indexes” (2007, p. 13). The gist of this theory is that we possess a limited number of FINST mechanisms (four or five), whose function is that of tracking material objects in the environment. (Pylyshyn calls the sensory individuals FINGs— from FINSTed THINGs (p. 56)—, but they are equivalent to Matthen’s material objects). On this account, material objects are said to “grab” a FINST in virtue of some property that allows a causal connection (p. 68). Pylyshyn argues that the FINST mechanisms are pre- representational and pre-conceptual: they merely register or detect the presence of an object, without representing any of its properties (pp. 74-75, p. 94). Pylyshyn’s theory is, however, sometimes unclear about how material objects grab a FINST. On the one hand, he seems to contend that sensory reference is fixed by means of physical properties or spectral properties of the light striking the retinas (Burge 2010, p. 89). Such properties, however, would not be encoded (represented) (Pylyshyn 2003, p. 219). On the other hand, he contends that sensory 90 Chapter 4: Facts, Sensory Individuals, and Sensory Reference reference is fixed not by means of these physical properties, but by the bearer of the properties itself (2007, p. 96). What is clear is that tracking mechanisms have precisely the role of fixing sensory reference in a way that resembles the role of demonstratives in language (p. 95). For example, in the proposition “This is red” the predicate “red” is attributed to the demonstrative “this.” Vision would have an analogous structure: first index mechanisms fix sensory reference to an undefined material object x and then higher-order mechanisms attach visual properties to it. As Pylyshyn says: «[p]roperties are predicated of things» (2003, p. 201).
It should be noted that this ‘two-layers’ conception of vision and visual processing is not the standard account in vision science. One reason to cast doubt on it is that there is ample evidence that processing of features begins very early, already on the retina. Features such as color or motion are extracted and processed in a hierarchy of topographic maps that preserve, to an extent, the spatial arrangement of the proximal stimulus (e.g. Op de Beeck et al. 2008; Silver & Kastner 2009; Somers & Shermata 2013; Wanderll et al. 2007). This of course does not amount to a rejection of Pylyshyn’s theory, but it may call into question the idea that features cannot fix sensory reference (§3.2; §4.2, §5.2).
Let us return to our central issue, for we have now acquired some precious insights that can help us determine the ontology of visual objects. More specifically, we know that:
a. A material object grabs a tracking mechanism. b. A material object unifies different properties as belonging to the same individual. c. A material object remains constant through featural change.
Whatever material objects are, they must fulfill these three roles. From an ontological point of view, however, it is clear that any theory of object will articulate an account of roles b-c. As we have seen, a central line of argument for defenders of the “material object” view of sensory individuals is based on their role in fixing sensory reference (a). Recall that Fish’s interpretation of the experimental evidence suggests that our visual system first identifies an object and then attributes properties to it. I will later (§4.2, §5.1-2) argue that there are good reasons to cast doubt on this ‘property-attribution’ model. For expository reasons, I will refer to the two-layers conception, mainly because it seems to fuel Fish’s intuition. I will thereby show that whether we accept or not this conception, we cannot find any scientific support for factualism. In order to articulate my argument, we will first need to make explicit some criteria of ontological commitments.
4. Tracking and Seeing Facts?
91 Chapter 4: Facts, Sensory Individuals, and Sensory Reference
4.1 Two Ontological Criteria
Our ontological inventories are always ad hoc with regard to a specific set of problems (Betti, 2015, p. 62): we introduce a new kind of entity in our discourses because we need it to elucidate or explain a particular problem. Of course, this does not mean that any entity can be freely added without following any criterion. Betti (ibid., pp. 62-63) puts forward two elegant criteria. The first criterion is simple: if the problem we want to solve is not genuine—perhaps, it is generated by wrong assumptions—, we do not need to solve it, and hence, we do not need to introduce any new entity. If the problem is genuine, so goes the second criterion, we can first try to solve it with the tools we already have in our ontological inventory. If our ontology does not sufficiently account for the problem, we can vouchsafe the new entity a place in our ontological inventory.
Let us start with the first ontological criterion. Our question is: Is the problem that facts are meant to solve a genuine one or not? I see at least two ways to show that the problem might not be a genuine one. The first way is to show that sensory individuals cannot be material objects, whilst the second way is to show that we can explain object perception without sensory individuals. If we opt for the first way, we are then led back to the question of what a sensory individual is. As we know, the choice is between objects and places (§3.1), but as we have seen (§3.2), the experimental evidence favors an object theory of sensory individuals. Certainly, this does not exclude that there might be a third option according to which sensory individuals are neither objects nor places. However, no third option is discussed in the literature, and it is therefore not possible to evaluate any alternative proposal with regard to our issue. In the absence of an alternative theory of sensory individuals, it is therefore more plausible to accept that sensory individuals are objects.
Let us examine our first criterion. We have seen that sensory individuals play a central role in Fish’s argument. There are at least two ways to show that the problem is not genuine. First, one may show that sensory individuals cannot be material objects. This option brings us back to the problem of what a sensory individual is. Some researchers may argue that the foregoing experiments do not refute the feature-placing hypothesis. One way to salvage this view is to observe that, although Blaser et al. show that the overlapping 2D retinal projections of superimposed objects cannot fix sensory reference, this does not represent a problem for the visual system, as it does not rule out that 3D places in the world may be the sensory referent. (I thank a reviewer for this suggestion). I will not further develop this proposal here (cfr. also §5.2), mainly because it is not sufficient to solve our problem. As long as we think that the visual system identifies a “something” of which properties are predicated—such as “a’s being F”— factualism remains a viable option.
92 Chapter 4: Facts, Sensory Individuals, and Sensory Reference
The second way to show that the problem is not a genuine one is more radical: perhaps, we do not need sensory individuals to fix sensory reference and bind features. We may for example reject the binding problem (e.g. Garson, 2001). Di Lollo (2012) has argued that recent advancements in neuroanatomy and neurophysiology refute the idea of modular specificity and independence that generated the binding problem in the 80s. He suggests that basic features are the units of information against which high-level perceptual hypotheses are compared (ibid., p. 318). Di Lollo’s remarks seem to point against the neural solutions to the binding problem, i.e. perhaps, we do not need any special neural mechanisms that bind different features. However, as I said (§3.1), I remain silent on the actual neural implementation of binding. Furthermore, Clark’s elegant theory of sensory individuals is that these are items in the world that carry properties. This means that even if we reject the neural binding problem, we still need to show how items in the environment are detected and tracked.
In light of Betti’s first criterion, we can conclude that we are facing a genuine problem: how perceptual items solve the problem of property binding and how they are individuated and tracked. It is the latter problem that will play a central role in my argument (§4.2): Does the visual system identify items to which properties are predicated? I will examine this question in light of Betti’s second criterion.
4.2 Material Objects as Particulars
As we have seen, Fish maintains that the experimental results can be explained on the assumption that we see object-properties couples (2009, p. 51). This suggests that he interprets Matthen’s material objects as facts’ particulars. According to Fish (ibid., p. 52), such particulars would be manifest in states of seeing together with their visual properties. Facts’ particulars can either be “thin” or “thick” (§1.2). I explore both options. I call the former option “Fact Thesis 1” (FT1) and the latter option “Fact Thesis 2” (FT2):
FT1: Material objects are thin particulars
FT2: Material objects are thick particulars.
Next, I will examine FT1, and then (§4.2.2) turn to FT2.
4.2.1 Tracking Thin Particulars?
Since thin particulars are abstractions, they can only be given in thought. But if they are objects of thought, it is unclear how they might play a role in perception. Perhaps, one might claim that tracking and individuation mechanisms possess some basic conceptual capacities. Such mechanisms would be able to identify a fact and track the thin particular. This strategy does not seem very promising. On Pylyshyn’s account of FINSTs, tracking mechanisms do not possess any conceptual capacity. Hence, FINST mechanisms cannot identify facts and track thin 93 Chapter 4: Facts, Sensory Individuals, and Sensory Reference particulars. But even if we do not accept Pylyshyn’s account, the idea that tracking mechanisms have some rudimental conceptual capacity is obscure5. Suppose some mechanisms were able to identify a fact, why should it conceptually subtract properties from it?
Suppose, for the argument’s sake, that the previous issue can be solved, and concede that somehow tracking mechanisms can identify thin particulars. If this were the case, it would be utterly unclear in virtue of what tracking mechanisms can detect a particular among many others. Let me explain. Fish (2009, pp. 54-58) states that our visual field embraces many distinct facts. But if there are many facts within the visual field, and tracking mechanisms can only identify and track few items (four or five, §3.3), how can they individuate the relevant particulars? Remember that a thin particular does not instantiate any property, so it cannot be distinguished from other particulars (§1.2). (For a somewhat similar point, cfr. Campbell, 1990, pp. 7ff). We can make this point clear by means of an analogy with the well-known phenomenon of vision in a Ganzfeld (Avanti, 1965). As we know, exposure to a structureless, qualitatively homogenous visual field results in a ‘mist of light’ or ‘empty field’ experience that defies ordinary visual experiences. Nothing is seen within a Ganzfeld. The problem with thin particulars can be understood as the converse of the Ganzfeld experience. Whereas in a Ganzfeld subjects do not see anything due to exposition to a qualitatively homogeneous field, thin particulars cannot be detected because they lack any property that might discriminate them from the background and other thin particulars.
These considerations are broadly consistent with the idea that «to recognize or otherwise analyze a visible object in the world, we must first distinguish it as a primitive individual thing, separate from the other clutter in the visual field» (Pylyshyn 2003, p. 210). Thin particulars cannot be detected because they lack a character that differentiates them from other particulars and allow tracking mechanisms to individuate them. It is worth bearing in mind that this is not an argument against the existence of thin or bare particulars. There might be metaphysical reasons to postulate thin or bare particulars. But even if thin or bare particulars exist, they cannot fix sensory reference.
At this juncture, friends of factualism may raise an objection: facts are complex entities made by particulars and properties. To think that sensory mechanisms track thin particulars is a misunderstanding of factualism and fact ontology. This brings us to FT2.
5 There is a long-standing controversy over conceptualism about perceptual experience (e.g. Heck, 2000; Wright 2015). The issue here is not whether perceptual content is conceptual or requires conceptual skills. Perhaps, content really is conceptual ‘all the way down’ (McDowell 1994). The point is whether some causal mechanisms do possess the conceptual capacity to metaphysically decompose a complex entity, a fact, into its constituents and track thin particulars. 94 Chapter 4: Facts, Sensory Individuals, and Sensory Reference
4.2.2 Tracking Thick Particulars?
A thick particular is a fact, a particular instantiating one or more properties. Obviously, FT2 assumes that facts exist—and their existence is assumed on metaphysical grounds—, but even if we concede that there are facts, it is certainly far from obvious that we see facts! Even if we accept that objects are facts, in order to defend factualism (§2), it must be argued that not only we detect particulars and properties, but that the former, too, must be manifested in states of seeing. Only in this case we would be able to see “[particular]-properties” couples. Factualism thus entails an extension of the ontological inventory required to describe what is “phenomenologically manifest” in a state of seeing. In this paragraph, I argue that perceptual psychology gives us no reason to expand the ontological inventory to include “particulars.”
Earlier (§3.3), I have discussed Pylyshyn’s view that vision would have a structure somewhat similar to language. The ‘two-layers’ conception has it that visual demonstratives cannot be features, since the latter are encoded only at later stages of visual processing. Pylyshyn takes the evidence from dynamic feature-object integration (§3.2.2) as showing that we can track an object in spite of featural change, and argues that visual properties therefore cannot be the referring element of tracking mechanisms (Bahrami, 2003; Pylyshyn, 2007, p. 68; Scholl et al., 1999)6. He therefore suggests that tracking mechanisms are grabbed by some physical properties of the material objects. These properties causally connect a material object with a tracking mechanism. What kind of physical properties can grab a tracking mechanism is matter of empirical investigation (Pylyshyn, 2003, p. 211).
There are two possible interpretations of FT2. The first interpretation follows Pylyshyn’s account and admits a distinction between physical and visual properties. The second interpretation admits that visual properties may fix sensory reference. We thus obtain:
FT2*: Material objects (particulars) instantiate both physical and visual properties7.
FT2**: Material objects (particulars) instantiate visual properties.
6 An anonymous reviewer has pointed out to me that Pylyshyn is actually much more cautions in denying that features can be visual demonstratives. In a passage, Pylyshyn actually states that the speed of objects’ motion or the rate at which they change direction seem to play a role in fixing sensory reference (2007, p. 68, ft. 2). However, he also adds that these properties too «do not appear to be encoded» (i.e. represented). 7 This formulation, which is consistent with Pylyshyn’s theory, includes a conjunction of both physical properties and features. Both must obtain in order for us to see the object. Remember that, on this theory, if no physical properties are given, index mechanisms cannot fix sensory reference, and hence, nothing can be detected. If physical properties are given, but no features, then the object can be detected, but it cannot be seen, as features are constitutive of states of seeing (§1.1). 95 Chapter 4: Facts, Sensory Individuals, and Sensory Reference
Consider FT2* first. Since features do not fix sensory reference, something else must do it. Two options are available. The first option is that physical properties are tracked. Material objects are identified by the visual system in virtue of some physical property, although such properties are neither represented nor accessible in states of seeing. The second option is that the particular itself is being tracked. In some passages, Pylyshyn adumbrates this second option, for example: «[…] if the FINST was captured by a property P, what the FINST refers to need not be P, but the bearer of P (the [material object] that has property P)» (2007, p. 96); and: «I take the view that objects are indexed directly, rather than via their properties or their locations» (2003, p. 202)8. This is unclear. The claim can be interpreted as saying that, when a material object grabs (thanks to some physical property) a tracking mechanism, such a mechanism refers to the bearer of the property itself. The bearer might be the ‘thin’ particular (but why not a bundle of properties?), but in this case, we are confronted again with the challenges already discussed earlier about FT1 (§4.2.1). Indeed, it us unclear how tracking mechanisms may pick out a ‘property bearer’, were it not for some property. Of course, this claim is compatible with the visual system being able to track a cluster of properties, rather than a single property. But this suggests that such properties are all we need to pick out and track items in the world!
Now, suppose that Pylyshyn’s theory is false, and that although features alone do not fix reference, it is always a conjunction of both physical and visual properties that allow object detection and tracking. On this reading, some properties may become conscious and appear in states of seeing, whilst other properties are neither represented nor can they become conscious. Pinna & Deiana’s (2015) definition of visual objects squares well with this suggestion; a visual object is a «structured holder […] an organized set of multiple properties, some of which are explicit, some other implicit, some become explicit or, on the contrary, implicit or invisible after a while». (p. 280). This is an intriguing option, but it does not support factualism is any way. Again, property instances are all we need to detect and track objects.
Consider now FT2**. As I said, most vision scientists believe that the processing of features starts already on the retina (§3.3). Perhaps, features can causally affect the visual system in such a way as to fix sensory reference. If this were correct, we would need some alternative interpretation of the experiments on multiple object tracking or dynamic feature-object integration (§3.2.1-2). I will outline an alternative strategy in §5.2. For now, what matters is that, again, properties are all we need to fix sensory reference.
8 These passages are ambiguous, but Pylyshyn also stresses that «there must be some properties that cause index assignment and that make it possible to keep track of certain objects visually— they may just constitute a very heterogeneous set and may differ from case to case» (2003, p. 213), thus suggesting the first interpretation (physical properties are tracked).
96 Chapter 4: Facts, Sensory Individuals, and Sensory Reference
Under all interpretations, Betti’s second ontological criterion suggests that we do already have all the indispensable ontological tools to explain sensory reference. There is no need, nor the problem of sensory reference suggests us to do so, to introduce an ontologically distinct ‘particular’ to which properties are attributed. All we need are property instances. A property instance is simply a particularized property sample: it is “that shade of red” or “that triangular form.” As I am using it, the term “property” is ontologically neutral: it may be a universal instantiated by some particular (§1.2); or it may be a trope. It is here that the scientific evidence stops. Perceptual psychology does not tell us how to particularize a property. All it tells us is that property instances are all we need to fix sensory reference. Once sensory reference is fixed, thanks to a qualitative discontinuity in the environment, the visual system starts extracting properties from the target. Indeed, the literature on object perception suggests that the visual system first represents property clusters, and then categorizes these clusters as either a face, an object, a building, etc. (e.g. DiCarlo et al. 2012; Grill-Spector, 2003; Op de Beeck et al. 2008). How object recognition works, and whether it presupposes or supports the ‘rich content view’ (e.g. Newen, 2016), is an issue that cannot be addressed here. The main lesson is that the problem of sensory reference does not entail that vision is a process of property attribution to a “particular.”
From these observations we can draw several implications. I will outline some of them in §5. In the next paragraph, I briefly return on Fish’s argument.
4.3 Fish’s Argument Revisited
Fish’s argument for factualism consists of two claims (§2). The first one (S1) is the phenomenological claim: we see visual properties as properties of objects. The problem with the phenomenological claim is that phenomenology does not provide robust evidence for any particular conclusion about the nature of visual objects (§2). On the very same phenomenological grounds, other philosophers may argue for a bundle view of visual objects.
The scientific claim (S2) is based on an interpretation of experiments on object tracking and the feature-binding problem (§3). Fish thinks that these experiments support the idea that we see particulars bearing properties. I have shown (§4.1-2) that perceptual psychology does not support factualism. All we need to fix sensory reference are property instances. Fish’s factualism is thus unwarranted: neither S1, nor S2 provide evidence for factualism.
Before I conclude, in the next section (§5) I will clarify the distinction between visual and material objects (§5.1), outline an alternative explanation of the experiments discussed in §3, and briefly draw some implications about the nature of perceptual content.
97 Chapter 4: Facts, Sensory Individuals, and Sensory Reference
5. Visual objects, Tracking, Binding, and Content
The arguments developed in §4 touch on issues like object perception and the nature of the phenomenologically manifest. I group the implications of my conclusions into the following subsections. In §5.1, I discuss the distinction between material and visual objects. In §5.2, I briefly suggest and alternate solution to the problem of tracking and binding. Finally, in §5.3, I draw some sketchy implications for the theories of perceptual content.
5.1 Material and Visual Objects
In §1.1, I said that factualism is one possible answer to the puzzle of visual objects. An alternative view is to say that visual objects are bundles of properties. From this disjunction, applying our conclusion, we can see that my considerations provide support for the bundle view. There is no scientific support for factualism. But perceptual psychology supports the idea that that property instances are all that enters in a perceptual relation with the subject.
At this point, the reader may feel confused about the distinction between material and visual objects, for I apparently jumped from discussing of tracking material objects to visual objects. Earlier (§3), I have introduced the concept of material object, defined as a «spatio-temporally confined and continuous entity that can move while taking its features with it» (Matthen, 2005, p. 281). Material objects are things in the world. Visual objects, on the contrary, are the coherent units that are made manifest in states of seeing. On my characterization, visual objects are bundles of properties. From this, we cannot conclude anything about the ontological status of material objects. We should not expect our perceptual capacities to reveal the metaphysical status of things in the world, and neither is the metaphysical and ontological status of material objects a problem for perceptual psychologists or philosophers of perception. For all we (perceptually) know, a material object may be a bundle of properties, or a fact, of which we only see some properties. The relation between visual and material objects is graphically displayed in Fig. 10.
The picture shows a material object (the apple) and the visual system (the brain). The visual system is in contact with some of the material object’s property instances, regardless whether they are features or physical properties. (Of course, we should assume that many of an object’s properties are not, even in principle, perceptually accessible). The visual object is constituted in part or entirely by the extracted visual properties. This claim finds also support in the scientific literature on visual objects: Blaser et al. say that visual objects are «composed of constellation of visual features» (2000, p. 196). Here we should use some caution. My claim should not be confused with the stronger—and likely false—claim that all we need to explain object perception are properties. Other factors may play a role, like memories and semantic categorization that have been shown to influence visual processing even at an early stage (e.g. Grill-Spector & Kanwisher, 2005). 98 Chapter 4: Facts, Sensory Individuals, and Sensory Reference
Fig. 10: Material and visual objects. The perceiver tracks some properties of the material objects, and few of them are extracted in order to form a descriptive state.
Finally, the exact ontological distinction between material and visual objects depends on our assumptions about the nature of perception. Naïve realists like Fish usually hold that we have a genuine direct acquaintance relation to items in the world. In this case, the perceiver is in direct contact with the material object’s properties themselves. Visual objects would then be bundles composed by these properties. Intentionalists (e.g. Siegel 2010b) argue that states of seeing have conditions of accuracy. In this case, the perceiver may be representing these properties. Thus, visual objects would be bundles of represented properties. In both cases, we can draw a distinction between visual and material objects.
5.2 Tracking and Binding
The foregoing considerations have some implications for the role of sensory individuals (§3.1). I first consider their role in object tracking, and then turn to their role in the feature-object binding.
As we have seen (§3.2) Matthen, following Pylyshyn, thinks that since features cannot fix sensory reference, something like a ‘substance’ must play this role. If ‘substance’ is interpreted as “particular” in the fact’s sense we are then confronted with the challenges discussed earlier (§4). In this work, it is not my purpose to articulate an alternative account of sensory reference, and what kind of things may fix it. But my anti-factualist conclusion is compatible with all three different options outlined in §4.2, namely, sensory reference may be fixed by: physical properties, features, or both. In all cases, a visual object will be a property bundle, and in neither case we have evidence for Fish’s scientific claim (§2). A plausible alternative could be to say that sensory reference may be fixed not by a single property, but by a property cluster
99 Chapter 4: Facts, Sensory Individuals, and Sensory Reference
(physical, visual, or both)9. The properties may thus collectively fix sensory reference. Consider a simple case of seeing two distinct objects, item 1 and item 2. We thus have:
! ! ! ! Item 1: {!! ∨ !! ∨ !! … !!}
! ! ! ! Item 2: {!! ∨ !! ∨ !! … !!}
On this formulation, a disjunctive cluster of properties fix sensory reference. Not all properties may be required, but perhaps just a collection of heterogeneous properties. If this cluster is an object, this will depend on a number of other assumptions, both regarding the ontology of visual objects and regarding the kind of elements that our perceptual system can identify.
The second role of sensory individuals is in solving the feature-object binding problem (§3.1). Clark’s claim, as we have seen, is that places are the sensory individuals to which properties are attributed. It is dubious, however, whether Clark’s rendition of the sensory individuals is committed to or entails a commitment to factualism for it is far from clear whether places can be facts’ particulars. On Armstrong’s ontology (1997), space is a conjunction of facts. A discussion of this issue would lead us too far away from the present concern. Still, Clark’s theory, too, presupposes a property attribution model to solve the binding problem. This claim seems to contrast with our conclusion.
One way to preserve sensory individuals’ role in unifying different properties could be to say that, when sensory reference is fixed, the visual system starts extracting features from the property cluster. Suppose a subject sees a red triangle and a blue circle. In order to solve the feature-binding problem, the visual system may simply fix reference to a distinct set of property ! ! ! ! ! ! ! ! instances (the individuals)—like {!! ∨ !! ∨ !! … !!} from item 1, and {!! ∨ !! ∨ !! … !!} from item 2—and then further extract properties from the respective items. In this example, from item 1, it will extract the property instances of being red and triangular, and from item 2 the property instances of being blue and circular. In this way, we preserve the role of sensory individuals in the feature-object binding problem without committing to the further claim that properties are attributed to objects. This is a mere suggestion that deserves to be further articulated in subsequent works.
Finally, let me stress that these considerations about sensory reference are compatible with different neural solutions to the binding problem. The brain might actually bind features by means of neural synchrony (e.g. Singer, 1999), or by means of some feature-integration mechanism (e.g. Treisman & Gelade, 1980; Chan & Hayward, 2009).
9 I thank an anonymous reviewer for suggesting me this option. 100 Chapter 4: Facts, Sensory Individuals, and Sensory Reference
5.3 Perceptual Content
Finally, I will briefly consider few implications for philosophical theories of perceptual content. My claim that visual objects are bundles of properties is not new. On different grounds, and without relying on experimental results, Textor contends that «[s]eeing x is constituted by seeing features, states or changes of x and additional factors. (…). I see x in virtue of seeing its features, states or changes» (2009, p. 141) (cfr. also Stout, 1921). These additional factors may be for example the role of memories and semantic categorization (§5.1).
My argument bears on philosophical theories of perceptual content, understood as conditions of accuracy. Many intentionalists about perceptual experience hold that perceptual content is propositional (e.g. Crane, 2009 for a dissenting voice). The propositional character of perceptual content depends not only on our assumptions about the intentional character of states of seeing, but also on our assumptions about the nature of propositions. Some philosophers hold that propositions are functions to possible worlds (e.g. Byrne, 2001; Stalnaker, 1976). In this case, the propositional character of states of seeing is decided by their having veridicality conditions. However, some philosophers hold that propositions are structured contents (e.g. Thompson, 2009). Several theories are available to friends of structured contents. For example, a content is Russellian if it involves the attribution of properties to objects (e.g. Chalmers, 2004). Another option is to argue that perceptual contents are better cast in terms of Fregean contents involving modes of presentation of objects and properties, rather than ‘naked’ properties (Schellenberg, 2010, p. 34).
In these cases, a state of seeing is individuated by means of two kinds of entities: properties (and relations), and a ‘something’ (a particular) the properties are predicated of. My arguments do not cohere well with the structured account of propositional content. As we have seen, states of seeing do not attribute properties to objects; instead, visual objects are exhausted by their properties. My contention is broadly consistent, for example, with a ‘Property Complex Theory’ of visual objects (e.g. Pautz, 2007, pp. 498-499). This theory has it that perceptual content is a property complex structured in different parts and standing in relations R1, R2, etc. On this view, a visual object is roughly a spatial-meretopologically-structured bundle of properties. These complexes are very different from structured propositions. It follows that perceptual content does not have a propositional shape. Perhaps, a better analogy would be to describe such contents as maps (Burge, 2010, p. 540) that make manifest to the perceiver a scenario filled with spatially arranged properties, where some of them at least coalesce into visual objects. For reasons of space, it is not possible to fully articulate this alternative proposal that I leave for future research.
101 Chapter 4: Facts, Sensory Individuals, and Sensory Reference
Conclusion
In this Chapter, I have attacked factualism, the claim according to which we actual states of affairs. Basing my considerations on experimental evidence, I have shown that perceptual psychology does not support factualism, and that we should understand visual objects solely in terms of properties. Notice that this conclusion is perfectly consistent with the claim that visual objects are not exclusively explained by processes of property extraction: memory, background knowledge, and many other factors contribute in the shaping of our visual perceptual experience. With this final step, I have shown what items populate the phenomenological domain, and therefore what items supposedly form the relational structure of this domain. In Ch. 7 I will put forward additional arguments to favor a trope bundle theory of visual objects.
102
PART III
THE NEURAL DOMAIN
INTENTIONAL MECHANISMS AND THE STRUCTURE OF SENSORIMOTOR EXPLANATION
5
A MECHANISTIC STANDPOINT ON CONTENT-NCC RESEARCH
In the Second Part, I have clarified the nature of the Phenomenological Domain, and specified what are the basic elements that constitute visual objects. In the Third Part, I will examine the nature of the Neural Domain ϕ. Again, this Part is divided into two Chapters. In this Chapter, I tackle the issue of the neural correlates of conscious content, or “content-NCCs.” I set out to show, contra Chalmers, that there is no unique mechanism corresponding to what is sometimes called “content-NCC,” but that at least three different kinds of mechanisms fix the visual content of consciousness. Chapter 6 has a more apologetic character. Not every philosopher might agree with the view defended here about content-NCCs. In particular, proponents of the sensorimotor theory, as well as dynamic system theory, are sometimes credited to be critical against mechanisms more generally. I will examine a particular instance of these theories, the sensorimotor theory, and show that it is compatible with the approach developed in this Chapter.
Recently, we have witnessed a growing interest for the problem of the neural correlates of consciousness (or “NCC” for short) (Baars 1995; Crick 1994; Crick & Koch 1990, 1998; Fink 2016; Koch 2004; Miller 2015a; Rees et al. 2002; Singer 2015; Tononi & Koch 2008). Most of these contributions cast doubt on the mainstream definition of “NCC” put forward by Chalmers (2000), and urged for the need of new approaches to the issue (e.g. Bayne 2007; Bayne & Hohwy 2013; Fink 2016; Miller 2014, 2015b; Neisser 2012; Noë & Thompson 2004). Whereas most philosophers of mind, so far, have focused on whether consciousness can be metaphysically explained (e.g. Chalmers 1996), Neisser (2012) has argued that what we really need is a more robust philosophy of science for NCC research, rather than philosophy of mind. From this standpoint, one still open issue is to articulate the explanatory structure of NCC research. Some philosophers have already put forward some considerations, and suggested adopting a mechanistic framework of explanation (Bayne & Hohwy 2013; Hohwy 2009; Neisser 2012; Opie & O’Brien 2015; Revonsuo 2015; Vernazzani 2015).
In this Chapter, I build up the suggestion and elaborate on the problem of the neural correlates of the contents of consciousness. I will continue focusing on my proper object of (phenomenological) interest, i.e. visual objects, and leave open how much of my considerations apply to other kinds of content, like the content of other distal senses, feelings and moods, etc. I advance several claims. Firstly, I claim that scientists try to uncover the brain structures that subserve the perceptual skills we employ by showing us visual accuracy phenomena. Second, I show that the notion of “content-NCC” is opaque, as it may not correspond to a single mechanism. As I am going to show, there probably are many distinct mechanisms working in a Chapters 5: A Mechanistic Standpoint on Content-NCC Research specific arrangement that, jointly, produce our experience of a single visual object. I thereby show that content-NCC research is inherently mechanistic, and try to uncover the putative architecture of the mechanisms underlying conscious visual content.
The Chapter unfolds as follows. I will first (§1) briefly summarize some key concepts about content and consciousness that I have exposed in Ch. 3. This will be helpful in order to bring into sharper focus the proper topic of this Chapter. Next (§2), I will briefly introduce the scientific problem of explaining consciousness, and highlight the goals of the neuroscience research on consciousness. Then (§3), I will introduce Chalmers’ mainstream definition of “content-NCC” and provide some reasons to be skeptical of it. An answer to the worries raised by Chalmers’ definition will be sketched out in the following Section (§4), where I articulate a new approach to content-NCCs in light of a mechanistic-manipulationist framework of explanation. In particular, I will argue that there are no such things as “content-NCCs” in the brain, but rather the complex and orchestrated activity of at least three different kinds of mechanisms. Finally (§5), I will outline the advantages of my approach over Chalmers’ definition, zooming in on the following areas: the heuristic strategies of mechanistic research, the problem of interfield integration in consciousness studies, and the problem of the ontology of visual content. We will later see (Ch. 8, §3), how the heuristic strategies for the discovery of mechanisms help us reshaping the problem of the neural correlates of consciousness.
1. The Contents of Visual Perception 1.1 The Content View and Visual Accuracy Phenomena
As I said in Ch. 3, in his work I focus on a specific kind of mental state that I call state of seeing. A state of seeing is a conscious mental state that has visual representational character. For conciseness, I will frequently use the verbal form “to see” in the next pages. I first briefly return on the notion of content, and later (§1.2) turn to consciousness.
To say that a mental state has a representational character is to say that it has “content.” The word “content” is a term of art, which means something assessable for accuracy or veridicality. (It is far from clear whether accuracy is just a form of veridicality, or not; I do not take stance on the issue, and continue to talk about veridicality and accuracy interchangeably). The view that visual perceptual experience has content is sometimes called the “Content View” (e.g. Brewer 2006, 2011; Byrne 2001; Siegel 2010; Schellenberg 2011). The Content View is the current orthodoxy in philosophy of perception (Locatelli & Wilson 2017) and the sciences of the mind. Philosophers like Byrne (2001), Burge (2005), Chalmers (2010), Evans (1982, p. 226), Harman (1990, p. 34), Pautz (2010), Peacocke (1992), Searle (1983), and Sellars (1956, §§16-18) all
106 Chapters 5: A Mechanistic Standpoint on Content-NCC Research assume or defend some version of the Content View1. The core tenet of the orthodoxy, is thus the claim that states of seeing are assessable for accuracy.
It is analytical that if seeing can be more or less accurate it is so only in relation to what seeing is about. This is just to say that states of seeing, on the Content View, are intentional states, states that exhibit aboutness or directedness to some object (Searle 1983)2. Intentional states belong to a specific subject S, and are individuated by content and modes (perception, belief, thought, etc.) (Crane 2001, p. 32) that specify the kind of relation S stands in to the content of that intentional state. Narrowing down our attention to perception, different senses or perceptual modalities, like vision, taste, etc., are different modes. In a state of seeing, the mode is seeing.
There are mainly three motivations that warrant talk about content in the philosophy of perception (Crane 2011): aspect, absence, and accuracy. The notion of “aspect” is linked with the notion of having a perspective. The observer is always situated in a certain spatial relation towards the target or object of her state of seeing (Crane 2001, pp. 6-8). For instance, two states of seeing might both have Tibble the cat as their object, but represent her in different ways, for instance when the observer sees the cat from behind or from another vantage point. The notion of absence refers to the fact that the intentional object needs not to exist (e.g. Anscombe 1965/2002, p. 63; Crane 2001, p. 22; 2013). An obvious example here are hallucinations, states of seeing that have no object. Finally, contents may differ from how the objects they are about, i.e. a mental state might be inaccurate. A classical example is that of the straight stick that put in a glass of water looks bent, as well as many other examples of illusions. In the next pages, I will use the notions of “content” and “accuracy conditions” interchangeably (following for example Pautz 2011; Peacocke 1992; Searle 1983, p. 39; Siegel 2010a, p. 30).
What kind of entities fixes a mental state’s conditions of accuracy? Or, in other words, what kind of entities can we see? Casati (2015) enumerates for example properties, events, boundaries, and property bundles. Other philosophers maintain that we see both objects and properties (e.g. Nanay 2013; Siegel 2010a, pp. 45-49; Lycan 2003, p. 71), or actual states of affairs, i.e. facts (e.g. McDowell 1994; Nanay 2013; cfr. Textor 2009 for a critical view) (cfr. Ch. 4). As I have shown in Ch. 4, visual objects are better understood as property bundles. However, in this Chapter I remain neutral on the issue, which I will further develop in Ch. 7. Let us assume, like virtually every philosopher and psychologist, that we see properties, like
1 The Content View has recently been challenged by naïve realist theories (e.g. Brewer 2006, 2011; Fish 2009; Travis 2004; for an overview, see Locatelli & Wilson 2017) or relationism (Campbell 2002). In this study, I will simply assume the Content View. I leave to naïve realists to assess whether and to what extent they can accept my account. 2 The intentionality of seeing is not equivalent to their representational character. On some interpretations, a mental state may exhibit intentionality, i.e. be about something else, even though it is not representational. However, a representational state is a state that has intentionality (cfr. Neander 2017). 107 Chapters 5: A Mechanistic Standpoint on Content-NCC Research colors, forms, etc (Ch. 4, §1.1). Two questions arise in conjunction with this claim. First, we should determine the ontological status of properties (e.g. Nanay 2012): they may be universals—perhaps instantiated in a fact—or tropes (cfr. Ch. 7). Second, we should determine what kind of properties we can see: merely basic visual properties, or also state properties—e.g. the property of being a pine tree, of being human, etc.—and others? (cfr. Siegel 2010b)3. As we will see, this will also bear on the search for content-NCCs.
The visual properties that feature in our states of seeing always come in clusters, coherent visible units that we call “visual objects” (Feldman 2003; Kimichi et al. 2016; Palmer 1977; Treisman 1986; Ch. 4, §1.1). Regardless of how we construe visual objects and their properties, one thing seems clear: from a phenomenological viewpoint, there is a recurrent feature of our states of seeing, in that they make us “open” to the physical reality or reveals it (McDowell 1994, p. 26; Ch. 3, §1). The capacity of our visual system to make us open towards objects in the world is a regular feature of our minds that is made possible by our distinctive perceptual capacities that range from color perception to the perception of speed and texture, the perception of shape, Gestalt factors, and many others that jointly form the mereotopological manifolds that we call visual objects (e.g. Palmer 1999; Pinna & Deiana 2015; Pomerantz et al. 1977; Tversky et al. 2008; cfr. Ch. 7, esp. §2.1). It is precisely the agenda of content-NCC research to uncover the underlying brain and computational structures that make the phenomenological appearance of these regularities possible.
From the perspective of vision scientists, the regularities we observe, i.e. visual objects, are explananda. I adopt a realist standpoint here, according to which scientific explanations target phenomena (Bogen & Woodward 1988; Woodward 1989, 2010, 2011). As Bogen & Woodward (1988, p. 321) state, there is hardly a single ontological category all phenomena belong to. Phenomena may be properties, objects, states of affairs, events, or processes. This is why I opt for ontological neutrality here, although I briefly elaborate on the ontology of visual objects in §4.4, and later in Ch. 7. Since our explananda are visual objects, which are conditions of accuracy, I will call them visual accuracy phenomena. Visual accuracy phenomena are clusters of closely interwoven phenomena that determine, at a time t, the conditions of accuracy of a state of seeing 4 . It is sometimes difficult to single out a specific phenomenon for
3 I gloss over many other issues, like the propositional and conceptual character of perceptual content, as they are tangent to the issue of the ontological kinds that are visible by seeing, i.e. the claim that we see properties is compatible with different options, like conceptual content and its propositional character. 4 I do not claim that all visual accuracy phenomena are visual objects, but only that visual objects are an important class of visual accuracy phenomena. Also, the reader should bear in mind that in this work I adopt a synchronic, rather than a diachronic perspective (Ch. 3, §1.2). Arguably, visual accuracy phenomena are diachronic, i.e. they are temporally extended (cfr. also Ch. 6, §4.2). When I look at a visual object, like the pencil on my desk, my state of seeing extends in time, as long as I keep looking at it. I will not dwell on how to account for the persistence in 108 Chapters 5: A Mechanistic Standpoint on Content-NCC Research explanatory purposes from an intricate set of distinct phenomena. Most often, scientists require a substantial amount of research to untangle different phenomena, or discern phenomena from artifacts (Bechtel & Richardson 2010).
Researchers interested in content-NCCs, however, are not simply interested in explaining perceptual content. They want to understand how the brain (or some beyond-the-brain extended system, e.g. Clark 2008) generates conscious content. I will now briefly turn to the relation between consciousness and content.
1.2 Content and Consciousness
States of seeing are conscious mental states, which leads us to the concept of consciousness and its relation to content (Ch. 3, §2.3). There are many concepts of consciousness, but the single most discussed one is that of phenomenal consciousness, which refers to the peculiar qualitative character of some mental states in contrast with unconscious states (e.g. Burge 1997, p. 427, 2006; Searle 2004, p. 134). Philosophers often use Nagel’s (1974) phrase “what it is like to be” to refer to the «way it feels» (Chalmers 1996, p. 11) to have a conscious mental state (Block 1995, p. 377). The terminology is not univocal, and some philosophers have coined other expressions for phenomenal consciousness, like «qualitative character» (Shoemaker 1994, p. 22), or «subjective character» (Metzinger 1995, p. 9; Schlicht 2011).
Phenomenal consciousness is usually contrasted with the concept of access consciousness introduced by Block (1995). Put crudely, a representational content is access conscious if that content is available to other cognitive modules (Block 2007)5. Access consciousness has a distinctive functional character, in contrast with the qualitative one of phenomenal consciousness (Block 1995, p. 170). The relation between phenomenal and access consciousness is a matter of controversy. What is unclear is whether the subjective or qualitative character of some mental states can be reduced to access consciousness, i.e. if it can be functionalized. If not, then one might wonder whether phenomenal and access consciousness have, at least in principle, two distinct neural correlates (Block 2005, 2007). If Block is right, then it is possible, under some circumstances, that a content may be accessible, but not experienced qualitatively, or vice-versa, a content may be experienced, albeit cognitively
time of visual objects, and how to differentiate static visual objects, i.e. visual objects as of motionless items, and changing visual objects, i.e. visual objects that move and change some of their features. 5 During the years, Block has further refined and changed the concept of access consciousness. For example, in his earlier publication (1995) he said that a content is accessible if it is poised for the rational control of action, whereas in his more recent writings (e.g. 2007) he doesn’t make reference to the rational control. The differences will not be important for the present account. 109 Chapters 5: A Mechanistic Standpoint on Content-NCC Research inaccessible (cfr. also Cohen & Dennett 2011; Phillips 2015). We will later return on this issue (§3.3).
Most defenders of the Content View accept some form of intentionalism, the thesis that every conscious state has content, and that the qualitative character of a mental state is somehow determined entirely or in part by its representational character. Some philosophers (e.g. Chalmers 2011) argue that it is possible to have the same content but distinct phenomenal experiences. Other philosophers argue for a bijection relation between content and phenomenal states, i.e. variations in content correspond to phenomenological variations, and variations in phenomenology correspond to content variations (Byrne 2001). The relation between phenomenal consciousness and content may be one of mere supervenience (Byrne 2001), or a more robust relation. For instance, consciousness may just be a particular kind of content that meets some functional requirements, rather than being a property of some mental state (e.g. Tye 1995, 2000); or it may be the product of a higher-order mental state directed at some content (e.g. Rosenthal 1986; Lycan 1996).
For now, we can simply assume the following. Let there be a set R of a subject’s contents at a time t (remember that I am focusing only on states of seeing, hence on visual content). Within this set, we isolate a proper subset of intentional contents Rc that are phenomenally conscious (I remain neutral for now about whether phenomenal consciousness can be reduced or not), such that Rc R. It is this proper subset that fixes the subjects’ visual accuracy condition at a time t. When looking for content-NCCs, neuroscientists are looking for specific brain structures that are responsible for visual accuracy phenomena, Rc.
2. Goals and Aims of Content-NCC Research
Most philosophers, so far, have studied the problem of consciousness from a metaphysical perspective. The key question has not focused on the explanatory structure of the scientific research on consciousness, but rather on an ontological question: Can consciousness be reduced to the “physical”? Framed in this way, the problem of consciousness is one aspect of the broader ontological enterprise of determining the fundamental ontological kinds of our world. In the case of conscious experience, it seems that every account must face the challenge of the explanatory gap (Levine 1983), which constitutes the hard problem of consciousness (Chalmers 1996). If consciousness cannot be reduced to the physical, it is either because it is not a real phenomenon (eliminativism), or because it itself belongs to the building blocks of reality. This in turn might entail some form of panpsychism, or emergentism (Chalmers 2010c). The metaphysical issue of consciousness is a perfectly legitimate philosophical question that will hardly disappear even with the best scientific theories of consciousness. The hard problem will resist, and probably will continue to fuel philosophical thoughts for quite a long time.
110 Chapters 5: A Mechanistic Standpoint on Content-NCC Research
The metaphysical problem has also generated an aura of mystery around the problem of consciousness, often characterized as an elusive or ineffable phenomenon. This has led philosophers to pay far less attention to the problem of what it means to explain consciousness scientifically. This much-neglected problem, however, can reveal some important clues about the nature of consciousness. My claim is not that by shifting perspective we will dissolve the hard problem, but that we can make progress in our scientific understanding of consciousness, and couch the hard problem within an intelligible structure. In other words, the question is not really whether we can in principle reduce consciousness to the “physical,” but rather whether we can articulate a robust philosophy of science that accounts for the explanatory structure of NCC research, and thus help us chart the geography of the problem, identifying which areas seem only tractable with the conceptual arsenal of philosophers and which areas can benefit from a closer cooperation with scientist.
The scientific problem of consciousness belongs to the domain of cognitive neuroscience6. As Craver puts it, neuroscience is mainly driven by two goals (2007, pp. 1-2). The first goal is explanation. Neuroscientists try to explain phenomena like the release of neurotransmitters in the synaptic cleft, how neurons store information, or how an organism can exercise the capacity of spatial navigation. The second goal is to control the brain. Under this goal we find the attempt to diagnose and treat neural diseases for example. The neuroscience of consciousness is no exception to these goals (Hohwy & Bayne 2015, pp. 161-163; Vernazzani 2015).
Focusing on content-NCC research, the first goal is to explain how the brain makes us conscious of a seemingly richly detailed visual field. We want to explain how the brain generates our conscious visual content, and in our case, visual objects. The second goal is to intervene on content-NCCs. There are many reasons for intervening on content-NCCs. An obvious reason is for diagnostic and therapeutic purposes. But there are also other reasons. Koch (2004, p. 100) for example states that manipulating NCCs can help us jumping from a mere neural- consciousness correlation to an account of how the brain causes conscious experience. Another reason is that manipulation of brain areas may help us locating the content-NCCs (e.g. Koubeissi et al. 2014; Parivizi et al. 2012). As we will later see (§4.3), recent developments of NIBS techniques have been successfully applied to content-NCC research trying to disentangle neural prerequisites and neural consequences of conscious experience (e.g. Aru et al. 2012; de Graaf et al. 2011). To these two goals, Hohwy & Bayne (2015, pp. 162-163) add a third one,
6 It may be objected that not all philosophers share this internalist standpoint (e.g. Noë & Thompson 2004). Some philosophers urge that consciousness might not be located in the brain at all, but perhaps be distributed in other bodily parts, or even external items. Virtually all philosophers, however, agree that the brain is necessary for consciousness. What is at stake in the debate is just how much consciousness depends on the brain. Since it is trivially accepted that the brain is necessary for consciousness, I will safely assume that consciousness is first and foremost a problem for neuroscientists. I will later (§4) show how a commitment to externalist views may alter the prospects for the search of content-NCCs. 111 Chapters 5: A Mechanistic Standpoint on Content-NCC Research prediction. Understanding content-NCCs may help us formulate reliable predictions about, for example, what a subject sees from the observation of neural activity (impressive advancements in this area have been achieved by the Gallant laboratory, cfr. Nishimoto et al. 2011). The three goals are complementary. Good explanations warrant reliable predictions (Douglas 2009), and manipulating the content-NCCs can both play an heuristic role, dissecting different kinds of neural correlates, and give us a better understanding of how content-NCC mechanisms work.
3. The Standard Definition of Content-NCC
In this Section, I introduce (§3.1), and later (§3.2) criticize the standard definition of content- NCC put forward by Chalmers (2000). As Fink (2016) rightly points out, this definition is the mainstream account accepted by most neuroscientists and philosophers working on NCC research (e.g. Block 2005; Hohwy 2007, 2009; Koch et al. 2016; Tononi & Koch 2008) (for an overview of theories and methods in the scientific study of consciousness, cfr. Klink et al. 2015). Therefore, criticizing it and its theoretical assumption means to make some steps towards a reconfiguration of the problem of NCC.
3.1 Chalmers’ Definition
In his seminal contribution, Chalmers (2000) provided the first rigorous definition of a “neural correlate of consciousness.” More specifically, and in light of the distinction between state, background, and contents of consciousness (cfr. Ch. 3, §2.1.2), Chalmers distinguished between neural system’s responsible for state consciousness, or “NCCs,” and specific neural systems that are responsible for the contents of consciousness, or “content-NCCs.” NCCs and content- NCCs jointly form the “total-NCC” (or “full-NCCs,” Koch et al. 2016) the sum of all brain systems responsible for an organism’s consciousness in its entirety. Let us focus on content- NCCs. Chalmers provided the following definition:
An NCC (for content) is a minimal neural representational system N such that representation of a content in N is sufficient, under conditions C, for representation of that content in consciousness. (Chalmers 2000, p. 31)
Before we turn to the problems of this definition, let us clarify some of its core features. I single out the following concepts as particularly relevant: correlation, conditions C, and the minimal sufficiency requirement. I will then turn to a special relation that would hold between the neural representational system and content, the matching relation.
The very idea of a “correlation” is so deeply rooted in NCC research as to be inscribed in the very notion of Neural Correlates of Consciousness. Needless to say, correlation is not equivalent to causation. For example, buying a TIAA life insurance may be correlated with better life expectancies, but it does not mean that owing a TIAA life insurance is causing a
112 Chapters 5: A Mechanistic Standpoint on Content-NCC Research longer life (Cartwright 1976). There might be a common factor that explains both why people purchase a TIAA life insurance and also make them living longer (perhaps, because such people are wealthier). The term “correlation” was put forward by Crick (1996, p. 485), who meant it as a mean to sidestep some thorny philosophical problems about the relation of consciousness with neural activity. In the same year, Chalmers declared that «neurobiological approaches to consciousness […] can […] tell us something about the brain processes that are correlated with consciousness. But none of these accounts explain the correlation […]» (1996, p. 115); and in his 2000 paper, he reiterated that the search for correlations «can be to a large extent theoretically neutral» (2000, p. 37). The correlation thesis has been criticized by McCauley & Bechtel (2001) who argue that talk about mere correlation does not make justice of the explanatory practice in the science, which would proceed by making heuristic identity assumptions. Other scientists, like Koch (2004, p. 100) adopt an instrumental account to correlation, with the aim of NCC science being that of jumping from correlation to causation. As I will later argue (§4.3), while the notion of correlation helpfully leaves out the exact metaphysical pattern holding between content and the underlying neural system, it does not helpfully distinguishes between systems responsible for a particular phenomenon, and systems closely correlated with it7.
Let us now consider the “conditions C.” Neural systems do not exists in a physical (biological) vacuum: they are embedded in a wider biological system. Some of the features of such a system make possible its proper working. I will call these features “supporting factors.” There are different kinds of supporting factors. Koch (2004, pp. 88-89) (cfr. also Rees 2002) distinguishes between enabling and specific factors. He defines enabling factors, or NCCe, as «tonic conditions and systems that are needed for any form of consciousness to occur at all» (Koch
2004, p. 88). Examples of NCCe include, but are not limited to: the activity of cholinergic neurons, activity of the intralaminar nuclei within the thalamus (ILN) (e.g. Bogen 1995, 2007), and in general other subcortical structures, like the basal forebrain, portions of the basal ganglia, and the claustrum (Blumenfeld 2016). Koch’s specific factors would be the proper NCCs, the mechanisms that generate consciousness or conscious content, i.e. creature-NCCs and content- NCCs. Block draws a somewhat similar distinction (2007) between “causal” and “constitutive” factors. The latter are equivalent to Koch’s specific factors, whilst the former are the set of specific causal conditions that must obtain in order to enable the activation of the constitutive factors. Note that Block’s causal factors are distinct from the prerequisite neural activity that is required to activate a specific mechanism (e.g. Aru et al. 2012; cfr. §4.1). Among the causal
7 Talk about “correlates” is not universally accepted in the science of consciousness. Some researchers prefer to talk about neural bases or substrates of consciousness (e.g. Aru et al. 2012, 2015; Block 2007; de Graaf et al. 2011; Hohwy & Bayne 2015; Miller 2015b; Revonsuo 2000, 2015). As I will later explain, the focus of scientific interest is on mechanisms that are constitutively relevant for a particular phenomenon, whereas other processes will be merely correlated with it. 113 Chapters 5: A Mechanistic Standpoint on Content-NCC Research factors, Block singles out what he calls “supply factors” such as appropriate oxygen and glucose levels, the role of glia cells in supporting neurons, etc. (Koch et al. 2016, p. 308).
It is obvious that without supporting factors no neural—and perhaps prosthetic systems as well, cfr. §3.2—can work. I will therefore follow Chalmers in adding a generic “condition C” as the set of all conditions under which a mechanism might constitute the phenomenon. As I have anticipated, I will argue that “content-NCCs” are in reality multiple mechanisms having different function. There is no reason of course to suppose that the conditions C will be identical for all these kinds of mechanisms. Arguably, such mechanisms will share some minimal supporting factors, such as the blood supply, but will also require more specific conditions.
Let us now turn to the notion of minimal sufficiency. The motivation for introducing the minimal sufficiency requirement is clear enough. If we target mere sufficiency, then the whole brain would trivially be sufficient for consciousness experience. What we want is a criterion that non-trivially pins down a minimal brain system that is responsible for a particular phenomenon, i.e. some content or consciousness. As Hohwy & Bayne (2015, pp. 157-159) and Miller (2015b) point out, however, the notion of minimal sufficiency is itself far from clear. To illustrate this point, Hohwy & Bayne put forward the following example. Suppose there is neural population N that is the minimally sufficient correlate of a mental state M, and that M only occur when neurons 1 to 10 of N fire and that any one of the 10 neurons may fail to fire and M would still occur as long as the other nine fire. It follows that none of the individual parts of N is indispensable for M (ibid., p. 158). Similarly, the notion of sufficiency is problematic. If with “sufficiency” we understand the idea that a system N generate consciousness all by itself, but other neural activity may be required in order to let N generate a given state M. Such neural activity may belong to the conditions C, the supporting factors, but how could we tell whether some neural activity is merely supporting or rather constituting M?
I have already adumbrated several issues in Chalmers’ definition. Before I raise more serious objections, and my proposal about how to overcome them, we need to dwell on the notion of a matching relation. In the case of content-NCCs, Chalmers posits some kind of matching relation between the content of N—the neural representational system—and the content of consciousness. Noe & Thompson (2004, p. 3) call this the Matching Content Doctrine (MCD). The MCD consists of the following theses:
i. N is the minimal neural representational system whose activation is sufficient for the occurrence of E; ii. There is a match between the contents of E and N.
We can graphically display the MCD by means of Fig. 11:
114 Chapters 5: A Mechanistic Standpoint on Content-NCC Research
N C i n c
Fig. 11: Chalmers’ content-NCCs. The neural representational system N represents content1 (n) in N, which is supposed to match (i) conscious content2 (c) in C.
It is unclear what this matching relation amounts to (perhaps, a form of isomorphism? Cfr. Ch. 8, §3.1) (Vernazzani 2016b). What is clear is that, for Chalmers, the notion of minimal sufficiency for content-NCCs is closely tied to the MCD. If a neural system N counts as content- NCC—excluding the confounding factors—there must be a matching relation between conscious and neural content.
I will now discuss some serious objections against Chalmers’ definition that, together with Fink’s (2016) criticism, will make a case for abandoning the mainstream definition and articulate a new account of content-NCC research.
3.2 Problems with the Standard Definition
I cluster the criticisms against Chalmers’ definition of content-NCC in two groups. The first group of objections is drawn from Fink (2016). Fink does not distinguish between content-NCC and state-NCC and it is unclear how his notion is supposed to do justice of the so-called “state- based approach” in the science of consciousness, i.e. the attempt to identify the NCCs for creature consciousness. State based approaches are usually devised in form of contrastive analyses between healthy participants and patients with severely diminished consciousness, perhaps due to coma, vegetative state, etc. (Koch et al. 2016, p. 308). The second group of objections is mainly mine, and cast doubt more radically on Chalmers’ understanding of content-NCC.
Given that Fink does not distinguish between content-NCCs and NCCs, he raises several objections against Chalmers’ definition of NCC or “state-NCC.” In particular, his objections aim at the following aspects: (i) that Chalmers’ definition targets the capacity of an experience, not the neural correlate of an occurrent experience; (ii) it does not mirror the actual usage of NCC in the science of consciousness; (iii) it connects too closely the definition of NCC with the neural system, without allowing for the possibility of an artificial NCC; (iv) it does not take into account neural plasticity; (v) it does not offer a useful operationalization in light of experiments on NCCs. The criticisms (ii) and (v) will be discussed more thoroughly later, respectively below in this Section, and in §4.3. I concur with Fink that Chalmers’ definition does not mirror the 115 Chapters 5: A Mechanistic Standpoint on Content-NCC Research actual usage of NCC in the science of consciousness, and I agree that it does not offer a useful account in light of experiments, manipulations on content-NCCs (§4.3). However, my considerations will be developed largely independently from Fink’s own standpoint, and steer decisively away from his account in that I espouse a mechanistic approach to content-NCC research (§4).
Concerning criticism (iii) and (iv), Fink’s considerations are as follows. If we take some neural activation as necessary for experience we would rule out a priori the very possibility of: (1) artificial experiencers «i.e. non-biotic conscious machines or programs» (2016, p. 2; Gamez 2008); (2) the possibility of preserving consciousness in silicon brain prostheses; (3) neural plasticity, the possibility that some brain regions might take over the function of an impaired structure (e.g. Wittenberg 2010). In this work, it is not possible to further explore to what extent artificial structures, or maybe completely artificial and non-biological agents are possible8. It is important to stress, however, that Fink’s objection is not so much against the fact that NCCs are neural or biological structures—something that is obvious given that neuroscientists seek to find out the brain structures responsible for conscious experience in animal-biological agents—, but on whether they logically need to be so. I retain this aspect of Fink’s criticism: we should allow NCCs to be (at least conceptually) possible also in non-biological artificial agents. Similarly, we should allow for the possibility of different brain structures being somehow involved in consciousness, according to the plasticity thesis.
However, I am far less convinced by Fink’s suggestion (i) that—since Chalmers’s definition targets neural “systems” that merely subserve the capacity of an experience—we should reformulate the NCC definition as being neural events or processes. Fink here overlooks one important aspect of NCC research—and perhaps of much of neuroscience research more generally—namely the fact that neuroscientists target mechanisms (§4.1). The search for brain correlates of conscious experience, or of conscious content, is instrumental to find out in virtue of what kind of neural activity, or computation, the brain is able to engender our conscious experience. This is part and parcel of the explanatory goal of neuroscience that we have discussed above (§2). Indeed, Fink, just like Chalmers (see below) misses this important feature of content-NCC research, and in this sense, they are both guilty of (ii): producing a definition of
8 As a side remark, I would like to point out that «artificial experiencers» is not synonymous with «non-biotic conscious machines or programs» (Fink 2016, p. 2). A system or component of a system may be artificial and biological. For example, we can imagine in a not-so-distant future a team of neuroscientists growing a population of artificially produced biological neurons to serve as prostheses in case of brain insult. Hence, the criticism may be better reformulated as follows: we should not rule out a priori the possibility that an entirely non-biological agent may be conscious in virtue of the activity of some system S. This way of formulating the criticism avoids construing S as a neural system. Notice, however, that this proposal differs substantially from Fink’s own rendition of NCC2.0, since he rejects altogether the claim that NCC are “systems” (cfr. the text above). 116 Chapters 5: A Mechanistic Standpoint on Content-NCC Research
NCCs that does not capture the actual practice of neuroscientists working on consciousness. In this sense, it violates the criterion of descriptive adequacy (Ladyman & Ross 2007; Machamer et al. 2000). As we will see in short, a mechanistic framework of explanation can overcome Fink’s problems by shifting the perspective to mechanisms as explanatory units of visual accuracy phenomena.
Let us now come to the second group of criticism against Chalmers’ definition of content-NCC. I single out the following problems: (i) it assumes a somewhat unclear relation between content and consciousness; (ii) it is problematic on its own, since it assumes that, along state-NCCs, there will be an indefinite number of content-NCCs; (iii) talk about minimal sufficiency seems to betray the acceptance of some form of covering-law model of explanation which does not seem to fit the explanatory structure of content-NCC research. This latter point dovetails nicely with the problem hinted at earlier with regard to Fink’s criticism, that Chalmers’ definition does not capture the scientists’ research goals on NCC research.
Consider the first (i) issue. Chalmers’ definition assumes a specific interpretation of the relation between consciousness and content. More specifically, it assumes, somewhat unclearly, that a specific content becomes conscious in virtue of being represented in a minimally sufficient neural system N, under some conditions C. But is the content produced in that very same neural system N? Or is it re-represented in N, as if appearing on an inner Cartesian stage (Dennett 1991; Ch. 1, §1.2)? Chalmers remains silent on this issue. But there is more. Not all philosophical theories of consciousness will be compatible with this conceptualization of content-NCCs. For example, suppose that content only becomes conscious if it meets some functional requirements, for example if the content is poised or accessible for other mental states (e.g. Tye 1995, 2000) (cfr. §1.2; Ch. 3, §2). On this understanding of the content- consciousness relation, one may suggest that a re-representation of content in an NCC is unnecessary, and that all is required is that content must be made available to other cognitive functions. Relatedly, the very definition of content-NCC seems to exhibit an odd content redundancy, as if there were two distinct contents (Fig. 11). One is the neural content, and the other one is the conscious content. Chalmers’ terminology strongly suggests that there are two kinds of contents, connected by a relation of supervenience or correlation (cfr. below). Once the neural content gains access to a content-NCC, the very same content is represented in consciousness. This seems to suggest that there will be two vehicles for content: one is the neural representational system N (the content-NCC) and the other one will be consciousness. Indeed, Chalmers assumes the existence of two distinct but parallels planes, a physical or neural plane and a consciousness plane. This also generates the problem of explaining in what relation they stand. As we will later see in relation to problem (iii), we touch here on the core issue of Chalmers’ account: the lack of a clear explanatory link between the content of consciousness and underlying neural representational systems.
117 Chapters 5: A Mechanistic Standpoint on Content-NCC Research
Consider now problem (ii): Chalmers’ account is unclear about how many content-NCCs there should be in the cognitive system. Remember that, for Chalmers, there are two kinds of NCCs: creature-NCCs and content-NCCs. Assuming that there will be a creature-NCC, a system responsible for making a subject conscious, one could argue that there must be as many content-NCCs as are the kind of contents that may be conscious9. For example, there might be content-NCCs for visual content—or perhaps, for many distinct features of visual content (§4.2.1)—for acoustic content, taste content, etc. A somewhat similar suggestion has been advanced by O’Brien & Opie, there would be «several distinct phenomenal consciousnesses, at least one for each of the senses, running in parallel» (1998, p. 387). Content-NCCs, so understood, may be a subcomponent of a content-mechanism, or a non-overlapping but connected system. This interpretation seems coherent with what Searle (2000) called the “building-block” approach (cfr. also Bayne 2007) (cfr. §4.2.2). On this approach, a subject’s overall consciousness emerges as the sum of many distinct phenomenal experiences, and each of these experiences is produced by a specific consciousness mechanism. The clearest statement of this view is the theory of micro-consciousness put forward by Bartels & Zeki (1998) (cfr. also Zeki 2007). The opposite view is sometimes called the “unified field view.” This view has it that consciousness should be understood as a single space—perhaps a global workspace (Dehaene & Naccache 2001)—or as a space of integrated information (e.g. Tononi 2007). The unified field approach casts doubt on the very notion of content-NCC. If consciousness is a single phenomenal field, what are content-NCCs really doing? A suggestion may be that content-NCCs are not really making a content conscious, but rather, they are selecting a content for consciousness (Hohwy 2009; cfr. §4.2.2). This interpretation seems particularly attractive on conceptual grounds (e.g. Bayne 2007; Hohwy 2009, & Bayne 2015), empirical findings, for example on sensory extinction (e.g. Rees 2001, et al. 2002; Driver & Mattingly 1998; Vuilleumier & Rafal 2000)—a failure to report a contralesional stimulus only in the presence of a competing ipsilesional stimulus, when both stimuli are briefly simultaneously presented—and experimental strategies, in particular works on binocular rivalry (e.g. Blake et al. 2014; Tong et al. 2006). In this sense, as I am going to show in the next Section (§4.4), Chalmers assumes the existence of a single locus of control that makes visual content conscious (Bechtel & Richardson 2010, p. 59), but recent advancements in NCC research suggest a more complex interaction between different loci of control. Taken together, these considerations will eventually lead us to reject the very notion of “content-NCC.”
9 Chalmers seems to assume that there will be one single creature-NCC. I am not so sure about that, and I believe that paying closer attention at both the scientists’ research strategies and the conceptual foundations of consciousness science, it will turn out that consciousness is actually a complex of distinct and closely related phenomena, generated by distinct mechanisms or at least by the joint activity of distinct mechanisms. I will not tackle the issue of creature-NCC in this work, and my assumption that there is a “something,” perhaps a single mechanism that makes us conscious, is mainly motivated by expository reasons. 118 Chapters 5: A Mechanistic Standpoint on Content-NCC Research
The final aspects that emerges from the foregoing discussion is that Chalmers (and Fink, too) do not connect the issue of content-NCCs to an explanatory framework. As I have stressed in §2, the quest for the NCCs is mainly driven by an explanatory goal. Neisser (2012) has pointed out that Chalmers’ commitment to the minimally sufficiency thesis betrays the adherence to a covering-law model of explanation (Hempel & Oppenheim 1948; Salmon 1989). In his words: «[t]he language of minimal sufficiency implies that neurobiological research aims at covering laws of the sort familiar from the tradition of logical empiricism» (Neisser 2012, p. 687). According to the covering-law model—a variant thereof is the deductive-nomological (DN) model (Hempel & Oppenheim 1948, cfr. also Ch. 6, §3.1)—explaining a phenomenon means to subsume it under a logical structure where at least a law of nature must figure among the premises. On the DN model, an explanation is just a deductive argument where the explanandum is the conclusion and among the premises must feature at least a law of nature plus some statements of antecedent conditions. Certainly, Hempel & Oppenheim (1948) were well aware that their model was an idealization that serves as a normative ideal, rather than an actual description of how scientists work. Short after its introduction in the debate, philosophers have articulated more and more objections against the covering-law model of explanation (e.g. Craver 2007; Salmon 1984). It is this explanatory model that seem assumed by Chalmers, where the explanatory burden is played by some mysterious law of consciousness or law of nature bridging NCCs with consciousness, as I am going to show. Since we do not know in virtue of what kind of law of nature we might deduce consciousness from some statements of antecedent conditions, we cannot explain consciousness.
On Chalmers’ understanding of content-NCCs, as well as of NCCs more generally, is that neuroscientists can, at best, uncover the antecedent conditions that must be fulfilled for a conscious experience E to occur. However, as we have seen, he does not think that these conditions will suffice to explain the correlation (Chalmers 1996, p. 115). The link between the phenomenon and the explanans in the covering-law model is nomological, not causal. The same assumption is in play in Chalmers’ understanding of NCCs. The main problem is that, for Chalmers, there is a relation of nomological supervenience between NCCs and the explanandum. The idea is basically this: there is a set of mental properties that supervene on a set of neural functional properties. More precisely, supervenience is a purely modal relation of dependent-variation between two sets of properties (McLaughlin 1995, 2011)10. Whenever there is a variation in a set of properties A, there is a corresponding variation in the more fundamental set of properties B. Supervenience is meant to fix a relation of covariance, of dependence, and of non-reducibility of the higher-set of properties to the more fundamental one (e.g. Kim 1993a; Savellos & Yalciņ 1995). It is precisely the irreducibility of the supervening set of properties that has fueled the philosophical interest for supervenience after
10 I construe the supervenience relation as holding between (sets of) properties for simplicity’s sake, but supervenience can also be construed as holding between other kinds of relata. 119 Chapters 5: A Mechanistic Standpoint on Content-NCC Research the critiques of Putnam (1967) and Davidson (1970) against reductionism in the philosophy of mind (Nagel 1961). According to the standard reductive story, a theory T1 can be reduced to a more fundamental theory T2 iff all the laws of T1 can be deduced from the laws of T2 in conjunction with bridge laws that connect the heterogeneous vocabularies of the two theories. Against him, Putnam argued that the bridge laws would not help us reducing the mental on the physical because of the multiple realizability of the former, whereas Davidson’s criticism centered on the absence of a law-like relation between the physical and the mental. Supervenience seems to be a promising move if one wants to preserve the non-reducibility of the mental, while keeping the mind dependent on the brain’s activity. There are different forms of supervenience, pending on the modal operators, or the range of world-binding quantifiers. We do not need to sort out the different versions of supervenience, it suffices here to mention one specific form of supervenience relation that Kim calls “Correlation Thesis:”
For each psychological event M there is a physical event P such that, [as a matter of law], an event of type M occurs to an organism at a time just in case an event of type P occurs to it at the same time (Kim 1993c, p. 178, brackets added)
It is easy to fill in this quotation with our vocabulary. The physical event P is nothing else but a neural content of N (n), and the psychological event M is the corresponding conscious content (c) in C (cfr. Fig. 11). Chalmers’ definition of content-NCC seems to be committed to a supervenience thesis that aims at isolating a specific subset of neural activity N that is alone minimally sufficient to merely correlate via supervenience to the corresponding content of consciousness. It is possible to further develop the supervenience framework without making any causal commitment between the two domains of the visual contents of consciousness (visual accuracy conditions) and the underlying neural system. All that is required is to fix some relation of systematic co-occurrence such that, in a statistically significant number of cases, an event P will co-occur with an event M. Per se, the supervenience relation is silent about the exact pattern that holds between the properties. And it is precisely this aspect that makes the correlative relation «theoretically neutral» (Chalmers 2000, p. 37). My contention is that in the present case supervenience is either philosophically uninteresting, or it offers an inadequate description of the explanatory practices of neuroscientists.
There are two possible interpretations of the supervenience relation. We might call the first interpretation “mere supervenience.” We get this interpretation if we suspend the bracketed phrase “as a matter of law” from the Kim’s quotation above. According to this reading, we merely state that the visual accuracy conditions supervene (strongly or weakly, etc.) on some minimally sufficient neural state. The problem with this sort of supervenience is that, as Kim observed, it «merely affirms a dependence relation of an unspecified sort and does nothing more to explain the nature of psychophysical covariance. [...] supervenience itself is not an explanatory relation» (Kim 1993b, p. 167). This is the critical issue: supervenience is not an
120 Chapters 5: A Mechanistic Standpoint on Content-NCC Research explanatory relation. A mere supervenience interpretation of the relation between neural states and contents of consciousness does simply not capture the explanatory undertaking of the science of consciousness. In fact, stating that there is some form of co-variation between contents of consciousness and underlying neural states only expresses a philosophical triviality. It is trivial to say that there is some co-variation between contents of consciousness and the underlying neural states. What we want from a definition of content-NCC is something more robust than mere supervenient correlation. Furthermore, as we will later see (§4.3), talk about mere correlation creates the problem of conceptual—rather than merely methodologically— untangling “the” proper NCC from its confounds: prerequisite and consequent neural activity. As I am going to show in the next Section, scientists aim at identifying the mechanisms that are constitutively relevant for the target phenomenon.
Let us now turn to the second interpretation of supervenience that we can call “nomological supervenience.” We get this interpretation if we remove the brackets from the Kim’s quotation above: it is «a matter of law» that property M supervenes on P. Here, the supervenience relation is fixed by means of some yet-unknown law of consciousness. This confers the correlation relation the appearance of an explanation, of a sort similar to a DN model. The putative explanatory structure of content-NCC becomes clear: we should expect a law, and statements of antecedent conditions, like the neural content being represented in N, conditions C, etc. I think that this is precisely what Neisser has in mind when he attacks the notion of minimal sufficiency. Indeed, there is some textual and theoretical evidence that some philosophers have interpreted the correlation of NCCs precisely in this sense. Neisser correctly quotes Metzinger, who defines an NCC as a «[...] minimal set of basic physical properties [...] that the system needs in order to exhibit the target properties by nomological necessity» (Metzinger 2000, p. 285). Analogous remarks can be found in Chalmers (1996), where he maintain that we could introduce a set of supervenience laws that show how phenomenal properties correlate with physical properties. Such supervenience laws would not «interfere» with physical laws, but would rather form another closed set of laws (1996, p. 127).
There are at least two motivations for being skeptical of the nomological interpretation. A first motivation is a generic commitment to some form of naturalism. There are different forms of naturalism in contemporary philosophy, and I won’t try to spell them out given the complexity of the problem (cfr. also Ch. 8, §2). Suffice to say that I espouse a minimal form of naturalism according to which we should take scientific knowledge as a key source of our understanding of the world (e.g. Bechtel 2008a; Ladyman & Ross 2007). Hence, philosophy should account for how phenomena are scientifically investigated and explained. This stance is also expressed as a criterion of descriptive adequacy (Craver 2007, pp. 19-20; Machamer et al. 2000, pp. 20-25), according to which philosophical theories about science and scientific explanations should adequately describe how scientists work. From this stance, it follows that a DN-like explanation of content-NCC plainly violates the criterion of descriptive adequacy. Scientists do not explain 121 Chapters 5: A Mechanistic Standpoint on Content-NCC Research content-NCCs by means of “laws of consciousness” (whatever these might be), nor they try to deduce conscious experience from statements of antecedent conditions (Bechtel & Abrahamsen 2005; Craver 2005, 2007). As I will argue in the next Section (§4), content-NCC research is inherently mechanistic. The second reason for being skeptical of nomological supervenience is motivated by the well-known critiques directed against the DN model (e.g. Craver 2007; Salmon 1984, 1989), such as the problem of screening off explanatory irrelevant premises from the deductive argument (for a review, cfr. Salmon 1989), or the problem of identifying exceptionless laws that are required to make the DN model work. There has been a considerable debate around the problem of laws in the special sciences. The problem with these kinds of laws is that they apparently admit many exceptions, making them unhelpful in the construction of DN explanations. Mitchell (2000) maintains for example that although biological laws are less stable than physical laws, they can nonetheless provide causal knowledge and be exploited to predict, explain, and guide interventions. Woodward (2001, 2003) on the contrary lays emphasis on the notion of invariance under interventions. Finally, Cummins (2000) has characterized the alleged cases of “psychological” laws as mere effects that are themselves explananda. In short, the main crux of this approach is that it would rely on a highly controversial—and still, to a large extent—mysterious, notion of a “law of consciousness.”
4. A Mechanistic Approach to Content-NCCs
The problems outlined in the previous Section can be overcome by adopting a mechanistic- manipulationist framework of explanation. Espousing this approach will pave the way also to other advantages for the science of consciousness (§5). I will first (§4.1) define the notion of mechanism and clarify the nature of mechanistic explanation. Next (§4.2), I will argue that the notion of “content-NCC” somewhat obscurely refers to different mechanisms, with different functions: intentional mechanisms, selection mechanisms, and the “proper NCC.” Later (§4.3), I adumbrate a manipulationist standpoint on content-NCC research. Finally (§4.4), I briefly summarize my results highlighting in what sense my account is an improvement over Chalmers’ definition.
4.1 Mechanisms and Mechanistic Explanation
Conceptually, there are at least two distinct problems in relation to content-NCCs. The first problem is that of explaining visual accuracy phenomena (§1.1). The second problem is to explain how (some) visual accuracy phenomena become conscious (§1.2). In both cases, our goal is to explain how the cognitive system engenders visual accuracy phenomena and consciousness thereof. As an extensive literature shows, explanation in the life sciences—as well as cognitive science—is broadly mechanistic (e.g. Bechtel 2008, & Abrahamsen 2005, & Richardson 2010; Craver 2007, & Darden 2013; Kauffman 1971; Machamer et al. 2000; Miłkowski 2013; Piccinini 2007; Wimsatt 1972). Mechanistic explanations are often contrasted
122 Chapters 5: A Mechanistic Standpoint on Content-NCC Research with deductive-nomological (DN) explanations. As we have seen (§3.2), according to the DN model, scientific explanations are deductive arguments, where the explanandum features as the conclusion, and among the premises there must be some statements of antecedent conditions, and at least a law of nature (Hempel & Oppenheim 1948). Another term of contrast is functional explanations (e.g. Cummins 1983), where the explanandum phenomenon is functionally decomposed into a number of sub-functions (e.g. Craver 2007, pp. 107-162).
Mechanistic explanations are sometimes called “how” explanations, i.e. they explain why a particular explanandum phenomenon occurred by showing how the underlying mechanism that constitute it works. On this framework, the explanatory emphasis is not on deductive arguments, but on causal relations holding between the mechanism’s parts and operations. To do so, according to many philosophers working on mechanisms—especially those who accept an ontic view of explanation (e.g. Craver 2007, 2014)—means, borrowing a term due to Salmon (1984), that correct explanations situate a phenomenon within the “causal structure of the world.” Quite obviously, since explanation is achieved by elucidating the structure of the mechanisms underlying a phenomenon, it is important to give a clear definition of “mechanism” before moving on. There are different notions of mechanism in the literature (e.g. Bechtel & Abrahamsen 2005; Glennan 1996, 2002; Garson 2013; Illari & Williamson 2012; Machamer et al. 2000). Although there are important differences among these definitions, all agree that mechanisms are systems with a specific organization that allows its internal parts to jointly produce the phenomenon. The following definition will work for our purposes:
Mechanism: A hierarchical system of component parts {c1, c2, …cn} and their
operations {o1, o2, …on} structured in such a way as to constitute a system-level activity {A} that is the explanandum phenomenon11.
Mechanisms are for a specific phenomenon, a feature that has been sometimes called “Glennan’s law” (Bechtel 2008a, pp. 13-14; Craver 2013; Darden 2006, p. 273; Glennan 1996; Kauffman 1971) 12 (interestingly, Dretske expressed a similar though in his 1995, p. 5). A complete mechanistic explanation is achieved when all and only the relevant component parts, operations, and their structure are uncovered, showing how the explanandum results from the
11 The definition is clearly tailored to capture the notion of mechanistic constitution. One could easily adjust the definition to make room for etiological explanations, but I will not further discuss the notion here. 12 This feature of mechanisms is sometimes characterized differently. For example, Machamer et al. (2000) stress that mechanisms are sought to explain how a phenomenon is produced, Bechtel & Richardson (2010) how a task is carried out, and Glennan (1996) how a mechanism behaves. At a finer grained level of analysis, these distinctions have significant consequences in characterizing the metaphysics of mechanisms, but for my purposes these remain merely terminological choices. I stick to “phenomena” in order to emphasize the realist commitment I laid out earlier. 123 Chapters 5: A Mechanistic Standpoint on Content-NCC Research joint activity of parts and operations (Craver 2007, p. 111; 2014, p. 40). The “relevancy” of a part, operation, or of the structural arrangement between them is determined essentially by our explanatory and descriptive goals. In other words, there is no general recipe for determining in every case what parts and operations will be: it is essential that they must play an active role within the mechanism, operating or being operated on (Bechtel & Wright 2009). On this aspect, philosophers sometimes speak of the perspectival nature of what is picked out to explain a phenomenon (Craver 2013, Darden 2006, pp. 273-274; Kauffman 1971)13.
A mechanistic explanation can be achieved in two ways: either by showing the causal chain of events that led to the explanandum, or by showing how the activity of the mechanism constitutes the explanandum. In the former case, we talk about etiological explanations, in the latter case of constitutive mechanistic explanations (Craver 2007, pp. 107ff; Kaiser & Krickel 2017). It is constitutive explanations that are of particular interest here. The notion of constitution refers to the «causal behavior of [the mechanism’s] constituents» (Salmon 1984, p. 270). A constitutive explanation thus strives to fathom out in virtue of what underlying constituents a capacity can be explained. Prototypical examples of constitutive explanations are the heart pumping blood (Bechtel & Abrahamsen 2005, p. 425; Craver & Darden 2013, pp. 98- 117), or the decomposition of the visual system (Bechtel 2008a, pp. 89-128; cfr. §4.2.2), and arguably content-NCC explanations (Miller 2014, 2015b).
Mechanistic explanation can be characterized as a piecemeal approximation towards a complete description of what is relevant about a mechanism. The final goal is to move from an incomplete sketch of how a mechanism may work—a representation containing black boxes that stand for component parts or operations of the mechanism—to an exhaustive how-actually description of all relevant parts, operations, and their structure (Bechtel 2008a, p. 18; Wright 2012; Wright & Bechtel 2007, pp. 49-54). In order to do this, the first step is to circumscribe the explanandum phenomenon, and then try to identify its locus of control (Bechtel 2002, Bechtel & Richardson 2010, pp. 63- 92; Craver & Darden 2013, chapter 4). Once the locus of control has been individuated, the next step is to decompose it and show what are its component parts, operations, and their organization. The decomposition strategy espoused by mechanicists is fairly similar to other decompositional strategies discussed in the literature, like articulation of parts explanation (Kauffman 1971), functional analysis (Cummins 1983, 2000), and reverse engineering (Dennett 1994) (cfr. also Craver 2007, p. 109). Bechtel distinguishes between phenomenal and mechanistic decomposition. The former consist in sorting out the varieties of the explanandum, differentiating similar but distinct phenomena. For each explanandum, a locus of control is sought. The identification of component parts in a
13 For example, in the mechanism of neurotransmitter release described by Craver (2007, pp. 22-24) Ca2+ is a component part of the mechanism, whereas the operations are the intracellular reactions triggered by Ca2+. They are parts and operations precisely because they play a role in producing the phenomenon, in this case, the release of neurotransmitters in the synaptic cleft. 124 Chapters 5: A Mechanistic Standpoint on Content-NCC Research mechanism is, by itself, not sufficient to achieve a complete explanation. Operations must be localized as well: this is to say that operations must be connected with the relevant component parts of the mechanism. This in turns yields insights into the system’s organization (Bechtel & Richardson 2010, p. 246)14. Finally, once a complete decomposition has been achieved, we should reassemble the mechanism to see whether it produces the explanandum phenomenon (Bechtel & Richardson 2010).
Is content-NCC research mechanistic? A quick glance at the literature reveals the widespread use of the term “mechanism” in NCC research. Consider the following passages; Aru & Bachamnn’s (2015) paper bears the title “Still wanted — the mechanisms of consciousness;” Koch defines content-NCCs as «the smallest set of brain mechanisms […] sufficient for some conscious feeling» (2004, pp. xv-xvi); Bachmann & Hudetz talk about «brain mechanisms and processes that have been proposed as necessary for consciousness» (2014, p. 3); Tononi & Koch define the NCCs as «minimal neuronal mechanisms that are jointly sufficient for any one specific conscious percept» (2008, p. 246) (all emphases are mine). Of course, mere terminological congruence is not by itself a reason to believe that content-NCC research is mechanistic. More relevant than terminology is the decompositional strategy of consciousness studies, which is exemplified by the words of Francis Crick: «while the whole may not be the simple sum of the separate parts, its behavior can, at least in principle, be understood from the nature and behavior of its parts plus the knowledge of how all these parts interact» (1994, p. 11). As I will show, this strategy is perfectly consistent with a mechanistic approach.
We have seen (§1.1) that human agents15 exercise the remarkable cognitive skills of identifying material objects in the world (Ch. 4), objects whose properties are extracted and made manifest in states of seeing. In virtue of what does an organism possess this capacity? A first answer may be to accept something like Chalmers’ definition: a visual accuracy phenomenon is conscious in virtue of a specialized mechanism that just makes contents conscious. However, a closer inspection at this concept reveals that things are more complex. Firstly, it seems that—given at least the possibility (and the empirical evidence thereof) of unconscious content—one phenomenon that deserves explanation is content itself. Secondly, given that not all contents are conscious, and that sometimes a particular content is selected over other options, it seems that there must be some kind of mechanism selecting contents to become conscious. Thirdly, there is the proper question of explaining what exactly makes a content conscious. In the next subsections, I set out to show that all these different phenomena are at play behind the
14 It is sometimes said that mechanisms afford a third way for thinking about explanation, between ruthless reductive accounts (Bickle 2003), and emergentism (Bechtel 2008a, & Richardson 2010, pp. xliv-xlvii; cfr. also Hensel 2013). In what sense mechanistic explanations can be said to occupy such a middle ground depends also on how we articulate the notion of “reduction.” I gloss over the problem of reduction in this work. 15 I here focus on humans, but of course, many of the experiment devised to uncover the structure of the visual system have been performed on monkeys. 125 Chapters 5: A Mechanistic Standpoint on Content-NCC Research somewhat obscure concept of “content-NCC.” These phenomena all contribute to fix the representational content of states of seeing. I will thereby show that current scientific research on content-NCCs actually reflects these different functions, and that the very notion of “content- NCC” is just a somewhat obscure label for research on different mechanisms that subserve different functions. In other words, scientific practice does not aim at finding Chalmers’ content-NCCs.
4.2 Decomposing Content-NCCs
The scientific search for neural correlates of the contents of consciousness, it will now be shown, is not tailored to look for Chalmers’ “content-NCCs.” A closer look at the experimental practice and theoretical assumptions reveal that there are at least three different kinds of mechanisms that are the object of content-NCC science. I call them: intentional mechanisms (§4.2.1), selection mechanisms (§4.2.2), and proper-NCC (§4.2.3). I justify the distinction between these different kinds of mechanisms in the next subsections. My account stands in contrast with Chalmers’ assumption that there must be (a) “content-NCC(s).” All these mechanisms are jointly responsible for producing and making a content conscious.
4.2.1 Intentional Mechanisms
In order to enjoy a state of seeing a visual object, the cognitive system must first generate content. In other words, there must be some mechanisms responsible for fixing the visual accuracy phenomena, in our case, visual objects. Strictly speaking, the problem of explaining how the cognitive system generates content is not an aspect of the quest for explaining consciousness, but an aspect of the problem of naturalizing intentionality. The explanation of visual accuracy phenomena is a paradigmatic example of successful mechanistic decomposition. I call the mechanisms responsible for content intentional mechanisms (IM) (Vernazzani 2015).
Explanation in psychology proceeds by means of functional analysis or decomposition (e.g. Cummins 1983, 2000; Dennett 1978; Fodor 1968; Piccinini & Craver 2011; Putnam 1960). There are different forms of functional analysis, but the general idea is that a complex capacity can be studied through decomposition into smaller and more tractable sub-capacities. Analogously, we can start by observing a psychological phenomenon, or set of phenomena, and then decompose it into a number of sub-phenomena. This is precisely the strategy developed by Cummins (1983, 2000), and that Piccinini & Craver (2011) call “task analysis.” The decomposition of the explanandum capacity can obey different functional criteria. Consider the case of visual objects. Visual objects are composed by many, distinct, properties which can be studied independently, and that together form a coherent whole, a visual accuracy phenomenon. Take a visual object, Ψ. (Notice that I follow the convention, introduced in Ch. 2, §1.1-2 of addressing the relational structure of the Phenomenological Domain Ψ with Ψ; as it
126 Chapters 5: A Mechanistic Standpoint on Content-NCC Research is by now clear, such relational structures are the visual objects, cfr. Ch. 4, Ch. 7. Visual objects are our explananda). Ψ can be decomposed into a number of sub-phenomena (Fig. 12).