Denaturalizing Information Visualization by Gabriel Resch A thesis submitted in conformity with the requirements for the degree of Doctor of Philosophy Graduate Department of Faculty of Information University of Toronto Copyright © 2019 by Gabriel Resch Released under the WTFPL free software license. Abstract Denaturalizing Information Visualization Gabriel Resch Doctor of Philosophy Graduate Department of Faculty of Information University of Toronto 2019 This dissertation investigates how, behind the recent proliferation of information visual- ization technologies, a number of opaque epistemic conventions structure distinct prac- tices of data analysis, sensemaking, argumentation, and persuasion. The dissertation’s primary claim is that contemporary infovis practices and tools naturalize specific repre- sentational forms and modes of interaction (e.g. ocularcentric objectivity) at the expense of others. It examines this naturalization process through a series of four interconnected case studies that consider, in turn, the translation of 2D images and graphics into tangible 3D objects; the development of two multimodal visualization projects; scale experiments in a virtual reality-based visualization environment; and an empirical study of 14 blind and visually impaired citizens interacting with tactile data objects. By surfacing specific naturalizations and attempting to denaturalize them, these four case studies illuminate a host of critical issues (e.g. a long-simmering tension between truth and aesthetic con- cerns) raised by the appearance of new interactive approaches to visualization. In doing so, they also demonstrate alternative visualization methods that might be deployed in service of a more critical infovis practice. As a result, the dissertation contributes to an emerging body of critical infovis research that spans domains ranging from HCI to critical data studies. Visualization media has become the de facto currency of data in- ii terpretation, and a rich and nuanced understanding of the epistemology of information visualization is absolutely necessary. Discussions around the challenge of multimodal representation, the tendency for new media to produce epistemic conflict, and the ben- efits of critical data literacy, all of which appear in the dissertation, will help colour in this rich and nuanced picture of visualization. iii What can be studied is always a relationship or an infinite regress of relationships. Never a “thing.” Gregory Bateson (2000, p. 246) iv Acknowledgements While this is original research, I can hardly take sole credit for many of the ideas that it documents. I stand on the shoulders of numerous giants, and there are so many people who have earned my endless gratitude that a truly exhaustive list would be impossible. That said, I must first thank my family. My parents, Sharon Cory and Michael Resch, and brothers Simon and Manny - you have all set the bar so high. Judi Kibbe, for always reminding me of the finish line and providing support throughout the years. Watts, who made it through my first few months of the PhD like a proud mother, and Volta, my walking companion on many cold nights as I sketched out ideas. All my family at Toronto BJJ, Jorge Britto, Josh Rapport, and especially Nathan Rector for putting your faith in me. My committee members, Cosmin Munteanu and Costis Dallas, whose experienced in- sights will forever be appreciated. Michelle Murphy, my internal reader, who inspired my approach to critical research from the time I was a new doctoral student. Chris Salter, my external examiner, whose model of scholarship has given me something to aspire toward. Cara Krmpotich, who helped me learn how to write for an academic audience, and has been supportive at various points along this journey. All the Inforum staff and librarians who have provided ideas and support throughout the years. Carol, Glen, Anna, Kathy, and all the other iSchool staff who have made so many things possible... and especially Christine Chan, the real central nervous system of the Faculty of Information. I owe a special debt of gratitude to Aida, Luis, and (especially) Sylvia, my companions on many late nights in Bissell. I wish you all the best in retirement. You have earned it tenfold! To everyone who has taken part in or supported research I’ve carried out, including all v those who participated in the InclusiVis project. eCampusOntario, Intel, and Autodesk for financial support. Donald Knuth for LaTeX, RMS for Emacs, and everyone else who has contributed to the free and open software I’ve used throughout my work. To my many mentors, collaborators, and colleagues... Jim Slotta, Cheryl Madeira, and all of my Encore Lab family. Diego Gonzaĺez, Sarah Choukah, Arno Verhoeven, Yanni Loukissas, Shayne Dahl, Margaux Smith, Chris Castle, and Sabrina Greupner for so many great ideas - I truly hope we will work together in the future. All of my Semaphore colleagues, who are far too many to list but hopefully know how much I appreciate every- thing they’ve given me (especially Amy, Isaac, and Adam). iSchool doctoral colleagues, particularly those who came before me and opened so many doors (Hannah, Quinn, An- tonio, Ashley). Again, there are so many of you who deserve recognition... it feels unfair, but also necessary, to only highlight a few by name. Andy Keenan for jokes. Jenna Jacobson for keeping us respectable. Christie Oh for coffee talk. And to my closest collaborators... Dan Southwick, my comrade in arms. A better colleague could never exist! Matt Ratto, for being the best supervisor someone like me could ask for! The gratitude I have for everything that you two have given me really cannot be expressed. Finally, Alden and Yuri, for having to sacrifice. I only did this because of you two. Watching you grow up throughout this period has been far more rewarding than the completion of a dissertation could ever be. And, of course, Alanna, who courageously battled cancer while I was nearing the end of this. Any hardships I have faced pale in comparison to what you have been through. Without your support, none of this would ever have been possible. To you, I will always dedicate everything. vi Contents 1 Visual Information1 Introduction: Information Anxiety........................1 Denaturalization...............................8 Representation................................ 11 Proliferation of Infovis............................ 13 Statement of Thesis................................. 17 Naturalizations the Dissertation Surfaces.................. 20 Research Questions.............................. 21 Methodological Approach.......................... 22 Structure of the Dissertation............................ 24 Chapter 2................................... 24 Chapter 3................................... 25 vii Chapter 4................................... 25 Chapter 5................................... 26 Chapter 6................................... 26 Contribution and Advancing Scholarship..................... 27 Scholarly Contribution............................ 27 Public Contribution.............................. 29 2 Crises of Ocularcentrism 31 Introduction: Ocularcentrism and Representation................ 32 Entanglements of Representation...................... 37 Diffractive Reading.............................. 41 Naturalization: Cartesian Ocularcentrism..................... 43 Case Study: Photographic Reliefs......................... 46 Project Description.............................. 48 Naturalizations in 3D Translation...................... 57 Method: Transduction............................... 61 Conclusion...................................... 68 viii 3 Visualization: Epistemic Technology 70 Introduction: The Epistemology of Infovis.................... 71 Epistemic Objects............................... 72 Epistemic Technologies............................ 74 What is Infovis? Where does it Come From? What does it do?........ 77 Historical Roots................................ 78 Modern Era.................................. 85 What is a Graph?............................... 87 What Do Graphs Do?............................ 91 Naturalization: Aesthetics vs Truth........................ 94 Mathesis and Graphesis........................... 95 Grammar of Graphics............................. 97 Aesthetics|Truth Entanglement....................... 101 Case Study: Prototyping Multimodal Visualization Interfaces......... 102 Visualizing Craft Expertise.......................... 103 Self Tracking Narratives........................... 106 Connections.................................. 110 ix Method: Critical Visualization........................... 111 Conclusion...................................... 113 4 Visualizing The Embodied Data Sublime 117 Introduction: The Data Sublime.......................... 117 The Sublime.................................. 120 The Anti-Sublime............................... 123 Immersive Visualization........................... 126 Naturalization: Disembodiment and Scale.................... 131 Case Study: The Embodied Data Sublime.................... 134 Project Description.............................. 135 Denaturalizing Scale............................. 140 Method: Estrangement............................... 142 Conclusion...................................... 144 5 Beyond the Visual 147 Introduction: Tangible and Multisensory Visualization............. 148 Multisensory Interaction........................... 150 Tactile Infovis and Data “Physicalization”................. 153 x Naturalization: