The Challenges of Exploring Local Place as a Context of Use in the Study of Interactive Risk Visualizations* Experience Report D. P. Richards Old Dominion University Norfolk, Virginia, USA [email protected] ABSTRACT This experience report shares the results of a user experience (UX) test on Climate Central’s Risk Zone Map (riskfinder.org), a risk group engage in decision making to better their lives. publicly-accessible, interactive sea level rise viewer. The Designing for user agency in decision making, indeed report begins with a brief overview of the trends in risk designing tools that possess usefulness [2] to vulnerable communication and risk visualization, with particular populations requires study of broad contexts of use and emphasis on the concept of place. The report then outlines the patterns of inquiry with each specific technology. But, because design of the study and methods used: think-aloud protocol many public health risks are largely factored by geographical and tasks analysis through Usertesting.com’s screencasting location, and because emerging scholarship in risk feature. Lastly, the report shares the findings of the study and communication advocates for techniques tailored to specific, discusses how they contribute to geographic place as a localized populations [3-5] UX design cannot lose sight of the context of use worthy of exploration. The report ends with importance of physical, material place in the study of widely recommendations for UX research further exploring accessible, interactive online tools. The challenge moving forward geographic place as a context of use. thus becomes: Despite our increasingly global understanding of public health risks, information and UX designers cannot CCS CONCEPTS lose sight of highly-localized attention to place. • Human-centered computing → Visualization design and evaluation methods This experience report uses the urgent topic of the effects of sea level rise on coastal communities to frame the challenge of KEYWORDS including local place as a critical context of use in the future development and study of risk-based communication platforms. User Experience; Risk Communication; Visual Risk Building upon issues identified in recent qualitative UX research Communication; Data Visualization; Qualitative Methods with interactive sea level rise viewers, or ISLRVs [6-7], this experience report discusses the ongoing work of this researcher in 1 INTRODUCTION public usage of ISLRVs, with specific attention to the connections between user experience (UX) design and risk communication. As we continue to live within what Ulrich Beck calls a “world While most research in this area has focused on the technical risk society” [1], technical communicators and information usability of these tools [8-9], this experience report shares and designers will increasingly be tasked with designing, reflects on the mixed-methods results of a second iteration of a researching, and testing online, interactive technologies that UX study. communicate data on a wide variety of public health risks, from sea level rise, to water quality, to domestic oil 2 TRENDS IN RISK VISUALIZATION production. Beyond merely communicating data visually to a public audience, however, these technologies can—and one Residing right at the intersection of localization and might argue, should—also be assistive in helping users of a visualization trends in risk communication and risk given at- scholarship are interactive sea level rise viewers, or ISLRVs Permission to make digital or hard copies of all or part of this work for for short. To increase public and stakeholder engagement personal or classroom use is granted without fee provided that copies are with scientific data on sea level rise, many government not made or distributed for profit or commercial advantage and that copies agencies, nonprofit organizations, and environmental bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. advocacy outlets are designing online, interactive data Abstracting with credit is permitted. To copy otherwise, or republish, to visualizations that allow users the ability to explore various post on servers or to redistribute to lists, requires prior specific displayed projections of sea level rise and associated impacts permission and/or a fee. Request permissions from [email protected]. SIGDOC '17, August 11-13, 2017, Halifax, NS, Canada in a given geographical area. While some were crafted as © 2017 Association for Computing Machinery. ACM ISBN 978-1-4503-5160-7/17/08…$15.00 https://doi.org/10.1145/3121113.3121208 ACM SIGDOC, August 2017, Halifax, Nova Scotia, Canada D. P. Richards powerful decision-making tools for city planners, coastal or final decision-making, they still have the potential to influence floodplain managers, and engineers who are looking to make a user’s perception of risk to themselves or their community data-driven risk assessments pertaining to water inundation [14] and it is imperative that these tools do as much as they in a given region and who are looking for engaging ways to can to ensure accurate risk assessment and ease of present such data to other stakeholders in the given localization. More work needs to be done appealing to a user’s community (as evidenced by the complexity of design), these sense of place, and thus more research is needed on tools can be used and harnessed by the lay public to make geographic place as a context of use (see Huatong Sun’s general risk assessments about sea level rise in their own seminal work on cultural usability and cross-cultural contexts community. They can serve as critical risk communication of use [15]). tools that engage the public and allow users to zoom into their location and tinker with settings to make general assessments 3 STUDY DESIGN about the timing and scope of their vulnerability to the This study design was informed by the first iteration of this changing climate and rising seas. As tools with the potential to research project, which asked residents of a specific locale to empower residents of coastal states to tailor risk data to their openly explore the Risk Zone Map [7]. The first study was own location, and thus empower residents to make decisions open enough to find out the types of tasks and problems and solve problems related to their prolonged livelihood, resident users wanted to broach. The 12-person user cohort ISLRVs represent precisely the type of technology that would identified being able to locate a specific property and assess be of any interest to scholars in technical communication its vulnerability by feet of water as an important task. As such, interested in public understanding of science, risk this study—the second iteration—included this task as one of communication strategies, and visual rhetorics of science. the several tasks and domains of user experience tested. The They offer possibilities for thinking about engagement and of following scenario was provided on screen at the beginning of environmental risks and opportunities for research. the testing session: Research on these types of tools have revealed that some Climate Central’s Risk Zone Map shows areas vulnerable to users may have difficulty with interpreting maps [10-11], and flooding from different combinations of sea level rise, storm studies using subject-matter experts in the development of surge, tides, and tsunamis, or to permanent submersion by ISLRVs had respondents even acknowledge the issues the long-term sea level rise. […] Imagine you stumble upon this public might have with using these tools for decision-making interactive site while researching property in a coastal [12]. As open data exploration tools, a public lay user might state. You are curious as to what the site has to offer given stumble upon an open, online ISLRV and be faced with your own concerns about storms and/or sea level rise. You complex challenges related to scientific and risk literacy. begin to play around with the site. While users might be able to locate themselves using the interface familiar to anyone who has used Google Maps, The purpose of this report is to explore any connections understanding and making risk assessments presents another between geographic place and use of the tool. challenge. Most ISLRVs have sliders that allow users to select a water level (e.g., 6 feet) so users might be able to visualize at what level of inundation their property or region would be affected; but would this be accurate? And how would the user know? This would require at least some basic understanding of water levels as some tools, such as Climate Central’s (Figure 2), begin the user at 5 feet—which might imply that the current coast is at 5 feet, as opposed to it starting out the user with some visualization cues and direction as to how to use the slider. Also lacking are significant contextual markers. Lay users might be led to make inaccurate risk assessments about their vulnerability and might not have the contextual, place- based knowledge to make broader statements about the risk of the region at hand. Sonia Stephens has coined this issue with ISLRVs as a problem of “too much agency” [13]. Given the Figure 1: Google Map of locations explored by the users. openness of data and the complexity of the tools’ designs, All states Were covered except for AL, MS, ME, and DE. users face too many choices, too many variables, too many moving parts to even answer the most basic questions, such 3.1 Participants as: What type of event would cause my house to flood? Or, Participants were recruited and observed through where in this neighborhood should I purchase a home? While UserTesting.com’s audio plus screen-capturing usability tool. disclaimers on several sites warn against using these tools for Participants were not restricted to coastal states but could 2 The Importance of Localized Design in the Context of Global ACM SIGDOC, August 2017, Halifax, Nova Scotia, Canada Risks take the test from anywhere in the continental United States place as a context of use requires specific attention to how (Figure 1).