A Task-Based Taxonomy of Cognitive Biases for Information Visualization
Total Page:16
File Type:pdf, Size:1020Kb
Load more
Recommended publications
-
Addressing Cognitive Biases in Augmented Business Decision Systems Human Performance Metrics for Generic AI-Assisted Decision Making
Addressing Cognitive Biases in Augmented Business Decision Systems Human performance metrics for generic AI-assisted decision making. THOMAS BAUDEL* IBM France Lab, Orsay, France MANON VERBOCKHAVEN IBM France Lab & ENSAE VICTOIRE COUSERGUE IBM France Lab, Université Paris-Dauphine & Mines ParisTech GUILLAUME ROY IBM France Lab & ENSAI RIDA LAARACH IBM France Lab, Telecom ParisTech & HEC How do algorithmic decision aids introduced in business decision processes affect task performance? In a first experiment, we study effective collaboration. Faced with a decision, subjects alone have a success rate of 72%; Aided by a recommender that has a 75% success rate, their success rate reaches 76%. The human-system collaboration had thus a greater success rate than each taken alone. However, we noted a complacency/authority bias that degraded the quality of decisions by 5% when the recommender was wrong. This suggests that any lingering algorithmic bias may be amplified by decision aids. In a second experiment, we evaluated the effectiveness of 5 presentation variants in reducing complacency bias. We found that optional presentation increases subjects’ resistance to wrong recommendations. We conclude by arguing that our metrics, in real usage scenarios, where decision aids are embedded as system-wide features in Business Process Management software, can lead to enhanced benefits. CCS CONCEPTS • Cross-computing tools and techniques: Empirical studies, Information Systems: Enterprise information systems, Decision support systems, Business Process Management, Human-centered computing, Human computer interaction (HCI), Visualization, Machine Learning, Automation Additional Keywords and Phrases: Business decision systems, Decision theory, Cognitive biases * [email protected]. 1 INTRODUCTION For the past 20 years, Business Process Management (BPM) [29] and related technologies such as Business Rules [10, 52] and Robotic Process Automation [36] have streamlined processes and operational decision- making in large enterprises, transforming work organization. -
Conjunction Fallacy' Revisited: How Intelligent Inferences Look Like Reasoning Errors
Journal of Behavioral Decision Making J. Behav. Dec. Making, 12: 275±305 (1999) The `Conjunction Fallacy' Revisited: How Intelligent Inferences Look Like Reasoning Errors RALPH HERTWIG* and GERD GIGERENZER Max Planck Institute for Human Development, Berlin, Germany ABSTRACT Findings in recent research on the `conjunction fallacy' have been taken as evid- ence that our minds are not designed to work by the rules of probability. This conclusion springs from the idea that norms should be content-blind Ð in the present case, the assumption that sound reasoning requires following the con- junction rule of probability theory. But content-blind norms overlook some of the intelligent ways in which humans deal with uncertainty, for instance, when drawing semantic and pragmatic inferences. In a series of studies, we ®rst show that people infer nonmathematical meanings of the polysemous term `probability' in the classic Linda conjunction problem. We then demonstrate that one can design contexts in which people infer mathematical meanings of the term and are therefore more likely to conform to the conjunction rule. Finally, we report evidence that the term `frequency' narrows the spectrum of possible interpreta- tions of `probability' down to its mathematical meanings, and that this fact Ð rather than the presence or absence of `extensional cues' Ð accounts for the low proportion of violations of the conjunction rule when people are asked for frequency judgments. We conclude that a failure to recognize the human capacity for semantic and pragmatic inference can lead rational responses to be misclassi®ed as fallacies. Copyright # 1999 John Wiley & Sons, Ltd. KEY WORDS conjunction fallacy; probabalistic thinking; frequentistic thinking; probability People's apparent failures to reason probabilistically in experimental contexts have raised serious concerns about our ability to reason rationally in real-world environments. -
Bad Is Stronger Than Good
Review of General Psychology Copyright 2001 by the Educational Publishing Foundation 2001. Vol. 5. No. 4. 323-370 1089-2680/O1/S5.O0 DOI: 10.1037//1089-2680.5.4.323 Bad Is Stronger Than Good Roy F. Baumeister and Ellen Bratslavsky Catrin Finkenauer Case Western Reserve University Free University of Amsterdam Kathleen D. Vohs Case Western Reserve University The greater power of bad events over good ones is found in everyday events, major life events (e.g., trauma), close relationship outcomes, social network patterns, interper- sonal interactions, and learning processes. Bad emotions, bad parents, and bad feedback have more impact than good ones, and bad information is processed more thoroughly than good. The self is more motivated to avoid bad self-definitions than to pursue good ones. Bad impressions and bad stereotypes are quicker to form and more resistant to disconfirmation than good ones. Various explanations such as diagnosticity and sa- lience help explain some findings, but the greater power of bad events is still found when such variables are controlled. Hardly any exceptions (indicating greater power of good) can be found. Taken together, these findings suggest that bad is stronger than good, as a general principle across a broad range of psychological phenomena. Centuries of literary efforts and religious pothesis that bad is stronger than good (see also thought have depicted human life in terms of a Rozin & Royzman, in press). That is, events struggle between good and bad forces. At the that are negatively valenced (e.g., losing metaphysical level, evil gods or devils are the money, being abandoned by friends, and receiv- opponents of the divine forces of creation and ing criticism) will have a greater impact on the harmony. -
Ambiguity Aversion in Qualitative Contexts: a Vignette Study
Ambiguity aversion in qualitative contexts: A vignette study Joshua P. White Melbourne School of Psychological Sciences University of Melbourne Andrew Perfors Melbourne School of Psychological Sciences University of Melbourne Abstract Most studies of ambiguity aversion rely on experimental paradigms involv- ing contrived monetary bets. Thus, the extent to which ambiguity aversion is evident outside of such contexts is largely unknown, particularly in those contexts which cannot easily be reduced to numerical terms. The present work seeks to understand whether ambiguity aversion occurs in a variety of different qualitative domains, such as work, family, love, friendship, exercise, study and health. We presented participants with 24 vignettes and measured the degree to which they preferred risk to ambiguity. In a separate study we asked participants for their prior probability estimates about the likely outcomes in the ambiguous events. Ambiguity aversion was observed in the vast majority of vignettes, but at different magnitudes. It was predicted by gain/loss direction but not by the prior probability estimates (with the inter- esting exception of the classic Ellsberg ‘urn’ scenario). Our results suggest that ambiguity aversion occurs in a wide variety of qualitative contexts, but to different degrees, and may not be generally driven by unfavourable prior probability estimates of ambiguous events. Corresponding Author: Joshua P. White ([email protected]) AMBIGUITY AVERSION IN QUALITATIVE CONTEXTS: A VIGNETTE STUDY 2 Introduction The world is replete with the unknown, yet people generally prefer some types of ‘unknown’ to others. Here, an important distinction exists between risk and uncertainty. As defined by Knight (1921), risk is a measurable lack of certainty that can be represented by numerical probabilities (e.g., “there is a 50% chance that it will rain tomorrow”), while ambiguity is an unmeasurable lack of certainty (e.g., “there is an unknown probability that it will rain tomorrow”). -
Avoiding the Conjunction Fallacy: Who Can Take a Hint?
Avoiding the conjunction fallacy: Who can take a hint? Simon Klein Spring 2017 Master’s thesis, 30 ECTS Master’s programme in Cognitive Science, 120 ECTS Supervisor: Linnea Karlsson Wirebring Acknowledgments: The author would like to thank the participants for enduring the test session with challenging questions and thereby making the study possible, his supervisor Linnea Karlsson Wirebring for invaluable guidance and good questions during the thesis work, and his fiancée Amanda Arnö for much needed mental support during the entire process. 2 AVOIDING THE CONJUNCTION FALLACY: WHO CAN TAKE A HINT? Simon Klein Humans repeatedly commit the so called “conjunction fallacy”, erroneously judging the probability of two events occurring together as higher than the probability of one of the events. Certain hints have been shown to mitigate this tendency. The present thesis investigated the relations between three psychological factors and performance on conjunction tasks after reading such a hint. The factors represent the understanding of probability and statistics (statistical numeracy), the ability to resist intuitive but incorrect conclusions (cognitive reflection), and the willingness to engage in, and enjoyment of, analytical thinking (need-for-cognition). Participants (n = 50) answered 30 short conjunction tasks and three psychological scales. A bimodal response distribution motivated dichotomization of performance scores. Need-for-cognition was significantly, positively correlated with performance, while numeracy and cognitive reflection were not. The results suggest that the willingness to engage in, and enjoyment of, analytical thinking plays an important role for the capacity to avoid the conjunction fallacy after taking a hint. The hint further seems to neutralize differences in performance otherwise predicted by statistical numeracy and cognitive reflection. -
Gender De-Biasing in Speech Emotion Recognition
INTERSPEECH 2019 September 15–19, 2019, Graz, Austria Gender de-biasing in speech emotion recognition Cristina Gorrostieta, Reza Lotfian, Kye Taylor, Richard Brutti, John Kane Cogito Corporation fcgorrostieta,rlotfian,ktaylor,rbrutti,jkaneg @cogitocorp.com Abstract vertisement delivery [9], object classification [10] and image search results for occupations [11] . Machine learning can unintentionally encode and amplify neg- There are several factors which can contribute to produc- ative bias and stereotypes present in humans, be they conscious ing negative bias in machine learning models. One major cause or unconscious. This has led to high-profile cases where ma- is incomplete or skewed training data. If certain demographic chine learning systems have been found to exhibit bias towards categories are missing from the training data, models developed gender, race, and ethnicity, among other demographic cate- on this can fail to generalise when applied to new data contain- gories. Negative bias can be encoded in these algorithms based ing those missing categories. The majority of models deployed on: the representation of different population categories in the in modern technology applications are based on supervised ma- training data; bias arising from manual human labeling of these chine learning and much of the labeled data comes from people. data; as well as modeling types and optimisation approaches. In Labels can include movie reviews, hotel ratings, image descrip- this paper we assess the effect of gender bias in speech emotion tions, audio transcriptions, and perceptual ratings of emotion. recognition and find that emotional activation model accuracy is As people are inherently biased, and because models are an es- consistently lower for female compared to male audio samples. -
The Art of Thinking Clearly
For Sabine The Art of Thinking Clearly Rolf Dobelli www.sceptrebooks.co.uk First published in Great Britain in 2013 by Sceptre An imprint of Hodder & Stoughton An Hachette UK company 1 Copyright © Rolf Dobelli 2013 The right of Rolf Dobelli to be identified as the Author of the Work has been asserted by him in accordance with the Copyright, Designs and Patents Act 1988. All rights reserved. No part of this publication may be reproduced, stored in a retrieval system, or transmitted, in any form or by any means without the prior written permission of the publisher, nor be otherwise circulated in any form of binding or cover other than that in which it is published and without a similar condition being imposed on the subsequent purchaser. A CIP catalogue record for this title is available from the British Library. eBook ISBN 978 1 444 75955 6 Hardback ISBN 978 1 444 75954 9 Hodder & Stoughton Ltd 338 Euston Road London NW1 3BH www.sceptrebooks.co.uk CONTENTS Introduction 1 WHY YOU SHOULD VISIT CEMETERIES: Survivorship Bias 2 DOES HARVARD MAKE YOU SMARTER?: Swimmer’s Body Illusion 3 WHY YOU SEE SHAPES IN THE CLOUDS: Clustering Illusion 4 IF 50 MILLION PEOPLE SAY SOMETHING FOOLISH, IT IS STILL FOOLISH: Social Proof 5 WHY YOU SHOULD FORGET THE PAST: Sunk Cost Fallacy 6 DON’T ACCEPT FREE DRINKS: Reciprocity 7 BEWARE THE ‘SPECIAL CASE’: Confirmation Bias (Part 1) 8 MURDER YOUR DARLINGS: Confirmation Bias (Part 2) 9 DON’T BOW TO AUTHORITY: Authority Bias 10 LEAVE YOUR SUPERMODEL FRIENDS AT HOME: Contrast Effect 11 WHY WE PREFER A WRONG MAP TO NO -
MITIGATING COGNITIVE BIASES in RISK IDENTIFICATION: Practitioner Checklist for the AEROSPACE SECTOR
MITIGATING COGNITIVE BIASES IN RISK IDENTIFICATION: Practitioner Checklist for the AEROSPACE SECTOR Debra L. Emmons, Thomas A. Mazzuchi, Shahram Sarkani, and Curtis E. Larsen This research contributes an operational checklist for mitigating cogni- tive biases in the aerospace sector risk management process. The Risk Identification and Evaluation Bias Reduction Checklist includes steps for grounding the risk identification and evaluation activities in past project experiences through historical data, and emphasizes the importance of incorporating multiple methods and perspectives to guard against optimism and a singular project instantiation-focused view. The authors developed a survey to elicit subject matter expert judgment on the value of the check- list to support its use in government and industry as a risk management tool. The survey also provided insights on bias mitigation strategies and lessons learned. This checklist addresses the deficiency in the literature in providing operational steps for the practitioner to recognize and implement strategies for bias reduction in risk management in the aerospace sector. DOI: https://doi.org/10.22594/dau.16-770.25.01 Keywords: Risk Management, Optimism Bias, Planning Fallacy, Cognitive Bias Reduction Mitigating Cognitive Biases in Risk Identification http://www.dau.mil January 2018 This article and its accompanying research contribute an operational FIGURE 1. RESEARCH APPROACH Risk Identification and Evaluation Bias Reduction Checklist for cognitive bias mitigation in risk management for the aerospace sector. The checklist Cognitive Biases & Bias described herein offers a practical and implementable project management Enabling framework to help reduce biases in the aerospace sector and redress the Conditions cognitive limitations in the risk identification and analysis process. -
Bias and Fairness in NLP
Bias and Fairness in NLP Margaret Mitchell Kai-Wei Chang Vicente Ordóñez Román Google Brain UCLA University of Virginia Vinodkumar Prabhakaran Google Brain Tutorial Outline ● Part 1: Cognitive Biases / Data Biases / Bias laundering ● Part 2: Bias in NLP and Mitigation Approaches ● Part 3: Building Fair and Robust Representations for Vision and Language ● Part 4: Conclusion and Discussion “Bias Laundering” Cognitive Biases, Data Biases, and ML Vinodkumar Prabhakaran Margaret Mitchell Google Brain Google Brain Andrew Emily Simone Parker Lucy Ben Elena Deb Timnit Gebru Zaldivar Denton Wu Barnes Vasserman Hutchinson Spitzer Raji Adrian Brian Dirk Josh Alex Blake Hee Jung Hartwig Blaise Benton Zhang Hovy Lovejoy Beutel Lemoine Ryu Adam Agüera y Arcas What’s in this tutorial ● Motivation for Fairness research in NLP ● How and why NLP models may be unfair ● Various types of NLP fairness issues and mitigation approaches ● What can/should we do? What’s NOT in this tutorial ● Definitive answers to fairness/ethical questions ● Prescriptive solutions to fix ML/NLP (un)fairness What do you see? What do you see? ● Bananas What do you see? ● Bananas ● Stickers What do you see? ● Bananas ● Stickers ● Dole Bananas What do you see? ● Bananas ● Stickers ● Dole Bananas ● Bananas at a store What do you see? ● Bananas ● Stickers ● Dole Bananas ● Bananas at a store ● Bananas on shelves What do you see? ● Bananas ● Stickers ● Dole Bananas ● Bananas at a store ● Bananas on shelves ● Bunches of bananas What do you see? ● Bananas ● Stickers ● Dole Bananas ● Bananas -
“Dysrationalia” Among University Students: the Role of Cognitive
“Dysrationalia” among university students: The role of cognitive abilities, different aspects of rational thought and self-control in explaining epistemically suspect beliefs Erceg, Nikola; Galić, Zvonimir; Bubić, Andreja Source / Izvornik: Europe’s Journal of Psychology, 2019, 15, 159 - 175 Journal article, Published version Rad u časopisu, Objavljena verzija rada (izdavačev PDF) https://doi.org/10.5964/ejop.v15i1.1696 Permanent link / Trajna poveznica: https://urn.nsk.hr/urn:nbn:hr:131:942674 Rights / Prava: Attribution 4.0 International Download date / Datum preuzimanja: 2021-09-29 Repository / Repozitorij: ODRAZ - open repository of the University of Zagreb Faculty of Humanities and Social Sciences Europe's Journal of Psychology ejop.psychopen.eu | 1841-0413 Research Reports “Dysrationalia” Among University Students: The Role of Cognitive Abilities, Different Aspects of Rational Thought and Self-Control in Explaining Epistemically Suspect Beliefs Nikola Erceg* a, Zvonimir Galić a, Andreja Bubić b [a] Department of Psychology, Faculty of Humanities and Social Sciences, University of Zagreb, Zagreb, Croatia. [b] Department of Psychology, Faculty of Humanities and Social Sciences, University of Split, Split, Croatia. Abstract The aim of the study was to investigate the role that cognitive abilities, rational thinking abilities, cognitive styles and self-control play in explaining the endorsement of epistemically suspect beliefs among university students. A total of 159 students participated in the study. We found that different aspects of rational thought (i.e. rational thinking abilities and cognitive styles) and self-control, but not intelligence, significantly predicted the endorsement of epistemically suspect beliefs. Based on these findings, it may be suggested that intelligence and rational thinking, although related, represent two fundamentally different constructs. -
The Lightbulb Paradox: Evidence from Two Randomized Experiments
NBER WORKING PAPER SERIES THE LIGHTBULB PARADOX: EVIDENCE FROM TWO RANDOMIZED EXPERIMENTS Hunt Allcott Dmitry Taubinsky Working Paper 19713 http://www.nber.org/papers/w19713 NATIONAL BUREAU OF ECONOMIC RESEARCH 1050 Massachusetts Avenue Cambridge, MA 02138 December 2013 We are grateful to Raj Chetty, Lucas Davis, Stefano DellaVigna, Mushfiq Mubarak, Sendhil Mullainathan, Emmanuel Saez, Josh Schwartzstein, and other colleagues, as well as seminar audiences at the ASSA Annual Meeting, the Behavioral Economics Annual Meeting, Berkeley, the European Summer Symposium for Economic Theory, Harvard, the NBER Public Economics Meetings, Resources for the Future, Stanford, the Stanford Institute for Theoretical Economics, UCLA, the University of California Energy Institute, and the University of Chicago for constructive feedback. We thank our research assistants - Jeremiah Hair, Nina Yang, and Tiffany Yee - as well as management at the partner company, for their work on the in-store experiment. Thanks to Stefan Subias, Benjamin DiPaola, and Poom Nukulkij at GfK for their work on the TESS experiment. We are grateful to the National Science Foundation and the Sloan Foundation for financial support. Files containing code for replication, the in-store experiment protocol, and audio for the TESS experiment can be downloaded from Hunt Allcott's website. The views expressed herein are those of the authors and do not necessarily reflect the views of the National Bureau of Economic Research. NBER working papers are circulated for discussion and comment purposes. They have not been peer- reviewed or been subject to the review by the NBER Board of Directors that accompanies official NBER publications. © 2013 by Hunt Allcott and Dmitry Taubinsky. -
Working Memory, Cognitive Miserliness and Logic As Predictors of Performance on the Cognitive Reflection Test
Working Memory, Cognitive Miserliness and Logic as Predictors of Performance on the Cognitive Reflection Test Edward J. N. Stupple ([email protected]) Centre for Psychological Research, University of Derby Kedleston Road, Derby. DE22 1GB Maggie Gale ([email protected]) Centre for Psychological Research, University of Derby Kedleston Road, Derby. DE22 1GB Christopher R. Richmond ([email protected]) Centre for Psychological Research, University of Derby Kedleston Road, Derby. DE22 1GB Abstract Most participants respond that the answer is 10 cents; however, a slower and more analytic approach to the The Cognitive Reflection Test (CRT) was devised to measure problem reveals the correct answer to be 5 cents. the inhibition of heuristic responses to favour analytic ones. The CRT has been a spectacular success, attracting more Toplak, West and Stanovich (2011) demonstrated that the than 100 citations in 2012 alone (Scopus). This may be in CRT was a powerful predictor of heuristics and biases task part due to the ease of administration; with only three items performance - proposing it as a metric of the cognitive miserliness central to dual process theories of thinking. This and no requirement for expensive equipment, the practical thesis was examined using reasoning response-times, advantages are considerable. There have, moreover, been normative responses from two reasoning tasks and working numerous correlates of the CRT demonstrated, from a wide memory capacity (WMC) to predict individual differences in range of tasks in the heuristics and biases literature (Toplak performance on the CRT. These data offered limited support et al., 2011) to risk aversion and SAT scores (Frederick, for the view of miserliness as the primary factor in the CRT.