Taxonomies of Cognitive Bias How They Built
Total Page:16
File Type:pdf, Size:1020Kb
Load more
Recommended publications
-
Addressing Cognitive Biases in Augmented Business Decision Systems Human Performance Metrics for Generic AI-Assisted Decision Making
Addressing Cognitive Biases in Augmented Business Decision Systems Human performance metrics for generic AI-assisted decision making. THOMAS BAUDEL* IBM France Lab, Orsay, France MANON VERBOCKHAVEN IBM France Lab & ENSAE VICTOIRE COUSERGUE IBM France Lab, Université Paris-Dauphine & Mines ParisTech GUILLAUME ROY IBM France Lab & ENSAI RIDA LAARACH IBM France Lab, Telecom ParisTech & HEC How do algorithmic decision aids introduced in business decision processes affect task performance? In a first experiment, we study effective collaboration. Faced with a decision, subjects alone have a success rate of 72%; Aided by a recommender that has a 75% success rate, their success rate reaches 76%. The human-system collaboration had thus a greater success rate than each taken alone. However, we noted a complacency/authority bias that degraded the quality of decisions by 5% when the recommender was wrong. This suggests that any lingering algorithmic bias may be amplified by decision aids. In a second experiment, we evaluated the effectiveness of 5 presentation variants in reducing complacency bias. We found that optional presentation increases subjects’ resistance to wrong recommendations. We conclude by arguing that our metrics, in real usage scenarios, where decision aids are embedded as system-wide features in Business Process Management software, can lead to enhanced benefits. CCS CONCEPTS • Cross-computing tools and techniques: Empirical studies, Information Systems: Enterprise information systems, Decision support systems, Business Process Management, Human-centered computing, Human computer interaction (HCI), Visualization, Machine Learning, Automation Additional Keywords and Phrases: Business decision systems, Decision theory, Cognitive biases * [email protected]. 1 INTRODUCTION For the past 20 years, Business Process Management (BPM) [29] and related technologies such as Business Rules [10, 52] and Robotic Process Automation [36] have streamlined processes and operational decision- making in large enterprises, transforming work organization. -
The Status Quo Bias and Decisions to Withdraw Life-Sustaining Treatment
HUMANITIES | MEDICINE AND SOCIETY The status quo bias and decisions to withdraw life-sustaining treatment n Cite as: CMAJ 2018 March 5;190:E265-7. doi: 10.1503/cmaj.171005 t’s not uncommon for physicians and impasse. One factor that hasn’t been host of psychological phenomena that surrogate decision-makers to disagree studied yet is the role that cognitive cause people to make irrational deci- about life-sustaining treatment for biases might play in surrogate decision- sions, referred to as “cognitive biases.” Iincapacitated patients. Several studies making regarding withdrawal of life- One cognitive bias that is particularly show physicians perceive that nonbenefi- sustaining treatment. Understanding the worth exploring in the context of surrogate cial treatment is provided quite frequently role that these biases might play may decisions regarding life-sustaining treat- in their intensive care units. Palda and col- help improve communication between ment is the status quo bias. This bias, a leagues,1 for example, found that 87% of clinicians and surrogates when these con- decision-maker’s preference for the cur- physicians believed that futile treatment flicts arise. rent state of affairs,3 has been shown to had been provided in their ICU within the influence decision-making in a wide array previous year. (The authors in this study Status quo bias of contexts. For example, it has been cited equated “futile” with “nonbeneficial,” The classic model of human decision- as a mechanism to explain patient inertia defined as a treatment “that offers no rea- making is the rational choice or “rational (why patients have difficulty changing sonable hope of recovery or improvement, actor” model, the view that human beings their behaviour to improve their health), or because the patient is permanently will choose the option that has the best low organ-donation rates, low retirement- unable to experience any benefit.”) chance of satisfying their preferences. -
A Task-Based Taxonomy of Cognitive Biases for Information Visualization
A Task-based Taxonomy of Cognitive Biases for Information Visualization Evanthia Dimara, Steven Franconeri, Catherine Plaisant, Anastasia Bezerianos, and Pierre Dragicevic Three kinds of limitations The Computer The Display 2 Three kinds of limitations The Computer The Display The Human 3 Three kinds of limitations: humans • Human vision ️ has limitations • Human reasoning 易 has limitations The Human 4 ️Perceptual bias Magnitude estimation 5 ️Perceptual bias Magnitude estimation Color perception 6 易 Cognitive bias Behaviors when humans consistently behave irrationally Pohl’s criteria distilled: • Are predictable and consistent • People are unaware they’re doing them • Are not misunderstandings 7 Ambiguity effect, Anchoring or focalism, Anthropocentric thinking, Anthropomorphism or personification, Attentional bias, Attribute substitution, Automation bias, Availability heuristic, Availability cascade, Backfire effect, Bandwagon effect, Base rate fallacy or Base rate neglect, Belief bias, Ben Franklin effect, Berkson's paradox, Bias blind spot, Choice-supportive bias, Clustering illusion, Compassion fade, Confirmation bias, Congruence bias, Conjunction fallacy, Conservatism (belief revision), Continued influence effect, Contrast effect, Courtesy bias, Curse of knowledge, Declinism, Decoy effect, Default effect, Denomination effect, Disposition effect, Distinction bias, Dread aversion, Dunning–Kruger effect, Duration neglect, Empathy gap, End-of-history illusion, Endowment effect, Exaggerated expectation, Experimenter's or expectation bias, -
Cognitive Bias Mitigation: How to Make Decision-Making More Rational?
Cognitive Bias Mitigation: How to make decision-making more rational? Abstract Cognitive biases distort judgement and adversely impact decision-making, which results in economic inefficiencies. Initial attempts to mitigate these biases met with little success. However, recent studies which used computer games and educational videos to train people to avoid biases (Clegg et al., 2014; Morewedge et al., 2015) showed that this form of training reduced selected cognitive biases by 30 %. In this work I report results of an experiment which investigated the debiasing effects of training on confirmation bias. The debiasing training took the form of a short video which contained information about confirmation bias, its impact on judgement, and mitigation strategies. The results show that participants exhibited confirmation bias both in the selection and processing of information, and that debiasing training effectively decreased the level of confirmation bias by 33 % at the 5% significance level. Key words: Behavioural economics, cognitive bias, confirmation bias, cognitive bias mitigation, confirmation bias mitigation, debiasing JEL classification: D03, D81, Y80 1 Introduction Empirical research has documented a panoply of cognitive biases which impair human judgement and make people depart systematically from models of rational behaviour (Gilovich et al., 2002; Kahneman, 2011; Kahneman & Tversky, 1979; Pohl, 2004). Besides distorted decision-making and judgement in the areas of medicine, law, and military (Nickerson, 1998), cognitive biases can also lead to economic inefficiencies. Slovic et al. (1977) point out how they distort insurance purchases, Hyman Minsky (1982) partly blames psychological factors for economic cycles. Shefrin (2010) argues that confirmation bias and some other cognitive biases were among the significant factors leading to the global financial crisis which broke out in 2008. -
The Art of Thinking Clearly
For Sabine The Art of Thinking Clearly Rolf Dobelli www.sceptrebooks.co.uk First published in Great Britain in 2013 by Sceptre An imprint of Hodder & Stoughton An Hachette UK company 1 Copyright © Rolf Dobelli 2013 The right of Rolf Dobelli to be identified as the Author of the Work has been asserted by him in accordance with the Copyright, Designs and Patents Act 1988. All rights reserved. No part of this publication may be reproduced, stored in a retrieval system, or transmitted, in any form or by any means without the prior written permission of the publisher, nor be otherwise circulated in any form of binding or cover other than that in which it is published and without a similar condition being imposed on the subsequent purchaser. A CIP catalogue record for this title is available from the British Library. eBook ISBN 978 1 444 75955 6 Hardback ISBN 978 1 444 75954 9 Hodder & Stoughton Ltd 338 Euston Road London NW1 3BH www.sceptrebooks.co.uk CONTENTS Introduction 1 WHY YOU SHOULD VISIT CEMETERIES: Survivorship Bias 2 DOES HARVARD MAKE YOU SMARTER?: Swimmer’s Body Illusion 3 WHY YOU SEE SHAPES IN THE CLOUDS: Clustering Illusion 4 IF 50 MILLION PEOPLE SAY SOMETHING FOOLISH, IT IS STILL FOOLISH: Social Proof 5 WHY YOU SHOULD FORGET THE PAST: Sunk Cost Fallacy 6 DON’T ACCEPT FREE DRINKS: Reciprocity 7 BEWARE THE ‘SPECIAL CASE’: Confirmation Bias (Part 1) 8 MURDER YOUR DARLINGS: Confirmation Bias (Part 2) 9 DON’T BOW TO AUTHORITY: Authority Bias 10 LEAVE YOUR SUPERMODEL FRIENDS AT HOME: Contrast Effect 11 WHY WE PREFER A WRONG MAP TO NO -
Attribution of Intentions and Context Processing in Psychometric Schizotypy
Cognitive Neuropsychiatry ISSN: 1354-6805 (Print) 1464-0619 (Online) Journal homepage: http://www.tandfonline.com/loi/pcnp20 Attribution of intentions and context processing in psychometric schizotypy Romina Rinaldi, Laurent Lefebvre, Wivine Blekic, Frank Laroi & Julien Laloyaux To cite this article: Romina Rinaldi, Laurent Lefebvre, Wivine Blekic, Frank Laroi & Julien Laloyaux (2018) Attribution of intentions and context processing in psychometric schizotypy, Cognitive Neuropsychiatry, 23:6, 364-376, DOI: 10.1080/13546805.2018.1528972 To link to this article: https://doi.org/10.1080/13546805.2018.1528972 Published online: 06 Oct 2018. Submit your article to this journal Article views: 33 View Crossmark data Full Terms & Conditions of access and use can be found at http://www.tandfonline.com/action/journalInformation?journalCode=pcnp20 COGNITIVE NEUROPSYCHIATRY 2018, VOL. 23, NO. 6, 364–376 https://doi.org/10.1080/13546805.2018.1528972 Attribution of intentions and context processing in psychometric schizotypy Romina Rinaldia,b, Laurent Lefebvreb, Wivine Blekicb, Frank Laroic,d,e and Julien Laloyauxc,d,e aGrand Hôpital de Charleroi, Hôpital Notre-Dame, Charleroi, Belgium; bCognitive psychology and Neuropsychology Department, University of Mons, Mons, Belgium; cDepartment of Biological and Medical Psychology, University of Bergen, Bergen, Norway; dNORMENT – Norwegian Center of Excellence for Mental Disorders Research, University of Oslo, Oslo, Norway; ePsychology and Neuroscience of Cognition Research Unit, University of Liège, Liège, Belgium ABSTRACT ARTICLE HISTORY Introduction: Impairment in Theory of mind (TOM) has frequently Received 26 January 2018 been associated with schizophrenia and with schizotypy. Studies Accepted 15 September 2018 have found that a tendency to over-attribute intentions and KEYWORDS special meaning to events and to people is related to positive Psychotic symptoms; theory psychotic symptoms. -
Bias and Fairness in NLP
Bias and Fairness in NLP Margaret Mitchell Kai-Wei Chang Vicente Ordóñez Román Google Brain UCLA University of Virginia Vinodkumar Prabhakaran Google Brain Tutorial Outline ● Part 1: Cognitive Biases / Data Biases / Bias laundering ● Part 2: Bias in NLP and Mitigation Approaches ● Part 3: Building Fair and Robust Representations for Vision and Language ● Part 4: Conclusion and Discussion “Bias Laundering” Cognitive Biases, Data Biases, and ML Vinodkumar Prabhakaran Margaret Mitchell Google Brain Google Brain Andrew Emily Simone Parker Lucy Ben Elena Deb Timnit Gebru Zaldivar Denton Wu Barnes Vasserman Hutchinson Spitzer Raji Adrian Brian Dirk Josh Alex Blake Hee Jung Hartwig Blaise Benton Zhang Hovy Lovejoy Beutel Lemoine Ryu Adam Agüera y Arcas What’s in this tutorial ● Motivation for Fairness research in NLP ● How and why NLP models may be unfair ● Various types of NLP fairness issues and mitigation approaches ● What can/should we do? What’s NOT in this tutorial ● Definitive answers to fairness/ethical questions ● Prescriptive solutions to fix ML/NLP (un)fairness What do you see? What do you see? ● Bananas What do you see? ● Bananas ● Stickers What do you see? ● Bananas ● Stickers ● Dole Bananas What do you see? ● Bananas ● Stickers ● Dole Bananas ● Bananas at a store What do you see? ● Bananas ● Stickers ● Dole Bananas ● Bananas at a store ● Bananas on shelves What do you see? ● Bananas ● Stickers ● Dole Bananas ● Bananas at a store ● Bananas on shelves ● Bunches of bananas What do you see? ● Bananas ● Stickers ● Dole Bananas ● Bananas -
Cognitive Biases in Economic Decisions – Three Essays on the Impact of Debiasing
TECHNISCHE UNIVERSITÄT MÜNCHEN Lehrstuhl für Betriebswirtschaftslehre – Strategie und Organisation Univ.-Prof. Dr. Isabell M. Welpe Cognitive biases in economic decisions – three essays on the impact of debiasing Christoph Martin Gerald Döbrich Abdruck der von der Fakultät für Wirtschaftswissenschaften der Technischen Universität München zur Erlangung des akademischen Grades eines Doktors der Wirtschaftswissenschaften (Dr. rer. pol.) genehmigten Dissertation. Vorsitzender: Univ.-Prof. Dr. Gunther Friedl Prüfer der Dissertation: 1. Univ.-Prof. Dr. Isabell M. Welpe 2. Univ.-Prof. Dr. Dr. Holger Patzelt Die Dissertation wurde am 28.11.2012 bei der Technischen Universität München eingereicht und durch die Fakultät für Wirtschaftswissenschaften am 15.12.2012 angenommen. Acknowledgments II Acknowledgments Numerous people have contributed to the development and successful completion of this dissertation. First of all, I would like to thank my supervisor Prof. Dr. Isabell M. Welpe for her continuous support, all the constructive discussions, and her enthusiasm concerning my dissertation project. Her challenging questions and new ideas always helped me to improve my work. My sincere thanks also go to Prof. Dr. Matthias Spörrle for his continuous support of my work and his valuable feedback for the articles building this dissertation. Moreover, I am grateful to Prof. Dr. Dr. Holger Patzelt for acting as the second advisor for this thesis and Professor Dr. Gunther Friedl for leading the examination board. This dissertation would not have been possible without the financial support of the Elite Network of Bavaria. I am very thankful for the financial support over two years which allowed me to pursue my studies in a focused and efficient manner. Many colleagues at the Chair for Strategy and Organization of Technische Universität München have supported me during the completion of this thesis. -
“Dysrationalia” Among University Students: the Role of Cognitive
“Dysrationalia” among university students: The role of cognitive abilities, different aspects of rational thought and self-control in explaining epistemically suspect beliefs Erceg, Nikola; Galić, Zvonimir; Bubić, Andreja Source / Izvornik: Europe’s Journal of Psychology, 2019, 15, 159 - 175 Journal article, Published version Rad u časopisu, Objavljena verzija rada (izdavačev PDF) https://doi.org/10.5964/ejop.v15i1.1696 Permanent link / Trajna poveznica: https://urn.nsk.hr/urn:nbn:hr:131:942674 Rights / Prava: Attribution 4.0 International Download date / Datum preuzimanja: 2021-09-29 Repository / Repozitorij: ODRAZ - open repository of the University of Zagreb Faculty of Humanities and Social Sciences Europe's Journal of Psychology ejop.psychopen.eu | 1841-0413 Research Reports “Dysrationalia” Among University Students: The Role of Cognitive Abilities, Different Aspects of Rational Thought and Self-Control in Explaining Epistemically Suspect Beliefs Nikola Erceg* a, Zvonimir Galić a, Andreja Bubić b [a] Department of Psychology, Faculty of Humanities and Social Sciences, University of Zagreb, Zagreb, Croatia. [b] Department of Psychology, Faculty of Humanities and Social Sciences, University of Split, Split, Croatia. Abstract The aim of the study was to investigate the role that cognitive abilities, rational thinking abilities, cognitive styles and self-control play in explaining the endorsement of epistemically suspect beliefs among university students. A total of 159 students participated in the study. We found that different aspects of rational thought (i.e. rational thinking abilities and cognitive styles) and self-control, but not intelligence, significantly predicted the endorsement of epistemically suspect beliefs. Based on these findings, it may be suggested that intelligence and rational thinking, although related, represent two fundamentally different constructs. -
Memory, Attention, and Choice
Memory, Attention, and Choice Pedro Bordalo, Nicola Gennaioli, Andrei Shleifer1 Revised May 7, 2019 (original version 2015) Abstract. Building on the textbook description of associative memory (Kahana 2012), we present a model of choice in which options cue recall of similar past experiences. Recall shapes valuation and choice in two ways. First, recalled experiences form a norm, which serves as an initial anchor for valuation. Second, salient quality and price surprises relative to the norm lead to large adjustments in valuation. The model provides a unified account of many well documented choice puzzles including experience effects, projection and attribution biases, background contrast effects, and context- dependent willingness to pay. The results suggest that well-established psychological processes – memory-based norms and attention to surprising features – are key to understanding decision-making. 1 The authors are from University of Oxford, Universita Bocconi, and Harvard University, respectively. We are grateful to Dan Benjamin, Paulo Costa, Ben Enke, Matt Gentzkow, Sam Gershman, Thomas Graeber, Michael Kahana, Spencer Kwon, George Loewenstein, Sendhil Mullainathan, Josh Schwartzstein, Jesse Shapiro, Jann Spiess, Linh To, and Pierre- Luc Vautrey for valuable comments. Shleifer thanks the Sloan Foundation and the Pershing Square Venture Fund for Research on the Foundations of Human Behavior for financial support. 1 1. Introduction Memory appears to play a central role in even the simplest choices. Consider a thirsty traveler thinking of whether to look for a shop to buy a bottle of water at the airport. He automatically retrieves from memory similar past experiences, including the pleasure of quenching his thirst and the prices he paid before, and decides based on these recollections. -
Detection of Confirmation and Distinction Biases in Visual
EuroVis Workshop on Trustworthy Visualization (TrustVis) (2019) R. Kosara, K. Lawonn, L. Linsen, and N. Smit (Editors) Detection of Confirmation and Distinction Biases in Visual Analytics Systems . A. Nalcaci , D. Girgin , S. Balki , F. Talay, H. A. Boz and S. Balcisoy 1Sabanci University, Faculty of Engineering & Natural Sciences, Istanbul, Turkey Abstract Cognitive bias is a systematic error that introduces drifts and distortions in the human judgment in terms of visual decompo- sition in the direction of the dominant instance. It has a significant role in decision-making process by means of evaluation of data visualizations. This paper elaborates on the experimental depiction of two cognitive bias types, namely Distinction Bias and Confirmation Bias, through the examination of cognate visual experimentations. The main goal of this implementation is to indicate the existence of cognitive bias in visual analytics systems through the adjustment of data visualization and crowdsourc- ing in terms of confirmation and distinction biases. Two distinct surveys that include biased and unbiased data visualizations which are related to a given data set were established in order to detect and measure the level of existence of introduced bias types. Practice of crowdsourcing which is provided by Amazon Mechanical Turk have been used for experimentation purposes through prepared surveys. Results statistically indicate that both distinction and confirmation biases has substantial effect and prominent significance on decision-making process. CCS Concepts • Human-centered computing ! Empirical studies in visualization; Visualization design and evaluation methods; 1. Introduction cording to existing studies, usual heuristic errors involve confirma- tion bias, which characterizes people’s approaches to receive the Visual perception is the combination of physical and thoughtful de- confirmatory corroboration of a pre-existing hypothesis and dis- sign that provides the ability to interpret the environment and the miss contrary information. -
Working Memory, Cognitive Miserliness and Logic As Predictors of Performance on the Cognitive Reflection Test
Working Memory, Cognitive Miserliness and Logic as Predictors of Performance on the Cognitive Reflection Test Edward J. N. Stupple ([email protected]) Centre for Psychological Research, University of Derby Kedleston Road, Derby. DE22 1GB Maggie Gale ([email protected]) Centre for Psychological Research, University of Derby Kedleston Road, Derby. DE22 1GB Christopher R. Richmond ([email protected]) Centre for Psychological Research, University of Derby Kedleston Road, Derby. DE22 1GB Abstract Most participants respond that the answer is 10 cents; however, a slower and more analytic approach to the The Cognitive Reflection Test (CRT) was devised to measure problem reveals the correct answer to be 5 cents. the inhibition of heuristic responses to favour analytic ones. The CRT has been a spectacular success, attracting more Toplak, West and Stanovich (2011) demonstrated that the than 100 citations in 2012 alone (Scopus). This may be in CRT was a powerful predictor of heuristics and biases task part due to the ease of administration; with only three items performance - proposing it as a metric of the cognitive miserliness central to dual process theories of thinking. This and no requirement for expensive equipment, the practical thesis was examined using reasoning response-times, advantages are considerable. There have, moreover, been normative responses from two reasoning tasks and working numerous correlates of the CRT demonstrated, from a wide memory capacity (WMC) to predict individual differences in range of tasks in the heuristics and biases literature (Toplak performance on the CRT. These data offered limited support et al., 2011) to risk aversion and SAT scores (Frederick, for the view of miserliness as the primary factor in the CRT.