Mitigation of Cognitive Bias with a Serious Game: Two Experiments Testing Feedback Timing and Source

Total Page:16

File Type:pdf, Size:1020Kb

Mitigation of Cognitive Bias with a Serious Game: Two Experiments Testing Feedback Timing and Source University of Nebraska at Omaha DigitalCommons@UNO Information Systems and Quantitative Analysis Department of Information Systems and Faculty Publications Quantitative Analysis 2017 Mitigation of Cognitive Bias with a Serious Game: Two Experiments Testing Feedback Timing and Source Norah E. Dunbar Matthew L. Jensen Elena Bessarabova Yu-Hao Lee Scott N. Wilson See next page for additional authors Follow this and additional works at: https://digitalcommons.unomaha.edu/isqafacpub Part of the Computer Sciences Commons Authors Norah E. Dunbar, Matthew L. Jensen, Elena Bessarabova, Yu-Hao Lee, Scott N. Wilson, Javier Elizondo, Bradley J. Adame, Joseph Valacich, Sara Straub, Judee K. Burgoon, Brianna Lane, Cameron W. Piercy, David Wilson, Shawn King, Cindy Vincent, and Ryan Schuetzler International Journal of Game-Based Learning Volume 7 • Issue 4 • October-December 2017 Mitigation of Cognitive Bias with a Serious Game: Two Experiments Testing Feedback Timing and Source Norah E. Dunbar, University of California Santa Barbara, Department of Communication, Santa Barbara, California Matthew L. Jensen, University of Oklahoma, Price College of Business and Center for Applied Social Research, Norman, Oklahoma Claude H. Miller, University of Oklahoma, Department of Communication, Norman, Oklahoma Elena Bessarabova, University of Oklahoma, Department of Communication, Norman, Oklahoma Yu-Hao Lee, University of Florida, Department of Telecommunication, Gainesville, Florida Scott N. Wilson, University of Oklahoma, K20 Center, Norman, Oklahoma Javier Elizondo, University of Oklahoma, K20 Center, Norman, Oklahoma Bradley J. Adame, Arizona State University, Hugh Downs School of Communication, Tempe, Arizona Joseph Valacich, University of Arizona, Eller College of Management, Tucson, Arizona Sara Straub, Independent Researcher, Norman, Oklahoma Judee K. Burgoon, University of Arizona, Eller College of Management, Tucson, Arizona Brianna Lane, Christopher Newport University, Department of Communication, Newport News, Virginia Cameron W. Piercy, University of Central Missouri, Department of Management, Warrensburg, Missouri David Wilson, University of Nebraska-Omaha, Department of Information Systems and Quantitative Analysis, Omaha, Nebraska Shawn King, Independent Researcher, Norman, Oklahoma Cindy Vincent, Salem State University, Department of Communications, Salem, Massachusetts Ryan M. Schuetzler, University of Arizona, Eller College of Management, Tucson, Arizona ABSTRACT Oneofthebenefitsofusingdigitalgamesforeducationisthatgamescanprovidefeedbackfor learnerstoassesstheirsituationandcorrecttheirmistakes.Weconductedtwostudiestoexaminethe effectivenessofdifferentfeedbackdesign(timing,duration,repeats,andfeedbacksource)inaserious gamedesignedtoteachlearnersaboutcognitivebiases.Wealsocomparedthedigitalgame-based learningconditiontoaprofessionaltrainingvideo.Overall,thedigitalgamewassignificantlymore .effectivethanthevideocondition.Longerdurationsandrepeatsimprovetheeffectsonbias-mitigation ,Surprisingly,therewasnosignificantdifferencebetweenjust-in-timefeedbackanddelayedfeedback .andcomputer-generatedfeedbackwasmoreeffectivethanfeedbackfromotherplayers KEywoRdS Cognitive Bias, Confirmation Bias, Feedback, Fundamental Attribution Error, Training Game DOI: 10.4018/IJGBL.2017100105  .Copyright©2017,IGIGlobal.CopyingordistributinginprintorelectronicformswithoutwrittenpermissionofIGIGlobalisprohibited  86 International Journal of Game-Based Learning Volume 7 • Issue 4 • October-December 2017 INTRODUCTIoN Proponentsofdigitalgame-basedlearningmaintainthatgamesandsimulationscanfacilitatelearning ,becausethey(a)catertothedigitalgenerationoflearners(Prensky,2005),(b)allowforimmersive activelearningincreasingengagementandretention,and(c)encouragenewformsofknowledge interactionunavailableinatraditionalcurricula(e.g.,perspective-taking,slowingdownorspeeding uptimeprocesses,accessinghazardousordistantenvironments(Jackson,2008).Importantly,digital gamesallowforimmediatefeedbackthatcanhelplearnerscorrecttheirmistakesandrewardlearners .formakingcorrectdecisions Theprovisionoffeedbackgenerallyimproveslearning,howeverthereareimportantcaveats ’regardinghowandwhenfeedbackisgiven.Digitalgamescanprovidefeedbackbasedonlearners paceanddecisionmaking(Azevedo&Bernard,1995).Recentstudieshaveexaminedthecostsand ,benefitsofofferingfeedbackduringinstruction(Hays,Kornell,&Bjork,2010),thetiming(Butler Karpicke,&Roediger,2007)andthesourceoffeedback(e.g.,ateacher,parent,peer,oracomputer agentinthegame(Goldberg&Cannon-Bowers,2015;Hattie&Timperley,2007).Weaddtothis bodyofresearchbypresentingtwostudiesexploringtheeffectsoffeedbacktiming(immediate vs.delayed)andfeedbacksource(computeragentsvs.humanpartners)inagame-basedlearning environmentdesignedtoteachlearnersaboutthepitfallsofcognitivebiases.Totesttheseeffects,we createdaseriousgamecalledMACBETH(MitigatingAnalystCognitiveBias byEliminatingTask Heuristics)1,whereinplayersaretaskedwithdetectingandpreventingaseriesofterroristthreats bygatheringandassessingintelligencedata(forMACBETHdevelopmentseeauthorcitation).The gamefocusesonknowledgeandmitigationofconfirmation bias(CB)andfundamental attribution error(FAE).Thetrainingeffectivenessofthegamewascomparedtoatraditionalinstructionalvideo .explainingFAEandCB,whichofcourseexcludedfeedback Using Feedback in a Serious Game to Mitigate Cognitive Biases Biasedinformationprocessingisoftencausedbytheover-relianceonheuristics—definedasmental shortcuts,orsimpledecisionrules—arisingfromconventionalbeliefs.Byprovidingswiftsolutions andminimizingcognitiveeffort,heuristicscanbenefitdecision-making;however,theymayoften alsoleadtoinsufficientconsiderationofrelevant,diagnosticinformation,resultinginincreaseduse &ofcognitiveshortcutsassociatedwithpoordecisionsandbiasedinformationprocessing(Tversky Kahneman,1974).Confirmationbiasharmssystematicinformation-processingbydirectingattention towardevidencethatconfirmsexistingattitudesandbeliefs(Lundgren&Prislin,1998)attheexpense ofweighingandexaminingpertinentavailableevidencethatmightotherwisedisconfirmerroneous assumptions.Similarly,FAEfostersatendencytofocusoninternal,dispositionalexplanationsof (others’behaviorsattheexpenseofexternal,situationalfactors(Harvey,Town,&Yarkin,1981 .likewisehinderingthedecision-makingprocess Cognitivebiasesaredifficulttochange:Theyaredeeplyembeddedwithinnaturalcognitive processes,andpeoplerarelyrecognizetheirbiaseddecision-making.Tomitigatebias,peoplemust ,firstbecomeawareoftheiruseofheuristics(Bornstein&Emler,2001)forwhichfeedbackcanhelp therebyleadingtobetter-informeddecisions.Feedbackingame-basedlearningcanbeeffectivewhen itprovidesplayersobjectivelearninggoalswithclearcriteriaforsuccess,alongwithmethodsfor .(improvementtoattaingoals(Erhel&Jamet,2013 Notallfeedbackbenefitslearning:Repeatednegativefeedback,forinstance,canleadtolowered .(expectations,reducedeffort,andamorenegativeself-image(Krenn,Würth,&Hergovich,2013 Formativeandcorrectiveoutcomefeedbackthroughsuggestionsandguidancecanhelpmodify 87 International Journal of Game-Based Learning Volume 7 • Issue 4 • October-December 2017 thinkingandbehaviorandimprovelearning(Shute,2008).Yet,performancedecrementsarelikely tooccuriftoomuchfeedbackinformationispresented,causingoverload.Thus,bothtimingand .quantityoffeedbackiscriticaltolearningandoptimalperformance ,Timinghasalsobeenexaminedtodiscerntheadvantagesofimmediateversusdelayedfeedback andameta-analysishasconcludeddelayedfeedbackisgenerallysuperiorinlaboratorystudies,since studentsareoftenrequiredtoexplicitlyconsiderandrespondtoit,whereasimmediatefeedbacktends tobemoreeffectiveinappliedstudies,suchasclassroomsettings(Kulik&Kulik,1988;vander Kleij,Eggen,Timmers,&Veldkamp,2012).Theamountofa“delay”varieswidelyinthestudies withfeedbackbeingprovidedfollowinganassessment,attheendofaday,oruptoaweekaftertask completion(vanderKleijetal.,2012).Althoughofferingfeedbackduringgameplaycanenhanceits .salience,allowingplayerstoadjusttheirdecisions,itcanalsobeadistraction,harmingenjoyment In-gamefeedbackcanslowgameplay,inhibitinggoalattainment,particularlywhenspeedofplay isabasisforadvancement(Ryan&Pintrich,1997).Ontheotherhand,despiteitspotentialfor ,slowingplay,detailedfeedbackearlyintheprocesscanleadtofasterlearning(Billings,2010;Tsai Tsai,&Lin,2015).Becauseplayerscanusein-task“just-in-time”(JIT)feedbacktoimprovetheir performanceandcorrectmistakes,webelieveitcanbemoreeffectivethanfeedbackdelayeduntil :aftertaskcompletion.Thus,wehypothesize .H1:JITfeedbackismoreeffectiveatmitigatingCBandFAEthandelayedfeedback &Knowledgeisentwinedwithpractice,andlearningviavideogamesisnoexception(Lave Wenger,1991).Discoveringhowtoplayanewgametakestime.Noviceuserscanbeoverwhelmed
Recommended publications
  • The Status Quo Bias and Decisions to Withdraw Life-Sustaining Treatment
    HUMANITIES | MEDICINE AND SOCIETY The status quo bias and decisions to withdraw life-sustaining treatment n Cite as: CMAJ 2018 March 5;190:E265-7. doi: 10.1503/cmaj.171005 t’s not uncommon for physicians and impasse. One factor that hasn’t been host of psychological phenomena that surrogate decision-makers to disagree studied yet is the role that cognitive cause people to make irrational deci- about life-sustaining treatment for biases might play in surrogate decision- sions, referred to as “cognitive biases.” Iincapacitated patients. Several studies making regarding withdrawal of life- One cognitive bias that is particularly show physicians perceive that nonbenefi- sustaining treatment. Understanding the worth exploring in the context of surrogate cial treatment is provided quite frequently role that these biases might play may decisions regarding life-sustaining treat- in their intensive care units. Palda and col- help improve communication between ment is the status quo bias. This bias, a leagues,1 for example, found that 87% of clinicians and surrogates when these con- decision-maker’s preference for the cur- physicians believed that futile treatment flicts arise. rent state of affairs,3 has been shown to had been provided in their ICU within the influence decision-making in a wide array previous year. (The authors in this study Status quo bias of contexts. For example, it has been cited equated “futile” with “nonbeneficial,” The classic model of human decision- as a mechanism to explain patient inertia defined as a treatment “that offers no rea- making is the rational choice or “rational (why patients have difficulty changing sonable hope of recovery or improvement, actor” model, the view that human beings their behaviour to improve their health), or because the patient is permanently will choose the option that has the best low organ-donation rates, low retirement- unable to experience any benefit.”) chance of satisfying their preferences.
    [Show full text]
  • Cognitive Bias Mitigation: How to Make Decision-Making More Rational?
    Cognitive Bias Mitigation: How to make decision-making more rational? Abstract Cognitive biases distort judgement and adversely impact decision-making, which results in economic inefficiencies. Initial attempts to mitigate these biases met with little success. However, recent studies which used computer games and educational videos to train people to avoid biases (Clegg et al., 2014; Morewedge et al., 2015) showed that this form of training reduced selected cognitive biases by 30 %. In this work I report results of an experiment which investigated the debiasing effects of training on confirmation bias. The debiasing training took the form of a short video which contained information about confirmation bias, its impact on judgement, and mitigation strategies. The results show that participants exhibited confirmation bias both in the selection and processing of information, and that debiasing training effectively decreased the level of confirmation bias by 33 % at the 5% significance level. Key words: Behavioural economics, cognitive bias, confirmation bias, cognitive bias mitigation, confirmation bias mitigation, debiasing JEL classification: D03, D81, Y80 1 Introduction Empirical research has documented a panoply of cognitive biases which impair human judgement and make people depart systematically from models of rational behaviour (Gilovich et al., 2002; Kahneman, 2011; Kahneman & Tversky, 1979; Pohl, 2004). Besides distorted decision-making and judgement in the areas of medicine, law, and military (Nickerson, 1998), cognitive biases can also lead to economic inefficiencies. Slovic et al. (1977) point out how they distort insurance purchases, Hyman Minsky (1982) partly blames psychological factors for economic cycles. Shefrin (2010) argues that confirmation bias and some other cognitive biases were among the significant factors leading to the global financial crisis which broke out in 2008.
    [Show full text]
  • Emotional Reasoning and Parent-Based Reasoning in Normal Children
    Morren, M., Muris, P., Kindt, M. Emotional reasoning and parent-based reasoning in normal children. Child Psychiatry and Human Development: 35, 2004, nr. 1, p. 3-20 Postprint Version 1.0 Journal website http://www.springerlink.com/content/105587/ Pubmed link http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?cmd=Retrieve&db=pubmed&dop t=Abstract&list_uids=15626322&query_hl=45&itool=pubmed_docsum DOI 10.1023/B:CHUD.0000039317.50547.e3 Address correspondence to M. Morren, Department of Medical, Clinical, and Experimental Psychology, Maastricht University, P.O. Box 616, 6200 MD Maastricht, The Netherlands; e-mail: [email protected]. Emotional Reasoning and Parent-based Reasoning in Normal Children MATTIJN MORREN, MSC; PETER MURIS, PHD; MEREL KINDT, PHD DEPARTMENT OF MEDICAL, CLINICAL AND EXPERIMENTAL PSYCHOLOGY, MAASTRICHT UNIVERSITY, THE NETHERLANDS ABSTRACT: A previous study by Muris, Merckelbach, and Van Spauwen1 demonstrated that children display emotional reasoning irrespective of their anxiety levels. That is, when estimating whether a situation is dangerous, children not only rely on objective danger information but also on their own anxiety-response. The present study further examined emotional reasoning in children aged 7–13 years (N =508). In addition, it was investigated whether children also show parent-based reasoning, which can be defined as the tendency to rely on anxiety-responses that can be observed in parents. Children completed self-report questionnaires of anxiety, depression, and emotional and parent-based reasoning. Evidence was found for both emotional and parent-based reasoning effects. More specifically, children’s danger ratings were not only affected by objective danger information, but also by anxiety-response information in both objective danger and safety stories.
    [Show full text]
  • Dunning–Kruger Effect - Wikipedia, the Free Encyclopedia
    Dunning–Kruger effect - Wikipedia, the free encyclopedia http://en.wikipedia.org/wiki/Dunning–Kruger_effect Dunning–Kruger effect From Wikipedia, the free encyclopedia The Dunning–Kruger effect is a cognitive bias in which unskilled individuals suffer from illusory superiority, mistakenly rating their ability much higher than average. This bias is attributed to a metacognitive inability of the unskilled to recognize their mistakes.[1] Actual competence may weaken self-confidence, as competent individuals may falsely assume that others have an equivalent understanding. David Dunning and Justin Kruger of Cornell University conclude, "the miscalibration of the incompetent stems from an error about the self, whereas the miscalibration of the highly competent stems from an error about others".[2] Contents 1 Proposal 2 Supporting studies 3 Awards 4 Historical references 5 See also 6 References Proposal The phenomenon was first tested in a series of experiments published in 1999 by David Dunning and Justin Kruger of the Department of Psychology, Cornell University.[2][3] They noted earlier studies suggesting that ignorance of standards of performance is behind a great deal of incompetence. This pattern was seen in studies of skills as diverse as reading comprehension, operating a motor vehicle, and playing chess or tennis. Dunning and Kruger proposed that, for a given skill, incompetent people will: 1. tend to overestimate their own level of skill; 2. fail to recognize genuine skill in others; 3. fail to recognize the extremity of their inadequacy; 4. recognize and acknowledge their own previous lack of skill, if they are exposed to training for that skill. Dunning has since drawn an analogy ("the anosognosia of everyday life")[1][4] with a condition in which a person who suffers a physical disability because of brain injury seems unaware of or denies the existence of the disability, even for dramatic impairments such as blindness or paralysis.
    [Show full text]
  • Ilidigital Master Anton 2.Indd
    services are developed to be used by humans. Thus, understanding humans understanding Thus, humans. by used be to developed are services obvious than others but certainly not less complex. Most products bioengineering, and as shown in this magazine. Psychology mightbusiness world. beBe it more the comparison to relationships, game elements, or There are many non-business flieds which can betransfered to the COGNTIVE COGNTIVE is key to a succesfully develop a product orservice. is keytoasuccesfullydevelopproduct BIASES by ANTON KOGER The Power of Power The //PsychologistatILI.DIGITAL WE EDIT AND REINFORCE SOME WE DISCARD SPECIFICS TO WE REDUCE EVENTS AND LISTS WE STORE MEMORY DIFFERENTLY BASED WE NOTICE THINGS ALREADY PRIMED BIZARRE, FUNNY, OR VISUALLY WE NOTICE WHEN WE ARE DRAWN TO DETAILS THAT WE NOTICE FLAWS IN OTHERS WE FAVOR SIMPLE-LOOKING OPTIONS MEMORIES AFTER THE FACT FORM GENERALITIES TO THEIR KEY ELEMENTS ON HOW THEY WERE EXPERIENCED IN MEMORY OR REPEATED OFTEN STRIKING THINGS STICK OUT MORE SOMETHING HAS CHANGED CONFIRM OUR OWN EXISTING BELIEFS MORE EASILY THAN IN OURSELVES AND COMPLETE INFORMATION way we see situations but also the way we situationsbutalsotheway wesee way the biasesnotonlychange Furthermore, overload. cognitive avoid attention, ore situations, guide help todesign massively can This in. take people information of kind explainhowandwhat ofperception egory First,biasesinthecat andappraisal. ory, self,mem perception, into fourcategories: roughly bedivided Cognitive biasescan within thesesituations. forusers interaction andeasy in anatural situationswhichresults sible toimprove itpos and adaptingtothesebiasesmakes ingiven situations.Reacting ways certain act sively helpstounderstandwhypeople mas into consideration biases ing cognitive Tak humanbehavior. topredict likely less or andmore relevant illusionsare cognitive In each situation different every havior day.
    [Show full text]
  • How Cognitive Bias Undermines Value Creation in Life Sciences M&A
    ❚ DEAL-MAKING In Vivo Pharma intelligence | How Cognitive Bias Undermines Value Creation In Life Sciences M&A Life sciences mergers and acquisitions are typically based on perceived future value rather than objective financial parameters, but the cognitive biases inherent in subjective assessments can derail deals. Executives need to take emotion out of the equation and rely on relevant data to craft successful transactions. Shutterstock: enzozo Shutterstock: BY ODED BEN-JOSEPH erger and acquisition transactions play a central role in the life sci- ences sector and are the catalyst for growth and transformation, Executives who evaluate their prospects driving innovation from the laboratory all the way to the patient. As I based on a narrow, internally focused discussed in my August 2016 article, “Where the Bodies Lie” (Nature view relying on limited information and Biotechnology, 34, 909–911), life sciences companies often fall victim personal experience – rather than by to recurring misconceptions that lead to unnecessary failure. consulting the statistics of similar cases M These failures often hinge upon management’s misunderstanding of the funda- – are prone to overestimate both their chances and degree of success. mentals of market and transactional dynamics. In particular, cognitive biases play a critical role, often leading to mistakes that are predictable and systematic. These biases disproportionally hinder the life sciences sector where, unlike other sectors, objective This tendency to think narrowly about transaction strategies leads to a and measurable financial parameters such as revenue, earnings and margins play a number of pervasive and severe biases minor role in determining company value as compared with scientific and clinical data.
    [Show full text]
  • The Dunning–Kruger Effect Is (Mostly) a Statistical Artefact
    Intelligence 80 (2020) 101449 Contents lists available at ScienceDirect Intelligence journal homepage: www.elsevier.com/locate/intell The Dunning-Kruger effect is (mostly) a statistical artefact: Valid approaches to testing the hypothesis with individual differences data T ⁎ Gilles E. Gignaca, , Marcin Zajenkowskib a University of Western Australia, Australia b Faculty of Psychology, University of Warsaw, Poland ARTICLE INFO ABSTRACT Keywords: The Dunning-Kruger hypothesis states that the degree to which people can estimate their ability accurately Dunning-Kruger effect depends, in part, upon possessing the ability in question. Consequently, people with lower levels of the ability Intelligence tend to self-assess their ability less well than people who have relatively higher levels of the ability. The most Self-assessed intelligence common method used to test the Dunning-Kruger hypothesis involves plotting the self-assessed and objectively assessed means across four categories (quartiles) of objective ability. However, this method has been argued to be confounded by the better-than-average effect and regression toward the mean. In this investigation, it is argued that the Dunning-Kruger hypothesis can be tested validly with two inferential statistical techniques: the Glejser test of heteroscedasticity and nonlinear (quadratic) regression. On the basis of a sample of 929 general community participants who completed a self-assessment of intelligence and the Advanced Raven's Progressive Matrices, we failed to identify statistically significant heteroscedasticity, contrary to the Dunning-Kruger hy- pothesis. Additionally, the association between objectively measured intelligence and self-assessed intelligence was found to be essentially entirely linear, again, contrary to the Dunning-Kruger hypothesis. It is concluded that, although the phenomenon described by the Dunning-Kruger hypothesis may be to some degree plausible for some skills, the magnitude of the effect may be much smaller than reported previously.
    [Show full text]
  • Self-Distancing and Human Reflection: Overcoming Bias in Judgment And
    Self-Distancing and Human Reflection: Overcoming Bias in Judgment and Emotional Reasoning by Ryan Hanlon Bremner A dissertation submitted in partial fulfillment of the requirements for the degree of Doctor of philosophy (Psychology) in the University of Michigan 2013 Doctoral committee: Assistant Professor Ethan Kross, Chair Professor Norbert Schwarz Professor Oscar Ybarra Assistant Professor Sonya Dal Cin 2013 Ryan H. Bremner ALL RIGHTS RESERVED Dedication To three mentors who helped make my time at Michigan the best of my life: Ethan Kross, Norbert Schwarz, and Ricks Warren ii Table of Contents DEDICATION..............................................................................................................ii LIST OF FIGURES ..................................................................................................... v ABSTRACT ................................................................................................................. vi CHAPTER 1: GETTING OUTSIDE OF OURSELVES ............................................ 1 WHY SELF-DISTANCING? ..................................................................................................................... 1 SELF-DISTANCING AS A GENERAL TECHNIQUE TO CORRECT COGNITIVE BIASES ...................................... 4 SELF-DISTANCING CAN IMPROVE CBT INTERVENTIONS ........................................................................ 5 SELF-DISTANCING CAN CHANGE INTERPRETATIONS OF THREAT AND CHALLENGE .................................. 7 CHAPTER 2: SELF-DISTANCING
    [Show full text]
  • Forensic Science Regulator Guidance
    Forensic Science Regulator Guidance Cognitive Bias Effects Relevant to Forensic Science Examinations FSR-G-217 Issue 2 Forensic Science Regulator GUIDANCE – GUIDANCE – GUIDANCE – GUIDANCE – GUIDANCE – GUIDANCE – GUIDANCE – GUIDANCE - GUIDANCE © Crown Copyright 2020 The text in this document (excluding the Forensic Science Regulator’s logo, any other logo, and material quoted from other sources) may be reproduced free of charge in any format or medium providing it is reproduced accurately and not used in a misleading context. The material must be acknowledged as Crown Copyright and its title specified. This document is not subject to the Open Government Licence. FSR-G-217 Issue 2 Page 2 of 90 Forensic Science Regulator GUIDANCE – GUIDANCE – GUIDANCE – GUIDANCE – GUIDANCE – GUIDANCE – GUIDANCE – GUIDANCE - GUIDANCE Contents 1. Executive Summary 6 1.1 Introduction 6 1.2 Categories of Cognitive Bias 6 1.3 General Conditions Impacting on the Level of Cognitive Bias Risk 7 1.4 General Controls or Mitigation Impacting on the Level of Risk 9 2. Introduction 10 2.1 General 10 2.2 Effective Date 10 2.3 Scope 10 2.4 Modification 10 3. Terms and Definitions 12 4. An Explanation and Brief Overview of Cognitive Bias 13 4.1 Overview 13 4.2 Categories of Cognitive Bias 14 4.3 Academic Research into Cognitive Bias in Forensic Science 16 4.4 Bias Countermeasures (Also Known as ‘Debiasing Techniques’) 17 5. A Generic Process to Manage Cognitive Bias for a Range of Forensic Evidence Types 23 5.1 The Role of the Investigating Officer or Instructing Authority 23 5.2 The Role of the Scientist in the Analysis or Initial Evaluation Stage 24 5.3 The Role of a Forensic Expert 25 5.4 Process Outline 25 5.5 Mitigation Strategies to Reduce the Risk of Cognitive Bias 27 5.6 Recommended Good Practice 28 FSR-G-217 Issue 2 Page 3 of 90 Forensic Science Regulator GUIDANCE – GUIDANCE – GUIDANCE – GUIDANCE – GUIDANCE – GUIDANCE – GUIDANCE – GUIDANCE - GUIDANCE 6.
    [Show full text]
  • 1 Embrace Your Cognitive Bias
    1 Embrace Your Cognitive Bias http://blog.beaufortes.com/2007/06/embrace-your-co.html Cognitive Biases are distortions in the way humans see things in comparison to the purely logical way that mathematics, economics, and yes even project management would have us look at things. The problem is not that we have them… most of them are wired deep into our brains following millions of years of evolution. The problem is that we don’t know about them, and consequently don’t take them into account when we have to make important decisions. (This area is so important that Daniel Kahneman won a Nobel Prize in 2002 for work tying non-rational decision making, and cognitive bias, to mainstream economics) People don’t behave rationally, they have emotions, they can be inspired, they have cognitive bias! Tying that into how we run projects (project leadership as a compliment to project management) can produce results you wouldn’t believe. You have to know about them to guard against them, or use them (but that’s another article)... So let’s get more specific. After the jump, let me show you a great list of cognitive biases. I’ll bet that there are at least a few that you haven’t heard of before! Decision making and behavioral biases Bandwagon effect — the tendency to do (or believe) things because many other people do (or believe) the same. Related to groupthink, herd behaviour, and manias. Bias blind spot — the tendency not to compensate for one’s own cognitive biases. Choice-supportive bias — the tendency to remember one’s choices as better than they actually were.
    [Show full text]
  • Cognitive Debiasing 1: Origins of Bias and Theory of Debiasing
    Downloaded from qualitysafety.bmj.com on January 30, 2014 - Published by group.bmj.com NARRATIVE REVIEW Cognitive debiasing 1: origins of bias and theory of debiasing Pat Croskerry,1 Geeta Singhal,2 Sílvia Mamede3 1Department of Pediatrics, ABSTRACT used. They are fast, usually effective, but Division of Medical Education, Numerous studies have shown that diagnostic also more likely to fail. As they are largely Dalhousie University, Halifax, — Nova Scotia, Canada failure depends upon a variety of factors. unconscious, mistakes when they occur 1–3 2Baylor College of Medicine Psychological factors are fundamental in —are seldom corrected. In contrast, Texas Children’s Hospital, influencing the cognitive performance of the Type 2 processes are fairly reliable, safe Houston, Texas, USA decision maker. In this first of two papers, we and effective, but slow and resource inten- 3Institute of Medical Education Research, Rotterdam, Erasmus discuss the basics of reasoning and the Dual sive. The intuitive mode of decision University Medical Center, Process Theory (DPT) of decision making. The making is characterised by heuristics— Rotterdam general properties of the DPT model, as it applies short-cuts, abbreviated ways of thinking, ‘ ’ Correspondence to to diagnostic reasoning, are reviewed. A variety maxims, seen this many times before , Professor Pat Croskerry, Division of cognitive and affective biases are known to ways of thinking. Heuristics represent an of Medical Education, Dalhousie compromise the decision-making process. They adaptive mechanism that saves us time University, Clinical Research mostly appear to originate in the fast intuitive and effort while making daily decisions. Centre, 5849 University Avenue, PO Box 15000, Halifax, NS, processes of Type 1 that dominate (or drive) Indeed, it is a rule of thumb among cogni- Canada B3H 4R2; decision making.
    [Show full text]
  • Cognitive Biases and Their Importance for Critical Thinking
    Cognitive Biases and Their Importance for Critical Thinking CONTENTS Introduction ...................................................................................................... 2 1.-Cognitive-Biases:-What-They-Are-and-Why-They’re-Important............ 3 2.-Cognitive-Biases-and-the-Authority-of-Science ...................................... 10 3.-Confirmation-Bias-and-the-Evolution-of-Reason ................................... 24 Critical Thinker Academy © Kevin deLaplante 2014 2 Cognitive Biases: An Introduction Introduction In-my-fiveGdimensional-model-of-the-most-important-components-of- critical-thinking-I-put-“knowledge-of-the-psychology-of-human-judgment”- under-the-heading-of-background+knowledge: 1. logic 2. argumentation 3. rhetoric 4. background-knowledge a. of+subject+ma4er b. of+the+history+of+debate+on+a+topic c. of#the#psychology#of#human#judgment 5. character-(aPitudes-and-values) Knowledge-of-cognitive-biases-is-a-subGtopic-that-fits-within-the-broader- category-of-the-psychology-of-human-judgment.- There-has-been-an-explosion-of-research-on-cognitive-biases-over-the- past-forty-years,-but-the-critical-thinking-education-community-has-been- slow-to-integrate-this-content-into-the-traditional-curriculum-of-critical- thinking-textbooks.-There-is-no-doubt,-however,-that-the-study-of-cognitive- biases-will-be-a-central-feature-of-critical-thinking-education-in-the-21st- century.- What They Are and Why They’re Important 3 1. Cognitive Biases: What They Are and Why They’re Important Everyone-agrees-that-logic-and-argumentation-are-important-for-critical-
    [Show full text]