Effect of a Metacognitive Intervention on Cognitive

Total Page:16

File Type:pdf, Size:1020Kb

Effect of a Metacognitive Intervention on Cognitive EFFECT OF A METACOGNITIVE INTERVENTION ON COGNITIVE HEURISTIC USE DURING DIAGNOSTIC REASONING by Velma Lucille Payne Bachelor of Science in Computer Science, Oral Roberts University, 1984 Master of Science in Computer Information Systems, Robert Morris University, 1996 Master of Business Administration, Robert Morris University, 1997 Master of Science in Biomedical Informatics, University of Pittsburgh, 2008 Submitted to the Graduate Faculty of School of Medicine in partial fulfillment of the requirements for the degree of Doctor of Philosophy University of Pittsburgh 2011 UNIVERSITY OF PITTSBURGH SCHOOL OF MEDICINE This dissertation proposal was presented by Velma Lucille Payne To the following committee members: Claudia Mello-Thoms, MSEE, PhD, Assistant Professor of Biomedical Informatics and Radiology, University of Pittsburgh Mark S. Roberts, MD, MPP, Professor of Medicine, Health Policy and Management, and Industrial Engineering, University of Pittsburgh Cleotilde Gonzalez, PhD, Associate Research Professor, Department of Social and Decision Sciences, Carnegie Mellon University Pat Croskerry, MD, PhD, Professor, Department of Emergency Medicine, Dalhousie University Dissertation Advisor: Rebecca S. Crowley, MD, MS, Associate Professor of Biomedical Informatics, Pathology and Intelligent Systems, University of Pittsburgh ii Copyright © by Velma Lucille Payne 2011 iii EFFECT OF A METACOGNITIVE INTERVENTION ON COGNITIVE HEURISTIC USE DURING DIAGNOSTIC REASONING Velma Lucille Payne, M.S., MBA, M.S. University of Pittsburgh, 2011 Abstract Medical judgment and decision-making frequently occur under conditions of uncertainty. In order to reduce the complexity of diagnosis, physicians often rely on cognitive heuristics. Use of heuristics during clinical reasoning can be effective; however when used inappropriately the result can be flawed reasoning, medical errors and patient harm. Many researchers have attempted to debias individuals from inappropriate heuristic use by designing interventions based on normative theories of decision-making. There have been few attempts to debias individuals using interventions based on descriptive decision-making theories. Objectives: (1) Assess use of Anchoring and Adjustment and Confirmation Bias during diagnostic reasoning; (2) Investigate the impact of heuristic use on diagnostic accuracy; (3) Determine the impact of a metacognitive intervention based on the Mental Model Theory designed to reduce biased judgment by inducing physicians to ‘think about how they think’; and (4) Test a novel technique using eye-tracking to determine heuristic use and diagnostic accuracy within mode of thinking as defined by the Dual Process Theory. Methods: Medical students and residents assessed clinical scenarios using a computer system, specified a diagnosis, and designated the data used to arrive at the diagnosis. During case analysis, subjects either verbalized their thoughts or wore eye-tracking equipment to capture eye iv movements and pupil size as they diagnosed cases. Diagnostic data specified by the subject was used to measure heuristic use and assess the impact of heuristic use on diagnostic accuracy. Eye- tracking data was used to determine the frequency of heuristic use (Confirmation Bias only) and mode of thinking. Statistic models were executed to determine the effect of the metacognitive intervention. Results: Use of cognitive heuristics during diagnostic reasoning was common for this subject population. Logistic regression showed case difficulty to be an important factor contributing to diagnostic error. The metacognitive intervention had no effect on heuristic use and diagnostic accuracy. Eye-tracking data reveal this subject population infrequently assess cases in the Intuitive mode of thinking; spend more time in the Analytical mode of thinking, and switches between the two modes frequently as they reason through a case to arrive at a diagnosis. v TABLE OF CONTENTS DEDICATION........................................................................................................................ XVII ACKNOWLEDGEMENTS .................................................................................................XVIII 1 INTRODUCTION ................................................................................................................ 1 1.1 BACKGROUND.................................................................................................. 1 1.2 PROBLEM DESCRIPTION .............................................................................. 2 1.3 SIGNIFICANCE OF THIS RESEARCH ......................................................... 2 1.4 GUIDE FOR THE READER ............................................................................. 4 2 MEDICAL ERRORS ........................................................................................................... 5 2.1 MEDICAL ERROR DEFINITIONS ................................................................. 5 2.2 MEDICAL ERROR RESEARCH STUDIES ................................................... 6 2.3 DIAGNOSTIC ERRORS.................................................................................... 8 3 COGNITIVE HEURISTICS AND BIASES .................................................................... 14 3.1 STUDY OF COGNITIVE HEURISTICS AND BIASES .............................. 14 3.2 APPLICATION OF HEURISTICS TO DIAGNOSTIC REASONING ...... 16 4 THEORIES OF DECISION MAKING............................................................................ 21 4.1 NORMATIVE AND DESCRIPTIVE DECISION THEORY....................... 21 4.2 NORMATIVE THEORIES OF DECISION MAKING ................................ 22 4.2.1 Expected Utility Theory ......................................................................................22 vi 4.2.1.1 Application of Expected Utility Theory to Diagnostic Reasoning.. 22 4.2.2 Bayes’ Theorem....................................................................................................23 4.2.2.1 Application of Bayes’ Theorem to Diagnostic Reasoning............... 24 4.3 DESCRIPTIVE THEORIES OF DECISION MAKING .............................. 25 4.3.1 Mental Model Theory..........................................................................................25 4.3.1.1 Principles of the Mental Model Theory of Deductive Reasoning... 25 4.3.1.2 Predictions of the Mental Model Theory.......................................... 28 4.3.1.3 Application of Mental Model Theory to Diagnostic Reasoning ..... 30 4.3.2 Dual Process Theory............................................................................................32 4.3.2.1 Intuitive Mode of Thinking................................................................ 34 4.3.2.2 Analytical Mode of Thinking............................................................. 35 4.3.2.3 Conversion of Analytical Thinking to Intuitive Thinking .............. 36 4.3.2.4 Application of Dual Process Theory to Diagnostic Reasoning ....... 36 4.3.2.5 Relationship of Heuristics to Mode of Thinking in DPT................. 39 5 PRIOR RESEARCH ON COGNITIVE HEURISTIC DEBIASING AND COGNITIVE FEEDBACK............................................................................................... 41 5.1 PRIOR RESEARCH ON COGNITIVE HEURISTIC DEBIASING........... 41 5.2 PRIOR WORK ON COGNTIVE FEEDBACK ............................................. 46 5.2.1 Impact of Different Types of Feedback .............................................................46 5.2.2 Temporal Aspects of Feedback...........................................................................47 5.2.3 Feedback and Diagnostic Errors ........................................................................48 6 RESEARCH STATEMENT.............................................................................................. 50 6.1 RESEARCH OBJECTIVES............................................................................. 50 vii 6.2 RESEARCH QUESTIONS............................................................................... 50 6.3 HEURISTIC AND BIAS UNDER STUDY ..................................................... 51 6.4 RESEARCH METHODS.................................................................................. 52 6.4.1 Subjects .................................................................................................................52 6.4.1.1 Type and Number of Subjects ........................................................... 52 6.4.1.2 Subject Approval, Recruitment and Consent .................................. 53 6.4.2 Instrument ............................................................................................................53 6.4.3 Expert Case Models .............................................................................................55 6.4.4 Study Design.........................................................................................................57 6.4.5 Case Review Process............................................................................................59 6.4.6 Determining Subject’s Mental Model ................................................................62 6.4.7 Intervention ..........................................................................................................63 6.4.8 Application of Mental Model Theory to Feedback...........................................64 6.4.9 Data Capture ........................................................................................................68 6.4.9.1 Case Analysis Computer-Based
Recommended publications
  • The Status Quo Bias and Decisions to Withdraw Life-Sustaining Treatment
    HUMANITIES | MEDICINE AND SOCIETY The status quo bias and decisions to withdraw life-sustaining treatment n Cite as: CMAJ 2018 March 5;190:E265-7. doi: 10.1503/cmaj.171005 t’s not uncommon for physicians and impasse. One factor that hasn’t been host of psychological phenomena that surrogate decision-makers to disagree studied yet is the role that cognitive cause people to make irrational deci- about life-sustaining treatment for biases might play in surrogate decision- sions, referred to as “cognitive biases.” Iincapacitated patients. Several studies making regarding withdrawal of life- One cognitive bias that is particularly show physicians perceive that nonbenefi- sustaining treatment. Understanding the worth exploring in the context of surrogate cial treatment is provided quite frequently role that these biases might play may decisions regarding life-sustaining treat- in their intensive care units. Palda and col- help improve communication between ment is the status quo bias. This bias, a leagues,1 for example, found that 87% of clinicians and surrogates when these con- decision-maker’s preference for the cur- physicians believed that futile treatment flicts arise. rent state of affairs,3 has been shown to had been provided in their ICU within the influence decision-making in a wide array previous year. (The authors in this study Status quo bias of contexts. For example, it has been cited equated “futile” with “nonbeneficial,” The classic model of human decision- as a mechanism to explain patient inertia defined as a treatment “that offers no rea- making is the rational choice or “rational (why patients have difficulty changing sonable hope of recovery or improvement, actor” model, the view that human beings their behaviour to improve their health), or because the patient is permanently will choose the option that has the best low organ-donation rates, low retirement- unable to experience any benefit.”) chance of satisfying their preferences.
    [Show full text]
  • Ambiguity Seeking As a Result of the Status Quo Bias
    Ambiguity Seeking as a Result of the Status Quo Bias Mercè Roca 1, Robin M. Hogarth 2, A. John Maule 3 1ESRC Postgraduate Researcher, Centre for Decision Research, Leeds University Business School, The University of Leeds, Leeds, LS2 9JT, United Kingdom 2ICREA Research Professor, Departament d’Economia i Empresa, Universitat Pompeu Fabra, Ramon Trias Fargas, 08005, Barcelona, Spain 3Professor, Centre for Decision Research, Leeds University Business School, The University of Leeds, Leeds, LS2 9JT, United Kingdom Contact details: Mercè Roca, [email protected] , Telephone: (0044)07709557423. Leeds University Business School, Maurice Keyworth Building. The University of Leeds, Leeds, LS2 9JT, United Kingdom * Funds for the experiments were provided by the Centre for Decision Research of Leeds University Business School. The authors are grateful for the comments received from Gaëlle Villejoubert, Albert Satorra and Peter Wakker. This paper was presented at SPUDM20 in Stockholm. 1 Abstract Several factors affect attitudes toward ambiguity. What happens, however, when people are asked to exchange an ambiguous alternative in their possession for an unambiguous one? We present three experiments in which individuals preferred to retain the former. This status quo bias emerged both within- and between-subjects, with and without incentives, with different outcome distributions, and with endowments determined by both the experimenter and the participants themselves. Findings emphasize the need to account for the frames of reference under which evaluations of probabilistic information take place as well as modifications that should be incorporated into descriptive models of decision making. Keywords Ambiguity, risk, status quo bias, decision making, uncertainty. JEL code: C91, D81. 2 The phenomenon of ambiguity aversion – or the preference for gambles with known as opposed to unknown probabilities – has been well documented in the literature on decision making in both psychology and economics (see, e.g., Ellsberg, 1961; Camerer & Weber, 1992; Keren & Gerritsen, 1999).
    [Show full text]
  • A Task-Based Taxonomy of Cognitive Biases for Information Visualization
    A Task-based Taxonomy of Cognitive Biases for Information Visualization Evanthia Dimara, Steven Franconeri, Catherine Plaisant, Anastasia Bezerianos, and Pierre Dragicevic Three kinds of limitations The Computer The Display 2 Three kinds of limitations The Computer The Display The Human 3 Three kinds of limitations: humans • Human vision ️ has limitations • Human reasoning 易 has limitations The Human 4 ️Perceptual bias Magnitude estimation 5 ️Perceptual bias Magnitude estimation Color perception 6 易 Cognitive bias Behaviors when humans consistently behave irrationally Pohl’s criteria distilled: • Are predictable and consistent • People are unaware they’re doing them • Are not misunderstandings 7 Ambiguity effect, Anchoring or focalism, Anthropocentric thinking, Anthropomorphism or personification, Attentional bias, Attribute substitution, Automation bias, Availability heuristic, Availability cascade, Backfire effect, Bandwagon effect, Base rate fallacy or Base rate neglect, Belief bias, Ben Franklin effect, Berkson's paradox, Bias blind spot, Choice-supportive bias, Clustering illusion, Compassion fade, Confirmation bias, Congruence bias, Conjunction fallacy, Conservatism (belief revision), Continued influence effect, Contrast effect, Courtesy bias, Curse of knowledge, Declinism, Decoy effect, Default effect, Denomination effect, Disposition effect, Distinction bias, Dread aversion, Dunning–Kruger effect, Duration neglect, Empathy gap, End-of-history illusion, Endowment effect, Exaggerated expectation, Experimenter's or expectation bias,
    [Show full text]
  • Cognitive Bias Mitigation: How to Make Decision-Making More Rational?
    Cognitive Bias Mitigation: How to make decision-making more rational? Abstract Cognitive biases distort judgement and adversely impact decision-making, which results in economic inefficiencies. Initial attempts to mitigate these biases met with little success. However, recent studies which used computer games and educational videos to train people to avoid biases (Clegg et al., 2014; Morewedge et al., 2015) showed that this form of training reduced selected cognitive biases by 30 %. In this work I report results of an experiment which investigated the debiasing effects of training on confirmation bias. The debiasing training took the form of a short video which contained information about confirmation bias, its impact on judgement, and mitigation strategies. The results show that participants exhibited confirmation bias both in the selection and processing of information, and that debiasing training effectively decreased the level of confirmation bias by 33 % at the 5% significance level. Key words: Behavioural economics, cognitive bias, confirmation bias, cognitive bias mitigation, confirmation bias mitigation, debiasing JEL classification: D03, D81, Y80 1 Introduction Empirical research has documented a panoply of cognitive biases which impair human judgement and make people depart systematically from models of rational behaviour (Gilovich et al., 2002; Kahneman, 2011; Kahneman & Tversky, 1979; Pohl, 2004). Besides distorted decision-making and judgement in the areas of medicine, law, and military (Nickerson, 1998), cognitive biases can also lead to economic inefficiencies. Slovic et al. (1977) point out how they distort insurance purchases, Hyman Minsky (1982) partly blames psychological factors for economic cycles. Shefrin (2010) argues that confirmation bias and some other cognitive biases were among the significant factors leading to the global financial crisis which broke out in 2008.
    [Show full text]
  • A Dissertation Entitled Exploring Common Antecedents of Three Related Decision Biases by Jonathan E. Westfall Submitted As Parti
    A Dissertation Entitled Exploring Common Antecedents of Three Related Decision Biases by Jonathan E. Westfall Submitted as partial fulfillment of the requirements for the Doctor of Philosophy in Psychology __________________________ Advisor: Dr. J. D. Jasper __________________________ Dr. S. D. Christman __________________________ Dr. R. E. Heffner __________________________ Dr. K. L. London __________________________ Dr. M. E. Doherty __________________________ Graduate School The University of Toledo August 2009 Exploring Common Antecedents ii Copyright © 2009 – Jonathan E. Westfall This document is copyrighted material. Under copyright law, no parts of this document may be reproduced in any manner without the expressed written permission of the author. Exploring Common Antecedents iii An Abstract of Exploring Common Antecedents of Three Related Decision Biases Jonathan E. Westfall Submitted as partial fulfillment of the requirements for The Doctor of Philosophy in Psychology The University of Toledo August 2009 “Decision making inertia” is a term loosely used to describe the similar nature of a variety of decision making biases that predominantly favor a decision to maintain one course of action over switching to a new course. Three of these biases, the sunk cost effect, status-quo bias, and inaction inertia are discussed here. Combining earlier work on strength of handedness and the sunk cost effect along with new findings regarding counterfactual thought, this work principally seeks to determine if counterfactual thought may drive the three decision biases of note while also analyzing common relationships between the biases, strength of handedness, and the variables of regret and loss aversion. Over a series of experiments, it was found that handedness differences did exist in the three biases discussed, that amount and type of counterfactuals generated did not predict choice within the status-quo bias, and that the remaining variables potentially thought to drive the biases presented did not link causally to them.
    [Show full text]
  • Drug Exposure Definition and Healthy User Bias Impacts on the Evaluation of Oral Anti Hyperglycemic Therapies
    Drug Exposure Definition and Healthy User Bias Impacts on the Evaluation of Oral Anti Hyperglycemic Therapies by Maxim Eskin A thesis submitted in partial fulfillment of the requirements for the degree of Master of Science in Health Policy Research School of Public Health University of Alberta © Maxim Eskin, 2017 ABSTRACT Accurate estimation of medication use is an essential component of any pharmacoepidemiological research as exposure misclassification will threaten study validity and lead to spurious associations. Many pharmacoepidemiological studies use simple definitions, such as the categorical “any versus no use” to classify oral antihyperglycemic medications exposure, which has potentially serious drawbacks. This approach has led to numerous highly publicized observational studies of metformin effect on health outcomes reporting exaggerated relationships that were later contradicted by randomized controlled trials. Although selection bias, unmeasured confounding, and many other factors contribute to the discrepancies, one critical element, which is often overlooked, is the method used to define exposure. Another factor that may provide additional explanation for the discrepancy between randomized controlled trials and observational study results of the association between metformin use and various health outcomes is the healthy user effect. Aspects of a healthy lifestyle such as following a balanced diet, exercising regularly, avoiding tobacco use, etc., are not recorded in typical administrative databases and failure to account for these factors in observational studies may introduce bias and produce spurious associations. The influence of a healthy user bias has not been fully examined when evaluating the effect of oral antihyperglycemic therapies in observational studies. It is possible that some, if not all, of the benefit, observed with metformin in observational studies may be related to analytic design and exposure definitions.
    [Show full text]
  • 1. Service Evaluations and Qualitative Research
    EAHP Academy Seminars 20 - 21 September 2019 Brussels #ACASEM2019 EAHP Academy Seminars 20-21 September 2019 Introduction to service evaluation and qualitative research Jonathan Underhill, NICE and Keele University, UK Ulrika Gillespie Uppsala University Hospital, Sweden Conflicts of interest • No conflicts of interest to declare Introduction • Understanding how humans make decisions and its impact on: – Communicating findings – Conducting research • Answering questions using qualitative and quantitative studies Introduction • Understanding how humans make decisions and its impact on: – Communicating findings – Conducting research • Answering questions using qualitative and quantitative studies What do we know about how people make decisions? • Behavioural economics and cognitive psychology: – Bounded rationality (Herbert Simon 1978) – Dual process theory (Daniel Kahneman 2002) – Most decisions are informed by brief reading and talking to other people - please find a piece of paper and a pen - a list of words follows look at them once, do not re-read them - when you have read the list close your eyes Flange Routemaster Laggard Sausages Automaton Approach Antichrist Research Slipper Haggle Fridge Locomotive Bracket Confused Telesales Professor Stool pigeon Hale Banquet Irrelevance Write down as many words as you can remember Flange How many words Routemaster A that you remembered Laggard are in each group? Sausages Automaton Approach B Antichrist Research Slipper Haggle C Fridge Locomotive Bracket Confused D Telesales Professor Stool pigeon Hale E Banquet Irrelevance Herbert Simon 1978 Economics Bounded rationality Satisfycing Please list all the medicines which have a potential interaction with warfarin – both increasing and decreasing its effect Drug interactions with warfarin – decreased effect • Amobarbital • Primidone Butabarbital Ribavirin Carbamazepine Rifabutin Cholestyramine Rifampin Dicloxacillin Secobarbital Griseofulvin Sucralfate Mercaptopurine Vitamin K Mesalamine Coenzyme Q10 Nafcillin Ginseng Phenobarbital St.
    [Show full text]
  • “Dysrationalia” Among University Students: the Role of Cognitive
    “Dysrationalia” among university students: The role of cognitive abilities, different aspects of rational thought and self-control in explaining epistemically suspect beliefs Erceg, Nikola; Galić, Zvonimir; Bubić, Andreja Source / Izvornik: Europe’s Journal of Psychology, 2019, 15, 159 - 175 Journal article, Published version Rad u časopisu, Objavljena verzija rada (izdavačev PDF) https://doi.org/10.5964/ejop.v15i1.1696 Permanent link / Trajna poveznica: https://urn.nsk.hr/urn:nbn:hr:131:942674 Rights / Prava: Attribution 4.0 International Download date / Datum preuzimanja: 2021-09-29 Repository / Repozitorij: ODRAZ - open repository of the University of Zagreb Faculty of Humanities and Social Sciences Europe's Journal of Psychology ejop.psychopen.eu | 1841-0413 Research Reports “Dysrationalia” Among University Students: The Role of Cognitive Abilities, Different Aspects of Rational Thought and Self-Control in Explaining Epistemically Suspect Beliefs Nikola Erceg* a, Zvonimir Galić a, Andreja Bubić b [a] Department of Psychology, Faculty of Humanities and Social Sciences, University of Zagreb, Zagreb, Croatia. [b] Department of Psychology, Faculty of Humanities and Social Sciences, University of Split, Split, Croatia. Abstract The aim of the study was to investigate the role that cognitive abilities, rational thinking abilities, cognitive styles and self-control play in explaining the endorsement of epistemically suspect beliefs among university students. A total of 159 students participated in the study. We found that different aspects of rational thought (i.e. rational thinking abilities and cognitive styles) and self-control, but not intelligence, significantly predicted the endorsement of epistemically suspect beliefs. Based on these findings, it may be suggested that intelligence and rational thinking, although related, represent two fundamentally different constructs.
    [Show full text]
  • Working Memory, Cognitive Miserliness and Logic As Predictors of Performance on the Cognitive Reflection Test
    Working Memory, Cognitive Miserliness and Logic as Predictors of Performance on the Cognitive Reflection Test Edward J. N. Stupple ([email protected]) Centre for Psychological Research, University of Derby Kedleston Road, Derby. DE22 1GB Maggie Gale ([email protected]) Centre for Psychological Research, University of Derby Kedleston Road, Derby. DE22 1GB Christopher R. Richmond ([email protected]) Centre for Psychological Research, University of Derby Kedleston Road, Derby. DE22 1GB Abstract Most participants respond that the answer is 10 cents; however, a slower and more analytic approach to the The Cognitive Reflection Test (CRT) was devised to measure problem reveals the correct answer to be 5 cents. the inhibition of heuristic responses to favour analytic ones. The CRT has been a spectacular success, attracting more Toplak, West and Stanovich (2011) demonstrated that the than 100 citations in 2012 alone (Scopus). This may be in CRT was a powerful predictor of heuristics and biases task part due to the ease of administration; with only three items performance - proposing it as a metric of the cognitive miserliness central to dual process theories of thinking. This and no requirement for expensive equipment, the practical thesis was examined using reasoning response-times, advantages are considerable. There have, moreover, been normative responses from two reasoning tasks and working numerous correlates of the CRT demonstrated, from a wide memory capacity (WMC) to predict individual differences in range of tasks in the heuristics and biases literature (Toplak performance on the CRT. These data offered limited support et al., 2011) to risk aversion and SAT scores (Frederick, for the view of miserliness as the primary factor in the CRT.
    [Show full text]
  • Cognitive Bias in Emissions Trading
    sustainability Article Cognitive Bias in Emissions Trading Jae-Do Song 1 and Young-Hwan Ahn 2,* 1 College of Business Administration, Chonnam National University, Gwangju 61186, Korea; [email protected] 2 Korea Energy Economics Institute, 405-11 Jongga-ro, Jung-gu, Ulsan 44543, Korea * Correspondence: [email protected]; Tel.: +82-52-714-2175; Fax: +82-52-714-2026 Received: 8 February 2019; Accepted: 27 February 2019; Published: 5 March 2019 Abstract: This study investigates whether cognitive biases such as the endowment effect and status quo bias occur in emissions trading. Such cognitive biases can serve as a barrier to trade. This study’s survey-based experiments, which include hypothetical emissions trading scenarios, show that the endowment effect does occur in emissions trading. The status quo bias occurs in only one of the three experiments. This study also investigates whether accumulation of experience can reduce cognitive bias as discovered preference hypothesis expects. The results indicate that practitioners who are supposed to have more experience show no evidence of having less cognitive bias. Contrary to the conventional expectation, the practitioners show significantly higher level of endowment effect than students and only the practitioners show a significant status quo bias. A consignment auction situation, which is used in California’s cap-and-trade program, is also tested; no significant difference between general permission trading and consignment auctions is found. Keywords: emissions trading; cognitive bias; consignment auction; climate policy 1. Introduction Emissions trading allows entities to achieve emission reduction targets in a cost-effective way through buying and selling emission allowances in emissions trading markets [1,2].
    [Show full text]
  • 10. Sample Bias, Bias of Selection and Double-Blind
    SEC 4 Page 1 of 8 10. SAMPLE BIAS, BIAS OF SELECTION AND DOUBLE-BLIND 10.1 SAMPLE BIAS: In statistics, sampling bias is a bias in which a sample is collected in such a way that some members of the intended population are less likely to be included than others. It results in abiased sample, a non-random sample[1] of a population (or non-human factors) in which all individuals, or instances, were not equally likely to have been selected.[2] If this is not accounted for, results can be erroneously attributed to the phenomenon under study rather than to the method of sampling. Medical sources sometimes refer to sampling bias as ascertainment bias.[3][4] Ascertainment bias has basically the same definition,[5][6] but is still sometimes classified as a separate type of bias Types of sampling bias Selection from a specific real area. For example, a survey of high school students to measure teenage use of illegal drugs will be a biased sample because it does not include home-schooled students or dropouts. A sample is also biased if certain members are underrepresented or overrepresented relative to others in the population. For example, a "man on the street" interview which selects people who walk by a certain location is going to have an overrepresentation of healthy individuals who are more likely to be out of the home than individuals with a chronic illness. This may be an extreme form of biased sampling, because certain members of the population are totally excluded from the sample (that is, they have zero probability of being selected).
    [Show full text]
  • Communication Science to the Public
    David M. Berube North Carolina State University ▪ HOW WE COMMUNICATE. In The Age of American Unreason, Jacoby posited that it trickled down from the top, fueled by faux-populist politicians striving to make themselves sound approachable rather than smart. (Jacoby, 2008). EX: The average length of a sound bite by a presidential candidate in 1968 was 42.3 seconds. Two decades later, it was 9.8 seconds. Today, it’s just a touch over seven seconds and well on its way to being supplanted by 140/280- character Twitter bursts. ▪ DATA FRAMING. ▪ When asked if they truly believe what scientists tell them, NEW ANTI- only 36 percent of respondents said yes. Just 12 percent expressed strong confidence in the press to accurately INTELLECTUALISM: report scientific findings. ▪ ROLE OF THE PUBLIC. A study by two Princeton University researchers, Martin TRENDS Gilens and Benjamin Page, released Fall 2014, tracked 1,800 U.S. policy changes between 1981 and 2002, and compared the outcome with the expressed preferences of median- income Americans, the affluent, business interests and powerful lobbies. They concluded that average citizens “have little or no independent influence” on policy in the U.S., while the rich and their hired mouthpieces routinely get their way. “The majority does not rule,” they wrote. ▪ Anti-intellectualism and suspicion (trends). ▪ Trump world – outsiders/insiders. ▪ Erasing/re-writing history – damnatio memoriae. ▪ False news. ▪ Infoxication (CC) and infobesity. ▪ Aggregators and managed reality. ▪ Affirmation and confirmation bias. ▪ Negotiating reality. ▪ New tribalism is mostly ideational not political. ▪ Unspoken – guns, birth control, sexual harassment, race… “The amount of technical information is doubling every two years.
    [Show full text]