Safe-To-Fail Probe Has…

Total Page:16

File Type:pdf, Size:1020Kb

Safe-To-Fail Probe Has… Liz Keogh [email protected] If a project has no risks, don’t do it. @lunivore The Innovaon Cycle Spoilers Differentiators Commodities Build on Cynefin Complex Complicated sense, probe, analyze, sense, respond respond Obvious Chaotic sense, act, categorize, sense, respond respond With thanks to David Snowden and Cognitive Edge EsBmang Complexity 5. Nobody has ever done it before 4. Someone outside the org has done it before (probably a compeBtor) 3. Someone in the company has done it before 2. Someone in the team has done it before 1. We all know how to do it. Esmang Complexity 5 4 3 Analyze Probe (Break it down) (Try it out) 2 1 Fractal beauty Feature Scenario Goal Capability Story Feature Scenario Vision Story Goal Code Capability Feature Code Code Scenario Goal A Real ProjectWhoops, Don’t need forgot this… Can’t remember Feature what this Scenario was for… Goal Capability Story Feature Scenario Vision Story Goal Code Capability Feature Code Code Scenario Goal Oops, didn’t know about Look what I that… found! A Real ProjectWhoops, Don’t need forgot this… Can’t remember Um Feature what this Scenario was for… Goal Oh! Capability Hmm! Story FeatureOoh, look! Scenario Vision Story GoalThat’s Code funny! Capability Feature Code Er… Code Scenario Dammit! Oops! Oh F… InteresBng! Goal Sh..! Oops, didn’t know about Look what I that… found! We are uncovering be^er ways of developing so_ware by doing it Feature Scenario Goal Capability Story Feature Scenario Vision Story Goal Code Capability Feature Code Code Scenario Goal We’re discovering how to discover stuff by doing it Can’t Don’t need Whoops, remember this… forgot what this was for… Um… Oh! Hmm! Ooh, look! That’s funny! Er… Oops! Sh..! Dammit! Oh F… InteresBng! Oops, didn’t know about Look what I that… found! Risk (Newest Stuff) First Feature Scenario Goal Capability Story FeatureStory ScenarioFeature Vision ScenarioStory GoalGoal Code Capability Feature Code Code Scenario Goal If your stakeholders don’t trust you, that’s your biggest risk A Safe-To-Fail Probe has… A way of knowing it’s succeeding A way of knowing it’s failing A way of dampening it A way of amplifying it Coherence Coherence A realisBc reason for thinking the probe might have a posiBve impact Can you give me an example? @lunivore Well-formed outcomes Vision Hearing Smell Taste Sensaon KinestheBc PropriacepBon @lunivore In high uncertainty… …scenarios provide coherence, not tests @lunivore Coherence Given my boyfriend and I have been going out for four years When we move in with each other Then we should be even happier together. @lunivore “That won’t work because…” System Illusion of jusBficaon Normalcy bias transparency Decoy effect InsensiBvity Confirmaon Loss to sample Bandwagon False Fundamental Bias Aversion size effect consensus Pessimism AribuBon Negavity effect bias Error 159 Cognive Omission Disncon OpBmism biasbias Hyperbolic bias bias discounngGoogle effectBiases on Overconfidence Illusion of Naïve effectCryptomnesia Restraint biasControl Wikipedia cynicism Actor- Pseudocertainty Stereotyping Observer Anchoring effect Choice- Apophenia Bias Pareidolia Worse-than-supporve Trait average bias ascrypBon Forer effect effectCongruence bias Moral luck bias Failure Scenarios Given my boyfriend and I have been going out for four years When we move in with each other Then we might get on each other’s nerves. @lunivore A Safe-To-Fail Probe has… A way of knowing it’s succeeding A way of knowing it’s failing A way of dampening it A way of amplifying it Coherence A way of avoiding failure completely @lunivore The Probe “How about we try it for 1 year as an experiment?” @lunivore The Palchinsky Principles Seek out new ideas and try new things When trying something new, do it on a scale where failure is survivable Seek out feedback and learn from your mistakes as you go along @lunivore @lunivore .
Recommended publications
  • A Task-Based Taxonomy of Cognitive Biases for Information Visualization
    A Task-based Taxonomy of Cognitive Biases for Information Visualization Evanthia Dimara, Steven Franconeri, Catherine Plaisant, Anastasia Bezerianos, and Pierre Dragicevic Three kinds of limitations The Computer The Display 2 Three kinds of limitations The Computer The Display The Human 3 Three kinds of limitations: humans • Human vision ️ has limitations • Human reasoning 易 has limitations The Human 4 ️Perceptual bias Magnitude estimation 5 ️Perceptual bias Magnitude estimation Color perception 6 易 Cognitive bias Behaviors when humans consistently behave irrationally Pohl’s criteria distilled: • Are predictable and consistent • People are unaware they’re doing them • Are not misunderstandings 7 Ambiguity effect, Anchoring or focalism, Anthropocentric thinking, Anthropomorphism or personification, Attentional bias, Attribute substitution, Automation bias, Availability heuristic, Availability cascade, Backfire effect, Bandwagon effect, Base rate fallacy or Base rate neglect, Belief bias, Ben Franklin effect, Berkson's paradox, Bias blind spot, Choice-supportive bias, Clustering illusion, Compassion fade, Confirmation bias, Congruence bias, Conjunction fallacy, Conservatism (belief revision), Continued influence effect, Contrast effect, Courtesy bias, Curse of knowledge, Declinism, Decoy effect, Default effect, Denomination effect, Disposition effect, Distinction bias, Dread aversion, Dunning–Kruger effect, Duration neglect, Empathy gap, End-of-history illusion, Endowment effect, Exaggerated expectation, Experimenter's or expectation bias,
    [Show full text]
  • A Neural Network Framework for Cognitive Bias
    fpsyg-09-01561 August 31, 2018 Time: 17:34 # 1 HYPOTHESIS AND THEORY published: 03 September 2018 doi: 10.3389/fpsyg.2018.01561 A Neural Network Framework for Cognitive Bias Johan E. Korteling*, Anne-Marie Brouwer and Alexander Toet* TNO Human Factors, Soesterberg, Netherlands Human decision-making shows systematic simplifications and deviations from the tenets of rationality (‘heuristics’) that may lead to suboptimal decisional outcomes (‘cognitive biases’). There are currently three prevailing theoretical perspectives on the origin of heuristics and cognitive biases: a cognitive-psychological, an ecological and an evolutionary perspective. However, these perspectives are mainly descriptive and none of them provides an overall explanatory framework for the underlying mechanisms of cognitive biases. To enhance our understanding of cognitive heuristics and biases we propose a neural network framework for cognitive biases, which explains why our brain systematically tends to default to heuristic (‘Type 1’) decision making. We argue that many cognitive biases arise from intrinsic brain mechanisms that are fundamental for the working of biological neural networks. To substantiate our viewpoint, Edited by: we discern and explain four basic neural network principles: (1) Association, (2) Eldad Yechiam, Technion – Israel Institute Compatibility, (3) Retainment, and (4) Focus. These principles are inherent to (all) neural of Technology, Israel networks which were originally optimized to perform concrete biological, perceptual, Reviewed by: and motor functions. They form the basis for our inclinations to associate and combine Amos Schurr, (unrelated) information, to prioritize information that is compatible with our present Ben-Gurion University of the Negev, Israel state (such as knowledge, opinions, and expectations), to retain given information Edward J.
    [Show full text]
  • Infographic I.10
    The Digital Health Revolution: Leaving No One Behind The global AI in healthcare market is growing fast, with an expected increase from $4.9 billion in 2020 to $45.2 billion by 2026. There are new solutions introduced every day that address all areas: from clinical care and diagnosis, to remote patient monitoring to EHR support, and beyond. But, AI is still relatively new to the industry, and it can be difficult to determine which solutions can actually make a difference in care delivery and business operations. 59 Jan 2021 % of Americans believe returning Jan-June 2019 to pre-coronavirus life poses a risk to health and well being. 11 41 % % ...expect it will take at least 6 The pandemic has greatly increased the 65 months before things get number of US adults reporting depression % back to normal (updated April and/or anxiety.5 2021).4 Up to of consumers now interested in telehealth going forward. $250B 76 57% of providers view telehealth more of current US healthcare spend % favorably than they did before COVID-19.7 could potentially be virtualized.6 The dramatic increase in of Medicare primary care visits the conducted through 90% $3.5T telehealth has shown longevity, with rates in annual U.S. health expenditures are for people with chronic and mental health conditions. since April 2020 0.1 43.5 leveling off % % Most of these can be prevented by simple around 30%.8 lifestyle changes and regular health screenings9 Feb. 2020 Apr. 2020 OCCAM’S RAZOR • CONJUNCTION FALLACY • DELMORE EFFECT • LAW OF TRIVIALITY • COGNITIVE FLUENCY • BELIEF BIAS • INFORMATION BIAS Digital health ecosystems are transforming• AMBIGUITY BIAS • STATUS medicineQUO BIAS • SOCIAL COMPARISONfrom BIASa rea• DECOYctive EFFECT • REACTANCEdiscipline, • REVERSE PSYCHOLOGY • SYSTEM JUSTIFICATION • BACKFIRE EFFECT • ENDOWMENT EFFECT • PROCESSING DIFFICULTY EFFECT • PSEUDOCERTAINTY EFFECT • DISPOSITION becoming precise, preventive,EFFECT • ZERO-RISK personalized, BIAS • UNIT BIAS • IKEA EFFECT and • LOSS AVERSION participatory.
    [Show full text]
  • John Collins, President, Forensic Foundations Group
    On Bias in Forensic Science National Commission on Forensic Science – May 12, 2014 56-year-old Vatsala Thakkar was a doctor in India but took a job as a convenience store cashier to help pay family expenses. She was stabbed to death outside her store trying to thwart a theft in November 2008. Bloody Footwear Impression Bloody Tire Impression What was the threat? 1. We failed to ask ourselves if this was a footwear impression. 2. The appearance of the impression combined with the investigator’s interpretation created prejudice. The accuracy of our analysis became threatened by our prejudice. Types of Cognitive Bias Available at: http://en.wikipedia.org/wiki/List_of_cognitive_biases | Accessed on April 14, 2014 Anchoring or focalism Hindsight bias Pseudocertainty effect Illusory superiority Levels-of-processing effect Attentional bias Hostile media effect Reactance Ingroup bias List-length effect Availability heuristic Hot-hand fallacy Reactive devaluation Just-world phenomenon Misinformation effect Availability cascade Hyperbolic discounting Recency illusion Moral luck Modality effect Backfire effect Identifiable victim effect Restraint bias Naive cynicism Mood-congruent memory bias Bandwagon effect Illusion of control Rhyme as reason effect Naïve realism Next-in-line effect Base rate fallacy or base rate neglect Illusion of validity Risk compensation / Peltzman effect Outgroup homogeneity bias Part-list cueing effect Belief bias Illusory correlation Selective perception Projection bias Peak-end rule Bias blind spot Impact bias Semmelweis
    [Show full text]
  • Dear Friends and Colleagues
    Dear friends and colleagues On behalf of the organizational team, it is our pleasure to extend a warm welcome to all of you. We hope that you are ready for the stimulating and exciting academic experience of the 16th General Meeting of the European Association of Social Psychology. We received a total of 960 submissions this year representing more than 40 countries. This reflects roughly 1200 presentations within symposia, thematic sessions, and as posters, and constitutes a 34% increase relative to the last General Meeting. The program committee has worked with great dedication to organize an exciting program on the basis of these worldwide contributions. The scientific program includes 11 parallel sessions with 90 symposia, 63 thematic sessions, four large poster sessions (one each day), awards session and the Tajfel lecture. Moreover, round-table discussions will be held by some of our most prominent colleagues during lunch breaks. The scientific program will start on Wednesday at 9:30, and will occupy most of Wednesday, Thursday, and Saturday, while Friday will only have scientific sessions during the morning. Friday afternoon will be dedicated to the awards session including the Tajfel lecture, and the business meeting. It is our hope that the program will serve as an invitation to many fruitful discussions yielding valuable insights about all topics in our field and about social psychology at large. An international, scientific meeting should also provide opportunities for collaborative meetings and social interactions between friends and colleagues, outside the scientific program. We have organised a social programme which we hope will provide good opportunities to renew old friendships and to make new ones.
    [Show full text]
  • Influence of Cognitive Biases in Distorting Decision Making and Leading to Critical Unfavorable Incidents
    Safety 2015, 1, 44-58; doi:10.3390/safety1010044 OPEN ACCESS safety ISSN 2313-576X www.mdpi.com/journal/safety Article Influence of Cognitive Biases in Distorting Decision Making and Leading to Critical Unfavorable Incidents Atsuo Murata 1,*, Tomoko Nakamura 1 and Waldemar Karwowski 2 1 Department of Intelligent Mechanical Systems, Graduate School of Natural Science and Technology, Okayama University, Okayama, 700-8530, Japan; E-Mail: [email protected] 2 Department of Industrial Engineering & Management Systems, University of Central Florida, Orlando, 32816-2993, USA; E-Mail: [email protected] * Author to whom correspondence should be addressed; E-Mail: [email protected]; Tel.: +81-86-251-8055; Fax: +81-86-251-8055. Academic Editor: Raphael Grzebieta Received: 4 August 2015 / Accepted: 3 November 2015 / Published: 11 November 2015 Abstract: On the basis of the analyses of past cases, we demonstrate how cognitive biases are ubiquitous in the process of incidents, crashes, collisions or disasters, as well as how they distort decision making and lead to undesirable outcomes. Five case studies were considered: a fire outbreak during cooking using an induction heating (IH) cooker, the KLM Flight 4805 crash, the Challenger space shuttle disaster, the collision between the Japanese Aegis-equipped destroyer “Atago” and a fishing boat and the Three Mile Island nuclear power plant meltdown. We demonstrate that heuristic-based biases, such as confirmation bias, groupthink and social loafing, overconfidence-based biases, such as the illusion of plan and control, and optimistic bias; framing biases majorly contributed to distorted decision making and eventually became the main cause of the incident, crash, collision or disaster.
    [Show full text]
  • How to Make Organisations More Innovative, Open Minded and Critical in Their Thinking and Judgment
    How to make organisations more innovative, open minded and critical in their thinking and judgment Crawford Hollingworth and Liz Barker Source: WARC Best Practice, September 2017 Downloaded from WARC This article offers strategies for recognising and minimising biases that can lead to suboptimal thinking and decisions in organisations. Bias is prevalent in all areas of business and types of organisation, and can often lead to less- than-optimal decision making. Once people learn how to recognise and challenge biases, they can learn how to be more innovative, open minded and critical in their thinking and judgment. The behavioural sciences have developed proven methods and techniques to improve thinking, which have been adopted by many organisations including the intelligence community, the military and top technology companies. Jump to: Where to start | Essentials | Checklist | Case studies | Conclusion | Further reading Behavioural science has revealed how numerous cognitive biases are manifest in organisational thinking and operations, biases which can mean employees, not least leaders, directors and management teams, often make judgements and decisions in potentially sub-optimal ways. Yet, whilst the world has woken up to how behavioural science can be used to nudge and optimise consumer behaviour, organisational processes and systems have remained largely untouched. However, in the last few years there has been a growing focus on internal decision-making processes within pioneering companies and organisations, who are drawing on the latest academic research and in-house data to design new frameworks and systems to both understand and optimise internal decision-making. In this article, we'll first explore some of the cognitive biases commonly operating in organisations, looking at how they can skew and prevent good decision-making.
    [Show full text]
  • Catalyzing Transformative Engagement: Tools and Strategies from the Behavioral Sciences
    Catalyzing Transformative Engagement: Tools and Strategies from the Behavioral Sciences GoGreen Portland 2014 Thursday, October 16 ANXIETY AMBIVALENCE ASPIRATION ANXIETY ASPIRATIONAMBIVALENCE A Few of Our Clients Published online 11 April 2008 | Nature | doi:10.1038/news.2008.751 Your brain makes up its mind up to ten seconds before you realize it, according to researchers. By looking at brain acLvity while making a decision, the researchers could predict what choice people would make before they themselves were even aware of having made a decision. Source:Soon, C. S., Brass, M., Heinze, H.-J. & Haynes, J.-D. Nature Neurosci.doi: 10.1038/nn.2112 (2008). Cognive Bias • a paern of deviaon in judgment that occurs in parLcular situaons. • can lead to perceptual distorLon, inaccurate judgment, or illogical interpretaon. Source: www.princeton.edu Cogni&ve Biases – A Par&al List Ambiguity effect Framing effect Ostrich effect Anchoring or focalism Frequency illusion Outcome bias AOenLonal bias FuncLonal fixedness Overconfidence effect Availability heurisLc Gambler's fallacy Pareidolia Availability cascade Hard–easy effect Pessimism bias Backfire effect Hindsight bias Planning fallacy Bandwagon effect HosLle media effect Post-purchase raonalizaon Base rate fallacy or base rate neglect Hot-hand fallacy Pro-innovaon bias Belief bias Hyperbolic discounLng Pseudocertainty effect Bias blind spot IdenLfiable vicLm effect Reactance Cheerleader effect IKEA effect ReacLve devaluaon Choice-supporLve bias Illusion of control Recency illusion Clustering illusion Illusion
    [Show full text]
  • To Err Is Human, but Smaller Funds Can Succeed by Mitigating Cognitive Bias
    FEATURE | SMALLER FUNDS CAN SUCCEED BY MITIGATING COGNITIVE BIAS To Err Is Human, but Smaller Funds Can Succeed by Mitigating Cognitive Bias By Bruce Curwood, CIMA®, CFA® he evolution of investment manage­ 2. 2000–2008: Acknowledgement, where Diversification meant simply expanding the ment has been a long and painful plan sponsors discovered the real portfolio beyond domestic markets into T experience for many institutional meaning of risk. less­correlated foreign equities and return plan sponsors. It’s been trial by fire and 3. Post­2009: Action, which resulted in a was a simple function of increasing the risk learning important lessons the hard way, risk revolution. (more equity, increased leverage, greater generally from past mistakes. However, foreign currency exposure, etc.). After all, “risk” doesn’t have to be a four­letter word Before 2000, modern portfolio theory, history seemed to show that equities and (!@#$). In fact, in case you haven’t noticed, which was developed in the 1950s and excessive risk taking outperformed over the there is currently a revolution going on 1960s, was firmly entrenched in academia long term. In short, the crux of the problem in our industry. Most mega funds (those but not as well understood by practitioners, was the inequitable amount of time and well­governed funds in excess of $10 billion whose focus was largely on optimizing effort that investors spent on return over under management) already have moved return. The efficient market hypothesis pre­ risk, and that correlation and causality were to a more comprehensive risk management vailed along with the rationality of man, supposedly closely linked.
    [Show full text]
  • Cognitive Biases in Fitness to Practise Decision-Making
    ADVICE ON BIASES IN FITNESS TO PRACTISE DECISION-MAKING IN ACCEPTED OUTCOME VERSUS PANEL MODELS FOR THE PROFESSIONAL STANDARDS AUTHORITY Prepared by: LESLIE CUTHBERT Date: 31 March 2021 Contents I. Introduction ................................................................................................. 2 Background .................................................................................................. 2 Purpose of the advice.................................................................................... 3 Summary of conclusions ................................................................................ 4 Documents considered .................................................................................. 4 Technical terms and explanations ................................................................... 5 Disclaimer .................................................................................................... 5 II. How biases might affect the quality of decision-making in the AO model, as compared to the panel model .............................................................................. 6 Understanding cognitive biases in fitness to practise decision-making ............... 6 Individual Decision Maker (e.g. a Case Examiner) in AO model ......................... 8 Multiple Case Examiners .............................................................................. 17 Group Decision Maker in a Panel model of 3 or more members ....................... 22 III. Assessment of the impact of these biases,
    [Show full text]
  • Cost Risk Estimating Management Glossary
    Cost Risk Estimating Management Glossary 2021 The beginning of wisdom is the definition of terms. Socrates (470 – 399 BCE) Theorem 1: 50% of the problems in the world result from people using the same words with different meanings. Theorem 2: the other 50% comes from people using different words with the same meaning. S. Kaplan (1997) Abbreviations AACE Association for the Advancement of Cost Engineering International (AACE International) ® ® CEVP Cost Estimate Validation Process FHWA Federal Highway Administration FRA Federal Railroad Administration FTA Federal Transit Administration FY Fiscal Year ISO International Organization for Standardization GSP General Special Provisions PMBOK™ Project Management Body of Knowledge (PMI's PMBOK) Third Edition PMI Project Management Institute Combined Standards Glossary ROD Record of Decision Revenue Operations Date (FTA) TAG Transportation Analysis Group TDM Transportation Demand Management TPA Transportation Partnership Act (Washington State Program of Projects) TRAC Transportation Center (WSDOT research center) TSM Transportation System Management A accountability The quality or state of being accountable; especially: an obligation or willingness to accept (12) responsibility or to account for one's actions. The person having accountability for responding, monitoring and controlling risk is the risk manager. accuracy The difference between the forecasted value and the actual value (forecast accuracy). (16) accuracy range An expression of an estimate's predicted closeness to final actual costs or time. Typically (1) Dec expressed as high/low percentages by which actual results will be over and under the 2011 estimate along with the confidence interval these percentages represent. See also: Confidence Interval; Range. activity A component of work performed during the course of a project.
    [Show full text]
  • Thinking About Thinking: Cognition, Science, and Psychotherapy
    THINKING ABOUT THINKING This book examines cognition with a broad and comprehensive approach. Draw- ing upon the work of many researchers, McDowell applies current scientific thinking to enhance the understanding of psychotherapy and other contemporary topics, including economics and health care. Through the use of practical exam- ples, his analysis is accessible to a wide range of readers. In particular, clinicians, physicians, and mental health professionals will learn more about the thought processes through which they and their patients assess information. Philip E. McDowell , LCSW, has a private practice in Lowville, New York. He earned a Lifetime Achievement Award from the New York State Office of Mental Health in 2002. This page intentionally left blank THINKING ABOUT THINKING Cognition, Science, and Psychotherapy Philip E. McDowell First published 2015 by Routledge 711 Third Avenue, New York, NY 10017 and by Routledge 27 Church Road, Hove, East Sussex BN3 2FA Routledge is an imprint of the Taylor & Francis Group, an informa business © 2015 Taylor & Francis The right of Philip E. McDowell to be identified as author of this work has been asserted by him in accordance with sections 77 and 78 of the Copyright, Designs and Patents Act 1988. All rights reserved. No part of this book may be reprinted or reproduced or utilised in any form or by any electronic, mechanical, or other means, now known or hereafter invented, including photocopying and recording, or in any information storage or retrieval system, without permission in writing from the publishers. Trademark notice : Product or corporate names may be trademarks or registered trademarks, and are used only for identification and explanation without intent to infringe.
    [Show full text]