Conflicts of Interest and Spin in Reviews of Psychological Therapies

Total Page:16

File Type:pdf, Size:1020Kb

Conflicts of Interest and Spin in Reviews of Psychological Therapies Open Access Research BMJ Open: first published as 10.1136/bmjopen-2015-010606 on 26 April 2016. Downloaded from Conflicts of interest and spin in reviews of psychological therapies: a systematic review Klaus Lieb,1 Jan von der Osten-Sacken,1 Jutta Stoffers-Winterling,1 Neele Reiss,2 Jürgen Barth3 To cite: Lieb K, Osten- ABSTRACT Strengths and limitations of this study Sacken J von der, Stoffers- Objective: To explore conflicts of interest (COI) and Winterling J, et al. Conflicts their reporting in systematic reviews of psychological ▪ of interest and spin in This study addresses a widely neglected research therapies, and to evaluate spin in the conclusions of reviews of psychological topic, that is, spin introduced by non-financial therapies: a systematic the reviews. conflicts of interest (COI), for example, the review. BMJ Open 2016;6: Methods: MEDLINE and PsycINFO databases were researcher’s allegiance to a specific therapy, in e010606. doi:10.1136/ searched for systematic reviews published between reviews on psychotherapy studies. bmjopen-2015-010606 2010 and 2013 that assessed effects of psychological ▪ Although authors of reviews of psychological therapies for anxiety, depressive or personality therapies frequently show COI (which mainly are ▸ Prepublication history and disorders, and included at least one randomised not declared), the relationship to spin in review additional material is controlled trial. Required COI disclosure by journal, conclusions is less clear and has to be inter- available. To view please visit disclosed COI by review authors, and the inclusion of preted with caution. the journal (http://dx.doi.org/ own primary studies by review authors were extracted. ▪ We decided to use the term ‘spin’ instead of 10.1136/bmjopen-2015- Researcher allegiance, that is, that researchers ‘bias’, although we cannot make claims about 010606). concluded favourably about the interventions they have the nature of the influence which might be mere studied, as well as spin, that is, differences between bias or more intentional spin. results and conclusions of the reviews, were rated by 2 ▪ The selection of studies up to 2013 does not Received 19 November 2015 independent raters. reflect possible changes in COI declarations in Revised 25 February 2016 Accepted 11 March 2016 Results: 936 references were retrieved, 95 reviews recent years. fulfilled eligibility criteria. 59 compared psychological http://bmjopen.bmj.com/ therapies with other forms of psychological therapies, and 36 psychological therapies with pharmacological professional judgement or action regarding interventions. Financial, non-financial, and personal COI a primary interest will be unduly influenced were disclosed in 22, 4 and 1 review, respectively. 2 of by a secondary interest.12Research on COI 86 own primary studies of review authors included in 34 has so far mainly focused on financial COI reviews were disclosed by review authors. In 15 of the such as close financial relationships between reviews, authors showed an allegiance effect to the researchers or medical doctors and pharma- evaluated psychological therapy that was never fi ceutical companies, or the nancing of drug on September 25, 2021 by guest. Protected copyright. disclosed. Spin in review conclusions was found in 27 3–7 of 95 reviews. Reviews with a conclusion in favour of trials by pharmaceutical companies. Such psychological therapies (vs pharmacological research has shown that studies funded by 1Department of Psychiatry interventions) were at high risk for a spin in conclusions pharmaceutical companies more often yield and Psychotherapy, (OR=8.31 (1.41 to 49.05)). Spin was related in trend to results or conclusions in favour of the spon- University Medical Center the inclusion of own primary studies in the systematic soring company as compared to Mainz, Mainz, Germany review (OR=2.08 (CI 0.83 to 5.18) p=0.11) and non-industry-funded trials;89that close rela- 2Department of Differential researcher allegiance (OR=2.63 (0.84 to 8.16) p=0.16). Psychology and tionships of researchers to pharmaceutical Psychological Assessment, Conclusions: Non-financial COI, especially the companies are linked to biased assessments Goethe-University Frankfurt, inclusion of own primary studies into reviews and of drug safety and efficacy;10 11 that positive Frankfurt, Germany researcher allegiance, are frequently seen in systematic 3 trials are more likely to be published than Institute for Complementary reviews of psychological therapies and need more trials unfavourable to sponsors;12 and that and Integrative Medicine, transparency and better management. University Hospital Zurich COI are under-reported in meta-analyses of 13 14 and University Zurich, pharmacological treatments. Zurich, Switzerland The influence of non-financial COI, however, on the framing of research ques- Correspondence to Dr Klaus Lieb; INTRODUCTION tions, the data analysis and interpretation klaus.lieb@unimedizin-mainz. Conflicts of interest (COI) are defined as a of results, or the decision which results de set of circumstances that creates a risk that a are being published, has been much less Lieb K, et al. BMJ Open 2016;6:e010606. doi:10.1136/bmjopen-2015-010606 1 Open Access BMJ Open: first published as 10.1136/bmjopen-2015-010606 on 26 April 2016. Downloaded from extensively studied.15 With respect to outcome research an author of the respective primary study. These primary of psychological therapies, researcher allegiance consti- studies were then used to rate researcher allegiance. tutes an important non-financial COI. Allegiance covers the belief of a researcher in the superiority of a treat- Assessment of disclosed and undisclosed COI ment.16 17 Allegiance may be due to a special training in All disclosed COI were extracted: financial COI (honor- one specific psychological therapy, the involvement in aria, eg, for consulting, lectures, scientific articles, train- previous efficacy research about this psychological ing courses, or money for research projects), therapy or the involvement in development of aetio- non-financial COI (eg, researcher allegiance to a psycho- – logical models via basic research.18 20 Empirical studies logical therapy, special qualification in a psychological showed a strong impact of researcher allegiance on therapy, enthusiasm for a psychological therapy in scien- outcome in psychotherapy studies: a recent meta-analysis tific publications, lectures and research, or inclusion of showed a robust and moderate allegiance outcome asso- own primary studies in reviews), and personal COI (eg, ciation (r=0.26),21 and such an association is also employee or private relationship to an employee of a present in equally effective treatments.22 Taking alle- company—regularly addressed as relationships to giance into account for the explanation of effect differ- pharmaceutical companies). If no COI was reported, the ences between two active treatments studies with websites of the respective journals as well as the guide- balanced allegiance for two different treatments show lines for authors were screened for requirements of COI no difference in the effectiveness.23 disclosures at the time of the publication of the review. Since nothing is known about the extent and nature In addition, we assessed whether review authors of non-financial COI in systematic reviews of psycho- included own studies on psychological therapies into logical therapies, the aim of this study was to investigate their review, and whether this inclusion was disclosed. how often non-financial COI are present and disclosed in systematic reviews of psychological therapies, and to Rating of researcher allegiance analyse whether these COI increase the risk of spin in In case that a review author included at least one own the conclusions of the reviews. primary study (which he or she coauthored) into the review, we retrieved these primary studies and rated the researcher allegiance according to information pre- METHODS sented in the primary study (note that a rating of Search strategy and eligibility criteria of systematic researcher allegiance was not possible in the reviews reviews since these do not provide essential information to rate We searched the MEDLINE and PsycINFO data bases researcher allegiance according to established stan- 18–20 for systematic reviews or meta-analyses of randomised dards). Researcher allegiance was rated in 73 of the http://bmjopen.bmj.com/ controlled trials (RCT) on psychological therapies. 86 included primary studies since 13 reviews did not Reviews were selected if they fulfilled the following inclu- compare psychological therapies to other treatments sion criteria: (1) inclusion of psychological therapies to and were therefore excluded. fi treat patients with anxiety disorders, personality disor- Researcher allegiance was de ned to be present if the ders and/or major depressive disorders in adults, (2) author (1) recommended the respective psychological active control groups with either other forms of psycho- therapy over another therapy and was (2) either involved logical therapy or pharmacological interventions, (3) in the development of the respective psychological inclusion of at least one randomised study and (4) therapy, or (3) was involved in research of/development on September 25, 2021 by guest. Protected copyright. English language. Searches were last run on 3 February of the aetiological model of the psychological therapy. 2014, covering the publication period of January 2010– Two independent researchers ( JvdOS, JB) assessed
Recommended publications
  • Biases in Research: Risk Factors for Non-Replicability in Psychotherapy and Pharmacotherapy Research
    Psychological Medicine, Page 1 of 12. © Cambridge University Press 2016 REVIEW ARTICLE doi:10.1017/S003329171600324X Biases in research: risk factors for non-replicability in psychotherapy and pharmacotherapy research F. Leichsenring1*†, A. Abbass2, M. J. Hilsenroth3, F. Leweke1, P. Luyten4,5, J. R. Keefe6, N. Midgley7,8, S. Rabung9,10, S. Salzer11,12 and C. Steinert1 1 Department of Psychosomatics and Psychotherapy, Justus-Liebig-University Giessen, Giessen, Germany; 2 Department of Psychiatry, Dalhousie University, Centre for Emotions and Health, Halifax, NS, Canada; 3 The Derner Institute of Advanced Psychological Studies, Adelphi University, NY, USA; 4 Faculty of Psychology and Educational Sciences, University of Leuven, Klinische Psychologie (OE), Leuven, Belgium; 5 Research Department of Clinical, Educational and Health Psychology, University College London, London, UK; 6 Department of Psychology, University of Pennsylvania, Philadelphia, PA, USA; 7 The Anna Freud Centre, London, UK; 8 Research Department of Clinical, Educational and Health Psychology, UCL, London, UK; 9 Department of Psychology, Alpen-Adria-Universität Klagenfurt, Universitätsstr, Klagenfurt, Austria; 10 Department of Medical Psychology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany; 11 Clinic of Psychosomatic Medicine and Psychotherapy, Georg-August-Universität Goettingen, Göttingen, Germany; 12 International Psychoanalytic University (IPU), Berlin, Germany Replicability of findings is an essential prerequisite of research. For both basic and clinical research, however, low rep- licability of findings has recently been reported. Replicability may be affected by research biases not sufficiently con- trolled for by the existing research standards. Several biases such as researcher allegiance or selective reporting are well-known for affecting results. For psychotherapy and pharmacotherapy research, specific additional biases may affect outcome (e.g.
    [Show full text]
  • The Case of Sequential Testing James WB Elsey, Anna I. Filmer, Lott
    1 Don’t Forget the Psychology in Psychological Analyses: The Case of Sequential Testing James W.B. Elsey, Anna I. Filmer, Lotte E. Stemerding Author Note Department of Clinical Psychology, University of Amsterdam, Amsterdam, Netherlands This manuscript was supported by salaries and departmental funding from the University of Amsterdam, and by Prof. Dr Merel Kindt's ERC Advanced Grant 743263. 2 Abstract Sequential testing enables researchers to monitor and analyze data as it arrives, and decide whether or not to continue data collection depending on the results. Although there are approaches that can mitigate many statistical issues with sequential testing, we suggest that current discussions of the topic are limited by focusing almost entirely on the mathematical underpinnings of analytic approaches. An important but largely neglected assumption of sequential testing is that the data generating process under investigation remains constant across the experimental cycle. Without care, psychological factors may result in violations of this assumption when sequential testing is used: researchers’ behavior may be changed by the observation of incoming data, in turn influencing the process under investigation. We argue for the consideration of an ‘insulated’ sequential testing approach, in which research personnel remain blind to the results of interim analyses. We discuss different ways of achieving this, from automation to collaborative inter-lab approaches. As a practical supplement to the issues we raise, we introduce an evolving resource aimed at helping researchers navigate both the statistical and psychological pitfalls of sequential testing: the Sequential Testing Hub (www.sequentialtesting.com). The site includes a guide for involving an independent analyst in a sequential testing pipeline, an annotated bibliography of relevant articles covering statistical aspects of sequential testing, links to tools and tutorials centered around how to actually implement a sequential analysis in practice, and space for suggestions to help develop this resource further.
    [Show full text]
  • Concepts and Implications of Altruism Bias and Pathological Altruism
    Concepts and implications of altruism bias and pathological altruism Barbara A. Oakley1 Department of Industrial and Systems Engineering, Oakland University, Rochester, MI 48309 Edited by John C. Avise, University of California, Irvine, CA, and approved April 9, 2013 (received for review February 14, 2013) The profound benefits of altruism in modern society are self-evident. Pathological altruism can be conceived as behavior in which However, the potential hurtful aspects of altruism have gone largely attempts to promote the welfare of another, or others, results unrecognized in scientific inquiry. This is despite the fact that instead in harm that an external observer would conclude was virtually all forms of altruism are associated with tradeoffs—some reasonably foreseeable. More precisely, this paper defines path- of enormous importance and sensitivity—and notwithstanding that ological altruism as an observable behavior or personal tendency examples of pathologies of altruism abound. Presented here are the in which the explicit or implicit subjective motivation is in- mechanistic bases and potential ramifications of pathological altru- tentionally to promote the welfare of another, but instead of ism, that is, altruism in which attempts to promote the welfare of overall beneficial outcomes the altruism instead has unreasonable others instead result in unanticipated harm. A basic conceptual ap- (from the relative perspective of an outside observer) negative proach toward the quantification of altruism bias is presented. consequences to the other or even to the self. This definition does Guardian systems and their over arching importance in the evolution not suggest that there are absolutes but instead suggests that, of cooperation are also discussed.
    [Show full text]
  • Running Head: Transformational Psychology and Reducing Bias
    RUNNING HEAD: TRANSFORMATIONAL PSYCHOLOGY AND REDUCING BIAS Using Transformational Psychology to reduce bias and maintain the ethical practice of forensic mental health evaluations 2018 Christian Association for Psychological Studies International Conference. Norfolk, VA Thomas Knudsen, Psy.D., ABPP Rubenzahl, Knudsen & Associates Psychological Services, PC. Watertown, NY State University of New York, Jefferson Authors Note: Correspondence concerning this article should be addressed to Thomas Knudsen, Psy.D., ABPP, Rubenzahl, Knudsen & Associates Psychological Services, PC, 22670 Summit Drive Watertown, NY 13601 Contact: [email protected] TRANSFORMATIONAL PSYCHOLOGY AND REDUCING BIAS 2 Abstract: Forensic mental health clinicians offer criminal and family court valuable insight for making legal decisions. However, there is evidence that bias exists in the clinician’s opinion due to a myriad of issues. Clinicians are often unaware of their bias due to the phenomenon called the “bias blind spot.” Promoting ethical forensic psychological practice requires the clinician to do what is necessary to reduce bias. The “Transformational Psychological View” proposed by Coe and Hall (2010) can provide a framework for the Christian mental health clinician to aid in the reduction of the bias blind spot. The “Transformational Psychology View” suggests that the practice of psychology begins as an act of love. This concept interfaces well with the practice of psychotherapy, but performing forensic evaluations poses new challenges to acting in love towards your patient. How do we love those that are deplorable in our site and have hurt others who are innocent? Do we act with love towards the patient or the victims of the patient’s crimes or abuses? How can we use compassion to minimize bias due to the clinician’s reactivity from a sense of justice, morality, or faith? This paper proposes that doing the forensic evaluation as an act of love will reduce bias.
    [Show full text]
  • Is Mediation Training De-Biasing?
    \\jciprod01\productn\H\HNR\21-1\HNR101.txt unknown Seq: 1 31-MAR-16 9:08 Improving Lawyers’ Judgment: Is Mediation Training De-Biasing? Douglas N. Frenkel* & James H. Stark** ABSTRACT When people are placed in a partisan role or otherwise have an objective they seek to accomplish, they are prone to pervasive cognitive and motivational biases. These judgmental distortions can affect what people believe and wish to find out, the predic- tions they make, the strategic decisions they employ, and what they think is fair. A classic example is confirmation bias, which can cause its victims to seek and interpret information in ways that are consistent with their pre-existing views or the goals they aim to achieve. Studies consistently show that experts as well as laypeople are prone to such biases, and that they are highly resis- tant to change, in large part because people are generally una- ware that they are operating. When they affect lawyers, egocentric, partisan and role bi- ases can hinder the ability to provide objective advice to clients, lead to overly optimistic forecasts about the probability of future events, and promote “we-they” thinking that can exacerbate and prolong conflicts, imposing substantial costs on both clients and society. There is reason to believe that by placing people in a media- tive stance—one in which people impartially try to help dispu- tants resolve a conflict—they can develop habits of objectivity crucial to much of what lawyers are called upon to do. That this is so is supported by social science research on two specific strate- gies for de-biasing judgment—considering alternative scenarios and taking another’s perspective—both core mediator mindsets.
    [Show full text]
  • Bias Is a Reciprocal Relationship 427
    \\jciprod01\productn\M\MAT\31-2\MAT209.txt unknown Seq: 1 13-MAR-19 14:24 Vol. 31, 2019 Bias Is a Reciprocal Relationship 427 Bias Is a Reciprocal Relationship: Forensic Mental Health Professionals and Lawyers in the Family Court Bottle by Dana E. Prescott* and Diane A. Tennies** I. Introduction The profession of law and its belief in the adversarial system as a means to discern factual truths in child custody litigation is deeply rooted in centuries of political and constitutional theory.1 Beyond political rhetoric and academic discourse, the definition of who is a parent and who has rights and responsibilities for children may mean that legal definitions, slower to evolve, are narrower than contemporary social definitions and demographic realties. Even as these social, legislative, and judicial adjustments occur over various time horizons, families in conflict must turn to the family court system to resolve the physical and legal custody of children. * Dana E. Prescott, JD, MSW, PhD is a lawyer licensed in Maine and Massachusetts. He may be contacted at [email protected]. The opin- ions expressed in this article are those of the authors and may not reflect the opinions of the AAML or the Journal. ** Diane A. Tennies, PhD, LADC is a clinical and forensic psychologist with a principle office in Bangor, Maine. She may be contacted at [email protected] 1 For a critical reflection on this history, see Rebecca Aviel, Why Civil Gideon Won’t Fix Family Law, 122 YALE L.J. 2106, 2120 (2012) (“This is a painfully glancing treatment of the fact that the adversarial model fits poorly with most pressing goals of family court, but the truth is that this disconnect is not news to scholars and reformers who study private custody disputes.“); Bar- bra A.
    [Show full text]
  • The Case of Sequential Testing James WB Elsey, Anna I. Filmer, Lott
    1 Don’t Forget the Psychology in Psychological Analyses: The Case of Sequential Testing James W.B. Elsey, Anna I. Filmer, Lotte E. Stemerding Author Note Department of Clinical Psychology, University of Amsterdam, Amsterdam, Netherlands This manuscript was supported by salaries and departmental funding from the University of Amsterdam, and by Prof. Dr Merel Kindt's ERC Advanced Grant 743263. This is a preprint version. 2 Abstract Sequential testing enables researchers to monitor and analyze data as it arrives, and decide whether or not to continue data collection depending on the results. Bayesian approaches can mitigate many statistical issues with sequential testing, but we suggest that current discussions of the topic are limited by focusing almost entirely on the mathematical underpinnings of analytic approaches. An important but largely neglected assumption of sequential testing is that the data generating process under investigation remains constant across the experimental cycle. Without care, psychological factors may result in violations of this assumption when sequential testing is used: researchers’ behavior may be changed by the observation of incoming data, in turn influencing the process under investigation. We urge that researchers adopt an ‘insulated’ sequential testing approach, in which research personnel remain blind to the results of interim analyses. We discuss different ways of achieving this, from automation to collaborative inter-lab approaches. As a practical supplement to the issues we raise, we introduce an evolving resource for sequential testing – the Sequential Testing Hub – including templates and a guide for involving an independent analyst in a sequential testing pipeline, an annotated bibliography centered around the practicalities of sequential analyses, and space for suggestions to help develop this resource further.
    [Show full text]
  • The Effective Practitioner: the Role and Contribution of Therapist Effects in the Delivery of Psychological Therapies
    "THE EFFECTIVE PRACTITIONER: THE ROLE AND CONTRIBUTION OF THERAPIST EFFECTS IN THE DELIVERY OF PSYCHOLOGICAL THERAPIES” A thesis submitted in fulfilment of the requirement for the Degree of Doctor of Philosophy Jo-Ann Pereira Department of Psychology University of Sheffield 2015 i Declaration I hereby declare that this thesis is my work and effort carried out under the supervision of Professor Michael Barkham and Dr Stephen Kellett. It has not been submitted anywhere for any award. Where other sources of information have been used, they have been acknowledged. Signature: …………………………………… Date: ……15 March 2016……………… i Abstract Background: Variability in human performance is a naturally occurring phenomenon and applies to practitioners. Mainstream psychotherapy research has focused on treatments rather than practitioners and has viewed variability as error within the dominant paradigm of the randomised controlled trial. Aims: To investigate variability via the role of practitioner personal qualities and their association with differential patient outcomes, their contribution to effective practice, and the extent these qualities vary with patient severity. Method: A practice-based paradigm was adopted and sampled practitioners and data within a single Improving Access to Psychological Therapies (IAPT) service. The full sample comprised 42 practitioners – psychological wellbeing practitioners, counsellors, and cognitive-behaviour therapists – who completed measures of resilience, empathy, and mindfulness as well as provided qualitative accounts of their practice. A series of seven sequential studies utilised subsamples of the responses from these 42 practitioners, which were analysed prior to yoking with their patient outcome data to determine associations with more and less effective practice. Studies comprised mixed and integrated quantitative and qualitative analyses comparing benchmarking and multilevel modelling research methods (N=37) and thematic analysis (N=6).
    [Show full text]
  • Adversarial Allegiance Among Expert Witnesses Daniel C
    LS11CH03-Murrie ARI 19 September 2015 12:41 ANNUAL REVIEWS Further Click here to view this article's online features: • Download figures as PPT slides • Navigate linked references • Download citations Adversarial Allegiance among • Explore related articles • Search keywords Expert Witnesses Daniel C. Murrie1 and Marcus T. Boccaccini2 1Institute of Law, Psychiatry, and Public Policy, University of Virginia, Charlottesville, Virginia 22903; email: [email protected] 2Psychology Department, Sam Houston State University, Huntsville, Texas 77341 Annu. Rev. Law Soc. Sci. 2015. 11:37–55 Keywords First published online as a Review in Advance on bias, allegiance, adversarial, forensic science, forensic assessment, expert August 20, 2015 witness, expert testimony The Annual Review of Law and Social Science is online at lawsocsci.annualreviews.org Abstract This article’s doi: Can experts remain objective and accurate when one particular side in ad- 10.1146/annurev-lawsocsci-120814-121714 versarial legal proceedings retains them? Despite long-standing concerns Access provided by 209.169.85.137 on 11/06/15. For personal use only. Copyright c 2015 by Annual Reviews. from the legal system and the general public, research has only recently All rights reserved explored whether experts can provide opinions unbiased by the side that Annu. Rev. Law. Soc. Sci. 2015.11:37-55. Downloaded from www.annualreviews.org retained them. This review addresses some of the factors that may cause dis- agreements between opposing experts. After summarizing recent field and experimental studies on mental health evaluations by forensic experts, we conclude that working for one side in an adversarial case causes some ex- perts’ opinions to drift toward the party retaining their services, even on ostensibly objective instruments and procedures.
    [Show full text]
  • Towards a Better Understanding of Lawyers' Judgmental Biases in Client Representation: the Role of Need for Cognitive Closure
    Washington University Journal of Law & Policy Volume 59 Access to Justice: The Social Responsibility of Lawyers 2019 Towards a Better Understanding of Lawyers’ Judgmental Biases in Client Representation: The Role of Need for Cognitive Closure James H. Stark Roger Sherman Professor of Law Emeritus and Oliver Ellsworth Research Professor of Law, University of Connecticut School of Law Maxim Milyavsky Senior Lecturer in the Faculty of Business Administration, Ono Academic College, Kiryat Ono, Israel Follow this and additional works at: https://openscholarship.wustl.edu/law_journal_law_policy Part of the Law and Psychology Commons, Legal Education Commons, and the Legal Profession Commons Recommended Citation James H. Stark and Maxim Milyavsky, Towards a Better Understanding of Lawyers’ Judgmental Biases in Client Representation: The Role of Need for Cognitive Closure, 59 WASH. U. J. L. & POL’Y 173 (2019), https://openscholarship.wustl.edu/law_journal_law_policy/vol59/iss1/12 This Article is brought to you for free and open access by the Law School at Washington University Open Scholarship. It has been accepted for inclusion in Washington University Journal of Law & Policy by an authorized administrator of Washington University Open Scholarship. For more information, please contact [email protected]. Towards a Better Understanding of Lawyers’ Judgmental Biases in Client Representation: The Role of Need for Cognitive Closure James H. Stark and Maxim Milyavsky* ABSTRACT Previous research demonstrates that lawyers and law students are, on average, prone to overconfidence bias and self-serving judgments of fairness when they take on a representative lawyering role. This is the first study to investigate individual differences in susceptibility to these biases.
    [Show full text]
  • Evidence-Based Or Biased? the Quality of Published Reviews of Evidence-Based Practices Julia H
    Bryn Mawr College Scholarship, Research, and Creative Work at Bryn Mawr College Graduate School of Social Work and Social Graduate School of Social Work and Social Research Faculty Research and Scholarship Research 2008 Evidence-based or Biased? The Quality of Published Reviews of Evidence-based Practices Julia H. Littell Bryn Mawr College, [email protected] Let us know how access to this document benefits ouy . Follow this and additional works at: http://repository.brynmawr.edu/gsswsr_pubs Part of the Social Work Commons Custom Citation Littell, Julia H. "Evidence-based or Biased? The Quality of Published Reviews of Evidence-based Practices." Children and Youth Services Review 30, no. 11 (2008): 1299-1317, doi: 10.1016/j.childyouth.2008.04.001. This paper is posted at Scholarship, Research, and Creative Work at Bryn Mawr College. http://repository.brynmawr.edu/gsswsr_pubs/35 For more information, please contact [email protected]. Evidence-based or biased? The quality of published reviews of evidence-based practices to appear in Children and Youth Services Review Final version submitted 20 April 2007 DO NOT CITE WITHOUT AUTHOR’S PERMISSION Julia H. Littell Graduate School of Social Work and Social Research Bryn Mawr College [email protected] Running head: Reviews of evidence-based practices Key words: evidence-based practice, research synthesis, systematic reviews, confirmation bias Author’s note: Portions of this work were supported by grants from the Smith Richardson Foundation, the Swedish Centre for Evidence-based Social Work Practice (IMS), and the Nordic Campbell Center. I thank Burnee’ Forsythe for her assistance with the search process and document retrieval.
    [Show full text]
  • Improving Lawyers' Judgment: Is Mediation Training De-Biasing?
    University of Pennsylvania Carey Law School Penn Law: Legal Scholarship Repository Faculty Scholarship at Penn Law Fall 2015 Improving Lawyers’ Judgment: Is Mediation Training De-Biasing? Douglas N. Frenkel University of Pennsylvania Carey Law School James H. Stark University of Connecticut Follow this and additional works at: https://scholarship.law.upenn.edu/faculty_scholarship Part of the Cognition and Perception Commons, Dispute Resolution and Arbitration Commons, Law and Psychology Commons, Legal Education Commons, Legal Profession Commons, Litigation Commons, and the Public Law and Legal Theory Commons Repository Citation Frenkel, Douglas N. and Stark, James H., "Improving Lawyers’ Judgment: Is Mediation Training De- Biasing?" (2015). Faculty Scholarship at Penn Law. 1680. https://scholarship.law.upenn.edu/faculty_scholarship/1680 This Article is brought to you for free and open access by Penn Law: Legal Scholarship Repository. It has been accepted for inclusion in Faculty Scholarship at Penn Law by an authorized administrator of Penn Law: Legal Scholarship Repository. For more information, please contact [email protected]. \\jciprod01\productn\H\HNR\21-1\HNR101.txt unknown Seq: 1 31-MAR-16 9:08 Improving Lawyers’ Judgment: Is Mediation Training De-Biasing? Douglas N. Frenkel* & James H. Stark** ABSTRACT When people are placed in a partisan role or otherwise have an objective they seek to accomplish, they are prone to pervasive cognitive and motivational biases. These judgmental distortions can affect what people believe and wish to find out, the predic- tions they make, the strategic decisions they employ, and what they think is fair. A classic example is confirmation bias, which can cause its victims to seek and interpret information in ways that are consistent with their pre-existing views or the goals they aim to achieve.
    [Show full text]