Keep Calm and Carry On: Inahta Members' Views On

Total Page:16

File Type:pdf, Size:1020Kb

Keep Calm and Carry On: Inahta Members' Views On KEEP CALM AND CARRY ON: INAHTA MEMBERS’ VIEWS ON PLANNING FOR POTENTIALLY DISRUPTIVE TECHNOLOGIES HTAi Annual Meeting 18 June 2019 in Cologne, Germany www.inahta.org ABOUT INAHTA International Network of Agencies for HTA Founded in 1993. Now a global network of 51 agencies (2019). Member agencies support health system decision making that affects over 1 billion people in 32 countries. Agencies by region: • 31Europe • 5 Latin America • 5 Canada & USA • 5 Asia • 3 Australia & New Zealand • 2 Africa Agencies by country economic status: • 41 in high income countries • 1 in upper-middle income countries • 2 in lower-middle income countries www.inahta.org INAHTA MEMBERS All INAHTA members are publicly-funded HTA agencies that: . Assess technology in health care . Are non-profit organizations . Relate to a regional or national government . Are funded at least 50% by public sources . Provide access to publicly- available reports to other members upon request www.inahta.org INAHTA BOARD OF DIRECTORS 2018/19 Dr. Sophie Söderholm Werkö Prof. Tracy Merlin SBU, Sweden AHTA, Australia Chair Vice Chair Dr. Matthias Perleth Dr. Mouna Jameleddine G-BA, Germany INASanté, Tunisia Treasurer Director Dr. Young Sung Lee Mrs. Debjani (Jani) Mueller NECA, Korea CMeRC, South Africa Director Director Ex officio members Dr. Brian O'Rourke Dr. Yingyao Chen Dr. Michelle Mujoomdar CADTH, Canada, Past Chair HTAi Board Observer CADTH, Canada Dr. Christopher McCabe IHE, Canada Director Head of Secretariat www.inahta.org INAHTA’S MISSION INAHTA connects and empowers national and regional HTA agencies to create better health policy around the globe. INAHTA´s mission is to: . Bring agency leadership and expertise to the global HTA community to advance the science and practice of HTA. Demonstrate the value of HTA agencies as key components of modern health systems to support robust decision-making based on the best available scientific evidence. Support best practice and innovation for building and maintaining thriving HTA agencies. Enable continuous exchange of knowledge and learning among member agencies. www.inahta.org GLOBAL COLLABORATION Memoranda of understanding with: • WHO • HTAi • EUnetHTA • HTAsiaLink • RedETSA • G-I-N • EuroScan www.inahta.org CONTACT INAHTA www.inahta.org Secretariat Executive Manager: Tara Schuller Tel (Canada): +1 780 401 1770 Email: [email protected] www.inahta.org PANEL SESSION OVERVIEW 1. Summary of INAHTA World Café on disruptive technologies Dr. Michelle Mujoomdar, CADTH, Canada 2. HTA agency experiences evaluating disruptive technologies KEEP CALM AND CARRY ON: INAHTA Susanna Axelson, SBU, Sweden MEMBERS’ VIEWS ON 3. Challenges with genetic diagnosis and PLANNING FOR screening POTENTIALLY Dr. Li Ying (Grace) Huang, CDE, Taiwan, DISRUPTIVE Republic of China TECHNOLOGIES 4. Challenges of anticipating & evaluating HTAi Annual Meeting disruptive technologies 18 June 2019 in Cologne, Dr. Rossella Di Bidino, UVT-Gemelli, Italy Germany 5. Looking back at disruptive technologies – what made them disruptive? Dr. Claudia Wild, LBI-HTA, Austria 6. Q&A, discussion Moderator: Ken Bond, IHE, Canada www.inahta.org THANK YOU ! www.inahta.org Secretariat Executive Manager: Tara Schuller Tel (Canada): +1 780 401 1770 Email: [email protected] www.inahta.org World Café on Disruptive Technologies: Reflections from the 2018 INAHTA Congress Michelle Mujoomdar, PhD HTAi 2019 18 June 2019 Disclosure • Funded by federal, provincial, and territorial ministries of health. • Application fees for three programs: • CADTH Common Drug Review (CDR) • CADTH pan-Canadian Oncology Drug Review (pCODR) • CADTH Scientific Advice 1 Disclosure - individual • Engaged as an individual external expert: • EC (June 2017 – Aug 2017; May 2018 – Aug 2018) • ZIN (April 2018 – May 2018) • Advisory roles for several IMI projects • PREFER (travel expenses paid by University of Uppsala) • PARADIGM (travel expenses paid by HTAi and European Patients’ Forum) • EHDEN (coordinated through Erasmus University) • Other travel expenses paid by CIRS (Sept 2018) and CIHR grants on which CADTH is a knowledge user (March 2019 and May 2019) 2 World Café Methodology • Related to the concept of “group intelligence” • A topic of mutual interest is discussed in small groups • At least 3 x 20-minute rounds, each round with a different question or focus • At the end of each round, participants move to next table • Building knowledge – we are “Wiser Together” 3 Groups / Areas of Focus per round • Pharmaceuticals • Devices / medtech • Public Health / screening / other 4 Objectives 1. Develop an common understanding of what a “disruptive health technology” is and how it is different from incremental technology. 2. Compile examples of disruptive medicines, devices/procedures, and screening/prevention technologies. 3. Develop recommendations for how HTA agencies should deal with disruptive technologies in the three areas. 4. Determine if there are any special considerations to be given to disruptive technologies (i.e., sources of evidence) and raise any other issues or ways of thinking about these disruptive technologies. 5 Findings • ATMPs / cell and gene therapy • ‘curative’ therapies • Artificial Intelligence • 3D-printing • Next generation sequencing • Cannabis • Mobile apps – self-monitoring • Self-testing • Tissue engineering, bionic limbs 6 Findings • Change • Change in the way that patients are treated, change in system, workforce • Doesn’t “fit” into current way of working • Potentially results in disinvestment • HTA agencies need to shift from reactive to proactive • Life-cycle approach • Additional data collection, reassessment • Social, ethical, legal, environmental, and privacy considerations 7 Plan Forward • Prioritised the topic of disruptive technologies for a Position Statement by INAHTA • INAHTA Task Group formed • Criteria on how HTA agencies can define a disruptive technology and manage it from an assessment point of view • Draft statement available for consultation with INAHTA members by end of 2019 8 9 SWEDISH AGENCY FOR HEALTH TECHNOLOGY ASSESSMENT AND ASSESSMENT OF SOCIAL SERVICES Disruptive technologies panel session Cologne June 2019 Susanna Axelsson, SBU A disruptive technology in healthcare impacts: • Patient outcomes • Care pathway • Healthcare delivery system • Payment mechanisms Example • Testing for human papilloma virus (HPV) can replace cytology as screening test for cervical cancer – Machine analysis – Easy to standardize – Expected lower costs Report from SBU, guidelines from NBHW • Health care delivery system and Care pathway • Longer ”protection”, 6 compared to 4 years for cytology • Patient outcomes • Better sensitivity • Payment outcomes • Lower costs (NBHW) HTA and disruptive technologies • Stakeholders along the technology lifecycle work together • Patient involvement • Dynamic assessment procedures • Early Reassessment • Need for real world evidence to show progress and maintain access – The National Quality Register for Prevention of Cervical Cancer • Monitoring and follow-up of the process and effect Evidence generation • HTA community should advocate the need for proper clinical evidence to allow access • Evidence can be accelerated and timely generated • Evidence generation plan, e.g. parallel consultation (scientific advice) involving various decision-makers to ensure evidence generation meets different needs • Preparedness of patient registries to collect relevant information in a robust manner (post-licensing evidence) Key elements • Need for proper clinical evidence, robust data (RCT) to allow access • Joint assessments supposed to accelerate access • A dynamic assessment procedure • Real world evidence required to confirm the initial assessment SWEDISH AGENCY FOR HEALTH TECHNOLOGY ASSESSMENT AND ASSESSMENT OF SOCIAL SERVICES Keep Calm and Carry On: INAHTA Members’ Views on Planning for Potentially Disruptive Technologies- Diagnostic and Screening HTA Disruptive technologies session Panel Grace Li-Ying Huang, PhD Director, Division of Health Technology Assessment Center For Drug Evaluation, Taiwan View our website: http://nihta.cde.org.tw/ June 18, 2019 Disclaimer • This presentation was not officially cleared, and the views offered here do not necessarily represent the official positions at MOHW, including NHIA. Outline • Development of HTA in Taiwan • Genomic analysis into routine care? • Potentially Disruptive Technologies in HTA Development of HTA in Taiwan • Since 2007, Taiwan began conducting health technology assessments (HTA) to support National Health Insurance Administration (NHIA)’s reimbursement decisions for drugs. • HTA’s extension to: – medical devices in 2011 – medical services in 2014 – social care in 2016 • The Division of HTA operates under the Center of Drug Evaluation (CDE), Taiwan. Int J Technol Assess Health Care. 2019 Feb 28:1-5. doi: 10.1017/S0266462319000011. [Epub ahead of print] About the Disruptive Technologies idea in HTA – Focus on Diagnostic and Screening 5 Genomic analysis into routine care? • In UK, Health and Social Care announces ambition to sequence 5 million genomes within five years. • Genomics England working with the NHS to introduce genomic analysis into routine care, with rare disease and cancer patients receiving diagnoses that lay the foundation for more effective treatments. • In sequencing up to 5 million genomes in the next five years, understanding of the link between genetic information and the risk of disease will grow, bringing new discoveries, new awareness and wider benefits to patients, and deliver
Recommended publications
  • Disruptive Technology Assessment Game 'DTAG' Handbook V0.1
    Disruptive Technology Assessment Game ‘DTAG’ Handbook V0.1 Executive Summary What is the DTAG? The Disruptive Technology Assessment Game (DTAG) is a table-top seminar wargame, used to assess potential future technologies and their impact on military operations and operating environment. How is it played? There are four distinct steps in executing a DTAG experiment. The first two are part of the planning process, prior to playing the game. Step 1: Identify Possible Future Technologies that are under development and are of interest to the military. Step 2 – Create Ideas of Systems (IoS) cards from the technologies identified. Specific technologies, or combinations of technologies are combined with equipment to create new systems that could be employed by the military or by an adversary. These are described on cards. Step 3 – Play the DTAG. Figure 1 summarizes the process. Red teams and Blue teams both plan courses of action in the context of a scenario & vignette. After the initial confrontation of plans, which establishes the baseline, the teams plan again with the addition of future technology from the IoS cards. The second confrontation highlights the effect that the technology has on the plans and the wargame outcome. Figure 1: The DTAG Process Step 4 – Assess the results of the wargame through questions and analysis of data captured. Who plays it? The DTAG unites Technology experts, Military and Analysts providing a broad perspective on the potential impacts of future technology on military operations. The approach allows for an element of unconstrained thinking and the wargame-like rounds encourage open communication opportunities. Why should a DTAG be played, and when? It is most useful when assessing technology that is a prototype or at early stage of development, or technology that is not in widespread use by the military.
    [Show full text]
  • Gao-20-246G, Technology Assessment Design Handbook
    HANDBOOK Technology Assessment Design Handbook Handbook for Key Steps and Considerations in the Design of Technology Assessments GAO-20-246G December 2019 Contents Preface 1 Chapter 1 The Importance of Technology Assessment Design 6 1.1 Reasons to Conduct and Uses of a Technology Assessment 6 1.2 Importance of Spending Time on Design 8 Chapter 2 Technology Assessment Scope and Design 8 2.1 Sound Technology Assessment Design 9 2.2 Phases and Considerations for Technology Assessment Design 9 2.2.1 GAO Technology Assessment Design Examples 14 Chapter 3 Approaches to Selected Technology Assessment Design and Implementation Challenges 18 3.1 Ensuring Technology Assessment Products are Useful for Congress and Others 19 3.2 Determining Policy Goals and Measuring Impact 20 3.3 Researching and Communicating Complicated Issues 20 3.4 Engaging All Relevant Stakeholders 21 Appendix I Objectives, Scope, and Methodology 22 Appendix II Summary of Steps for GAO’s General Engagement Process 35 Appendix III Example Methods for Technology Assessment 38 Appendix IV GAO Contact and Staff Acknowledgments 44 Page i GAO-20-246G Technology Assessment Handbook Tables Table 1: Summary of GAO’s Technology Assessment Process 3 Table 2: Examples for Technology Assessment Objectives that Describe Status and Challenges to Development of a Technology 15 Table 3: Examples for Technology Assessment Objectives that Assess Opportunities and Challenges that May Result from the Use of a Technology 16 Table 4: Examples for Technology Assessment Objectives that Assess Cost-Effectiveness,
    [Show full text]
  • A Systematic Review of Methods for Health Care Technology Horizon Scanning
    AHRQ Health Care Horizon Scanning System A Systematic Review of Methods for Health Care Technology Horizon Scanning Prepared for: Agency for Healthcare Research and Quality U.S. Department of Health and Human Services 540 Gaither Road Rockville, MD 20850 Contract No. 290-2010-00006-C Prepared by: Fang Sun, M.D., Ph.D. Karen Schoelles, M.D., S.M., F.A.C.P ECRI Institute 5200 Butler Pike Plymouth Meeting, PA 19462 AHRQ Publication No. 13-EHC104-EF August 2013 This report incorporates data collected during implementation of the U.S. Agency for Healthcare Research and Quality (AHRQ) Health Care Horizon Scanning System by ECRI Institute under contract to AHRQ, Rockville, MD (Contract No. 290-2010-00006-C). The findings and conclusions in this document are those of the authors, who are responsible for its content, and do not necessarily represent the views of AHRQ. No statement in this report should be construed as an official position of AHRQ or of the U.S. Department of Health and Human Services. The information in this report is intended to identify resources and methods for improving the AHRQ Health Care Horizon Scanning System in the future. The purpose of the AHRQ Health Care Horizon Scanning System is to assist funders of research in making well-informed decisions in designing and funding comparative-effectiveness research. This report may periodically be assessed for the urgency to update. If an assessment is done, the resulting surveillance report describing the methodology and findings will be found on the Effective Health Care Program website at: www.effectivehealthcare.ahrq.gov.
    [Show full text]
  • Horizon Scanning for New and Emerging Technologies in Healthtech What Do the Present and Future Hold? Foreword
    www.pwc.com/sg Horizon Scanning for New and Emerging Technologies in HealthTech What do the present and future hold? Foreword A collaborative, data-driven and evidence based study The last few years have seen an explosion of technology along with an increasing convergence of the Healthcare, Medical Devices, HealthTech, Pharma and Digital realms. It is imperative that in the midst of this, we keep the patients and their problems at the heart of it all. To effectively do so, understanding continuously evolving patient needs will be critical. And by doing so, we can better solve the real challenges they face and provide solutions to complement current clinical practices and technologies to improve what we at PwC call the 3 As in healthcare: Affordable, Accessible and A+ quality care. However, with the rapid and exponential pace of technological advancement, how do we keep track of the game-changing and clinically impactful developments? What are the present trends driving these developments, and what are likely future trends? Is there a fit-for- purpose framework that can be applied to assist in the assessment of these technologies? What will be the implications to regulators, health technology assessments (HTA), policy makers, payers, healthcare professionals and any and all other stakeholders? Horizon Scanning for New and Emerging Technologies in HealthTech aims to answer these questions. For the purposes of this paper, MedTech refers to the traditional innovation-led, fully integrated medical device industry. HealthTech on the other hand, refers to information technology (IT)-led solutions which are more patient-focused and comprise start-ups and non-traditional players who are causing an industry paradigm shift.
    [Show full text]
  • TECHNOLOGY and INNOVATION REPORT 2021 Catching Technological Waves Innovation with Equity
    UNITED NATIONS CONFERENCE ON TRADE AND DEVELOPMENT TECHNOLOGY AND INNOVATION REPORT 2021 Catching technological waves Innovation with equity Geneva, 2021 © 2021, United Nations All rights reserved worldwide Requests to reproduce excerpts or to photocopy should be addressed to the Copyright Clearance Center at copyright.com. All other queries on rights and licences, including subsidiary rights, should be addressed to: United Nations Publications 405 East 42nd Street New York, New York 10017 United States of America Email: [email protected] Website: https://shop.un.org/ The designations employed and the presentation of material on any map in this work do not imply the expression of any opinion whatsoever on the part of the United Nations concerning the legal status of any country, territory, city or area or of its authorities, or concerning the delimitation of its frontiers or boundaries. This publication has been edited externally. United Nations publication issued by the United Nations Conference on Trade and Development. UNCTAD/TIR/2020 ISBN: 978-92-1-113012-6 eISBN: 978-92-1-005658-8 ISSN: 2076-2917 eISSN: 2224-882X Sales No. E.21.II.D.8 ii TECHNOLOGY AND INNOVATION REPORT 2021 CATCHING TECHNOLOGICAL WAVES Innovation with equity NOTE Within the UNCTAD Division on Technology and Logistics, the STI Policy Section carries out policy- oriented analytical work on the impact of innovation and new and emerging technologies on sustainable development, with a particular focus on the opportunities and challenges for developing countries. It is responsible for the Technology and Innovation Report, which seeks to address issues in science, technology and innovation that are topical and important for developing countries, and to do so in a comprehensive way with an emphasis on policy-relevant analysis and conclusions.
    [Show full text]
  • A Science-Technology-Society Approach to Teacher Education for the Foundation Phase: Students’ Empiricist Views
    Lyn Kok & Rika van Schoor A science-technology-society approach to teacher education for the foundation phase: Students’ empiricist views Abstract Teacher education for South African foundation phase education requires student teachers to be prepared for teaching science concepts in an integrated programme in a learning area known as life skills . This study examined the challenges faced by university teachers of foundation phase student teachers in the development of science modules/ courses. The national curriculum for this subject aims to strengthen learner awareness of social relationships, technological processes and elementary science (DBE 2011a). We developed an integrated numeracy, science and technology module for foundation phase student teachers, based on the science-technology-society (STS) approach to teaching science concepts. Students’ understanding of science concepts was assessed, using a project method in which they solved a problem derived from children’s literature. Then students’ views of this integrated approach to teaching science concepts were gathered. The negative views of the foundation phase student teachers towards the integrated STS approach was thought to indicate an empiricist view of the nature of science that could impede their future teaching. Keywords: Foundation phase, science teacher education, science-technology-society, project method, nature of science Lyn Kok, University of Zululand. Email: [email protected] Rika van Schoor, University of the Free State. Email: [email protected] South African Journal of Childhood Education | 2014 4(1): 95-110 | ISSN: 2223-7674 |© UJ SAJCE– June 2014 Introduction In this study the object of inquiry was pre-service teachers’ knowledge of and views about an integrated pedagogy for science teaching in the first years of school.
    [Show full text]
  • Aalborg Universitet Technology Assessment in Techno
    Aalborg Universitet Technology Assessment in Techno-Anthropological Perspective Botin, Lars; Børsen, Tom Holmgaard Creative Commons License CC BY-NC-ND 4.0 Publication date: 2021 Document Version Publisher's PDF, also known as Version of record Link to publication from Aalborg University Citation for published version (APA): Botin, L., & Børsen, T. H. (Eds.) (2021). Technology Assessment in Techno-Anthropological Perspective. (OA ed.) Aalborg Universitetsforlag. Serie om lærings-, forandrings- og organisationsudviklingsprocesser Vol. 10 General rights Copyright and moral rights for the publications made accessible in the public portal are retained by the authors and/or other copyright owners and it is a condition of accessing publications that users recognise and abide by the legal requirements associated with these rights. ? Users may download and print one copy of any publication from the public portal for the purpose of private study or research. ? You may not further distribute the material or use it for any profit-making activity or commercial gain ? You may freely distribute the URL identifying the publication in the public portal ? Take down policy If you believe that this document breaches copyright please contact us at [email protected] providing details, and we will remove access to the work immediately and investigate your claim. Downloaded from vbn.aau.dk on: October 09, 2021 Technology Assessment in Techno-Anthropological Perspective Edited by Lars Botin Tom Børsen Technology Assessment in Techno-Anthropological Perspective Edited
    [Show full text]
  • Describing the Technological Scope of Industry 4.0 – a Review of Survey Publications
    LogForum 2018, 14 (3), 341-353 > Scientific Journal of Logistics < http://dx.doi.org/10.17270/J.LOG.2018.289 http://www.logforum.net p-ISSN 1895-2038 e-ISSN 1734-459X ORIGINAL PAPER DESCRIBING THE TECHNOLOGICAL SCOPE OF INDUSTRY 4.0 – A REVIEW OF SURVEY PUBLICATIONS Sebastian Schlund 1, Ferdinand Baaij 2 1) TU Wien, Vienna, Austria, 2) TRUMPF Werkzeugmaschinen GmbH + Co. KG, Ditzingen, Germany ABSTRACT . Background: The paper addresses common difficulties of understanding the scope and the underlying technologies of “Industry 4.0”. Existing definitions comprise a variety of technologies and applications, processes as well as business models. Their difficult differentiation has led to a complicated understanding of the topic altogether. Therefore, this study aims at a structuring of the scope of “Industry 4.0” using the average importance of its underlying technologies, as it is represented in 38 survey publications dedicated on Industry 4.0. Methods : Based on a review of existing survey literature on Industry 4.0, relevant technologies are identified. Next, these technologies are recapped in five technology areas. Furthermore, all technologies are assessed according to their relevance to Industry 4.0 using citation indices of the respective publication. Finally, two-dimensional figures are used to present an overview structure of all cited technologies, their structural connections and their relevance. In summary, a structuring of “Industry 4.0” through the cited technologies and their evolution over the years 2013 until 2016 is displayed to facilitate the understanding of significant research trends and promising application areas within “Industry 4.0”. Conclusion: Compared to existing reviews and empirical approaches on the topic, this paper focusses on a review of survey literature specifically dedicated to an understanding of the concept of Industry 4.0.
    [Show full text]
  • International Perspectives on Technology Assessment
    TECHNOLOGICAL FORECASTING AND SOCIAL CHANGE 13, 213-233 (1979) International Perspectives on Technology Assessment KAN CHEN ABSTRACT Technology assessment (TA) has attracted worldwide attention, but at present TA means different things to different countries. In industrialized market economy countries, TA consists of policy studies that deal with the side effects of technology. In centrally planned economy countries, TA is considered another tool for social management of technology. For developing countries, TA is expected to help in selecting appropriate technologies for development. These different perspectives have significant implications not only in how TA is done differently in different countries, but also in how international and global TA can be done effectively. Introduction Technology assessment (TA) has attracted worldwide interest. Discourses in TA have appeared in the literature of many countries and have taken place within several parts of the United Nations system. The professional society in this field, International Society for Technology Assessment (ISTA), has held conferences in a number of countries. Its Second International Congress on Technology Assessment was held at The University of Michigan, Ann Arbor (U.S.A.) in October, 1976, and was attended by participants from over fifteen countries [ 11. Subsequently, an international conference on “Technology Assessing: The Quest for Coherence” was sponsored by the East-West Center in Hon- olulu, Hawaii in May/June, 1977, attended by a number of experts from Asian developing countries as well as from industrialized market economy countries. Another international workshop on “Systems Assessment of New Technologies: International Perspectives” was later sponsored by the International Institute for Applied Systems Analysis (IIASA) in Laxenburg, Austria in July 1977.
    [Show full text]
  • Innovation Assessment: Governing Through Periods of Disruptive Technological Change
    Innovation assessment: governing through periods of disruptive technological change Jacob A. Hasselbalch Published at Journal of European Public Policy: http://dx.doi.org/10.1080/13501763.2017.1363805 ABSTRACT Current regulatory approaches are ill-equipped to address the challenges of governing through periods of disruptive technological change. This article hones in on the use of assessment regimes at the level of the European Union, particularly in the work of the Commission, to argue for a missing middle between technology assessment and impact assessment. Technology assessment focuses on the upstream governance of science and technology, while impact assessment focuses on the downstream governance of the impacts of specific policy options. What is missing is a form of midstream governance, which I label innovation assessment, to steer polities through periods of disruptive technological change, during which innovations have taken concrete forms and are beginning to diffuse, but still exhibit much scope for rapid, unexpected change and alternative trajectories of development. By juxtaposing these three forms of assessment regimes, I define the main dimensions along which they vary. KEYWORDS: disruptive innovation, governance, impact assessment, innovation assessment, technology assessment, policy appraisal 1 1 Introduction There is a growing sense of unease among the policymaking élite that they are increasingly placed on the back foot when it comes to addressing disruption, innovation and technological change, forced to suddenly react to such changes rather than shape them from the outset. We can observe this in, among other things, the increasing prevalence of the term ‘disruption’ in popular and political discourse. This observation challenges the governing logic of the relationship between regulation and innovation, namely that the purpose of regulation is to promote and support innovation, because more innovation is generally assumed to be a good thing.
    [Show full text]
  • A Meta-Meta-Analysis
    Journal of Intelligence Article Effect Sizes, Power, and Biases in Intelligence Research: A Meta-Meta-Analysis Michèle B. Nuijten 1,* , Marcel A. L. M. van Assen 1,2, Hilde E. M. Augusteijn 1, Elise A. V. Crompvoets 1 and Jelte M. Wicherts 1 1 Department of Methodology & Statistics, Tilburg School of Social and Behavioral Sciences, Tilburg University, Warandelaan 2, 5037 AB Tilburg, The Netherlands; [email protected] (M.A.L.M.v.A.); [email protected] (H.E.M.A.); [email protected] (E.A.V.C.); [email protected] (J.M.W.) 2 Section Sociology, Faculty of Social and Behavioral Sciences, Utrecht University, Heidelberglaan 1, 3584 CS Utrecht, The Netherlands * Correspondence: [email protected]; Tel.: +31-13-466-2053 Received: 7 May 2020; Accepted: 24 September 2020; Published: 2 October 2020 Abstract: In this meta-study, we analyzed 2442 effect sizes from 131 meta-analyses in intelligence research, published from 1984 to 2014, to estimate the average effect size, median power, and evidence for bias. We found that the average effect size in intelligence research was a Pearson’s correlation of 0.26, and the median sample size was 60. Furthermore, across primary studies, we found a median power of 11.9% to detect a small effect, 54.5% to detect a medium effect, and 93.9% to detect a large effect. We documented differences in average effect size and median estimated power between different types of intelligence studies (correlational studies, studies of group differences, experiments, toxicology, and behavior genetics).
    [Show full text]
  • Values, Ethics and Innovation Rethinking Technological Development in the Fourth Industrial Revolution
    White Paper Values, Ethics and Innovation Rethinking Technological Development in the Fourth Industrial Revolution August 2018 Authors: Thomas Philbeck Head of Technology, Society and Policy, World Economic Forum Nicholas Davis Head of Society and Innovation, Member of the Executive Committee, World Economic Forum Anne Marie Engtoft Larsen Knowledge Lead, Fourth Industrial Revolution, World Economic Forum World Economic Forum® The views expressed in this White Paper are those of the author(s) and do not necessarily represent the views of the World Economic Forum or its Members and Partners. White Papers are © 2018 – All rights reserved. No part of this publication may be reproduced or submitted to the World Economic Forum as contributions to its insight areas and interactions, and Transmitted in any form or by any means, including the Forum makes the final decision on the publication of the White Paper. White Papers describe Photocopying and recording, or by any information Storage research in progress by the author(s) and are published to elicit comments and further debate. and retrieval system. Contents Introduction 4 Towards a human-centred approach 5 A. Adopting a systems view of technologies 6 B. Appreciating and shaping the moral role of technologies 7 C. Engaging with a wide variety of stakeholders 9 D. The need for new disciplines 10 Achieving transformative innovation 11 A. New tools 12 B. New skills 13 C. New partnerships 14 D. New institutions 14 Conclusion 16 Endnotes 17 Bibliography 18 White Paper 3 direction. It recognizes that technologies will play a role in Introduction whether the Sustainable Development Goals are reached, and establishes a multistakeholder “Technology Facilitation Mechanism” to maximize the chances.5 The World Economic Forum is also pioneering a future- Technologies enable us to live longer, healthier, more fulfilling oriented agenda – one that promotes responsible lives.
    [Show full text]