Metascience 2019 Symposium Program
Total Page：16
File Type：pdf, Size：1020Kb
Load more
Recommended publications
-
1 Psychology As a Robust Science Dr Amy Orben Lent Term 2020 When
Psychology as a Robust Science Dr Amy Orben Lent Term 2020 When: Lent Term 2020; Wednesdays 2-4pm (Weeks 0-6; 15.1.2020 – 26.2.2020), Mondays 2-4pm (Week 7; 2.3.2020) Where: Lecture Theatre, Experimental Psychology Department, Downing Site Summary: Is psychology a robust science? To answer such a question, this course will encourage you to think critically about how psychological research is conducted and how conclusions are drawn. To enable you to truly understand how psychology functions as a science, however, this course will also need to discuss how psychologists are incentivised, how they publish and how their beliefs influence the inferences they make. By engaging with such issues, this course will probe and challenge the basic features and functions of our discipline. We will uncover multiple methodological, statistical and systematic issues that could impair the robustness of scientific claims we encounter every day. We will discuss the controversy around psychology and the replicability of its results, while learning about new initiatives that are currently reinventing the basic foundations of our field. The course will equip you with some of the basic tools necessary to conduct robust psychological research fit for the 21st century. The course will be based on a mix of set readings, class discussions and lectures. Readings will include a diverse range of journal articles, reviews, editorials, blog posts, newspaper articles, commentaries, podcasts, videos, and tweets. No exams or papers will be set; but come along with a critical eye and a willingness to discuss some difficult and controversial issues. Core readings • Chris Chambers (2017). -
Ois Laruelle
Frans;ois Laruelle --- and collaborators --- Dictio nary of Non-Philosophy -- translated by Taylor Adkins I Univocal -- Fran\:ois Laruelle ------ and collaborators ----- To ny Brachet. Gilbert Kieffer, Laurent Leroy, Da niel Nicolet, Anne-Fran�oise Schmid, Serge Valdinoci Dictio nary of Non-Philosophy translated by Taylor Adkins I Univocal ---- DJCT!ONNAIREDE LA NON-PHILOSOPH!Eby Fran�ois Laruelle ©Editions Kime, 1998 Translated by Taylor Adkins as Dictionary ofNon-Philosophy First Edition Minneapolis©2013, Univocal Publishing Published by Univocal 123 North 3rd Street, #202 Minneapolis, MN 55401 No part of this book may be reproduced or transmitted in any form or by any means, electronic or mechanical, including phorocopying, recording or any other information storage or retrieval system, without prior permission in writing from the publisher. Thanks to John David Ebert and Ben Woodard Designed & Printed by Jason Wagner Distributed by the University of Minnesota Press ISBN 9781937561130 Library of Congress Control Number 2013939530 TA BLE OF CONTENTS Translator's Introduction .......................................... .....................9 Preface to the English Language Edition...................... ................. 15 Preface .........................................................................................19 Theory of the Non-Philosophical Dictionary....................... .......23 Auto-position .......................... .....................................................39 Being-in-One (Being-according-to-the-One)............................... -
Promoting an Open Research Culture
Promoting an open research culture Brian Nosek University of Virginia -- Center for Open Science http://briannosek.com/ -- http://cos.io/ The McGurk Effect Ba Ba? Da Da? Ga Ga? McGurk & MacDonald, 1976, Nature Adelson, 1995 Adelson, 1995 Norms Counternorms Communality Secrecy Open sharing Closed Norms Counternorms Communality Secrecy Open sharing Closed Universalism Particularlism Evaluate research on own merit Evaluate research by reputation Norms Counternorms Communality Secrecy Open sharing Closed Universalism Particularlism Evaluate research on own merit Evaluate research by reputation Disinterestedness Self-interestedness Motivated by knowledge and discovery Treat science as a competition Norms Counternorms Communality Secrecy Open sharing Closed Universalism Particularlism Evaluate research on own merit Evaluate research by reputation Disinterestedness Self-interestedness Motivated by knowledge and discovery Treat science as a competition Organized skepticism Organized dogmatism Consider all new evidence, even Invest career promoting one’s own against one’s prior work theories, findings Norms Counternorms Communality Secrecy Open sharing Closed Universalism Particularlism Evaluate research on own merit Evaluate research by reputation Disinterestedness Self-interestedness Motivated by knowledge and discovery Treat science as a competition Organized skepticism Organized dogmatism Consider all new evidence, even Invest career promoting one’s own against one’s prior work theories, findings Quality Quantity Anderson, Martinson, & DeVries, -
Empiricism, Stances, and the Problem of Voluntarism
Swarthmore College Works Philosophy Faculty Works Philosophy 1-1-2011 Empiricism, Stances, And The Problem Of Voluntarism Peter Baumann Swarthmore College, [email protected] Follow this and additional works at: https://works.swarthmore.edu/fac-philosophy Part of the Philosophy Commons Let us know how access to these works benefits ouy Recommended Citation Peter Baumann. (2011). "Empiricism, Stances, And The Problem Of Voluntarism". Synthese. Volume 178, Issue 1. 27-36. DOI: 10.1007/s11229-009-9519-7 https://works.swarthmore.edu/fac-philosophy/13 This work is brought to you for free by Swarthmore College Libraries' Works. It has been accepted for inclusion in Philosophy Faculty Works by an authorized administrator of Works. For more information, please contact [email protected]. Empiricism, Stances and the Problem of Voluntarism Peter Baumann Synthese 178, 2011, 207-224 Empiricism can be very roughly characterized as the view that our knowledge about the world is based on sensory experience. Our knowledge about the world is "based" on sensory experience in the sense that we could not know what we know without relying on sense experience. This leaves open the possibility that sense experience is only necessary but not sufficient for the knowledge based upon it1-as long as the non-empirical elements are not themselves sufficient for the relevant piece of knowledge.2 The basing relation is not just a genetic one but also a justificatory one: Sense experience does not only lead to beliefs which happen to count as knowledge but also qualifies them as knowledge. In his important book The Empirical Stance Bas van Fraassen characterizes traditional empiricism at one point in a more negative way-as involving the rejection of "metaphysical" explanations which proceed by postulating the existence of something not 1 "But although all our cognition commences with experience, yet it does not on that account all arise from experience." (Kant, CpR, B1). -
Reply by Jean Bricmont and Alan Sokal
Reply to Turnbull Krips Dusek and Fuller For Metascience Jean Bricmont Institut de Physique Theorique Universite Catholique de Louvain chemin du Cyclotron B LouvainlaNeuve BELGIUM Internet BRICMONTFYMAUCLACBE Telephone Fax Alan Sokal Department of Physics New York University Washington Place New York NY USA Internet SOKALNYUEDU Telephone Fax February Biographical Note Jean Bricmont is professor of theoretical physics at the University of Louvain Belgium Alan Sokal is professor of physics at New York University Introduction 1 In the preface to the second edition of Intel lectual Impostures we wrote that the criticisms of our b o ok can b e divided roughly into four types A very few reviewers discuss what we wrote and try to refute it Other commentators raise ob jections often p erfectly valid ones to ideas that are not in fact ours and that we may have expressly rejected in the b o ok while attributing them to us implicitly or explicitly Yet a third group of critics pretend to discuss our b o ok while actually doing something completely dierent for example attacking our p ersonalities our alleged motivations for writing the b o ok or the failings of scientists in general And nally some reviewers agree with us but think that we do not go far enough I I p xv The comments by Turnbull and Dusek fall squarely into the second and third cat egories apart from o ccasional brief excursions into category while Krips and Fuller oer a mixture of the rst and second categories It would b e a hop eless task to address al l the issues -
Hop://Cos.Io/ Brian Nosek University of Virginia Hop://Briannosek.Com
hp://cos.io/ Brian Nosek University of Virginia h"p://briannosek.com/ General Article Psychological Science XX(X) 1 –8 False-Positive Psychology: Undisclosed © The Author(s) 2011 Reprints and permission: sagepub.com/journalsPermissions.nav Flexibility in Data Collection and Analysis DOI: 10.1177/0956797611417632 Allows Presenting Anything as Significant http://pss.sagepub.com Joseph P. Simmons1, Leif D. Nelson2, and Uri Simonsohn1 1The Wharton School, University of Pennsylvania, and 2Haas School of Business, University of California, Berkeley Abstract In this article, we accomplish two things. First, we show that despite empirical psychologists’ nominal endorsement of a low rate of false-positive findings (≤ .05), flexibility in data collection, analysis, and reporting dramatically increases actual false-positive rates. In many cases, a researcher is more likely to falsely find evidence that an effect exists than to correctly find evidence that it does not. We present computer simulations and a pair of actual experiments that demonstrate how unacceptably easy it is to accumulate (and report) statistically significant evidence for a false hypothesis. Second, we suggest a simple, low-cost, and straightforwardly effective disclosure-based solution to this problem. The solution involves six concrete requirements for authors and four guidelines for reviewers, all of which impose a minimal burden on the publication process. Keywords methodology, motivated reasoning, publication, disclosure Received 3/17/11; Revision accepted 5/23/11 Our job as scientists is to discover truths about the world. We Which control variables should be considered? Should spe- generate hypotheses, collect data, and examine whether or not cific measures be combined or transformed or both? the data are consistent with those hypotheses. -
The Reproducibility Crisis in Research and Open Science Solutions Andrée Rathemacher University of Rhode Island, [email protected] Creative Commons License
University of Rhode Island DigitalCommons@URI Technical Services Faculty Presentations Technical Services 2017 "Fake Results": The Reproducibility Crisis in Research and Open Science Solutions Andrée Rathemacher University of Rhode Island, [email protected] Creative Commons License This work is licensed under a Creative Commons Attribution 4.0 License. Follow this and additional works at: http://digitalcommons.uri.edu/lib_ts_presentations Part of the Scholarly Communication Commons, and the Scholarly Publishing Commons Recommended Citation Rathemacher, Andrée, ""Fake Results": The Reproducibility Crisis in Research and Open Science Solutions" (2017). Technical Services Faculty Presentations. Paper 48. http://digitalcommons.uri.edu/lib_ts_presentations/48http://digitalcommons.uri.edu/lib_ts_presentations/48 This Speech is brought to you for free and open access by the Technical Services at DigitalCommons@URI. It has been accepted for inclusion in Technical Services Faculty Presentations by an authorized administrator of DigitalCommons@URI. For more information, please contact [email protected]. “Fake Results” The Reproducibility Crisis in Research and Open Science Solutions “It can be proven that most claimed research findings are false.” — John P. A. Ioannidis, 2005 Those are the words of John Ioannidis (yo-NEE-dees) in a highly-cited article from 2005. Now based at Stanford University, Ioannidis is a meta-scientist who conducts “research on research” with the goal of making improvements. Sources: Ionnidis, John P. A. “Why Most -
2020 Impact Report
Center for Open Science IMPACT REPORT 2020 Maximizing the impact of science together. COS Mission Our mission is to increase the openness, integrity, and reproducibility of research. But we don’t do this alone. COS partners with stakeholders across the research community to advance the infrastructure, methods, norms, incentives, and policies shaping the future of research to achieve the greatest impact on improving credibility and accelerating discovery. Letter from the Executive Director “Show me” not “trust me”: Science doesn’t ask for Science is trustworthy because it does not trust itself. Transparency is a replacement for trust. Transparency fosters self-correction when there are errors trust, it earns trust with transparency. and increases confidence when there are not. The credibility of science has center stage in 2020. A raging pandemic. Partisan Transparency is critical for maintaining science’s credibility and earning public interests. Economic and health consequences. Misinformation everywhere. An trust. The events of 2020 make clear the urgency and potential consequences of amplified desire for certainty on what will happen and how to address it. losing that credibility and trust. In this climate, all public health and economic research will be politicized. All The Center for Open Science is profoundly grateful for all of the collaborators, findings are understood through a political lens. When the findings are against partners, and supporters who have helped advance its mission to increase partisan interests, the scientists are accused of reporting the outcomes they want openness, integrity, and reproducibility of research. Despite the practical, and avoiding the ones they don’t. When the findings are aligned with partisan economic, and health challenges, 2020 was a remarkable year for open science. -
LD5655.V855 1993.C655.Pdf (11.60Mb)
SCIENTIFIC DISCOURSE, SOCIOLOGICALT HEORY, AND THE STRUCTURE OF RHETORIC by James H. Collier Thesis submitted to the Faculty of the Virginia Polytechnic Institute and State University in partial fulfillment of the requirements for the degree of MASTER OF SCIENCE in Science and Technology Studies APPROVED: Y— Joseph C. Pitt, Chair Aone ble EtaaT hone, Steve Fuller Elisworth Fuhrman April, 1993 Blacksburg, VA LD S635 VE5S , DaQa cose} aM’~ Scientific Discourse, Sociological Theory, and the Structure of Rhetoric James H. Collier Graduate Program in Science and Technology Studies Chair: Joseph C. Pitt (ABSTRACT) This thesis examines the rhetorical, analytical and critical efficacy of reflexivity and sociological theory as means for reconciling the normative and descriptive functions of the rhetoric of science. In attempting to define a separate research domain within Science Studies, rhetoric of science has borrowed Strong Program and constructivist principles and descriptions of scientific practice from the Sociology of Scientific Knowledge (SSK) as a basis for analyzing scientific discourse. While epistemological claims in the social sciences have been considered inherently self-referential and subject to reflexive analysis and critique, rhetoricians have generally taken these claims on face value and applied them to a treatment of scientific practice. Accordingly, rhetoricians have maintained a natural ontological attitude to sociological theories and descriptions supporting an understanding of scientific discourse as implicitly rhetorical. Recently, however, the concept of "rhetoric" in rhetoric of science has come under scrutiny. This thesis will connect arguments involving the relation of the "irreducibly social" nature of science, to a concept of scientific discourse as rhetorical "without remainder,” to the philosophical commitments of reflexive analysis. -
Three Positivist Disputes in the 1960S
JOURNAL FOR THE HISTORY OF ANALYTICAL PHILOSOPHY THREE POSITIVIST DISPUTES IN THE 1960S VOLUME 6, NUMBER 8 CARL-GörAN HEIDEGREN EDITOR IN CHIEF MARCUS ROSSBERG, UnIVERSITY OF CONNECTICUT The West German positivist dispute in the 1960s is well known EDITORIAL BOARD and thoroughly studied. At about the same time positivist dis- ANNALISA COLIVA, UC IRVINE putes also took place in two Scandinavian countries: one in Nor- HENRY JACKMAN, YORK UnIVERSITY way and one in Sweden. What did the front lines in the debate KEVIN C. KLEMENt, UnIVERSITY OF MASSACHUSETTS look like in the three countries? What was the outcome of the dif- CONSUELO PRETI, THE COLLEGE OF NEW JERSEY ferent disputes? The main focus in the article is on the Swedish ANTHONY SKELTON, WESTERN UnIVERSITY case, but some comparative perspectives relating to the three MARK TEXTOR, KING’S COLLEGE LonDON disputes will also be presented. The Swedish positivist dispute AUDREY YAP, UnIVERSITY OF VICTORIA originated with Gerard Radnitzky’s doctoral dissertation in the- RICHARD ZACH, UnIVERSITY OF CALGARY ory of science, defended at the University of Gothenburg in May 1968, Contemporary Schools of Metascience (2 volumes). The dis- EDITOR FOR SPECIAL ISSUES sertation caused a stir of controversy. It meant a challenge to the SANDRA LaPOINte, MCMASTER UnIVERSITY Swedish philsophical establishment because it leaned heavily on continental philosophers such as Karl-Otto Apel and Jürgen REVIEW EDITORS Habermas, who at the time were more or less unknown in Swe- SEAN MORRIS, METROPOLITAN STATE UnIVERSITY OF DenVER den. The controversy was continuated in the following years, SANFORD SHIEH, WESLEYAN UnIVERSITY most notably in the leftist journal Häften för kritiska studier (Note- DESIGN AND LAYOUT books for Critical Studies). -
A History of Soviet Cybernetics. Cambridge, Mass: MIT Press, 2002
REVIEWS THE RISE OF CYBERNEWSPEAK Slava Gerovitch, From Newspeak to Cyberspeak: A History of Soviet Cybernetics. Cambridge, Mass: MIT Press, 2002. Pp. xiv + 369. £25.95, US$37.95 HB. By Andrew Pickering The growing interest in the history of cybernetics has so far largely focused on its early days in the US, the 1940s and 1950s: Norbert Wiener, Claude Shannon, Warren McCulloch, the Macy conferences. That cybernetics enjoyed more success institutionally on the other side of the Iron Curtain is well known, but Slava Gerovitch’s book is the first to tell us at any length about how that occurred, covering the decades from the 1950s to the 1970s. It is a valuable addition to the literature. Gerovitch distinguishes three phases in the history of Soviet cyber- netics. In the early 1950s, towards the end of the Stalinist era, cybernetics was trashed as “An American Pseudo-Science” and “cyberneticians were branded ‘semanticist-cannibals’ ” (p. 94 – what a splendid insult!). This despite the fact that a plausible ancestry for cybernetics could readily be constructed from the work of Soviet scientists and mathematicians, and that almost nothing about cybernetics was then known in the Soviet Union. Gerovitch argues that this was not the result of any centrally organised campaign, but rather the upshot of an almost randomly generated ritual of ideological denunciation of a type that was ubiquitous in the period. All sorts of sciences were liable to be condemned for their inconsistency with the official philosophy of dialectical materialism, condemnations always articulated in the formulaic terms that Gerovitch calls Newspeak – ‘mech- anist’, ‘idealist’, ‘formalist’, etc. -
The Trouble with Scientists How One Psychologist Is Tackling Human Biases in Science
How One Psychologist Is Tackling Human Biases in Science http://nautil.us/issue/24/error/the-trouble-with-scientists Purchase This Artwork BIOLOGY | SCIENTIFIC METHOD The Trouble With Scientists How one psychologist is tackling human biases in science. d BY PHILIP BALL ILLUSTRATION BY CARMEN SEGOVIA MAY 14, 2015 c ADD A COMMENT f FACEBOOK t TWITTER m EMAIL U SHARING ometimes it seems surprising that science functions at all. In 2005, medical science was shaken by a paper with the provocative title “Why most published research findings are false.”1 Written by John Ioannidis, a professor of medicine S at Stanford University, it didn’t actually show that any particular result was wrong. Instead, it showed that the statistics of reported positive findings was not consistent with how often one should expect to find them. As Ioannidis concluded more recently, “many published research findings are false or exaggerated, and an estimated 85 percent of research resources are wasted.”2 It’s likely that some researchers are consciously cherry-picking data to get their work published. And some of the problems surely lie with journal publication policies. But the problems of false findings often begin with researchers unwittingly fooling themselves: they fall prey to cognitive biases, common modes of thinking that lure us toward wrong but convenient or attractive conclusions. “Seeing the reproducibility rates in psychology and other empirical science, we can safely say that something is not working out the way it should,” says Susann Fiedler, a behavioral economist at the Max Planck Institute for Research on Collective Goods in Bonn, Germany.