Next-Generation Metrics: Responsible Metrics and Evaluation for Open Science
Total Page:16
File Type:pdf, Size:1020Kb
Load more
Recommended publications
-
Science-In-Transition-Position-Paper-Final.Pdf
Science in Transition POSITION PAPER – October 17, 2013 Why Science Does Not Work as It Should And What To Do about It Huub Dijstelbloem Frank Huisman Scientific Council for Government Policy University Medical Center Utrecht University of Amsterdam Descartes Centre, Utrecht University Frank Miedema Wijnand Mijnhardt University Medical Center Utrecht Descartes Centre, Utrecht University To the reader: The views in this position paper are the product of lively discussions in four workshops, organized by the initiators of Science in Transition in the spring of 2013. The participants of these workhops are listed on the website. However, the responsibility for this position paper rests solely with the Science in Transition initiators. Also, this position paper is not an end product, but a starting point for debate. This is the second version and after the November conference a revision will follow. Translation: Han van der Vegt. 1 Introduction ........................................................................................................................................................... 3 Images of Science .................................................................................................................................................. 5 Trust ..................................................................................................................................................................... 11 Quality ................................................................................................................................................................. -
AAO Position Papers July 2014
AAO Position Papers July 2014 Definition A position paper is a living document put forward by members of a Section or a Special Interest Group (SIG) of the Academy. The purpose of these documents is to educate the lay public and press on timely issues. On occasion the American Academy of Optometry may deviate from these stated audiences under special circumstances. Who May Generate a Position Paper? Sections and SIGs may originate a position paper or the Board of Directors (BOD) of the Academy may request that a Section or SIG author a position paper. In all cases the BOD shall be the final approving body of any and all position papers. Who Are Considered the Authors of Position Papers? Section and SIG’s will be considered the authors of position papers representing the American Academy of Optometry’s position on the topic to the lay public and press. Authorship information will be placed at the end of the paper and will include: Section Name Lead author(s) Writing Committee members It is at the authoring Section or SIG’s discretion whether to list all authors under the heading of the “writing committee” or to delineate “lead authors” separately from the writing committee. Although not typically included, if applicable, these can be used: Committee on ____________, 20xx – 20xx Consultants or liaisons Acknowledgments Position Paper Approval & Posting Date All position papers must be approved by the BOD; other organizations may also give approval. When other organizations are involved, they will be named and their approval dates (month & year) documented. Where Do Position Papers Reside After Final Approval by the Board of Directors? All position papers will reside on the Academy’s website. -
The Epistemology of Racism and Community-Based
THE EPISTEMOLOGY OF RACISM AND COMMUNITY-BASED ASSESSMENT PRACTICE By ASAO B. INOUE A dissertation submitted in partial fulfillment of the requirements for the degree of DOCTOR OF PHILOSOPHY WASHINGTON STATE UNIVERSITY Department of English May 2005 © Copyright by ASAO B. INOUE, 2005 All Rights Reserved © Copyright by ASAO B. INOUE, 2005 All Rights Reserved To the Faculty of Washington State University: The members of the Committee appointed to examine the dissertation of ASAO B. INOUE find it satisfactory and recommend that it be accepted. ___________________________________ Chair ___________________________________ ___________________________________ ii ACKNOWLEDGMENTS I would like to thank Dr. Victor Villanueva, Dr. Rory Ong, and Dr. William Condon for their careful reading of earlier drafts of this dissertation. Additionally, I appreciate Dr. Peter Elbow’s gracious help and copious suggestions on an earlier version of chapter five, a version of which appeared in the journal Assessing Writing 10.1 (2005). Most of all, I thank kelly Inoue for supporting me, keeping my life in order, and making it possible for me to do the work required for this dissertation. iii iv THE EPISTEMOLGY OF RACISM AND COMMUNITY-BASED ASSESSMENT PRACTICE Abstract by Asao B. Inoue, Ph.D. Washington State University May 2005 Chair: Victor Villanueva, Jr. This is a discussion that theorizes the epistemology of racism and incorporates it into a critical writing pedagogy. It uses primarily a critical sophistic pedagogy, a set of community- based assessment practices, and a rhetoric of hard agreements, all theorized. This discussion draws primarily from three areas: (1) sophistic rhetorical and pedagogical theory, primarily discussions around nomos-physis, Protagoras’ man-measure doctrine and his antilogical heuristics for rhetorical invention; (2) cultural theory and theories surrounding the ideological and rhetorical construction of race, class, and power; and (3) composition theory, primarily assessment theory and critical pedagogical theory. -
Publish & Perish
Publish & Perish Research on research and researchers Joeri K. Tijdink Publish & Perish Research on research and researchers colofon ISBN: 978-90-825123-4-2 ©Joeri Tijdink, 2016 opmaak: proefschrift-aio.nl druk: dpp.nl VRIJE UNIVERSITEIT Publish & Perish Research on research and researchers ACADEMISCH PROEFSCHRIFT ter verkrijging van de graad Doctor aan de Vrije Universiteit Amsterdam, op gezag van de rector magnificus prof.dr. V. Subramaniam, in het openbaar te verdedigen ten overstaan van de promotiecommissie van de Faculteit der Geneeskunde op donderdag 30 juni 2016 om 9.45 uur in de aula van de universiteit, De Boelelaan 1105 door Joeri Kees Tijdink geboren te Tiel promotoren: prof.dr. Y.M. Smulders prof.dr. L.M. Bouter CONTENT Chapter 1 General Introduction 7 Chapter 2 The assessment of publication pressure in medical science: validity and reliability of a Publication Pressure Questionnaire (PPQ) 19 Chapter 3 Emotional exhaustion and burnout among medical professors: a nationwide survey 39 Chapter 4 Publication pressure and burnout among Dutch medical professors: a nationwide survey 61 Chapter 5 Publication Pressure and Scientific Misconduct in Medical Scientists 81 Chapter 6 Medical scientists’ view on publication culture. Results from 12 focus groups among Dutch medical researchers 97 Chapter 7 How does industry funding disclosure influence psychiatrists? A randomized trial among Dutch psychiatrists 121 Chapter 8 Machiavellianism is associated with research misbehavior in Dutch biomedical scientists 137 Chapter 9 Publiphilia Impactfactorius: -
Offspring MAGAZINE
ISSUE 2018 The Offspring MAGAZINE A publication of the Max Planck PhDnet Who We Are & What We Stand For What’s in a Name? Mental Health at Top Performance WELCOME Letter from the Editorial Team In this world, there are things you can do alone, and things you can only do with some- body else. It is important to combine the two in just the right amount. – After Dark by Haruki Murakami or all of us, especially those involved with the Max Planck PhDnet, an exciting year has passed – filled with a F lot of science, challenges within our PhD, good and bad results, thrilling new adventures and new companions we met along the way. In this year`s print version we try to cover all of those topics in various sections. Who we are and what we stand for? One highlight since last year`s print version is the release of the 2017 PhDnet Survey report – a survey that gives us important insight about who the doctoral researchers of the Max Planck So- ciety are and how they feel – about general working conditions, supervision, mental health, discrimination, par- enting and so on. This survey serves as a basis for future surveys to come and we are already looking forward to the results of the 2018 PhDnet survey. One of the challenges this year was the recent media coverage about power abuse within the Max Planck Society. Because of the importance of this topic, the Offspring decided to include the PhDnet position paper by the PhDnet Steering Group 2018 about Power Abuse and Conflict Resolution. -
Download Preprint
Book chapter submitted on 15 July 2021 Preprint not peer-reviewed Title: Research assessments should recognize responsible research practices Narrative review of a lively debate and promising developments Noémie AUBERT BONN1 and Lex BOUTER2 1 Amsterdam University Medical Centers, Amsterdam, The Netherlands; Hasselt University, Hasselt, Belgium Email: [email protected] 2 Amsterdam University Medical Centers, Amsterdam, The Netherlands; Vrije Universiteit, Amsterdam, The Netherlands Submitted as chapter for the book: Handbook of Bioethical Decisions – Vol. II Scientific Integrity and Institutional Ethics Edited by Erick Valdés and Juan Alberto Lecaros 1 Book chapter submitted on 15 July 2021 Preprint not peer-reviewed Table of content Abstract 3 1. Brief introduction to research assessments 4 2. Problems and innovative actions 6 2.1 Content 7 2.1.1 An exaggerated focus on research outputs 7 2.1.2 Quantity over quality 10 2.1.3 Inappropriate use of metrics 11 2.1.4 Narrow views of impact 14 2.1.5 Obstacle to diversity 15 2.3 Procedure 17 2.4 Assessors 18 2.5 Research environments 19 2.6 Coordination 21 3. Way forward 22 Acknowledgements 23 Declaration of interests 23 Abbreviations 23 References 25 2 Book chapter submitted on 15 July 2021 Preprint not peer-reviewed Abstract Research assessments have been under growing scrutiny in the past few years. Te way in which researchers are assessed has a tangible impact on decisions and practices in research. Yet, there is an emerging understanding that research assessments as they currently stand might hamper the quality and the integrity of research. In this chapter, we provide a narrative review of the shortcomings of current research assessments and showcase innovative actions that aim to address these. -
Anita De Waard, [email protected]
The Mendeley Data Management Platform: Research Data Management From A Publisher’s Perspective Anita de Waard, [email protected] Introduction In its roles as both a publisher and an information analytics company, Elsevier is committed to contributing to ecosystems that support rigorous and reproducible research data creation throughout the research workflow, making data accessible, discoverable and reusable. Moving beyond content delivery, the overall goal of our Research Data1 Management efforts is to develop knowledge management tools and solutions to support researchers, librarians, universities and government agencies in managing, sharing and measuring a rich variety of research outputs. Throughout our publishing and analytics tools and workflows, we aim to support researchers with tools and practices to improve exposure and access to their full research cycle, to augment the quality, transparency and impact of research and scholarship. This position paper describes some research underlying our current research and development efforts, and touches on the principles and practice of our tool suite. 1. Elsevier Research Data Principles Elsevier actively participates in a number of community efforts, industry initiatives and standards and policy bodies to support more effective discovery, use and reuse of research data, including: • Co-authorship of the Brussels Declaration1, in collaboration with the STM Association2; • Cofounding, codevelopment and full implementation of3 the ORCID4 researcher ID System; • Strong support for and -
Bibliometrics: the Leiden Manifesto for Research Metrics
NATURE | COMMENT Diana Hicks, Paul Wouters, Ludo Waltman, Sarah de Rijcke & Ismael Rafols 22 April 2015 Use these ten principles to guide research evaluation, urge Diana Hicks, Paul Wouters and colleagues. Subject terms: Careers Research management Publishing Print Illustration by David Parkins Data are increasingly used to govern science. Research evaluations that were once bespoke and performed by peers are now routine and reliant on metrics1. The problem is that evaluation is now led by the data rather than by judgement. Metrics have proliferated: usually well intentioned, not always well informed, often ill applied. We risk damaging the system with the very tools designed to improve it, as evaluation is increasingly implemented by organizations without knowledge of, or advice on, good practice and interpretation. Before 2000, there was the Science Citation Index on CD-ROM from the Institute for Scientific Information (ISI), used by experts for specialist analyses. In 2002, Thomson Reuters launched an integrated web platform, making the Web of Science database widely accessible. Competing citation indices were created: Elsevier's Scopus (released in 2004) and Google Scholar (beta version released in 2004). Web-based tools to easily compare institutional research productivity and impact were introduced, such as InCites (using the Web of Science) and SciVal (using Scopus), as well as software to analyse individual citation profiles using Google Scholar (Publish or Perish, released in 2007). In 2005, Jorge Hirsch, a physicist at the University of California, San Diego, proposed the Related stories h-index, popularizing citation counting for individual researchers. Interest in the journal impact The focus on factor grew steadily after 1995 (see 'Impact-factor obsession'). -
Bury the Metrics Pages! T
Political Geography 68 (2019) A3–A5 Contents lists available at ScienceDirect Political Geography journal homepage: www.elsevier.com/locate/polgeo Guest editorial Calling all journal editors: Bury the metrics pages! T 1. Introduction Garfield first proposed the ‘impact factor’ in 1955. The key aim,inan age of proliferating publications that made exhaustive tracking re- Visitors to the homepage of Political Geography (PGQ) are told that it ference to one's work all but impossible, was to harness new compu- is “an interdisciplinary journal for all students of political studies with tational technologies to create an ‘association-of-ideas index’ (Garfield, an interest in the geographical and spatial aspects of politics.” As they 1955, p. 108). This would allow the scholar to easily be made ‘aware of scroll down, they are very quickly presented with a panel of key me- criticisms of earlier papers’ thus ‘increasing communication possibilities trics. They are informed, amongst other things, that PGQ has a Journal between scientists.’ In essence, it would be ‘just a starting point in lit- Impact Factor (JIF) of 3.495, a CiteScore of 2.82, and a Source erature research’ (Garfield, 1955, p. 111). It would also have a quan- Normalized Impact per Paper of 1.671. This data is presented without titative value, helping ‘the historian to measure the influence of the critical comment as though it is an objective, apolitical, natural and article – that is, its “impact factor.”’ In time, this simplistic quantitative uncontested feature of scholarly publishing. It is none of these things. conflation of ‘impact’ with number of times cited came to define theJIF, We consider this proliferation of metrics as both a symptom and a and the original crucial qualitative purpose of ‘transmission of ideas’ reproducer of neoliberalism in higher education, and that these metrics (Garfield, 1955, p. -
The Changing Role of Funders in Responsible Research Assessment : Progress, Obstacles and the Way Ahead
This is a repository copy of The changing role of funders in responsible research assessment : progress, obstacles and the way ahead. White Rose Research Online URL for this paper: http://eprints.whiterose.ac.uk/171602/ Version: Published Version Monograph: Curry, S., de Rijcke, S., Hatch, A. et al. (3 more authors) (2020) The changing role of funders in responsible research assessment : progress, obstacles and the way ahead. Working Paper. Research on Research Institute (RoRI) https://doi.org/10.6084/m9.figshare.13227914.v1 © 2020 The Authors. Working paper published under CC-BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Reuse This article is distributed under the terms of the Creative Commons Attribution (CC BY) licence. This licence allows you to distribute, remix, tweak, and build upon the work, even commercially, as long as you credit the authors for the original work. More information and the full terms of the licence here: https://creativecommons.org/licenses/ Takedown If you consider content in White Rose Research Online to be in breach of UK law, please notify us by emailing [email protected] including the URL of the record and the reason for the withdrawal request. [email protected] https://eprints.whiterose.ac.uk/ RoRI Working Paper No.3 The changing role of funders in responsible research assessment: progress, obstacles and the way ahead Stephen Curry, Sarah de Rijcke, Anna Hatch, Dorsamy (Gansen) Pillay, Inge van der Weijden and James Wilsdon November 2020 Produced in partnership with: About the authors Stephen Curry is Professor of Structural Biology and Assistant Provost for Equality, Diversity and Inclusion at Imperial College, London. -
Library Instruction Round Table News
School Public Special Academic LIBRARY INSTRUCTION ROUND TABLE NEWS The purpose of LIRT is to advocate library instruction as a means for developing competent library and information use as a part of life-long learning. LIRT June 2004, volume 26, no.4 issn 0270-6792 From The President by Stephanie Michel, [email protected] Changing Times Spring is blooming gloriously just outside my window, Similarly, LIRT is in a state of transition. After 25 years of beckoning me to go outside and explore the world of new advocacy for library instruction, LIRT is exploring how to growth. Yet, through the magic of time and publishing, by best serve our members in today’s information-heavy, the time you read this you may already be engulfed by the budget-thin world. At the Midwinter conference, LIRT hosted warm days of summer. Many of you may be wrapping up a a retreat that challenged attendees to think creatively about few loose ends before venturing off to sunny, humid the future direction of LIRT. As a result of this outpouring of Orlando to attend the ALA Annual conference and to catch ideas, LIRT is exploring our options and making plans that up with old friends. will shape the next 25 years of our organization. I’d like to challenge all LIRT members to tell us how LIRT can The themes of time and change have been resonating for become more relevant to you as instruction librarians. me lately. My colleagues and I are preparing a program for Are there new projects you’d like to see LIRT pursue? Are our regional library association conference about our new there issues, themes, or goals that LIRT should explore? classroom. -
Publication Pressure and Scientific Misconduct in Medical Scientists 81
VU Research Portal Publish & Perish Tijdink, J.K. 2016 document version Publisher's PDF, also known as Version of record Link to publication in VU Research Portal citation for published version (APA) Tijdink, J. K. (2016). Publish & Perish: Research on research and researchers. General rights Copyright and moral rights for the publications made accessible in the public portal are retained by the authors and/or other copyright owners and it is a condition of accessing publications that users recognise and abide by the legal requirements associated with these rights. • Users may download and print one copy of any publication from the public portal for the purpose of private study or research. • You may not further distribute the material or use it for any profit-making activity or commercial gain • You may freely distribute the URL identifying the publication in the public portal ? Take down policy If you believe that this document breaches copyright please contact us providing details, and we will remove access to the work immediately and investigate your claim. E-mail address: [email protected] Download date: 07. Oct. 2021 Publish & Perish Research on research and researchers Joeri K. Tijdink Publish & Perish Research on research and researchers colofon ISBN: 978-90-825123-4-2 ©Joeri Tijdink, 2016 opmaak: proefschrift-aio.nl druk: dpp.nl VRIJE UNIVERSITEIT Publish & Perish Research on research and researchers ACADEMISCH PROEFSCHRIFT ter verkrijging van de graad Doctor aan de Vrije Universiteit Amsterdam, op gezag van de rector magnificus prof.dr. V. Subramaniam, in het openbaar te verdedigen ten overstaan van de promotiecommissie van de Faculteit der Geneeskunde op donderdag 30 juni 2016 om 9.45 uur in de aula van de universiteit, De Boelelaan 1105 door Joeri Kees Tijdink geboren te Tiel promotoren: prof.dr.