Enabling More Collaborative, Transparent and Effective Research: Wiley &

Young Wu October 2018

Wiley Editor Symposium | Beijing, Oct 2018 Outline(概要)

1. Overview （开放科学简介） ▪ Definition of Open Science（开放科学的定义） ▪ Short history of Open Sciences (开放科学历史简介） ▪ Drivers of Open Science （开放科学的驱动者） ▪ Benefits of Open Science （开放科学的好处） ▪ Coverages and Topics of Open Science (开放科学涵盖领域）

2. Wiley Open Science（Wiley 开放科学举措) ▪ ▪ ▪ Practices ▪ Open Collaboration ▪ Open Recognition & Reward

3. Case Study ▪ Open Access （开放获取） ▪ Open Publishing Practices （开放出版实践） ▪ Open Recognition & Reward （开放认可与奖励）

Wiley Editor Symposium | Beijing, Oct 2018 Open Science Overview 开放科学简介

Wiley Editor Symposium | Beijing, Oct 2018 3 Definition of Open Science（开放科学的定义）

… broad term, covering the many exciting developments in how science is becoming more open, accessible, efficient, democratic, and transparent. This Open Science revolution is being driven by new, digital tools for scientific collaboration, experiments and analysis and which make scientific knowledge more easily accessible by professionals and the general public, anywhere, at any time.

- European Commission

广义上来讲，（开放科学）包括很多激动人心的 发展，例如科学如何变得更开放，易于获取，高 效，民主和透明。这这场开放科学的变革得益于 新的应用于科学合作，实验和分析的数字工具的 驱动，这些工具让专家和大众在任何时间，任何 地点都能够方便地获取科学知识。 - 欧洲委员会

Wiley Editor Symposium | Beijing, Oct 2018 What is Open Science（什么是开放科学？）

By making scientific knowledge available to Publicly funded scientific research is an important means for the society to create the broadest set of potential users, open knowledge, support innovation, and promote growth. Research articles from such science accelerates innovation and research are knowledge resources to be shared by all. Their open access will facilitate improvements in health, energy, the dissemination and utilization of knowledge, turn the knowledge produced by environmental protection, agriculture, public investment effectively into innovation and development capabilities of the national security, and other important society, ensure that public knowledge benefits all, and strengthen the innovation areas…Federal agencies are requiring their driven development strategy. research staff and scientists they fund to plan - Chinese Academy of Sciences for long-term preservation of and access to their research data, and to make their and reproducibility are core scientific values because science is a research publications accessible to the public distributed, non-hierarchical culture for accumulating knowledge. No individual is the via agency-designated repositories. arbiter of truth. Knowledge accumulates by sharing information and independently reproducing results. - Office of Science and Technology Policy - Center for Open Science

…the term refers to efforts by researchers, governments, research funding agencies or Open Knowledge is the concept that the scientific community itself to make the primary outputs of publicly funded knowledge can be openly shared. This means research results – publications and the research data – publicly accessible in digital anyone can use, modify, and share format with no or minimal restriction as a means for accelerating research; these knowledge without any legal, social, or efforts are in the interest of enhancing transparency and collaboration, and fostering technical restrictions. innovation. - Open Knowledge Australia - Organization of Economic Co-Operation and Development

Wiley Editor Symposium | Beijing, Oct 2018 Drivers of Open Science （开放科学的驱动者）

• Emerging digital technologies 新兴的数字技术 • Researchers looking for new ways to collaborate and then disseminate their outputs 研究人员寻找新的方法 传播其科研成果 • A desire for greater transparency in 对同行评审透明度的需求 • Growing public scrutiny of research and demand for faster solutions 对科研的公共监督和提供快速解决方案需求的增加 • Changes to research assessment metrics, including the emergence of Altmetrics 科研评价体系和指标的变化(包含新起的Altmetrics) • Pressure from funders to make their funded research more accessible, and track the impact of funded research来自资助者的压力 • Researchers looking to reproduce and verify research results 科研人员对科研结果可重复和核实性的需求

Wiley Editor Symposium | Beijing, Oct 2018 Benefits of Open Science （开放科学的好处）

我图网在2008年8月8日(奥运会开幕)兴建，是设计作 品交易平台，主要经营正版设计稿，正版摄影图，正 版插画，正版3d模型，正版flash源文件等销售。

Increased openness Increased reproducibility Increased accountability Increased Collaboration Higher returns 增强开放性 增加可重复性 增强责任性 增强合作性 on investment making scientific creating a more efficient protecting the integrity encourages researchers and faster research more open, and effective research and overall reputation of to improve their pace of transparent and landscape, whether research discovery together discovery accessible for conducting, funding or 更高的投资回 researchers, research supporting research 报和更快的发 stakeholders and the 1 2 3 4 现步伐 general public alike

Wiley Editor Symposium | Beijing, Oct 2018 Open Science Coverages: In One Figure（涵盖领域一览）

* Source: FOSTER

Wiley Editor Symposium | Beijing, Oct 2018 Wiley Open Science Initiatives Wiley 开放获取举措

Wiley Editor Symposium | Beijing, Oct 2018 9 An Overview: Wiley Open Science

Open Access Open Data Open Publishing Practices Increasing the Enabling verification of accessibility of publicly data, methodology and Increasing transparency funded research reporting standards and reproducibility of and allowing others to the research process build on existing work and published product

Open Collaboration Open Recognition & Reward Supporting inclusive and networked research Helping integrate practices researcher identification and evaluation tools

https://authorservices.wiley.com/open-science

Wiley Editor Symposium | Beijing, Oct 2018 Open Access

Increasing the accessibility of publicly funded research Open Access

Gold versus​ Green OA

Wiley Editor Symposium | Beijing, Oct 2018 Open Science at Wiley: Open Access

We enable researchers to publish OA and more researchers are choosing to go Gold

Gold Open Access Green Open Access Wiley Open Access Fully open access journals, Self-Archiving where every article published is Allows peer reviewed (but not OA v final) versionsv of a paper to Wiley OnlineOpen be hosted on a personal A hybrid model enabling website, or an institutional authors to make their article website after an embargo open access in one of our period subscription journals

https://authorservices.wiley.com/open-science/open-access/index.html

Wiley Editor Symposium | Beijing, Oct 2018 Open Data

Enabling verification of data, methodology and reporting standards and allowing others to build on existing work Open Data

Shared data that is Findable, Accessible, Interoperable, Reusable​ (FAIR)

Cited data that follows FORCE11 Data Citation Principles​ Here research data including, but not limited to: raw data, processed data, software, algorithms, protocols, methods, materials.

Wiley Editor Symposium | Beijing, Oct 2018 Open Science at Wiley: Open Data – ResearchersResearchers Need Help need help

70% of surveyed researchers say they share data Most often in supplementary material in journals It’s a significant effort to organise Badges: Small Knowing where to share it is confusing visible rewards that lead change Copyright is confusing Wiley survey of researcher’s Springer Nature survey of practical challenges attitudes towards open science researchers face when sharing their data

Wiley Editor Symposium | Beijing, Oct 2018 Open Science at Wiley: Open Data – Wiley Data Sharing Policies

• Data Statement: Data supporting this study are provided in the results section Authors of articles published in Wiley journals areand encouraged as supplementary to share their information research data including, but not limited to: raw data, processed data, software, algorithms, protocols, methods, materials, and to make their data FAIR https://www.force11.org/group/fairgroup/fairprinciples accompanying this paper.” the article The majority of Wiley’s journals enforce one of thehere following standardized data sharing policies: https://onlinelibrary.wiley.com/doi/10.1 Data availability Data has been shared2 Data has been peer Example journals statement is published1 002/mbo3.696 reviewed3 Encourages Data Sharing Optional Optional Optional Expects Data Sharing Required Optional Optional British Journal of Social Psychology Mandates Data Sharing Required Required Optional Ecology and Evolution Mandates Data Sharing Required Required Required Geoscience Data Journal and Peer Reviews Data American Journal of Political Science 1 A data availability statement confirms the presence or absence of shared data. 2 Links to data in data availability statements are checked to ensure they link to the data that the authors intended. If data have been shared in a data repository, the data availability statement includes a permanent link to the data. Shared data is also cited. 3 Quality and/or replicability of linked data are peer reviewed. Depending on the journal, this may be to peer review the quality of the data by ensuring that the results in the paper and the data in the repository align (for example, sample sizes and variables match), or it may be to peer review the replicability of the data to ensure that the claims presented in the journal article are valid and can be reproduced.

Wiley Editor Symposium | Beijing, Oct 2018 15 Open Science at Wiley：Open Data - Wiley Data Citation

In recognition of the significance of data as an output of research effort, Wiley has endorsed the FORCE11 Data Citation Principles. Data must be cited in the same way as article, book, and web citations and authors are required to include data citations as part of their reference list.

We recommend the format proposed by the Joint Declaration of Data Citation Principles: • [dataset] Authors; Year; Dataset title; Data repository or archive; Version (if any); Persistent identifier (e.g. DOI)

Wiley’s recommended methods of choosing an appropriate data repository : Wiley Author Compliance Tool to check the data sharing policy of the chosen journal and/or funder https://authorservices.wiley.com/author-resources/Journal-Authors/open-access/author-compliance- tool.html Visit re3data.org or fairsharing.org to help identify registered and certified data repositories relevant to your subject area http://www.re3data.org/ https://fairsharing.org/

Wiley Editor Symposium | Beijing, Oct 2018 Open Science at Wiley: Open Data – Researchers Need Help

Wiley Editor Symposium | Beijing, Oct 2018 Open Publishing Practices

Increasing transparency Open Publishing and reproducibility of the research process and published product Practices

Registered Reports Preprints

Resource Identification Transparent/Open Peer Review

Wiley Editor Symposium | Beijing, Oct 2018 Open Science at Wiley: Open Publishing Practices – Registered Reports We offer researchers Registered Reports

Peer review prior to data collection emphasizes the importance of the research question and the methods. High-quality studies are provisionally accepted. This eliminates questionable research practices, including low statistical power, selective reporting, and publication bias. More is here: https://cos.io/rr/

https://hub.wiley.com/community/exchanges/discover/blog/2017/12/05/8-answers-about-registered-reports- research-preregistration-and-why-both-are-important

Wiley Editor Symposium | Beijing, Oct 2018 Open Science at Wiley: Open Publishing Practices – Resource TheIdentification Resource Identification Initiative

Community-led effort to introduce better reporting standards for research resources through Research Resource Identifiers (RRIDs) which are:

• Machine readable and uniform across publishers

• Built upon established identifiers from existing community repositories

• Used in publications to help readers discover: • What resources are used in this paper and which specific ones? • What other information is known about these *Authentication of resources required in NIH grants beginning resources? May 2016 • What other papers use this resource? *NIDA points to the SciCrunch Portal as a method for meeting new requirement for Rigor and Transparency (NIDA • In use for antibodies, animals, cell lines and Neuroscience Update, March 4, 2016). software

Wiley Editor Symposium | Beijing, Oct 2018 Open Science at Wiley: Open Publishing Practices – Resource Identification Resource Identification at Wiley

Wiley participated in a cross-publisher pilot to test effectiveness RRIDs and results indicated significant improvement of resource identification in articles with RRIDs

• Wiley now has over 30 journals across a range of life science disciplines that are publishing manuscripts with RRIDs

Resources identified Improved resource identification • Wiley’s new Author Guidelines Template http://tinyurl.com/omvwmhl Bandrowski et al, 2016 includes all necessary text for implementing an RRID policy in your journal

Bandrowski, A., et al. (2016), The Resource Identification Initiative: A cultural shift in publishing. J. Comp. Neurol., 524: 8–22. doi:10.1002/cne.23913

Wiley Editor Symposium | Beijing, Oct 2018 Open Science at Wiley: Open Publishing Practices – Preprints

We help researchers use preprints to accelerate research and discovery

Researchers can “preprint” their work on a non-commercial preprint server before they submit it to a journal for peer review

We launched Earth and Space Science Open Archive, a preprint server for the American Geophysical Union https://www.essoar.org/

Tech tools are coming soon to help us alert journal editors to relevant preprinted papers

Growth in preprints http://www.prepubmed.org/monthly_stats/

Wiley’s preprints policy: Journals can enable and encourage researchers to submit preprints to journals for peer review

Wiley Editor Symposium | Beijing, Oct 2018 Details on Open Peer Review & The Platform to Facilitate the Process

Detailed - Editor’s Decision letter Detailed – Peer Review Report published Detailed – Author Response published published with DOI, it is Citable. with DOI, it is Citable. with DOI, it is Citable. It is available for further comments and It is available for further comments and further discussion. It is available for further comments and further discussion Reviewer decides to stay anonymous or not. further discussion.

Details: https://publons.com/publon/10.1111/cge.13363/

Wiley Editor Symposium | Beijing, Oct 2018 Open Collaboration

Supporting inclusive and networked research practices Open Collaboration

Collaborative research, writing, and sharing of published work

Wiley Editor Symposium | Beijing, Oct 2018 Open Science at Wiley: Open Publishing Practices – Peer Review We help researchers collaborate and share

Research writing is a huge task. Authors lay out their thoughts to complex documents. Then journal submission requires additional styling and formatting. And then sharing after publication is governed by often impenetrable copyright and permission requirements.

We help researchers collaborate with their peers using Manuscripts App. We enable researchers to focus on the substance of their research, not styling and formatting with Overleaf. We help them share their work in the best ways with “How Can I Share it”.com.

Article sharing policy: http://www.howcanishareit.com/

Wiley Editor Symposium | Beijing, Oct 2018 Open Recognition & Reward

Helping integrate researcher identification Open Recognition & and evaluation tools Reward

Open Science badges recognize and reward open science practices

Publons recognizes and rewards peer review

Wiley Editor Symposium | Beijing, Oct 2018 Open Science at Wiley: Recognition and Reward We reward researchers who adopt open practices with Open Science Badges

Open Science Badges help us encourage authors to publish research with us that’s more transparent. With badges we celebrate authors who take advantage of the new transparent choices our journals offer them, like data sharing and citation and Registered Reports. We use Center for Open Science badges.

Toolkit https://wiley.sharepoint.com/teams/OpenScienceBadges/Shared%20Documents/Forms/AllItems.aspx

Wiley Editor Symposium | Beijing, Oct 2018 Open Science at Wiley: Recognition and Reward We enable researchers to claim credit for peer review

Wiley reviewers When researchers review for participating Wiley journals they can opt-in to get credit on Publons. Researchers can then claim their reviews. 114,552+

Wiley reviews By default, the content of reviews is not publicly displayed on Publons. 507,029+

Wiley journals on Publons https://publons.com/journal/?publisher=23

Wiley Editor Symposium | Beijing, Oct 2018 Thank you! Please contact [email protected] for any question.

Wiley Editor Symposium | Beijing, Oct 2018 Wiley Open Research case study 开放科学案例分析

Xiaolin Li ( 李晓林 ) October 2018

Wiley Editor Symposium | Beijing, Oct 2018 Outline(概要)

1. Open Access （开放获取） Open Access Journals o Ecology and Evolution

2. Open Publishing Practices （开放出版实践） Reproducibility – Registered Reports o European Journal of Neuroscience

3. Open Recognition & Reward （开放认可与奖励） Open Peer Review Reports o Clinical Genetics

Wiley Editor Symposium | Beijing, Oct 2018 31 Open Access Journals

开放获取期刊

Wiley Editor Symposium | Beijing, Oct 2018 32 Ecology and Evolution – A sound science open access journal

Ecology and Evolution publication 2011-2017 • Ecology and Evolution start with 50 1200 papers in 2011, and publish 981 papers in 2017. 1000 981 • The compound annul growth rate is 800 730 30%. 600 • In 2017, over 1500 papers submit to the 430 391 497 400 journal.

262 Papers Papers Web in Science of 200 50 0 2011 2012 2013 2014 2015 2016 2017

Wiley Editor Symposium | Beijing, Oct 2018 33 Ecology and Evolution – A sound science open access journal Editor in Chief

Allen J. Moore

Journal Philosophy: Author Friendly -We look for reasons to publish rather than reasons to reject

Journal workflow: Regular Submissions&Cascade Papers -Let’s help you get your paper published as quickly as possible

Source: Allen Moore Interview video

Wiley Editor Symposium | Beijing, Oct 2018 34 Ecology and Evolution – A sound science open access journal

Ecology and Evolution Impact Factor Trend 2012-2017 • Ecology and Evolution’s first 3 100% Impact Factor in 2012 is 1.184, 2.537 2.44 2.32 2.34 increased to 2.34 in 2017. 2.25 75% • The diversity of papers is 1.658 1.5 50% increased, subject expend from 1.184 Ecology (rank 59%) to

0.75 25% Evolutionary Biology (rank 40%).

0 0% 2012 2013 2014 2015 2016 2017

Journal Impact Factor Ecology Evolutionary Biology

Wiley Editor Symposium | Beijing, Oct 2018 35 Ecology and Evolution - Impact Factor

Wiley Editor Symposium | Beijing, Oct 2018 36 Ecology and Evolution – A sound science open access journal More in Open Science – Ecology and Evolution • Open Data • Registered Reports • Novel category Academic Practice • ...

Wiley Editor Symposium | Beijing, Oct 2018 37 Reproducibility – Editor Yiqun Gan Registered Reports

注册报告

Wiley Editor Symposium | Beijing, Oct 2018 38 40 journals Wiley Journals publish Registered Reports since Spring 2018

Registered Reports emphasize • Importance of the research question • Quality of methodology

“Registered Reports eliminates the bias against negative results in publishing because the results are not known at the time of review." -- Daniel Simons, Professor at University of Illinois

"Because the study is accepted in advance, the incentives for authors change from producing the most beautiful story to the most accurate one." -- Chris Chambers, Professor at Cardiff University, Section Editor for European Journal of Neuroscience https://cos.io/rr/

Wiley Editor Symposium | Beijing, Oct 2018 39 Registered Reports – Workflow (二阶段审稿制)

In-principle acceptance (IPA), which means that the journal virtually guarantees publication if the authors conduct the experiment in accordance with their approved protocol.

Published Registered Report will thus appear very similar to a standard research report but will give readers confidence that the hypotheses and main analyses are free of questionable research practices.

Wiley Editor Symposium | Beijing, Oct 2018 40 Registered Reports - European Journal of Neuroscience

Q. How did you find the stage 1 peer review (of your hypotheses and experimental procedures) compared to peer review of a finished study?

A. The reviewers were incredibly helpful and contributed pages of comments and suggestions. I believe that the fact that the study has not yet been conducted makes the reviewers feel that they can really contribute to a novel piece of research - instead of simply having to evaluate it when a final paper is submitted for publication.

Q. Hypothetically, how would you feel about publishing your stage 1 submission? Or pre-registering it in a registry where you can set the First Registered Report author in EJN embargo? A. In fact, our stage 1 submission has been public as an OSF Matthias Mittner repository since the day of in-principle acceptance. We also publish our incoming raw data and everything else in that repository.

https://hub.wiley.com/community/exchanges/discover/blog/2018/05/29/registered-reports-good-for-both-science-and-authors

Wiley Editor Symposium | Beijing, Oct 2018 41 Open Peer Review Reports

开放评审报告

Wiley Editor Symposium | Beijing, Oct 2018 42 Clinical Genetics - Recognizing peer review with Publons now

• September 13, 2018, the journal starts to Open the peer reviewer reports on Publons.

• The peer review history for this article is available at Publons.

https://publons.com/journal/?publisher=23&order_by=reviews

Wiley Editor Symposium | Beijing, Oct 2018 43 Clinical Genetics - Recognizing peer review with Publons now

• Editor’s Decision letter published with DOI, it is Citable. It is available for further comments and further discussion.

• Peer Review Report published with DOI, it is Citable. It is available for further comments and further discussion. • Reviewer decides to stay anonymous or not.

• Author Response published with DOI, it is Citable. It is available for further comments and further discussion. Details: https://publons.com/publon/10.1111/cge.13363/• c

Wiley Editor Symposium | Beijing, Oct 2018 44 Clinical Genetics - Recognizing peer review with Publons now

Editor

Author

Reviewer

Wiley Editor Symposium | Beijing, Oct 2018 45 Embrace Open Science!

Xiaolin Li

Open Access & Journal Development Manager [email protected]

Wiley Editor Symposium WeChat group

Wiley Editor Symposium | Beijing, Oct 2018 46