DOCSLIB.ORG

Promoting an Open Research Culture

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Promoting an Open Research Culture Promoting an open research culture Brian Nosek University of Virginia -- Center for Open Science http://briannosek.com/ -- http://cos.io/ The McGurk Effect Ba Ba? Da Da? Ga Ga? McGurk & MacDonald, 1976, Nature Adelson, 1995 Adelson, 1995 Norms Counternorms Communality Secrecy Open sharing Closed Norms Counternorms Communality Secrecy Open sharing Closed Universalism Particularlism Evaluate research on own merit Evaluate research by reputation Norms Counternorms Communality Secrecy Open sharing Closed Universalism Particularlism Evaluate research on own merit Evaluate research by reputation Disinterestedness Self-interestedness Motivated by knowledge and discovery Treat science as a competition Norms Counternorms Communality Secrecy Open sharing Closed Universalism Particularlism Evaluate research on own merit Evaluate research by reputation Disinterestedness Self-interestedness Motivated by knowledge and discovery Treat science as a competition Organized skepticism Organized dogmatism Consider all new evidence, even Invest career promoting one’s own against one’s prior work theories, findings Norms Counternorms Communality Secrecy Open sharing Closed Universalism Particularlism Evaluate research on own merit Evaluate research by reputation Disinterestedness Self-interestedness Motivated by knowledge and discovery Treat science as a competition Organized skepticism Organized dogmatism Consider all new evidence, even Invest career promoting one’s own against one’s prior work theories, findings Quality Quantity Anderson, Martinson, & DeVries, 2007 Incentives for individual success are focused on getting it published, not getting it right Nosek, Spies, & Motyl, 2012 UNIVERSITIES PUBLISHING ecosystem FUNDERS SOCIETIES Evidence to encourage change Technology to enable change Training to enact change Incentives to embrace change Figure credit: fivethirtyeight.com Silberzahn et al., 2015 Signals: Making Behaviors Visible Promotes Adoption Kidwell et al., 2016 40% 30% 20% 10% % Articles reporting data available in repository in available data reporting Articles % 0% http://cos.io/top Data sharing Article states whether data are available, 1 and, if so, where to access them Data must be posted to a trusted repository. Exceptions must be identified 2 at article submission. Data must be posted to a trusted repository, and reported analyses will be 3 reproduced independently prior to publication. 757 Journals, 62 Organizations • AAAS/Science • Electrochemical Society • American Academy of Neurology • Frontiers • American Geophysical Union • MDPI • American Heart Association • Nature Publishing Group • American Meterological Society • PeerJ • American Society for Cell Biology • Pensoft Publishers • Association for Psychological • Public Library of Science Science • The Royal Society • Association for Research in • Society for Personality and Social Personality Psychology • Association of Research Libraries • Society for a Science of Clinical • Behavioral Science and Policy Psychology Association • Ubiquity Press • BioMed Central • Wiley • Committee on Publication Ethics Open Access Outcomes Open Data Content Open Workflows Process Analyze Data Write Search/ Report Discovery Analyze Develop Data OSF Idea Store Design Data Study Collect Data Open Workflow • Increases process transparency • Increases accountability • Facilitates reproducibility • Facilitates metascience • Fosters collaboration • Fosters inclusivity • Fosters innovation • Protects against lock-in • Open + Accessible Documentation Curation Preservation Accessibility http://osf.io OpenSesame OpenSesame SHARE (http://share.osf.io/) Providers Gather Notify Consumers OSF osf.io Application Framework journals Workflow Authentication registries Permissions File Storage preprint servers File Rendering Persistence grants management Meta-database Integrations Search peer review services SHARE Data curation, annotation Breaking tyranny of the publication Separating publication from evaluation Nosek & Bar-Anan, 2012 OSF Application Framework Workflow, Authentication, File Storage, File Rendering, Persistence, Meta-database, Integrations, Search, SHARE Data Community of Manucript services Moderation (pre-peer review) Commenting / Discussions (post-peer review) http://osf.io/preprints/ Evidence to encourage change Technology to enable change Training to enact change Incentives to embrace change What can you do? • Try out OSF (http://osf.io/) • Schedule OSF training • COS Ambassador • OSF Institutions • SHARE Harvesters • Integrate institutional services with OSF • OSF Meetings • Share OSF Preprints (http://osf.io/preprints) and Prereg Challenge (http://cos.io/prereg/) Email: [email protected] or [email protected] What can you do? • Try out OSF (http://osf.io/) • Schedule OSF training • COS Ambassador • OSF Institutions • SHARE Harvesters • Integrate institutional services with OSF • OSF Meetings • Share OSF Preprints (http://osf.io/preprints) and Prereg Challenge (http://cos.io/prereg/) Email: [email protected] or [email protected] These slides are shared: https://osf.io/mgv6j/ http://cos.io/ http://osf.io/ Brian Nosek [email protected] Search Publish and report discover Write Develop reportOpen Science Frameworkidea Interpret A scholarlyOSF commons Design findings connecting the entire research study lifecycle Analyze Acquire data materials https://osf.io/ Collect Store data data .
Load more

Recommended publications
  • 1 Psychology As a Robust Science Dr Amy Orben Lent Term 2020 When
    Psychology as a Robust Science Dr Amy Orben Lent Term 2020 When: Lent Term 2020; Wednesdays 2-4pm (Weeks 0-6; 15.1.2020 – 26.2.2020), Mondays 2-4pm (Week 7; 2.3.2020) Where: Lecture Theatre, Experimental Psychology Department, Downing Site Summary: Is psychology a robust science? To answer such a question, this course will encourage you to think critically about how psychological research is conducted and how conclusions are drawn. To enable you to truly understand how psychology functions as a science, however, this course will also need to discuss how psychologists are incentivised, how they publish and how their beliefs influence the inferences they make. By engaging with such issues, this course will probe and challenge the basic features and functions of our discipline. We will uncover multiple methodological, statistical and systematic issues that could impair the robustness of scientific claims we encounter every day. We will discuss the controversy around psychology and the replicability of its results, while learning about new initiatives that are currently reinventing the basic foundations of our field. The course will equip you with some of the basic tools necessary to conduct robust psychological research fit for the 21st century. The course will be based on a mix of set readings, class discussions and lectures. Readings will include a diverse range of journal articles, reviews, editorials, blog posts, newspaper articles, commentaries, podcasts, videos, and tweets. No exams or papers will be set; but come along with a critical eye and a willingness to discuss some difficult and controversial issues. Core readings • Chris Chambers (2017).
    [Show full text]
  • Hop://Cos.Io/ Brian Nosek University of Virginia Hop://Briannosek.Com
    hp://cos.io/ Brian Nosek University of Virginia h"p://briannosek.com/ General Article Psychological Science XX(X) 1 –8 False-Positive Psychology: Undisclosed © The Author(s) 2011 Reprints and permission: sagepub.com/journalsPermissions.nav Flexibility in Data Collection and Analysis DOI: 10.1177/0956797611417632 Allows Presenting Anything as Significant http://pss.sagepub.com Joseph P. Simmons1, Leif D. Nelson2, and Uri Simonsohn1 1The Wharton School, University of Pennsylvania, and 2Haas School of Business, University of California, Berkeley Abstract In this article, we accomplish two things. First, we show that despite empirical psychologists’ nominal endorsement of a low rate of false-positive findings (≤ .05), flexibility in data collection, analysis, and reporting dramatically increases actual false-positive rates. In many cases, a researcher is more likely to falsely find evidence that an effect exists than to correctly find evidence that it does not. We present computer simulations and a pair of actual experiments that demonstrate how unacceptably easy it is to accumulate (and report) statistically significant evidence for a false hypothesis. Second, we suggest a simple, low-cost, and straightforwardly effective disclosure-based solution to this problem. The solution involves six concrete requirements for authors and four guidelines for reviewers, all of which impose a minimal burden on the publication process. Keywords methodology, motivated reasoning, publication, disclosure Received 3/17/11; Revision accepted 5/23/11 Our job as scientists is to discover truths about the world. We Which control variables should be considered? Should spe- generate hypotheses, collect data, and examine whether or not cific measures be combined or transformed or both? the data are consistent with those hypotheses.
    [Show full text]
  • The Reproducibility Crisis in Research and Open Science Solutions Andrée Rathemacher University of Rhode Island, [email protected] Creative Commons License
    University of Rhode Island DigitalCommons@URI Technical Services Faculty Presentations Technical Services 2017 "Fake Results": The Reproducibility Crisis in Research and Open Science Solutions Andrée Rathemacher University of Rhode Island, [email protected] Creative Commons License This work is licensed under a Creative Commons Attribution 4.0 License. Follow this and additional works at: http://digitalcommons.uri.edu/lib_ts_presentations Part of the Scholarly Communication Commons, and the Scholarly Publishing Commons Recommended Citation Rathemacher, Andrée, ""Fake Results": The Reproducibility Crisis in Research and Open Science Solutions" (2017). Technical Services Faculty Presentations. Paper 48. http://digitalcommons.uri.edu/lib_ts_presentations/48http://digitalcommons.uri.edu/lib_ts_presentations/48 This Speech is brought to you for free and open access by the Technical Services at DigitalCommons@URI. It has been accepted for inclusion in Technical Services Faculty Presentations by an authorized administrator of DigitalCommons@URI. For more information, please contact [email protected]. “Fake Results” The Reproducibility Crisis in Research and Open Science Solutions “It can be proven that most claimed research findings are false.” — John P. A. Ioannidis, 2005 Those are the words of John Ioannidis (yo-NEE-dees) in a highly-cited article from 2005. Now based at Stanford University, Ioannidis is a meta-scientist who conducts “research on research” with the goal of making improvements. Sources: Ionnidis, John P. A. “Why Most
    [Show full text]
  • 2020 Impact Report
    Center for Open Science IMPACT REPORT 2020 Maximizing the impact of science together. COS Mission Our mission is to increase the openness, integrity, and reproducibility of research. But we don’t do this alone. COS partners with stakeholders across the research community to advance the infrastructure, methods, norms, incentives, and policies shaping the future of research to achieve the greatest impact on improving credibility and accelerating discovery. Letter from the Executive Director “Show me” not “trust me”: Science doesn’t ask for Science is trustworthy because it does not trust itself. Transparency is a replacement for trust. Transparency fosters self-correction when there are errors trust, it earns trust with transparency. and increases confidence when there are not. The credibility of science has center stage in 2020. A raging pandemic. Partisan Transparency is critical for maintaining science’s credibility and earning public interests. Economic and health consequences. Misinformation everywhere. An trust. The events of 2020 make clear the urgency and potential consequences of amplified desire for certainty on what will happen and how to address it. losing that credibility and trust. In this climate, all public health and economic research will be politicized. All The Center for Open Science is profoundly grateful for all of the collaborators, findings are understood through a political lens. When the findings are against partners, and supporters who have helped advance its mission to increase partisan interests, the scientists are accused of reporting the outcomes they want openness, integrity, and reproducibility of research. Despite the practical, and avoiding the ones they don’t. When the findings are aligned with partisan economic, and health challenges, 2020 was a remarkable year for open science.
    [Show full text]
  • 1 Maximizing the Reproducibility of Your Research Open
    1 Maximizing the Reproducibility of Your Research Open Science Collaboration1 Open Science Collaboration (in press). Maximizing the reproducibility of your research. In S. O. Lilienfeld & I. D. Waldman (Eds.), Psychological Science Under Scrutiny: Recent Challenges and Proposed Solutions. New York, NY: Wiley. Authors’ Note: Preparation of this chapter was supported by the Center for Open Science and by a Veni Grant (016.145.049) awarded to Hans IJzerman. Correspondence can be addressed to Brian Nosek, [email protected]. 1 Alexander A. Aarts, Nuenen, The Netherlands; Frank A. Bosco, Virginia Commonwealth University; Katherine S. Button, University of Bristol; Joshua Carp, Center for Open Science; Susann Fiedler, Max Planck Institut for Research on Collective Goods; James G. Field, Virginia Commonwealth University; Roger Giner-Sorolla, University of Kent; Hans IJzerman, Tilburg University; Melissa Lewis, Center for Open Science; Marcus Munafò, University of Bristol; Brian A. Nosek, University of Virginia; Jason M. Prenoveau, Loyola University Maryland; Jeffrey R. Spies, Center for Open Science 2 Commentators in this book and elsewhere describe evidence that modal scientific practices in design, analysis, and reporting are interfering with the credibility and veracity of the published literature (Begley & Ellis, 2012; Ioannidis, 2005; Miguel et al., 2014; Simmons, Nelson, & Simonsohn, 2011). The reproducibility of published findings is unknown (Open Science Collaboration, 2012a), but concern that is lower than desirable is widespread -
    [Show full text]
  • Using the OSF (Open Science Framework)
    Using the OSF Center for Open Science at BITSS 2014 Johanna Cohoon & Caner Uguz Pull out your laptop and visit www.osf.io Anderson, Martinson, & DeVries, 2007 NORMS COUNTERNORMS Communality Secrecy Open sharing Closed Universalism Particularism Evaluate research on own merit Evaluate research by reputation Disinterestedness Self interestedness Motivated by knowledge and discovery Treat science as a competition Organized skepticism Organized dogmatism Consider all new evidence, even Invest career promoting one’s own against one’s prior work theories, findings Quality Quantity COUNTERNORMS NORMS Incentives Incentives for individual success are focused on getting it published, not getting it right. Change the incentives. Center for Open Science COMMUNITY INFRASTRUCTURE METASCIENCE Community ■ Foster discussion of transparency and reproducibility issues ■ Support community efforts to increase openness in the sciences ■ Promote the establishment of reporting standards Center for Open Science COMMUNITY INFRASTRUCTURE METASCIENCE Infrastructure ■ Tools for scientists that increase transparency and access to resources ■ Connect services and allow users to easily organize and share their work Center for Open Science COMMUNITY INFRASTRUCTURE METASCIENCE Metascience ■ How are scientists currently behaving? ■ Do transparency and replication have a positive impact on research? ■ Reproducibility Project: Psychology and Cancer Biology; Many Labs 1, 2, and 3; Archival Project; CREP Open your laptop! www.osf.io OSF Nudge the incentive system ■ Support pre-registration ■ Create alternative means of measuring impact ■ Enable sharing of materials Facilitate good research ■ Organize files ■ Allow collaboration meanwhile Logs Commenting Tags Statistics Download counts Addons OSF Nudge the incentive system ■ Support pre-registration ■ Create alternative means of measuring impact ■ Enable sharing of materials Facilitate good research ■ Organize files ■ Allow collaboration In the future ■ Check lists ■ Notifications ■ Messaging ■ Dataverse, Evernote, Trello, Plot.ly.
    [Show full text]
  • The Trouble with Scientists How One Psychologist Is Tackling Human Biases in Science
    How One Psychologist Is Tackling Human Biases in Science http://nautil.us/issue/24/error/the-trouble-with-scientists Purchase This Artwork BIOLOGY | SCIENTIFIC METHOD The Trouble With Scientists How one psychologist is tackling human biases in science. d BY PHILIP BALL ILLUSTRATION BY CARMEN SEGOVIA MAY 14, 2015 c ADD A COMMENT f FACEBOOK t TWITTER m EMAIL U SHARING ometimes it seems surprising that science functions at all. In 2005, medical science was shaken by a paper with the provocative title “Why most published research findings are false.”1 Written by John Ioannidis, a professor of medicine S at Stanford University, it didn’t actually show that any particular result was wrong. Instead, it showed that the statistics of reported positive findings was not consistent with how often one should expect to find them. As Ioannidis concluded more recently, “many published research findings are false or exaggerated, and an estimated 85 percent of research resources are wasted.”2 It’s likely that some researchers are consciously cherry-picking data to get their work published. And some of the problems surely lie with journal publication policies. But the problems of false findings often begin with researchers unwittingly fooling themselves: they fall prey to cognitive biases, common modes of thinking that lure us toward wrong but convenient or attractive conclusions. “Seeing the reproducibility rates in psychology and other empirical science, we can safely say that something is not working out the way it should,” says Susann Fiedler, a behavioral economist at the Max Planck Institute for Research on Collective Goods in Bonn, Germany.
    [Show full text]
  • Researchers Overturn Landmark Study on the Replicability of Psychological Science
    Researchers overturn landmark study on the replicability of psychological science By Peter Reuell Harvard Staff Writer Category: HarvardScience Subcategory: Culture & Society KEYWORDS: psychology, psychological science, replication, replicate, reproduce, reproducibility, Center for Open Science, Gilbert, Daniel Gilbert, King, Gary King, Science, Harvard, FAS, Faculty of Arts and Sciences, Reuell, Peter Reuell Summary: A 2015 study claiming that more than half of all psychology studies cannot be replicated turns out to be wrong. Harvard researchers have discovered that the study contains several statistical and methodological mistakes, and that when these are corrected, the study actually shows that the replication rate in psychology is quite high – indeed, it is statistically indistinguishable from 100%. RELATED LINKS: According to two Harvard professors and their collaborators, a 2015 landmark study showing that more than half of all psychology studies cannot be replicated is actually wrong. In an attempt to determine the replicability of psychological science, a consortium of 270 scientists known as The Open Science Collaboration (OSC) tried to replicate the results of 100 published studies. More than half of them failed, creating sensational headlines worldwide about the “replication crisis” in psychology. But an in-depth examination of the data by Daniel Gilbert (Edgar Pierce Professor of Psychology at Harvard University), Gary King (Albert J. Weatherhead III University Professor at Harvard University), Stephen Pettigrew (doctoral student in the Department of Government at Harvard University), and Timothy Wilson (Sherrell J. Aston Professor of Psychology at the University of Virginia) has revealed that the OSC made some serious mistakes that make this pessimistic conclusion completely unwarranted: The methods of many of the replication studies turn out to be remarkably different from the originals and, according to Gilbert, King, Pettigrew, and Wilson, these “infidelities” had two important consequences.
    [Show full text]
  • Replicability, Robustness, and Reproducibility in Psychological Science
    1 Replicability, Robustness, and Reproducibility in Psychological Science Brian A. Nosek Center for Open Science; University of Virginia Tom E. Hardwicke University of Amsterdam Hannah Moshontz University of Wisconsin-Madison Aurélien Allard University of California, Davis Katherine S. Corker Grand Valley State University Anna Dreber Stockholm School of Economics; University of Innsbruck Fiona Fidler University of Melbourne Joe Hilgard Illinois State University Melissa Kline Struhl Center for Open Science Michèle Nuijten Meta-Research Center; Tilburg University Julia Rohrer Leipzig University Felipe Romero University of Groningen Anne Scheel Eindhoven University of Technology Laura Scherer University of Colorado Denver - Anschutz Medical Campus Felix Schönbrodt Ludwig-Maximilians-Universität München, LMU Open Science Center Simine Vazire University of Melbourne In press at the Annual Review of Psychology Final version Completed: April 6, 2021 Authors’ note: B.A.N. and M.K.S. are employees of the nonprofit Center for Open Science that has a mission to increase openness, integrity, and reproducibility of research. K.S.C. is the unpaid executive officer of the nonprofit Society for the Improvement of Psychological Science. This work was supported by grants to B.A.N. from Arnold Ventures, John Templeton Foundation, Templeton World Charity Foundation, and Templeton Religion Trust. T.E.H. received funding from the European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No. 841188. We thank Adam Gill for assistance creating Figures 1, 2, and S2. Data, materials, and code are available at https://osf.io/7np92/. B.A.N. Drafted the outline and manuscript sections, collaborated with section leads on conceptualizing and drafting their components, coded replication study outcomes for Figure 1, coded journal policies for Figure 5.
    [Show full text]
  • Open Science 1
    Running head: OPEN SCIENCE 1 Open Science Barbara A. Spellman, University of Virginia Elizabeth A. Gilbert, Katherine S. Corker, Grand Valley State University Draft of: 20 September 2017 OPEN SCIENCE 2 Abstract Open science is a collection of actions designed to make scientific processes more transparent and results more accessible. Its goal is to build a more replicable and robust science; it does so using new technologies, altering incentives, and changing attitudes. The current movement toward open science was spurred, in part, by a recent series of unfortunate events within psychology and other sciences. These events include the large number of studies that have failed to replicate and the prevalence of common research and publication procedures that could explain why. Many journals and funding agencies now encourage, require, or reward some open science practices, including pre-registration, providing full materials, posting data, distinguishing between exploratory and confirmatory analyses, and running replication studies. Individuals can practice and promote open science in their many roles as researchers, authors, reviewers, editors, teachers, and members of hiring, tenure, promotion, and awards committees. A plethora of resources are available to help scientists, and science, achieve these goals. Keywords: data sharing, file drawer problem, open access, open science, preregistration, questionable research practices, replication crisis, reproducibility, scientific integrity Thanks to Brent Donnellan (big thanks!), Daniël Lakens, Calvin Lai, Courtney Soderberg, and Simine Vazire OPEN SCIENCE 3 Open Science When we (the authors) look back a couple of years, to the earliest outline of this chapter, the open science movement within psychology seemed to be in its infancy.
    [Show full text]
  • Improving Reproducibility in Research: the Role of Measurement Science
    Volume 124, Article No. 124024 (2019) https://doi.org/10.6028/jres.124.024 Journal of Research of the National Institute of Standards and Technology Improving Reproducibility in Research: The Role of Measurement Science Robert J. Hanisch1, Ian S. Gilmore2, and Anne L. Plant1 1National Institute of Standards and Technology, Gaithersburg, MD 20899, USA 2National Physical Laboratory, Teddington, TW11 0LW, United Kingdom [email protected] [email protected] [email protected] Summary: • We report on a workshop held 1–3 May 2018 at the National Physical Laboratory, Teddington, U.K., in which the focus was how the world’s national metrology institutes might help to address the challenges of reproducibility of research. • The workshop brought together experts from the measurement and wider research communities in physical sciences, data analytics, life sciences, engineering, and geological science. The workshop involved 63 participants from metrology laboratories (38), academia (16), industry (5), funding agencies (2), and publishers (2). The participants came from the U.K., the United States, Korea, France, Germany, Australia, Bosnia and Herzegovina, Canada, Turkey, and Singapore. • Topics explored how good measurement practice and principles could foster confidence in research findings and how to manage the challenges of increasing volume of data in both industry and research. Key words: confidence; replicability; uncertainty. Accepted: September 5, 2019 Published: September 18, 2019 https://doi.org/10.6028/jres.124.024 1. Motivation and Scope Much has been written in the press recently suggesting that there is a “reproducibility crisis” in scientific research. This stems from well-publicized papers such as those by Brian Nosek et al.
    [Show full text]
  • Metascience 2019 Symposium Program
    DAY 4 | SUNDAY, SEPTEMBER 8th, 2019 GENERAL INFORMATION PROGRAM 6:30 – 7:30 AM Breakfast (Reception Room, Sheraton Palo Alto) **For hosted attendees only, registration required** 8:00 – 9:15 AM FUNDER PANEL: Review and Future Directions Moderator: Brian Nosek Center for Open Science, USA Panelists: Chonnettia Jones Wellcome Trust, UK Dawid Potgieter Templeton World Charity Foundation, BHS Arthur “Skip” Lupia National Science Foundation, USA COFFEE BREAK 9:45 – 11:00 AM PANEL DISCUSSION: Reflections on metascience topics and findings Moderator: Jon Krosnick Stanford University, USA Panelists: Jon Yewdell NIAID/DIR, USA Lisa Feldman Barrett Northeastern University, USA Kathleen Vohs University of Minnesota, USA Norbert Schwarz University of Southern California, USA BREAK 11:15 – 12:30 PM PANEL DISCUSSION: Journalists’ perspective on metascience and engagement with the broader public Moderator: Leif Nelson University of California, USA Panelists: Ivan Oransky Retraction Watch, USA Christie Aschwanden Emerging Form, USA Richard Harris National Public Radio, USA Stephanie M. Lee BuzzFeed News, USA LUNCH BREAK (CENTENNIAL LAWN) ADDRESS TAXI/UBER/LYFT Cubberley Auditorium | Use the following address: 1:30 PM UNCONFERENCE (Centennial Lawn) School of Education | 615 Escondido Road, Stanford, Breakouts, Open Space for Collaboration Stanford University CA 94305 **Beverages & Snacks provided** 485 Lasuen Mall Stanford, CA 94305 Walking to Cubberly Auditorium from Taxi/Uber/Lyft drop-off: It is PARKING a 10-15 minute walk to Cubberley Complimentary Conference Auditorium. Please allow yourself Parking is available plenty of time for a stroll through in the Galvez Lot. the beautiful Stanford Campus! Follow the Metascience signs to Walking to Cubberly Auditorium Cubberley Auditorium. from Galvez Lot: This lot is a 15-20 minute walk from the Cubberley CONTACT Auditorium.
    [Show full text]