ACRL Publications in Librarianship Open Peer Review Monograph title: Stories of Open: Opening Peer Review through Narrative Inquiry Author: Emily Ford Review close: Monday, March 23, 2020 Google document available at: https://docs.google.com/document/d/1KFiAhP9hp1hQpWEEdQ4gts4tEaD4uu5G6Yt5YIY5pMk/ edit# Code of Conduct Reviewers agree to: ● provide objective reviews that deliver constructive criticism in a positive and professional manner ● support their recommendations with clearly developed examples or arguments ● focus on substantive comments and suggestions on the content; the book will be professionally copyedited and designed, so formatting, typos, and other grammatical errors will be addressed later in the production process ● look for the following as they review: ○ significance of topic ○ conceptually/theoretically grounded ○ appropriate methodology/research design ○ coherent discussion ○ valid conclusions ○ advancement of knowledge ○ clear, articulate, and well written ● value diversity and inclusion in the review process ● meet all deadlines, or notify the Publications in Librarianship Editor as soon as possible if unable to meet deadlines ● maintain confidentiality of other reviewers’ comments ● recuse themselves from reviewing manuscripts for which they lack expertise, have any undisclosed conflicts of interest, or are unable to meet all deadlines ● consult with the Publications in Librarianship Editor if they have any questions: ○ Daniel Mack, Associate Dean, Collection Strategies and Services, University of Maryland ○ email: [email protected] ○ voice: 301.405.9264 Identifying and Contact Information Please send your name, position, email, and institutional affiliation (if any) with your comments to the Publications in Librarianship editor: Daniel Mack, Associate Dean, Collection Strategies and Services, University of Maryland email: [email protected] voice: 301.405.9264. Stories of Open: Opening Peer Review through Narrative Inquiry Emily Ford Table of Contents Part 1 - Orientation Ch. 1 - A Meta-Story: The Story of Stories of Open Ch. 2 - Discovering Method: Narrative Inquiry Part 2 – The Story Middle Ch. 3 - The Elusive Norm: Peer Review in LIS Ch. 4 - Roles of Peer Review Ch. 5 - Dualities and Multiplicities in Peer Review Ch. 6 - Collaborative Work and Discourse Community Ch. 7 - Transparency of Process Part 3 – Coda Ch. 8 - Storying Stories Ch. 9 - I just feel like this makes sense to me: Stuart’s Story Ch. 10 - The Next Layer of Publishing Transparency: Open Peer Review Ch. 11 - Crafting Future Stories of Openness Part 1: Orientation Ch. 1 - A Meta-Story: The Story of Stories of Open Why this book? “It’s just a process that hasn’t been questioned in forever and it needs to be” said Cheryl as we were sitting in a small study room at a branch of our local public library. The faint smell of cigarettes lingered in the study room from its previous occupant, and muffled giggles and cries of children filtered in as we spoke. I was fooling with my laptop, trying to get pertinent documents in Word to function, despite the corrupted install job that had been completed on my new grant-funded laptop. It didn’t work and I felt flustered. Despite this setback, I was ready to learn from her. What did she have to share of her experience, and what kind of meaning would we create together in this hour and a half? We were talking about peer review. I had asked Cheryl why she wanted to participate in this project as an interviewee. When she said it, I didn’t know that it would be the title of her interpretive story, the document culminating from our conversation, nor did I know that it would be how I opened this book. For years, since my time as a co-founder and editor at In the Library with the Lead Pipe, a peer- reviewed blog turned journal, I have been fascinated by open peer review. Our open peer- review process was something we “invented” as we began the journal, and something that I discovered to be invaluable during that time. Yet over the years I have learned that it’s not widely accepted or understood. Perhaps people fear it because it’s unknown, or simply we have naiveté—we don’t know anything different. We, academic librarians, don’t collectively know it. Few of us have experienced it and most of us don’t understand it. Recently I was catching up on my podcast listening and was delighted to hear Radiolab’s Latif Nasser talking about how he finds stories. “I tell myself that there are 7.5 billion people on planet earth… and if you presume that one percent of those 7.5 billion people have those stories, there’s no way all those stories are getting told…There’s an infinity of stories all around us.”[i] I truly believe that when we open ourselves to others’ experiences, we in turn reflect on our own. We have much to learn about ourselves by listening to others. That is why I’ve approached my work in stories, and that is why stories matter. This book is as much about discovering method and process as it is about sharing the stories in the hopes that it will incite our academic library community to reflect on our own experiences and imagine the possibilities to create new and improved ones. Readers who wish to discover answers to tightly scoped research questions backed by deep dives into academic literature and evidence will be highly disappointed. This book does not do that. Rather its intent is to share collective discoveries and explorations on a theme. It is here to share our colleagues’ stories so that we may reflect on our own, and potentially re-imagine future stories. Open Peer Review While Chapter 10, The Next Layer of Publishing Transparency: Open Peer Review, provides a closer look at open peer review, it remains pertinent to discuss it broadly in this introduction. Just what do we mean by open peer review? Although I and others have attempted to unpack this seemingly simple question, there still doesn’t remain a simple definition or application. Essentially, open peer review is an “opening up” of the peer review process. It could mean that referees sign their reviews for authors to see, such as may occur at BioMed Central journals. “Open peer review as practised by BMC, specifically refers to open identities and open content, i.e. authors know who the reviewers are and if the manuscript is accepted for publication the named reviewer reports accompany the published article.” [ii] I particularly love this framing of open peer review, because it positions the process as a practice, and each person, each community, may practice something in a different way. And this is how it shakes out. Each implementation of open peer review, as I have observed, is different and nuanced. Some implementations allow for the publication of reviewer reports alongside publications, whereas others keep these reviewer reports opaque. Open peer review may also mean that authors have the opportunity to more deeply and meaningfully engage with referees. During the process identities may be open, and the process itself may allow for discourse to occur on collaborative platforms like Google Docs, or using the WordPress Comments Press plugin. In fact, several books in the Digital Humanities have utilized an open peer review process—such as Debates in the Digital Humanities, and Kathleen Fitzpatrick’s recent volume, Generous Thinking—allowing for members of the public to register and provide their own annotations and comments on manuscripts.[iii] One of the nuances in open peer review, as it’s discussed in regards to scholarly communication, is that of the differences between the STEM disciplines and the social sciences, arts, and humanities. Peer review in STEM disciplines is frequently used as a “rigor” checker. Is the method sound? Do the data support the conclusions? Is the study reproducible? Arguably, social sciences, arts, and humanities research is more nuanced, and peer review in these disciplines takes on a slightly different role. As such, it is difficult to define what open peer review could and might do in these different arenas. With peer review being more straightforward in STEM, it makes sense that there are more implementations of and experimentation with it in those disciplines. Just as some view open access as a way to “democratize” scholarly publishing, many see open peer review as affording similar opportunities. With open peer review we can shorten timelines between manuscript submission and publication, hold reviewers accountable for their work, make more apparent the hidden labor of reviewing and editing, allow for collaborative discourse between authors and reviewers, and more. Some of these arguments are deterministic, just as arguments regarding OA being the great democratizer of journal publishing are. In fact, anything open is highly nuanced and contextual. Ultimately, when we discuss “open” we must discuss the stories around it. To what aim? What are the pitfalls? What are the gains? And are we trying to simply replicate a broken system instead of reinvent it? In LIS conversations regarding open peer review are nascent. While In the Library with the Lead Pipe has used an open peer review process since its formation in 2008, there remain few LIS journals implementing an open process.[iv] Journal of Radical Librarianship offers authors the opportunity to opt-in to open peer review.[v] An initial proposal I wrote with my friend and Lead Pipe colleague, Kim Leeder, asking the editorial board of College & Research Libraries to consider open peer review was rejected at ALA Annual 2013. Only recently did C&RL pursue an experiment with open peer review.[vi] With so few opportunities for folks in LIS to experience open peer review, it remains mysterious to us and we have few stories to share. What we do have in our field, as I discovered during my research process, is a curiosity and a desire to better understand open peer review.