Contexts and Contributions: Building the Distributed Library Martha L. Brogan Digital Library Federation Washington, D.C. 2006 First Digital Library Federation electronic edition, September 2008 Some rights reserved. Published by the Digital Library Federation Originally published in trade paperback in the United States by the Digital Library Federation, Washington, D.C., 2006 This edition licensed under the Creative Commons Attribution-Noncommercial 3.0 Unported License <http://creativecommons.org/licenses/by-nc/3.0/> The moral rights of the author have been asserted Digital Library Federation ISBN-13: 978-1-933645-32-2 www.diglib.org TABLE OF CONTENTS About the Author Acknowledgments Preface Part I: INTRODUCTION 1.0 Laying the Foundation 1.1 Aim, Scope, and Methodology 1.2 Overview of 2003 Findings 1.3 Catching‐up and Staying Current: A Review of the Literature 1.4 Problem Spaces Part II: CONTEXTS 2.0 Scholarly Information Environment 2006 2.1 Cyberinfrastructure (CI) Articulation 2.1.1 Convergence Across Higher Education Service Domains 2.1.2 Discipline‐based Landscape Analysis 2.2 Open Access Ascendant – Growth of OAI‐compliant Repositories 2.2.1 Enabling OA Technology Platforms 2.2.2 OAI Demographics 2006 2.3 “The ‘Amazoogle’ Effect” 2.3.1 What Recent User Studies Reveal 2.3.2 Creating User‐focused Services Part III: CONTRIBUTIONS 3.0 Next Generation OAI 3.1 Building the Distributed Library 3.1.1 Components of DLF’s Grant‐related Work 3.1.2 The Case for Sharing Metadata and Improving Its Quality 3.1.3 DLF 2006 Survey Responses about Metadata 3.2 Digital Library Services Registries 4.0 Review of Resources 4.1 Points of Reference: Open Access and the Open Archives Initiative 4.1.1 University of Illinois OAI‐PMH Data Provider Registry 4.1.2 DOAJ: Directory of Open Access Journals 4.1.3 Directories of Journal and Publisher Copyright and Self‐ archiving Policies 4.1.4 ROAR: Registry of Open Access Repositories 4.1.5 OpenDOAR: Directory of Open Access Repositories 4.1.6 Arc: Cross Archive Search Service 4.1.7 OAIster 4.1.8 Consortial Portals: CIC Metadata Portal, DLF Portal, DLF MODS Portal 4.1.9 Germany: OA and OAI Access Points 4.1.10 Current Issues and Future Directions 4.2 Links in the Scholarly Communication Value Chain 4.2.1 arXiv 4.2.2 NTRS: NASA Technical Reports Server 4.2.3 PubMed Central 4.2.4 CDS: CERN Document Server 4.2.5 OLAC: Open Language Archives Community 4.2.6 Electronic Theses and Dissertations (ETDs) 4.2.6.1 Scirus ETD Search Engine 4.2.7 Grainger Engineering Library OAI Aggregation (UIUC) 4.2.8 PerX: Pilot Engineering Repository Xsearch 4.2.9 CiteSeer 4.2.10 Citebase 4.2.11 Current Issues and Future Directions 4.3 Pathways to E‐Learning in Science and Beyond 4.3.1 NSDL: National Science Digital Library 4.3.2 SMETE: Science, Mathematics, Engineering and Technology Education Digital Library 4.3.2.1 NEEDS: National Engineering Education Delivery System 4.3.3 BioSciEdNet (BEN) Collaborative 4.3.4 DLESE: Digital Library for Earth System Education 4.3.5 MERLOT: Multimedia Educational Resource for Learning and Online Teaching 4.3.6 Current Issues and Future Directions 4.4 Joining Forces: Cultural Heritage and Humanities Scholarship 4.4.1 Cornucopia 4.4.2 IMLS Digital Collections & Content (DCC) 4.4.3 DLF Collections Registry 4.4.4 American Memory and Other OAI Collections at the Library of Congress 4.4.5 Sheet Music Consortium (SMC) 4.4.6 Heritage West 4.4.7 The American West 4.4.8 DLF Aquifer 4.4.9 SouthComb 4.4.10 Perseus Digital Library 4.4.11 NINES: Networked Interface for Nineteenth‐Century Scholarship 4.4.12 Current Issues and Future Directions 4.5 User Alchemy: Discover, Deliver, Divine 4.5.1 Scirus 4.5.2 INFOMINE 4.5.3 Intute (formerly RDN—Resource Discovery Network) 4.5.4 California Digital Library (CDL) Metasearch Initiative 4.5.5 Current Issues and Future Directions 5.0 Conclusion 5.1 Comparison of 2003 and 2006 Baseline Features 5.1.1 Organizational Model 5.1.2 Subject Coverage 5.1.3 Function 5.1.4 Audience 5.1.5 Status 5.1.6 Size 5.1.7 Use 5.2 An Embarrassment of Glitches 5.3 Updates: 2003 Issues and Future Directions 5.3.1 Registries, Metadata, and Placing Objects in Context 5.3.2 Users and Uses 5.3.3 Managing Digital Rights and Digital Content Preservation 5.3.4 Building Personal Libraries and Collaborative Workspaces 5.3.5 Putting Digital Libraries in the Classroom and Digital Objects in the Curriculum 5.3.6 Promoting Excellence 5.4 The Pulse in 2006 5.4.1 Acceptance of OAI‐PMH and Growth in Adoption 5.4.2 Interoperability in an International Framework 5.4.3 Sustainability and Funding—Ubiquitous Concerns 5.4.4 Next Generation Service Characteristics References Appendices 1 Survey Respondents and Contacts 2 Other Specialists and Projects Consulted 3 2003 Services Excluded in 2006 4 Comparison of Top Twenty OAIster and ROAR Archives About the Author Martha L. Brogan is the author of two previous studies commissioned by the Digital Library Federation and the Council on Library and Information Resources: A Survey of Digital Library Aggregation Services (DLF, 2003) http://www.diglib.org/pubs/brogan/ A Kaleidoscope of Digital American Literature (DLF and CLIR, 2005). http://www.diglib.org/pubs/brogan0505/ Ms. Brogan is an independent library consultant with two decades of experience in research libraries at the University of Minnesota, Yale University, and Indiana University, where she served as associate dean and director of collection development from 1998 to 2003. She currently holds an appointment on CLIR’s Scholarly Communications Advisory Committee. In 2001 Ms. Brogan participated as a fellow in the Frye Leadership Institute sponsored by CLIR, Educause, and Emory University. Acknowledgments In writing this report, I am indebted to many principal investigators, researchers, and scholars who are affiliated with the constellation of aggregation services under review. They generously responded to the online survey conducted by the Digital Library Federation in fall 2005 and continued to provide feedback about their services as the report evolved. Their names and project affiliations appear in Appendix 1, along with my heartfelt thanks. Carol Minton Morris and John Saylor deserve special mention for helping me negotiate my way through the National Science Digital Library. Thomas Habing, Martin Halbert, Elizabeth Milewicz, Katherine Skinner, and Katherine Kott all provided useful critiques and helped to improve the report. Kat Hagedorn repeatedly went above and beyond the call of duty in responding to my inquiries not only about OAIster but also more generally about OAI service provider issues. Too numerous to cite individually here, are the many other specialists who willingly shared their expertise with me. Their names are listed with gratitude in Appendix 2. In the early stages of developing this report, I benefited from the advice of David Stern, Donald Waters, and Gary Wiggins. Finally, Barrie Howard was swift to offer assistance from the good offices of the Digital Library Federation during the nine‐month period while I was working on this report. David Seaman was unfailing in his support and patience. Preface Martha L. Brogan’s Contexts and Contributions: Building the Distributed Library is a major contribution to the Digital Library Federation’s (DLF) suite of work that focuses on the Open Archives Initiative Protocol for Metadata Harvesting (OAI-PMH). With generous funding from the Institute of Museum and Library Services, DLF has harnessed deep OAI expertise from the University of Michigan, the University of Illinois at Urbana-Champaign, and Emory University to prototype “next-generation” OAI services informed by advisory panels of scholars and technical experts; to build registries of providers to aid in the creation of new OAI-based services; and to formulate best practices for sharable metadata that focus what we have learned collectively for innovative library services. The best practices work has received intellectual and practical support from our colleagues at the National Science Digital Library (NSDL), a service of the National Science Foundation (NSF). Contexts and Contributions had its starting point in a 2003 survey of digital library aggregation services compiled by Martha Brogan for DLF: A Survey of Digital Library Aggregation Services < http://www.diglib.org/pubs/brogan/>. This environmental scan was influential in the understanding of our early attempts to craft aggregated digital library services that served students and scholars well, and it had a very positive impact on the development of the services that followed. The current work is more difficult because the environment is maturing, and changing rapidly. Its value and timeliness is increased because of that, and I am proud that DLF can sponsor such a detailed evaluation of a shifting, but critically important landscape. Martha Brogan’s current study draws our attention to “major developments affecting the ecosystem of scholarly communications and digital libraries” and gives us all a rich comparative analysis of digital library aggregation services, including a clear-sighted view of—in Martha’s words— “the obstacles requiring further attention to realize … an open, distributed digital library.” The Digital Library Federation is delighted to acknowledge our funders and expert partners in this important work. We are pleased to have another opportunity to underscore our commitment to those standards, tools, and technologies that allow us to build innovative services that scholars and students need to produce richer teaching, learning, and scholarship. David Seaman Executive Director Digital Library Federation October 2006 PART I: INTRODUCTION 1.0 Laying the Foundation Since its founding ten years ago, the Digital Library Federation (DLF) aims to advance the goal of deep sharing of academic digital resources and services.