The Atlas of Digitised Newspapers and Metadata: Reports from Oceanic Exchanges
Total Page:16
File Type:pdf, Size:1020Kb
THE ATLAS OF DIGITISED NEWSPAPERS AND METADATA: REPORTS FROM OCEANIC EXCHANGES M. H. Beals and Emily Bell with additional contributions by Ryan Cordell, Paul Fyfe, Isabel Galina Russell, Tessa Hauswedell, Clemens Neudecker, Julianne Nyhan, Mila Oiva, Sebastian Padó, Miriam Peña Pimentel, Lara Rose, Hannu Salmi, Melissa Terras, and Lorella Viola and special thanks to Seth Cayley (Gale), Steven Claeyssens (KB), Huibert Crijns (KB), Nicola Frean (NLNZ), Julia Hickie (NLA), Jussi-Pekka Hakkarainen (NLF), Chris Houghton (Gale), Melanie Lovell-Smith (NLNZ), Minna Kaukonen (NLF), Luke McKernan (BL), Chris McPartlanda (NLA), Maaike Napolitano (KB), Tim Sherratt (University of Canberra) and Emerson Vandy (NLNZ) Document: DOI:10.6084/m9.figshare.11560059 Dataset: DOI:10.6084/m9.figshare.11560110 Disclaimer: This project was made possible by funding from Digging into Data, Round Four (HJ-253589). Although we have directly consulted with the various institutions discussed in this report, the final findings, conclusions and recommendations expressed in this publication do not necessarily represent those of the discussed database providers or the contributors’ host institutions. Executive Summary Between 2017 and 2019, Oceanic Exchanges (http://www.oceanicexchanges.org), funded through the Transatlantic Partnership for Social Sciences and Humanities 2016 Digging into Data Challenge (https://diggingintodata.org), brought together leading efforts in computational periodicals research from six countries—Finland, Germany, Mexico, the Netherlands, the United Kingdom, and the United States—to examine patterns of information flow across national and linguistic boundaries. Over the past thirty years, national libraries, universities and commercial publishers around the world have made available hundreds of millions of pages of historical newspapers through mass digitisation and currently release over one million new pages per month worldwide. These have become vital resources not only for academics but for journalists, politicians, schools, and the general public. However, these digitisation programmes share a critical weakness: the very creation of national newspapers collections obscures the fact that international news exchange was central to the nineteenth-century press. The Atlas of Digitised Newspapers and Metadata is an open access guide to digitised newspapers around the world. Its initial selection is limited in scope, being comprised of the ten databases (including the aggregator Europeana) for which we were able to secure access and licensing to the machine-readable data. Nonetheless, it aims to form the foundation of a wider mapping of collections beyond its current North Atlantic and Anglophone-Pacific focus. It brings together their histories and digitisation choices with a deeper look at the language of the digitised newspaper, the evolution of newspaper terminology and the variety of metadata available in these collections. It explores how machine-readable information about an issue, volume, page, and author is stored in the digital file alongside the raw content or text, and provides a controlled vocabulary designed to be used across disciplines, within academia and beyond. This report draws upon multiple taxonomies: our own open access dataset (doi:10.6084/m9.figshare.11560110), which provides a full catalogue of metadata fields across the collections, academic and industry discussions of the newspaper as a journalistic form and historical artefact, digitisation guidelines and strategies, library websites, annual reports, interviews with librarians and digitisation providers and the data files themselves. The maps of this Atlas explore each of our overarching categories in detail, providing a selection of language variants, the technical definition we employed in the categorisation process, and notes on its usage across the collections and in the wider world of press history. This allows a greater understanding of how the term is currently being used in different ways by different groups and allows researchers to navigate to the specific type of information they required and ascertain its availability across these collections. Each entry also includes technical information for obtaining this data across the collections, including data types, which often vary considerably, and XPaths for locating the information within that dataset. With this information, researchers should be able to understand the different structures of these collections and develop computational means for robustly comparing datasets to explore deeper and more meaningful research. After using the Atlas, we hope that readers will begin to understand the great wealth of metadata available for digitised newspapers, much of which is comparable across collections, nation and languages. As we explored these collections, we found a sincere effort on the part of librarians, scholars and commercial providers to converge upon a knowledge system that allowed meaningful enquiry and reflected a consistent layer (if not a complete reproduction) of these historical artefacts. However, this seeming convergence does mask important outliers and divergent interpretations of key bibliographic and conceptual categories— divergences that we hope these maps will highlight and encourage future digitisers to consider when building or expanding their databases. In sum, the rise of digitisation promises great opportunities for those who wish to engage with newspaper archives, but as with all historical archives, digital collections require researchers to be mindful of their shape, provenance and structure before any conclusion can be drawn. It is the responsibility of both digitiser and researcher to understand both the map and also the terrain. 2 Table of Contents Executive Summary ............................................................................................................................................. 2 Table of Contents ................................................................................................................................................ 3 List of Abbreviations ............................................................................................................................................ 4 Introduction ......................................................................................................................................................... 6 The Project....................................................................................................................................................... 6 Aims and Objectives ........................................................................................................................................ 7 Methodology ................................................................................................................................................... 7 Database Histories ......................................................................................................................................... 10 Metadata Maps ............................................................................................................................................. 11 Suggested Citation ......................................................................................................................................... 11 Database Histories ............................................................................................................................................. 12 British Library 19th Century Newspapers...................................................................................................... 13 Chronicling America ...................................................................................................................................... 18 Delpher .......................................................................................................................................................... 22 Europeana Newspapers................................................................................................................................. 26 Hemeroteca Nacional Digital de México ....................................................................................................... 29 Papers Past .................................................................................................................................................... 32 Suomen Kansalliskirjaston digitoidut sanomalehdet .................................................................................... 36 Times Digital Archive ..................................................................................................................................... 40 Trove .............................................................................................................................................................. 44 ZEFYS.............................................................................................................................................................. 49 Metadata Mappings .......................................................................................................................................... 52 Content Data ................................................................................................................................................. 54 Citation Metadata ........................................................................................................................................