Local Web Archiving for the Uninitiated Public Library: the Community Webs Program

Total Page:16

File Type:pdf, Size:1020Kb

Local Web Archiving for the Uninitiated Public Library: the Community Webs Program Local Web Archiving for the Uninitiated Public Library: The Community Webs Project Presenters: Kyrie Whitsett – The Internet Archive Jacquelyn Oshman - New Brunswick Free Public Library, New Jersey Emilirose Rasmusson – Marshall-Lyon County Library, Minnesota What is Web Archiving? Web Archiving is the process of evaluating, selecting, collecting, cataloging, providing access to, and preserving digital materials for researchers today and in the future. Source: Library of Congress https://www.loc.gov/webarchiving/ The Internet is really, really big. We can’t archive it all. Local libraries preserving local history LibTech 2019|Saint Paul, MN|#communitywebs > Non-profit Digital Library & Archive founded in 1996 > HQ a former church and it’s awesome (and please visit!) > Extensive open-source technology development for archiving/preservation > Archive-It > Web Archiving Service since 2006 > 625 Organizational Users > Web-based application > Includes training and support Web Archiving in Public Libraries 2015 NDSA Survey results: 2% from Public Libraries Many public libraries have long histories of collecting analog materials documenting their region. What happens now that these are now increasingly published exclusively online? Web Archiving in Public Libraries Perceived roadblocks > Lack of funding or institutional buy -in > Lack of training resources > Staff time requirements > Technical requirements Applicants 110 applications A cohort of 28 from public libraries small, medium, and across the country large public libraries 15 IMLS 13 IA Participants Participants Participants ★ Athens Regional Library System (GA) ★ Denver Public Library (CO) ★ Birmingham Public Library (AL) ★ Metropolitan Library System (OK) ★ Brooklyn Public Library (NY) ★ New Brunswick Free Public Library (NJ) ★ Buffalo & Erie County Public Library (NY) ★ Patagonia Library (AZ) ★ Cleveland Public Library (OH) ★ Pollard Memorial Library (MA) ★ Columbus Metropolitan Library (OH) ★ Queens Public Library (NY) ★ DC Public Library (DC) ★ San Diego Public Library (CA) ★ East Baton Rouge Parish Library (LA) ★ San Francisco Public Library (CA) ★ Forbes Library (MA) ★ Schomburg Center for Research in Black Culture, ★ Grand Rapids Public Library (MI) New York Public Library (NY) ★ Henderson District Public Libraries (NV) ★ Sonoma County Library (CA) ★ Kansas City Public Library (MO) ★ The Urbana Free Library (IL) ★ Lawrence Public Library (KS) ★ West Hartford Public Library (CT) ★ County of Los Angeles Public Library (CA) ★ Westborough Public Library (MA) ★ Marshall Lyon County Library (MN) Community Webs Program > IMLS LB21 grant, National Digital Platform > Community Webs: Empowering Public Librarians to Create Community History Web Archives > Two-year project (June 2017 - May 2019) > Three library “leads” Community Webs Goals Education & Training ➔ Establish a cohort network ➔ Professional development activities Collection Development ➔ Create training materials on community memory web archiving (communitywebs.archive-it.org) ➔ Seed innovative local programing and partnerships Expanding National Capacity ➔ Provide web archiving services and infrastructure and ongoing storage and access Community Webs Program Cohort Activities ➔ Build web archive collections ➔ Local programs and partnerships ➔ In-person and online training Participants Receive ➔ Web archiving services ➔ Stipends for events, conferences, professional development Program Outcomes ➔ Cohort of public library leaders with expertise in born-digital local history collecting ➔ ~15TB per year in born-digital local community archives https://communitywebs.archive-it.org/ > Started in 2016 to document massive floods and police shootings > Developed into a more formal program with a collection development policy > Working with community artists to identify content > “Digital companion to physical vertical file” Sonoma County Library > Developed out of an immediate need to capture content related to the North Bay Fires of 2017 > Involved community members from the local cultural heritage community > Social media, blogs, official & community response to the crises Project Themes > Think creatively about what collections are, can be, and how they relate to existing practices or start new ones > Focus on at-risk content liable to disappear quickly > Involvement of subject experts and community members in collecting and public programming > Collaboration is key! Project Outcomes > 2017: 13% PLs! > Numerous additional PLs now exploring/doing WA > Expanded diversity of org, prof, and collection types > 10s of TBs of local history web resources preserved > Public/professional events and outreach > Training material & OERs THANK YOU! Kyrie Whitsett [email protected] The technical side ... Intro to Web Archiving - https://communitywebs.archive-it.org/web-archive.html Archive-It User Guide - https://support.archive-it.org/hc/en-us/categories/201179946- Archive-It-User-Guide Terminology Collection - A group of Seed URLs curated around a common theme, topic, or domain. Seed - The starting point URL for a crawler and access point to archived collections. Crawl - A web archiving (or "capture") operation that is conducted by an automated agent, called a crawler, a robot, or a spider. Test Crawl - A crawl that isn’t automatically saved long-term. Crawler Trap - Part of a site that can generate an infinite number of (often invalid) URLs. Scope - What the crawler will capture and what it won’t - can be expanded or limited Robots.txt - Files that a site owner can add to their site to keep crawlers from accessing all or parts of it. Patch Crawl - A crawl to capture and patch in documents that may have been missing from your original crawl. https://support.archive-it.org/hc/en-us/articles/208111686-Glossary-of-Archive-It-and-Web-Archiving-Terms Challenges in Web Archiving Logistics ● Getting Administration on board ○ Explaining what web archiving is and its importance ● Collection policies for web archives ● Permission to crawl ○ Ethical, legal considerations ● Community involvement ● Dedicating time for maintenance & evaluation https://communitywebs.archive-it.org/curriculum.html Technical Challenges Sometimes the crawler doesn’t or can't do what you want it to ... Tips and Tricks ● ALWAYS test crawl first … ● Check in frequently ● With pages that pull in a lot of data, decide what you need and how often ● Add one-page crawls for pages that might create crawler traps ● Check the help files for recommendations for types of sites: ○ https://support.archive-it.org/hc/en-us/articles/208001336-Scoping-guidance-for-specific-types- of-sites ● Download your collection’s metadata to edit it ○ https://support.archive-it.org/hc/en-us/articles/208012996-Upload-and-download-metadata ● You can upload warc/arc files from other crawls or crawlers ○ https://support.archive-it.org/hc/en-us/articles/360000651246-Integrate-external-WARC-ARC- files-into-Archive-It-collections ● When in doubt, ask for help! How do I get involved with Web Archiving? ● “Archive-It is a subscription service of the Internet Archive. Subscriptions to AIT are paid annually and amounts vary depending on scope of collecting a new partner is looking to do. Our smallest account level is 3K/year, however we are somewhat flexible with pricing for smaller institutions who want to start WA programs so anyone interested should reach out!” - Maria Praetzellis ● Manually add URLs to the Wayback Machine ● Web Recorder New Brunswick Free Public Library City Statistics: •2016 Census-estimated population of 56,910 •Middlesex County Seat •Home of Rutgers University, Johnson and Johnson World HQ, Bristol- Meyers Squibb, Robert Wood Johnson and St. Peters Medical Centers •Racial breakup: –Hispanic 49.93%; White 45.43%; African American 16.04% –Spanish and Hungarian languages prominent What we are saving: EVERYTHING WE CAN THINK OF! •Websites –Non-profit organizations –Churches –City Government –City specific English and Spanish newspapers –History Related sites –New Brunswick Development Corporation (and related articles) •Instagram Pages – Library –Windows of Understanding project •Facebook Pages –African American Fireman’s Association –Spanish Community organizations that don’t have websites •Blogs –Local Historian/Architect •Podcast –WCTC AM radio show “New Brunswick Speaks” Policy Tracking Usage with Analytics Marshall-Lyon County Library Local statistics - City of Marshall, Minnesota - Population: 13,616 - One university, several manufacturing and food processing plants - County seat of Lyon County, MN - Lyon County, Minnesota - Southwestern area of Minnesota - Population: 25,857 - Predominately white (estimated 88%), but with growing international immigrant populations, esp. those with with refugee status. - Spanish, Somali, Hmong, and Karen - Marshall-Lyon County Library - Part of the (federated) Plum Creek Library System - Approx 20 employees, mostly part-time, across 3 branches Time for Questions Helpful & Related Links Community Webs - https://communitywebs.archive-it.org/ Community Webs curriculum - https://communitywebs.archive-it.org/curriculum.html Internet Archive - https://archive.org/ Archive-It - https://archive-it.org/ Archive-It help files - https://support.archive-it.org/ East Baton Rouge Parish Library collections - https://archive- it.org/organizations/1153 New Brunswick Free Public Library collections - https://archive- it.org/organizations/1326 Marshall-Lyon County Library collections - https://archive-it.org/organizations/1327.
Recommended publications
  • Public Libraries, Archives and Museums: Trends in Collaboration and Cooperation
    International Federation of Library Associations and Institutions IFLA Professional Reports, No. 108 108 Public Libraries, Archives and Museums: Trends in Collaboration and Cooperation Alexandra Yarrow, Barbara Clubb and Jennifer-Lynn Draper for the Public Libraries Section Standing Committee Copyright 2008 International Federation of Library Associations and Institutions Public Libraries, Archives and Museums: Trends in Collaboration and Cooperation / Alexandra Yarrow, Barbara Clubb and Jennifer-Lynn Draper. The Hague, IFLA Headquarters, 2008. – 50p. 30 cm. – (IFLA Professional Reports: 108) ISBN 978-90-77897-28-7 ISSN 0168-1931 Table of Contents Executive Summary 4 Introduction: Why Collaborate and Cooperate? 5 Project Proposal 6 Research Methods 7 Literature Review 8 Collaborative Programming Community and Heritage Programs 10 Museum/Art Pass Programs 13 Collaborative Electronic Resources Global Initiatives 16 Continental Initiatives 16 National Initiatives 17 Regional and Local Initiatives 20 Joint-use/Integrated Facilities Minimal Integration 25 Selective Integration 27 Full Integration 28 Guide to Collaboration Best Practices 31 A Successful Collaboration, from Start to Finish 32 Creating Collaborative Electronic Resources: Special Considerations 34 Benefits and Risks of Collaboration 35 Risk Management Strategies 36 Conclusion 37 Contributors 38 Acknowledgements 39 Works Consulted 41 1 Executive Summary This report examines the recent trends in collaboration and cooperation between public libraries, archives and museums. In many cases, the shared or similar missions of the institutions reviewed make them ideal partners in collaborative ventures. Different types of collaborative projects are examined, including exhibits, community programs, digital resources and joint-use facilities. Examples come from Canada, the United States and the United Kingdom (UK), as well as from Russia, Denmark, Norway, Sweden, Germany, Italy, Spain, South Africa, Australia and New Zealand.
    [Show full text]
  • Entire Public Libraries Directory In
    October 2021 Directory Local Touch Global Reach https://directory.sailor.lib.md.us/pdf/ Maryland Public Library Directory Table of Contents Allegany County Library System........................................................................................................................1/105 Anne Arundel County Public Library................................................................................................................5/105 Baltimore County Public Library.....................................................................................................................11/105 Calvert Library...................................................................................................................................................17/105 Caroline County Public Library.......................................................................................................................21/105 Carroll County Public Library.........................................................................................................................23/105 Cecil County Public Library.............................................................................................................................27/105 Charles County Public Library.........................................................................................................................31/105 Dorchester County Public Library...................................................................................................................35/105 Eastern
    [Show full text]
  • White Awards Over $18 Million in Public Library Per Capita and Equalization Aid Grants
    For Immediate Release: August 20, 2021 White Awards Over $18 Million in Public Library Per Capita and Equalization Aid Grants Secretary of State and State Librarian Jesse White has awarded FY21 Illinois Public Library Per Capita and Equalization Aid Grants totaling $18.1 million to 638 public libraries serving almost 12 million patrons. “Public Act 102-0039 allowed my office to award these grants at $1.475 per capita, an increase from the previous rate of $1.25,” White said. “I am extremely proud of the outstanding service Illinois’ public libraries provide to all residents. I truly believe libraries are cornerstones of our communities, and I am pleased to provide this increased funding to help them serve the public.” Some of the valuable services public libraries provide with grant money include the following: • Large print material for aging patrons • Books, magazines, newspapers, CDs and DVDs • Audiobooks and eBooks • Home visit book delivery service • New computers, iPads and printers • Spanish and dual language materials • Expanded access to online resources • Adult programming • Newsletters, postcards and other promotional materials Per Capita Grant funding is authorized under Illinois library law for public libraries, which allows resources for expenses such as materials, personnel, equipment, electronic access, telecommunications and technology. Equalization Aid Grants help qualifying public libraries with a low library tax base ensure a minimum level of funding for library services. Information concerning the grant programs can
    [Show full text]
  • Archival Selection Criteria
    Edinburgh University Library EDINBURGH UNIVERSITY ARCHIVES Archival Selection Criteria General Background This document provides some basic guidance on how to identify records holding potential archival value. As mentioned in section 4d of “Developing a retention schedule” you must decide whether any of your records have long-term research value for historical or other purposes. If so, and if the University Archivist agrees, the records can be designated part of the University’s official archives. Much of the guidance contained in “Developing a Retention Schedule” is also relevant to the archival selection process. Discovering what records you have, identifying duplicated or related records, determining legal requirements and deciding how long to keep the records may already have isolated the core of potential archives from your area of work. By applying some basic archival selection criteria you should be able to define the archive still more clearly, either by reducing or adding to your list of what may need to be preserved permanently as the unique archives of the University. Aims Probably less than five per cent of records generated by the University need to be preserved permanently as archives. The archival process therefore aims to preserve only a small selection of records. These will reflect and provide the essential evidence of the University’s most significant functions and activities, and will also serve legitimate research needs either on the part of the University itself or the wider academic and public user community. The surviving archives should show what the University has done and why, how it was organised and operated, and its effect on the wider community.
    [Show full text]
  • Brookings Public Library Policy Manual
    Brookings Public Library Policy Manual Continuously Reviewed and Approved by Brookings Public Library Board of Trustees BROOKINGS PUBLIC LIBRARY MISSION STATEMENT The Brookings Public Library will provide materials and information contributing to the education, recreation and quality of life for the community. The Brookings Public Library offers the same quality of service to all regardless of race, color, creed, national origin, educational background, disability, age, sex, or sexual orientation or gender identity or any other criteria. BROOKINGS PUBLIC LIBRARY BOARD OF TRUSTEE BYLAWS ARTICLE I - Name This organization shall be called "The Board of Trustees of the Brookings Public Library" existing by virtue of the provisions of Chapter 14-2 of the South Dakota Codified Laws, 1975 revision and 1977 supplement, and exercising the powers and authority and assuming the responsibilities delegated to it under the said statute. ARTICLE II – Appointment of Trustees Section 2.03 of the Brookings City Charter requires that the Mayor shall appoint with the advice and consent of the City Council the members of citizen advisory boards, committees and commissions including the BPL Board of Trustees.1 A majority of the members shall be residents of the City. Members shall have a current library card in good standing. The City Clerk will post the call for BPL Board of Trustee applications and contact incumbents whose terms are expiring and inquire if they wish to be considered for reappointment. Normally only those who have filed applications will be considered for appointment. Trustees are encouraged to suggest that potential Board members apply. A book of filed applications is maintained by the City Clerk and will be available for review by the public.
    [Show full text]
  • The Role of Archival and Manuscript Research in the Investigation of Translator Decision-Making
    This is a repository copy of The role of archival and manuscript research in the investigation of translator decision-making. White Rose Research Online URL for this paper: http://eprints.whiterose.ac.uk/84758/ Version: Accepted Version Article: Munday, J (2013) The role of archival and manuscript research in the investigation of translator decision-making. Target, 25 (1). 125 - 139. ISSN 0924-1884 https://doi.org/10.1075/target.25.1.10mun Reuse Unless indicated otherwise, fulltext items are protected by copyright with all rights reserved. The copyright exception in section 29 of the Copyright, Designs and Patents Act 1988 allows the making of a single copy solely for the purpose of non-commercial research or private study within the limits of fair dealing. The publisher or other rights-holder may allow further reproduction and re-use of this version - refer to the White Rose Research Online record for this item. Where records identify the publisher as the copyright holder, users can verify any specific terms of use on the publisher’s website. Takedown If you consider content in White Rose Research Online to be in breach of UK law, please notify us by emailing [email protected] including the URL of the record and the reason for the withdrawal request. [email protected] https://eprints.whiterose.ac.uk/ The role of archival and manuscript research in the investigation of translator decision-making Jeremy Munday, University of Leeds, UK Abstract This paper discusses the application of research methodologies from history and literary studies to the analysis of the translation process.
    [Show full text]
  • Who Runs the Library?
    Who Runs the Library? The mission of most public libraries is to support the educational, recreational, and informational needs of the community. Everyone is welcome at the library, from the preschooler checking out his or her first book to the hobbyist looking for a 2 favorite magazine to the middle-aged breadwinner continuing her education by taking a class over the Internet. Providing a large number of services to meet the needs of a diverse population In This Trustee Essential requires a large supporting cast including trustees, the library director and staff, Responsibilities of the and representatives of the municipal government. When all members of the team library board know their responsibility and carry out their particular tasks, the library can run like a well-oiled machine. When one of the players attempts to take on the job of Responsibilities of the another, friction may cause a breakdown. library director The division of labor Responsibilities of the Library Board between the library director and the board The separate roles and responsibilities of each member of the team are spelled out in Wisconsin Statutes under Section 43.58, which is titled “Powers and Duties.” Responsibilities of the The primary responsibilities of trustees assigned here include: municipal government Exclusive control of all library expenditures. Purchasing of a library site and the erection of the library building when authorized. Exclusive control of all lands, buildings, money, and property acquired or leased by the municipality for library purposes. Supervising the administration of the library and appointing a librarian. Prescribing the duties and compensation of all library employees.
    [Show full text]
  • The Discursive Construction of Archival Science: Conceptual Foundations of a Discipline in Construction
    Thiago Henrique Bragato Barros and João Batista Ernesto de Moraes. 2011. The discursive construction of archival science: Conceptual foundations. In Smiraglia, Richard P., ed. Proceedings from North American Symposium on Knowledge Organization, Vol. 3. Toronto, Canada, pp. 196-206. Thiago Henrique Bragato Barros ([email protected]) and João Batista Ernesto de Moraes ([email protected]) Universidade Estadual Paulista, Marília SP Brazil The Discursive Construction of Archival Science: Conceptual Foundations of a Discipline in Construction Abstract: This work outlines a theoretical background established in Archival Science based mainly on discourse analysis as a key discipline to understand which the differences are and points of concep- tual commonality in the area. Uses the French Discourse Analysis as a principle with a theoretical and methodological framework to typify the archive as a discursive practice defined by their historical aspects of its institutional junctures. The study of discourse helps to understand how certain linguistic formations construct the discourse, concerned mainly with the context in which the text was pro- duced. This analysis take place from manuals and treatises of Archival Science produced during the development of discipline and regarded as grounds for discipline. We analyzed the Manual of an Arc- hival Arrangement and Description (vor Handleiding van het ordenen in bescheijven archieven) of Muller, Feith, and Fruin (Ed.1 1898). Another work considered is the Manual of Archive Administra- tion Including the Problems of War Archives and Archive a Making (1 Ed. 1922) and some of late works of Sir Hillary Jenkinson and finally analyzed the work of Theodore R. Schellenberg some as- pects of his vast bibliography.
    [Show full text]
  • A 2020 Vision and Plan for Library Service in New York State
    Creating the Future: A 2020 Vision and Plan for Library Service in New York State Recommendations of the New York State Regents Advisory Council on Libraries to the New York State Board of Regents Albany, New York Table of Contents Executive Summary Page 1 Introduction Page 3 Purpose Page 3 Libraries - An Investment in Our Future Page 4 School Libraries Page 7 Academic and Research Libraries Page 9 Public Libraries Page 10 Special Libraries Page 12 New York State Library Systems Page 13 State Library/SED/Board of Regents Page 15 Technology and the Information Marketplace Page 17 Sustaining our Libraries Page 18 Regents Advisory Council Members Page 19 Creating the Future: A 2020 Vision and Plan for Library Service in New York State Executive Summary The Regents Advisory Council Vision 2020 Plan presents strategic directions for New York’s libraries and library systems. Developed in partnership with the state’s library community, the Vision 2020 Plan affirms the ongoing value of libraries and provides a clear vision of what excellent libraries should look like. The Plan offers models of success that may be emulated by libraries throughout New York, and makes 60 inter-related strategic recommendations for libraries, library systems, the New York State Library, and the Board of Regents. Several essential themes run through the Vision 2020 Plan. Foremost, there is a recognition that the state’s 7000 libraries matter very much to the people of New York: libraries represent communities and they empower individuals. Libraries are adapting very quickly to ever-changing technology, and have continued to employ both traditional and contemporary methods to sustain their institutional commitment to several core values shared by all types of libraries.
    [Show full text]
  • Borrow Free Audiobooks, Ebooks & Videos from the Library
    Borrow Free Audiobooks, eBooks & Videos from the Library What is Library2Go? Library2Go is a free online service that allows you to borrow digital audiobooks, eBooks and videos for use on your home computer and/or portable device, such as an eBook reader, tablet, MP3 player or smart phone. There are currently over 500,000 titles to choose from in Library2Go, and that number continues to grow as more popular titles are added. To use Library2Go you need: A valid library card A personal computer with internet access and free soft- ware you can download from Library2Go AND/OR A device like an e-reader or MP3 player Perks of Using Library2Go It’s absolutely free. There are never any overdue fees! You can check out library materials from home on your computer or on the go using a mobile device. You can check out up to six items at a time on any library card. Revised Jan 2015 Getting Started Go to www.maclibrary.org. Click Digital. Scroll down to Library2Go. If you are using Library2Go on your computer, click the Help but- ton, then the Applications link to download the software onto your computer. For apps and mobile devices, turn to the back page. The first time you use Library2Go, click the account icon. Choose “CCRLS” from the drop-down menu. Enter all 14 digits (no spaces) of your library card number. No PIN is needed. Click on “Settings” from the menu on the right side, and in the settings set your lending period. We recommend the default lending period of 14 days, to help reduce wait time on holds.
    [Show full text]
  • Blair 2007 Archival Science Intro Milligan.Pdf (131.1
    Introduction The Harvard community has made this article openly available. Please share how this access benefits you. Your story matters Citation Blair, Ann, and Jennifer Milligan. 2007. “Introduction.” Archival Science 7 (4) (December): 289–296. doi:10.1007/s10502-008-9069-7. Published Version 10.1007/s10502-008-9069-7 Citable link http://nrs.harvard.edu/urn-3:HUL.InstRepos:29674917 Terms of Use This article was downloaded from Harvard University’s DASH repository, and is made available under the terms and conditions applicable to Other Posted Material, as set forth at http:// nrs.harvard.edu/urn-3:HUL.InstRepos:dash.current.terms-of- use#LAA manuscript for Ann Blair and Jennifer Milligan, "Introduction," Archival Science 7:4 (2007), pp. 289-96. Introduction Archives -- collections of paper, books, and other substrates of information (some might say “memory”) and the institutions that house and manage these objects -- are subjects of a renewed and vital current critical historical interest. Archives, broadly conceived, have been used for the writing of history since historical writing began, and archival materials and institutions are an integral part of the making not just of history but of the modern historical profession as well. The historian’s relationship with the archive has been long and varied and described in a broad range of terms, as being as unproblematic as “bread and butter” (Giles 1996) or as driven by erotic, fetishistic desire (Smith 1998). It is fitting that historians should turn their scholarly attentions to these depositories that have been the object, if not the subject, of so much historical work.
    [Show full text]
  • Positioning Library and Information Science Graduate Programs for 21St Century Practice
    Positioning Library and Information Science Graduate Programs for 21st Century Practice Forum Report November 2017, Columbia, SC Compiled and edited by: Ashley E. Sands, Sandra Toro, Teri DeVoe, and Sarah Fuller (Institute of Museum and Library Services), with Christine Wolff-Eisenberg (Ithaka S+R) Suggested citation: Sands, A.E., Toro, S., DeVoe, T., Fuller, S., and Wolff-Eisenberg, C. (2018). Positioning Library and Information Science Graduate Programs for 21st Century Practice. Washington, D.C.: Institute of Museum and Library Services. Institute of Museum and Library Services 955 L’Enfant Plaza North, SW Suite 4000 Washington, DC 20024 June 2018 This publication is available online at www.imls.gov Positioning Library and Information Science Graduate Programs for 21st Century Practice | Forum Report II Table of Contents Introduction ...........................................................................................................................................................1 Panels & Discussion ............................................................................................................................................ 3 Session I: Diversity in the Library Profession ....................................................................................... 3 Defining metrics and gathering data ............................................................................................... 4 Building professional networks through cohorts ........................................................................ 4
    [Show full text]