DOCSLIB.ORG

Proceedings Template

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Proceedings Template Meeting the Challenges of Preserving the UK Web Helen Hockx-Yu British Library 96 Euston Road, London NW1 2DB United Kingdom [email protected] ABSTRACT Collecting and providing continued access to the UK’s digital heritage is a core purpose for the British Library. An important element of this is the World Wide Web. The British Library The British Library started archiving UK websites in 2004, started web archiving in 2004, building from scratch the based on the consent from site owners. This resulted in the 1 capability of eventually preserving the entire UK web domain. Open UK Web Archive , a curated collection currently This is required by the non-print Legal Deposit Regulations consisting of over 70,000 point-in-time snapshots of nearly which came into force in April 2013, charging the Legal 16,000 selected websites, archived by the British Library and 2 Deposit Libraries with capturing, among a wide range of digital partners. publications, the contents of every site carrying the .uk suffix Non-Print Legal Deposit (NPLD) Regulations became effective (and more), preserving the material and making it accessible in in the UK in April 2013, applying to all digitally published and the Legal Deposit Libraries’ reading rooms. on line work. NPLD is a joint responsibility of publishers and The paper provides an overview of the key challenges related to Legal Deposit Libraries (LDLs). An important requirement is archiving the UK web, and the approaches the British Library that access to NPLD content is restricted to premises controlled has taken to meet these challenges. Specific attention will be by the LDLs. given to issues such as the “right to be forgotten” and the treatment for social networks. The paper will also discuss the The British Library leads the implementation of NPLD for the access and scholarly use of web archives, using the Big UK UK web. While the many existing web archiving challenges Domain Data for Arts and Humanities project as an example. described in detail by Hockx-Yu[7] remain valid, the significant increase of scale, from archiving hundreds of Keywords websites to millions, has brought about new and additional Web Archiving, Non-print Legal Deposit, Digital Preservation, challenges. The key ones are discussed in this paper. Big data, Scholarly use, Digital Humanities. 2. IMPLEMENTING NON-PRINT LEGAL 1. INTRODUCTION DEPOSIT Web Archiving was initiated by the Internet Archive in the NPLD of UK websites is mainly implemented through periodic mid-1990’s, followed by memory institutions including crawling of the openly available UK web domain, following an national libraries and archives around the world. Web archiving automated harvesting process where web crawlers request has now become a mainstream digital heritage activity. Many resources from web servers hosting in-scope content. countries expanded the existing mandatory deposit scheme to include digital publications and passed regulations to enable systematic collection of the national web domain. A recent 2.1 Collecting Strategy survey identified 68 web archiving initiatives and estimated With over 10 million registered domain names, .uk is one of the that 534 billion files (measuring 17PB) had been archived since largest Top Level Domains (TLDs) in the world. A strategy to 1996. [2] archive such a large web space requires striking a balance between comprehensive snapshots of the entire domain and adequate coverage of changes of important resources. Figure 1. outlines our current strategy, which is a mixed model allowing annual crawl of the UK web in its entirety, augmented by prioritisation of the parts which are deemed important and Copyright Helen Hockx-Yu (2015), licensed under a Creative receive greater curatorial attention. Commons 4.0 Attribution International Licence. When citing this paper please use the following: Hockx-Yu, H., “Meeting the Challenges of Preserving the UK Web”, Digital Preservation for the Arts, Social Sciences and Humanities, Dublin, 25-26 June 2015. Dublin: The Digital Repository of Ireland. 1 Open UK Web Archive, http://www.webarchive.org.uk. 2 Another key collection is the UK Government UK Web Archive provided by the National Archives, containing government records on the web, http://www.nationalarchives.gov.uk/webarchive. Data volume limitation3 4 A default per-host data cap of 512MB or 20 hops is applied to our domain crawls with the exception of a few selected hosts. As soon as one of the pre-configured caps has been reached, the crawl of a given host will terminate automatically. Robots.txt policy We obey robots.txt and META exclusions, except for the home pages and content required to render a page (e.g. JavaScript, CSS). Embedded resources Resources which are essential to the coherent Figure 1. UK Web Archive collecting strategy interpretation of a web page (e.g. JavaSrcript, CSS) are considered in-scope and collected, regardless of where The domain crawl is intended to capture the UK domain as these are hosted. comprehensively as possible, providing the “big picture”. The key sites represent UK organisations and individuals of general and enduring interest in a particular sector of 3. “RIGHT TO BE FORGOTTEN” [6] the life of the UK and its constituent nations. The “right to be forgotten” relates to the European Court of News websites contain news published frequently on the Justice (ECJ)’s ruling against Google, who were asked to web by journalistic organisations. remove the index and access to a 16-year old newspaper article The events-based collections are intended to capture concerning an individual’s proceedings over social security political, cultural, social and economic events of national debts. [10] interest, as reflected on the web. “Right to be forgotten” reflects the principle of an individual The key sites, news sites and events collections are maintained being able to remove traces of past events in life from the by curators across the LDLs and governed by a sub-group Internet or other records. When considering this, it is important overseeing web archiving for NPLD. These are typically not to lose sight of the purpose of NPLD. By keeping a captured more than once a year. historical record of the UK web for heritage purposes, it ensures the “right to be remembered”. Websites archived for NPLD are only accessible within the LDL’s reading rooms and 2.2 UK Territoriality the content of the archive is not available for search engines. The Regulations define an on line work as in scope if: This significantly reduces the potential damage and impact to individuals and the libraries’ exposure to take-down requests. a) it is made available to the public from a website with a There is at present no formal and general “right to be forgotten” domain name which relates to the United Kingdom or to a place in UK law by which a person may demand withdrawal of the within the United Kingdom; or lawfully archived copy of lawfully published material, just b) it is made available to the public by a person and any of that because they do not wish it to be available any longer. We person’s activities relating to the creation or the publication of apply the Data Protection Act 1998 for withdrawing material the work take place within the United Kingdom. [13] containing sensitive personal data from the NPLD collection. A notice and takedown policy is in place allowing withdrawal of Part a) is interpreted as including all .uk websites, plus websites public access or removal of deposited material under specific in future geographic top level domains that relate to the UK circumstances.[12] "Evidence of damage and distress to such as .scotland, .wales or .london. This part of the UK individuals" is a key criterion used to review complaints. territoriality criteria can be implemented using automated methods, by assembling various lists or directories, or through discovery crawls, which identify linked resources from an 4. ARCHIVING SOCIAL MEDIA [5] initial list and extract additional URLs recursively. A sampling approach was taken to archiving social media Part b) concerns websites using non .uk domains. It is a content prior to NPLD. The Open UK Web Archive contains a statement about the location of the publisher or the publishing limited amount of pages from Twitter, Facebook and YouTube. process without defining explicitly what “takes place within the These typically are parts of “special collections”, groups of United Kingdom” constitutes. We use a mixture of automated websites about a particular theme or an event, usually archived and manual means to discover content relevant to this category. for a fixed period of time. An example is the special collection Manual checks include UK postal address, private on the UK General Election 2010, which includes Twitter communication, who-is records and professional judgment. A pages belonging to the Prospective Parliamentary Candidates crawl-time process has also been developed, to check non .uk (PPCs). The decision not to systematically archive social media URLs against an external Geo-IP database and add UK-hosted related to the selective nature of the archive itself, the difficulty content to the fetch-chain. This helped us identify over 2 in obtaining permissions and resources constraints – even the million non .uk hosts during our 2014 domain crawl. exemplar content required highly skilled technical staff to At a more detailed level, crawler configurations also determine develop customised solutions outside standard workflow. the scope and boundary of a national web archive collection. Some key parameters of our current implementation are as follows: 3 This is a common way to manage large scale crawls, which otherwise could require significant machine resources or time to complete. 4 Each page below the level of the seed, i.e. the starting point of a crawl, is considered a hop.
Load more

Recommended publications
  • Arhiviranje Weba
    Arhiviranje weba Lučić, Lucija Master's thesis / Diplomski rad 2020 Degree Grantor / Ustanova koja je dodijelila akademski / stručni stupanj: University of Zagreb, University of Zagreb, Faculty of Humanities and Social Sciences / Sveučilište u Zagrebu, Filozofski fakultet Permanent link / Trajna poveznica: https://urn.nsk.hr/urn:nbn:hr:131:448437 Rights / Prava: In copyright Download date / Datum preuzimanja: 2021-09-25 Repository / Repozitorij: ODRAZ - open repository of the University of Zagreb Faculty of Humanities and Social Sciences SVEUČILIŠTE U ZAGREBU FILOZOFSKI FAKULTET ODSJEK ZA INFORMACIJSKE I KOMUNIKACIJSKE ZNANOSTI SMJER ARHIVISTIKA Ak. god. 2019./2020. Lucija Lučić Arhiviranje weba Diplomski rad Mentor: prof. dr. sc. Hrvoje Stančić Zagreb, 2020. Izjava o akademskoj čestitosti Izjavljujem i svojim potpisom potvrđujem da je ovaj rad rezultat mog vlastitog rada koji se temelji na istraživanjima te objavljenoj i citiranoj literaturi. Izjavljujem da nijedan dio rada nije napisan na nedozvoljen način, odnosno da je prepisan iz necitiranog rada, te da nijedan dio rada ne krši bilo čija autorska prava. Također izjavljujem da nijedan dio rada nije korišten za bilo koji drugi rad u bilo kojoj drugoj visokoškolskoj, znanstvenoj ili obrazovnoj ustanovi. Sadržaj 1. Uvod ....................................................................................................................................... 3 2. Što je arhiviranje weba? .....................................................................................................
    [Show full text]
  • Cultural Heritage Digitisation, Online Accessibility and Digital Preservation
    1 Cultural heritage Digitisation, online accessibility and digital preservation REPORT on the Implementation of Commission Recommendation 2011/711/EU 2013-2015 Cover image: Albert Edelfelt’s 'The Luxembourg Gardens, Paris', Finnish National Gallery. Source: europeana.eu Back cover image: Raphael's 'Sposalizio della Vergine', Pinacoteca di Brera (Milano). Source: europeana.eu Page | 2 EUROPEAN COMMISSION Directorate-General for Communications Networks, Content and Technology Page | 3 Implementation of Commission Recommendation on the digitisation and online accessibility of cultural material and digital preservation Progress report 2013-2015 Working document June 2016 Table of contents EXECUTIVE SUMMARY ............................................................................................................................ 6 1. DIGITISATION: ORGANISATION AND FUNDING ................................................................................ 10 1.1. Planning and monitoring digitisation ......................................................................................... 10 1.1.1. Schemes, quantitative targets and allocated budgets ........................................................ 11 Page | 4 1.1.2 National and European overviews of digitised cultural material ........................................ 14 1.2 Public - private partnerships ....................................................................................................... 16 1.3 Use of Structural Funds ..............................................................................................................
    [Show full text]
  • The UK Web Archive As a Source for the Contemporary History of Public Health Downloaded from Martin Gorsky*
    Social History of Medicine Vol. 28, No. 3 pp. 596–616 Sources and Resources Into the Dark Domain: The UK Web Archive as a Source for the Contemporary History of Public Health Downloaded from Martin Gorsky* Summary. With the migration of the written record from paper to digital format, archivists and histor- http://shm.oxfordjournals.org/ ians must urgently consider how web content should be conserved, retrieved and analysed. The British Library has recently acquired a large number of UK domain websites, captured 1996–2010, which is col- loquially termed the Dark Domain Archive while technical issues surrounding user access are resolved. This article reports the results of an invited pilot project that explores methodological issues surrounding use of this archive. It asks how the relationship between UK public health and local government was represented on the web, drawing on the ‘declinist’ historiography to frame its questions. It points up some difficulties in developing an aggregate picture of web content due to duplication of sites. It also highlights their potential for thematic and discourse analysis, using both text and image, illustrated through an argument about the contradictory rationale for public health policy under New Labour. at London School of Hygiene & Tropical Medicine on March 8, 2016 Keywords: methodology; websites; local government; public health Introduction: the Dark Domain Archive Public health researchers have long been interested in the internet as a medium of communi- cation, focusing inter alia on web tools for data gathering, on dissemination of health mes- sages and on the networking potential which the World Wide Web provides.1 Facilities for the capture of websites, for example, are now routinely included in qualitative data analysis software such as NVivo.
    [Show full text]
  • Web Archiving in the UK: Current
    CITY UNIVERSITY LONDON Web Archiving in the UK: Current Developments and Reflections for the Future Aquiles Ratti Alencar Brayner January 2011 Submitted in partial fulfillment of the requirements for the degree of MSc in Library Science Supervisor: Lyn Robinson 1 Abstract This work presents a brief overview on the history of Web archiving projects in some English speaking countries, paying particular attention to the development and main problems faced by the UK Web Archive Consortium (UKWAC) and UK Web Archive partnership in Britain. It highlights, particularly, the changeable nature of Web pages through constant content removal and/or alteration and the evolving technological innovations brought recently by Web 2.0 applications, discussing how these factors have an impact on Web archiving projects. It also examines different collecting approaches, harvesting software limitations and how the current copyright and deposit regulations in the UK covering digital contents are failing to support Web archive projects in the country. From the perspective of users’ access, this dissertation offers an analysis of UK Web archive interfaces identifying their main drawbacks and suggesting how these could be further improved in order to better respond to users’ information needs and access to archived Web content. 2 Table of Contents Abstract 2 Acknowledgements 5 Introduction 6 Part I: Current situation of Web archives 9 1. Development in Web archiving 10 2. Web archiving: approaches and models 14 3. Harvesting and preservation of Web content 19 3.1 The UK Web space 19 3.2 The changeable nature of Web pages 20 3.3 The evolution of Web 2.0 applications 23 4.
    [Show full text]
  • 'Non-Published' Outputs of Research Datacite
    Towards systemic solutions for preservation and archiving, citation and referencing systems for data and web-based ‘non-published’ outputs of research DataCite Data sharing and re-use are becoming increasingly central to the research process, meaning that it is vital to have effective tools to find, access and use that data. DataCite is a global network of national libraries, data centres and other research organisations that work to increase the recognition of data as a legitimate, citable contribution to scholarly record. DataCite provides Digital Object Identifiers (DOIs) for data sets and other non-traditional research outputs. DOI assignment helps to make data persistently identifiable and citable. DataCite chooses to work with DOIs because they have number of features that make them more suitable than other persistent identifiers1. For example, they are already well-established for research publications, recognised as an ISO standard and are centrally managed by the International DOI Foundation (IDF). The British Library is one of the founding members of DataCite and provides UK-based organisations with the ability to mint DOIs for their data. The British Library provides a web interface for DOI creation and the Metadata Store, which is a centralised database that makes data easy to find and access. The infrastructure and governance provided by the IDF and DataCite means that there are standards, policies and guidelines that allow for data citation to take place. However, this technical infrastructure cannot function in isolation. The participating universities and research organisations have to have their own repository infrastructure, senior level buy-in, policies and skilled staff in place to ensure that they can meet the requirements for providing persistent access to data.
    [Show full text]
  • Missing Links: the Enduring Web
    Missing Links 135 The International Journal of Digital Curation Issue 2, Volume 4 | 2009 Missing Links: The Enduring Web Marieke Guy, Alex Ball, Michael Day UKOLN, University of Bath Summary The Web runs at risk. Our generation has witnessed a revolution in human communications on a trajectory similar to that of the origins of the written word and language itself. Early Web pages have an historical importance comparable with prehistoric cave paintings or proto-historic pressed clay ciphers. They are just as fragile. The ease of creation, editing and revising gives content a flexible immediacy: ensuring that sources are up to date and, with appropriate concern for interoperability, content can be folded seamlessly into any number of presentation layers. How can we carve a legacy from such complexity and volatility? The International Journal of Digital Curation is an international journal committed to scholarly excellence and dedicated to the advancement of digital curation across a wide range of sectors. ISSN: 1746-8256 The IJDC is published by UKOLN at the University of Bath and is a publication of the Digital Curation Centre. 136 Missing Links Introduction The opening lines on the Digital Preservation Coalition Web page1 for the Missing Links workshop pull no punches. Web resource preservation is an important area from the institutional level upwards and the one-day event sponsored by the Digital Preservation Coalition (DPC) and the Joint Information Systems Committee (JISC) along with the six partners of the UK Web Archiving Consortium (the British Library, the National Library of Wales, JISC, the Wellcome Library, The National Archives and the National Library of Scotland) was an attempt to validate the work in hand.
    [Show full text]
  • Bookofabstracts-Ewavirtual2020
    Published by: #EWAVirtual Conference Organisers, Maynooth University Arts and Humanities Institute Edited by Sharon Healy, Michael Kurzmeier, Helena La Pina and Patricia Duffe DOI: http://doi.org/10.5281/zenodo.4058013 This work is licensed under a Creative Commons Attribution 4.0 International License https://creativecommons.org/licenses/by/4.0/ Program Committee: Co-Chairs Sharon Healy, PhD Candidate and IRC Scholar in Digital Humanities, Maynooth University Michael Kurzmeier, PhD Candidate and IRC Scholar in Digital Humanities/Media Studies, Maynooth University #EWAVirtual Coordinators Rebecca O’Neill, MA Historical Archives, Maynooth University Helena La Pina, MA Historical Archives, Maynooth University Programme Coordinator Maria Ryan, Web archivist at the National Library of Ireland (NLI Web Archive) Treasurer Dr Joseph Timoney, Head of Department of Computer Science, Maynooth University PR/Outreach Julian Carr, MA Geography (Urban Studies), Maynooth University Committee Dr Martin Maguire, History/Digital Humanities, Dundalk Institute of Technology. Dr Thomas Lysaght, Deputy Head of Department of Computer Science, Maynooth University Gavin MacAllister, Historian in Residence, Irish Military War Museum. Bernadette McKevitt, MA International Peace Studies, Trinity College Dublin. Table of Contents Introduction 1 Welcome from Sharon Healy and Michael Kurzmeier, Conference Co-Chairs 4 #EWAVirtual Keynotes 6 #EWAVirtual Programme 9 #EWAVirtual Abstracts 15 Session 1: Archiving Initiatives 15 Session 2: Collaborations 20 Session 3: Archiving
    [Show full text]
  • Web-Archiving 01000100 01010000 Maureen Pennock 01000011 01000100 DPC Technology Watch Report 13-01 March 2013 01010000 01000011 01000100 01010000
    01000100 01010000 01000011 Web-Archiving 01000100 01010000 Maureen Pennock 01000011 01000100 DPC Technology Watch Report 13-01 March 2013 01010000 01000011 01000100 01010000 Series editors on behalf of the DPC 01000011 Charles Beagrie Ltd. Principal Investigator for the Series 01000100 Neil Beagrie 01010000 01000011DPC Technology Watch Series © Digital Preservation Coalition 2013 and Maureen Pennock 2013 Published in association with Charles Beagrie Ltd. ISSN: 2048 7916 DOI: http://dx.doi.org/10.7207/twr13-01 All rights reserved. No part of this publication may be reproduced, stored in a retrieval system, or transmitted, in any form or by any means, without the prior permission in writing from the publisher. The moral right of the author has been asserted. First published in Great Britain in 2013 by the Digital Preservation Coalition Foreword The Digital Preservation Coalition (DPC) is an advocate and catalyst for digital preservation, ensuring our members can deliver resilient long-term access to digital content and services. It is a not-for-profit membership organization whose primary objective is to raise awareness of the importance of the preservation of digital material and the attendant strategic, cultural and technological issues. It supports its members through knowledge exchange, capacity building, assurance, advocacy and partnership. The DPC’s vision is to make our digital memory accessible tomorrow. The DPC Technology Watch Reports identify, delineate, monitor and address topics that have a major bearing on ensuring our collected digital memory will be available tomorrow. They provide an advanced introduction in order to support those charged with ensuring a robust digital memory, and they are of general interest to a wide and international audience with interests in computing, information management, collections management and technology.
    [Show full text]
  • Archiwizacja Webu W Europie – Narodowe Archiwa Sieci
    ARCHEION, T. CXXI WARSZAWA 2020 ISSN 0066-6041 e-ISSN 2658-1264 DOI 10.4467/26581264ARC.20.016.12973 BARTŁOMIEJ KONOPA ORCID 0000-0001-9843-5552 [email protected] (Uniwersytet Mikołaja Kopernika w Toruniu, Archiwum Państwowe w Bydgoszczy) ARCHIWIZACJA WEBU W EUROPIE – NARODOWE ARCHIWA SIECI Słowa kluczowe: archiwizacja Webu, archiwa Webu, archiwa cyfrowe, witryny Internetowe, badania nad Internetem Streszczenie Archiwizacja Webu, czyli działania mające na celu gromadzenie i zachowanie zasobów Sieci, prowadzona jest już od prawie 25 lat. Przez ten czas powstało wiele projektów realizujących to za- danie, a także parę organizacji, takich jak np. International Internet Preservation Consortium, które wspierają jego realizowanie. W artykule zaprezentowano rozwój działań w tym zakresie, a następnie omówiono wnioski z analizy funkcjonowania wybranych europejskich archiwów Sieci o charakterze narodowym, przeprowadzonej w oparciu o publicznie dostępne materiały ich dotyczące. Analiza ta miała na celu zbadanie, w jaki sposób obecnie archiwizowany jest Web w tej części świata. Rozpa- trzone zostały trzy główne zagadnienia: gromadzenie, opisywanie i udostępnianie zasobów dawnego WWW. Pierwsze z nich obejmuje zakres archiwizacji, a więc określenie tego, jakie materiały jej podlegają, a także wykorzystywanych w tym celu strategii, z których wynika ukształtowanie zbiorów. Drugie dotyczy stosowanych metadanych i innych elementów służących przekazaniu informacji na temat tego, co zostało w jej trakcie zgromadzone. Ostatni element analizy obejmuje zakres udostęp- niania zasobów archiwalnego WWW, występujące ograniczenia i ich przyczyny, a także wykorzysty- wane do tego narzędzia. W trakcie badań zainteresowano się również używanym przez poszczególne projekty oprogramowaniem. Uzyskane wyniki pozwalają stwierdzić, że model archiwum Sieci został wypracowany, a działalność analizowanych inicjatyw w Europie jest do siebie bardzo zbliżona.
    [Show full text]
  • SCONUL Focus 34.Indd
    SCONUL Focus Number 34 Spring 2005 Contents ISSN 1745-5782 (print) ISSN 1745-5790 (online) 3 A is for Advocacy… 4 Putting library staff back into libraries Phil Sykes 8 What’s in a name? Bill Simpson 10 ‘Stirring up other men’s benevolence’: library fundraising in Oxford Reg Carr 15 Selling centuries of history through innovative design: the development of commercial operations in the Bodleian Library 1985 - 2005 Rachel Clark 21 By any means necessary: a future for multiple copy provision? Gareth J Johnson 26 Supporting distance learners at the University of Central Lancashire Julie Hitchen 31 The ‘Seven pillars of wisdom’ model: a case study to test academic staff perceptions Jacqui Weetman 37 Staff Information skills: workplace support and development Alison Mackenzie 40 My VLE at Maynooth: e-learning and the library Mary Delaney 42 Just what I wanted! The perfect Christmas gift – Google scholar - or is it? Martin Myhill 44 Selective web archiving in the UK : a perspective of the National Library of Scotland within UK Web Archiving Consortium (UKWAC) Paul Cunnea 49 Bridging the evidence gap - the eVALUEd toolkit training project Fiona Mullany 51 How do others see us? - mystery visiting as a tool for service evaluation Philippa Jones, Jill Woodman 53 Taking a planned approach to evaluation Sarah McNicol and Pete Dalton 56 The M25 Consortium: advocating a success story Máire Lanigan 57 News from SCONUL 57 ‘What’s occupying you?’ SCONUL top concerns survey 2004 Suzanne Enright 61 Benchmarking the standard SCONUL User Survey – report of a pilot study Claire Creaser 66 ‘The Shape of Things to Come’ Conference reviewed by Antony Brewerton 75 Report on the SCONUL Annual General Meeting, 6 April 2005 Suzanne Enright 79 Trading in knowledge? Toby Bainton 82 CURL/SCONUL Digest of Scholarly Communication News Fredrick J.
    [Show full text]
  • Web Archiving
    Web Archiving Alex Ball Digital Curation Centre, UKOLN, University of Bath DCC STATE OF THE ART REPORT Deliverable B 7.5.8 Version: 1.1 Status: Final Date: 1st March 2010 Copyright c Digital Curation Centre, 2010. Licensed under Creative Commons BY-NC-SA 2.5 Scotland: http://creativecommons.org/licenses/by-nc-sa/2.5/scotland/ Catalogue Entry Title Web Archiving Creator Alex Ball (author) Subject World Wide Web; Web harvesting; temporal consistency; significant properties; archiving strategy; software tools for Web archiving; malware; Web spam; OAI-ORE; blog archiving Description Web archiving is important not only for future research but also for organisations’ records management processes. There are technical, or- ganisational, legal and social issues that Web archivists need to address, some general and some specific to types of content or archiving oper- ations of a given scope. Many of these issues are being addressed in current research and development projects, as are questions concerning how archived Web material may integrate with the live Web. Publisher University of Edinburgh; UKOLN, University of Bath; HATII, University of Glasgow; Science and Technology Facilities Council Date 8th January 2010 (creation) Type Text Format Portable Document Format version 1.4 Language English Rights c 2010 Digital Curation Centre, UKOLN, University of Bath Citation Guidelines Alex Ball. (2010). Web Archiving (version 1.1). Edinburgh, UK: Digital Curation Centre. 2 Contents 1 Introduction 4 2 Motivations for Web archiving 5 3 Challenges for Web archiving 7 3.1 Technical challenges . 7 3.2 Management challenges . 9 4 Large-scale Web archiving 13 4.1 Agents and scope .
    [Show full text]
  • Uk Web Archiving Consortium Evaluation Report: April 2006
    UK WEB ARCHIVING CONSORTIUM EVALUATION REPORT: APRIL 2006 UKWAC Evaluation Report April 2006 UK WEB ARCHIVING CONSORTIUM.........................................................................1 EVALUATION REPORT: APRIL 2006 ...........................................................................1 ..........................................................................................................................................3 Executive Summary...........................................................................................................4 1. The UK Web Archiving Consortium (UKWAC)...........................................................5 1.1 Aims, Objectives and Deliverables..........................................................................5 1.1.1. Aims.................................................................................................................5 1.1.2 Objectives.........................................................................................................5 1.1.3 Deliverables......................................................................................................6 1.2 Budget......................................................................................................................6 1.3 Governance..............................................................................................................6 2. EVALUATION..............................................................................................................7 2.1 Licence Procurement...............................................................................................7
    [Show full text]