DOCSLIB.ORG

ICT Tools for Searching, Annotation and Analysis of Audiovisual Media

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
ICT Tools for Searching, Annotation and Analysis of Audiovisual Media ICT Tools for Searching, Annotation and Analysis of Audiovisual Media Alan Marsden*, Harriet Nock†, Adrian Mackenzie*, Adam Lindsay*, John Coleman†, and Greg Kochanski† * Lancaster Institute for the † Phonetics Laboratory, Contemporary Arts, and University of Oxford Institute for Cultural Research, Lancaster University AHRC ICT Strategy Project report October 2006 ICT Tools for Searching, Annotation and Analysis of Audiovisual Media ii Executive Summary 1. This report concerns the use of ICT tools in research in the arts and humanities using speech, music, video and film in digital form, hereafter referred to as AV (audio-visual material). 2. The quantity of AV available to researchers is now massive and rapidly expanding, far exceeding the quantity of available print material in sheer number of bytes. 3. The main problem for researchers is no longer a paucity of AV but how to locate the material of interest in the vast quantity available, and how to organise material once collected. 4. Metadata and tagging continue to be important to facilitate search. Standards for metadata for AV do exist but are not yet widely adopted. 5. Content-based search is becoming possible for speech, but is still beyond the horizon for music, and even more distant for video and film. Mixed speech, music and noise is very hard to search. 6. Copyright protection hampers research with AV, and digital rights management systems (DRM) threaten to prevent research altogether. 7. Once AV has been located and accessed, much research proceeds by annotation, for which many tools exist. Systems for reuse and sharing of annotations are in their infancy, however. 8. Many researchers make some kind of transcription of AV, and would value tools to automate this process. For speech, such tools exist with important limits to their accuracy and applicability. 9. Full music transcription tools do not exist, but researchers can benefit from other sorts of visualisations, for which tools do exist. 10. Researchers could work more effectively with better knowledge of ICT. A common failing is not so much ignorance of how to use particular tools as a misunderstanding of the processes the computer carries out and the validity of its results. 11. In Section 1.3, recommendations are made concerning: i. provision of ICT infrastructure for arts and humanities research, ii. training for researchers, iii. copyright law and digital rights management (DRM), iv. resource development unlikely to receive commercial support, v. dissemination of expertise and examples in research on AV with ICT, vi. standards and commercial tools, vii. metadata and digitisation projects outside the research community, viii. management of researchers’ private collections of AV, ix. deposit and sharing of AV, including annotations of AV. ICT Tools for Searching, Annotation and Analysis of Audiovisual Media iii Acknowledgments We are very grateful to the following for their contributions to this survey: the Oxford ‘Building a Virtual Research Environment for the Humanities Project’ team: Ruth Kirkham, John Pybus and Alan Bowman; Bill Byrne, Stanley Chen, Colin Connolly, Peter Enser, Thomas Hain, Jing Huang, Giridharan Iyengar, Sanjeev Khudanpur, Roger Moore, Jiri Navratil, Mari Ostendorf, Christine Sandom, Andrew Senior, Sue Tranter, Phil Woodland, Ed Whittaker and many others for informal conversations. We also gratefully acknowledge the generous amount of time and information given by all of the participants with whom interviews are reported in Appendix C. This project has been supported by a grant from the Arts and Humanities Research Council. ICT Tools for Searching, Annotation and Analysis of Audiovisual Media iv Contents 1 Project report. Audiovisual media, ICT tools, and humanities research............................................1 1.1 Introduction...................................................................................................................................1 1.1.1 Scope of the report ................................................................................................................2 1.1.2 Report website and project weblog.......................................................................................3 1.1.3 Other relevant reports...........................................................................................................3 1.2 Overview of the report .................................................................................................................. 4 1.2.1 Organisation of the report ................................................................................................... 4 1.2.2 Accessing audiovisual materials .......................................................................................... 4 1.2.3 Technologies — state of the art, gaps, obstacles...................................................................5 1.2.4 User experience and expectations ....................................................................................... 8 1.3 Conclusions and Recommendations ............................................................................................ 9 2 Appendix A. Accessing: sources and types of audiovisual media .....................................................12 2.1 Digitisation...................................................................................................................................12 2.2 Quantity of data ...........................................................................................................................13 2.3 Examples and sources of audiovisual data..................................................................................14 2.4 Technology and formats .............................................................................................................. 17 2.5 Platform survey............................................................................................................................18 2.6 Availability ...................................................................................................................................18 2.7 Access rights.................................................................................................................................19 2.8 Altered rights management .........................................................................................................21 3 Appendix B. Technologies for researching speech, music and moving image ................................ 23 3.1 Other sources of information...................................................................................................... 23 3.2 Searching and collecting............................................................................................................. 24 3.2.1 Searching the spoken word................................................................................................ 24 3.2.2 Searching for music and sound ..........................................................................................25 3.2.3 Searching video and film ................................................................................................... 26 3.2.4 Searching for AV on the web...............................................................................................27 3.2.5 Content management systems........................................................................................... 28 3.3 Annotation .................................................................................................................................. 29 3.3.1 Annotation and standards ................................................................................................. 29 3.3.2 Manual annotation............................................................................................................. 30 3.3.3 Collaborative annotation ................................................................................................... 32 3.3.4 Automatic annotation ........................................................................................................ 34 3.4 Transcription .............................................................................................................................. 36 3.4.1 Speech-to-text transcription.............................................................................................. 36 3.4.2 Transcription-related annotation of speech...................................................................... 39 ICT Tools for Searching, Annotation and Analysis of Audiovisual Media v 3.4.3 Music transcription.............................................................................................................41 3.5 Analysis ........................................................................................................................................41 3.5.1 Analysis of audio and music .............................................................................................. 42 3.5.2 Analysis of film................................................................................................................... 43 3.6 Presentation ................................................................................................................................ 44 3.6.1 Summarisation...................................................................................................................44 3.6.2 Speech-to-Speech Translation............................................................................................45
Load more

Recommended publications
  • UNESCO Kalinga Prize Winner – 1981 Sir David Attenborough
    Glossary on Kalinga Prize Laureates UNESCO Kalinga Prize Winner – 1981 Sir David Attenborough A British Legend of Science Serials, Britain’s Best Known Natural History Film Maker & Arguably the World’s Foremost Television Naturalist [Born: May 8, 1926 in London, England …………] Mankind has Probably done more damage to the earth in the 20th Century than in all of Previous human history. ... David Attenborough “If we [humans] disappeared over right, the world would Probably be better off.” The Daily Telegraph, London, 12, November, 2005 … David Atenborough “It seems to me that natural world is the greatest source of excitement, the greatest source of visual beauty; the greatest source of intellectual interest . It is the greatest source of so much in life that makes life worth living.” … David Attenborough. 1 Glossary on Kalinga Prize Laureates David Attenborough : A Biographical Profile World’s Best Known Broadcasters, Humanists and Naturalists Born : May 8, 1926 London, England Residence : Richmond, London Nationality : British Field : Naturalist Alma mater : Clare College, Cambridge (Natural Sciences) Notable Prizes : Order of Merit, Order of the Companions of Honour, Royal Victorian Order, Order of the British Empire, Fellow of the Royal Society Sir David Frederick Attenborough, OM, CH, CVO, series is in production. He is also a former senior CBE, FRS (born on May 8, 1926 in London, England) manager at the BBC, having served as controller of is one of the world’s best known broadcasters and BBC2 and director of programming for BBC naturalists. Widely considered one of the pioneers Television in the 1960s and 1970s. of the nature documentary, his career as the He is the younger brother of director and actor respected face and voice of British natural history Richard Attenborough.
    [Show full text]
  • European High-End Fiction Series. State of Play and Trends
    European high-end fiction series: State of play and trends This report was prepared with the support of the Creative Europe programme of the European Union. If you wish to reproduce tables or graphs contained in this publication, please contact the European Audiovisual Observatory for prior approval. The analysis presented in this publication cannot in any way be considered as representing the point of view of the European Audiovisual Observatory, its members or the Council of Europe. The European Commission support for the production of this publication does not constitute an endorsement of the contents, which reflect the views only of the authors, and the Commission cannot be held responsible for any use which may be made of the information contained therein. European high-end fiction series: State of play and trends Gilles Fontaine Marta Jiménez Pumares Table of contents Executive summary .................................................................................................. 1 Scope and methodology .......................................................................................... 5 1. Setting the scene in figures ............................................................................. 8 1.1. The production of high-end fiction series in the European Union .................................................................... 8 1.1.1. The UK is the primary producer of high-end series in Europe ................................................... 10 1.1.2. International co-productions: small but growing ..........................................................................
    [Show full text]
  • Changes to BBC Iplayer: Competition Assessment
    CHANGES TO BBC IPLAYER Competition assessment April 2019 Clive Kenny [email protected] Frontier Economics Ltd is a member of the Frontier Economics network, which consists of two separate companies based in Europe (Frontier Economics Ltd) and Australia (Frontier Economics Pty Ltd). Both companies are independently owned, and legal commitments entered into by one company do not impose any obligations on the other company in the network. All views expressed in this document are the views of Frontier Economics Ltd. CHANGES TO BBC IPLAYER CONTENTS Executive Summary 5 1 Introduction 18 1.1 Structure of this report 18 2 Framework for assessing the impact of the BBC iPlayer changes on competition 20 2.1 Introduction 20 2.2 Regulatory framework to assess changes to the BBC’s services 20 2.3 Analytical framework for the assessment of crowding out 24 2.4 Analytical framework for the assessment of scope for harm to competition elsewhere in the supply chain 28 3 The competitive context for the proposed changes to BBC iPlayer 30 3.1 The audio-visual sector is characterised by constant innovation 30 3.2 VoD competes with linear broadcasters, as well as newer audio-visual suppliers 31 3.3 Technological advances have led to convergence between different forms of content 33 3.4 Entrant broadcasters have put pressure on broadcasters to compete and innovate 33 3.5 Conclusion on sector wide trends 35 4 Suppliers affected by the changes to BBC iPlayer 37 4.1 Introduction 37 4.2 The BBC iPlayer’s role in the TV value chain 37 4.3 Identifying
    [Show full text]
  • BBC Annual Report and Accounts 2017/18
    Annual Report and Accounts 2017/18 BBC Annual Report and Accounts 2017/18 Presented to Parliament by the Secretary of State for Digital, Culture, Media and Sport by Command of Her Majesty © BBC Copyright 2018 The text of this document (this excludes, where present, the Royal Arms and all departmental or agency logos) may be reproduced free of charge in any format or medium provided that it is reproduced accurately and not in a misleading context. The material must be acknowledged as BBC copyright and the document title specified. Photographs are used ©BBC or used under the terms of the PACT agreement except where otherwise identified. Permission from copyright holders must be sought before any photographs are reproduced. You can download this publication from bbc.co.uk/annualreport Designed by Emperor emperor.works Prepared pursuant to the BBC Royal Charter 2016 (Article 37) ABOUT THE BBC Contents Nations’ data packs p.150 Performance and market context p.02 p.59 p.168 About the BBC Detailed financial The year at a glance, award-winning statements content and how we’re structured p.08 Forewords from the Chairman and Director-General Performance against public commitments p.240 p.125 Equality Information Report Governance p.88 p.66 Finance and Delivering our creative remit operations How we’ve met the requirements of our public purposes p.18 About the BBC Governance Financial statements 02 The year at a glance 90 BBC Board 169 Certificate and Report of the Comptroller 92 Governance Report and Auditor General Strategic report 93 Remuneration
    [Show full text]
  • Departmental Overview 2019-20 the BBC Group
    Departmental Overview 2019-20 The BBC Group October 2020 This overview summarises the work of the BBC Group including what it does, how much it costs, recent and planned changes and what to look out for across its main business areas and services. We are the UK’s independent public spending watchdog If you are reading this document with a screen reader you may wish to use the bookmarks option to navigate through the parts. If you require any of the graphics in another format, we can provide this on request. Please email us at www.nao.org.uk/contact-us 2 Departmental Overview 2019-20 The BBC group Contents Overview Part One People 10 About the BBC – key facts 3 Part Two The BBC's audiences 13 The BBC's public service and commercial arms 5 Part Three New markets 18 The BBC's income 6 Part Four COVID-19 20 How the BBC spends its money 7 Part Five Issues to look out for 22 Overview of the BBC's accounts 2019-20 8 Part Six Our value-for-money work 2019-20 23 Major programmes and key developments 2019-20 9 Bookmarks New Markets Overview Part Four About the BBC – key facts COVID-19 The BBC's public service and commercial arms Part Five The BBC's income Issues to look out for How the BBC spends its money Part Six Overview of the BBC's accounts 2019-20 Our value for money work on BBC Studios in 2019-20 Major programmes and key developments 2019-20 Part One People Part Two The BBC's audiences Part Three The National Audit Office (NAO) scrutinises public spending for Parliament and If you would like to know more about the NAO’s work on the BBC, If you are interested in the NAO’s is independent of government and the civil service.
    [Show full text]
  • ICT Tools for Searching, Annotation and Analysis of Audiovisual Media
    ICT Tools for Searching, Annotation and Analysis of Audiovisual Media Alan Marsden*, Harriet Nock², Adrian Mackenzie*, Adam Lindsay*, John Coleman², and Greg Kochanski² * Lancaster Institute for the ² Phonetics Laboratory, Contemporary Arts, and University of Oxford Institute for Cultural Research, Lancaster University AHRC ICT Strategy Project report October 2006 ICT Tools for Searching, Annotation and Analysis of Audiovisual Media 2 Executive Summary 1. This report concerns the use of ICT tools in research in the arts and humanities using speech, mu- sic, video and film in digital form, hereafter referred to as AV (audio-visual material). 2. The quantity of AV available to researchers is now massive and rapidly expanding, far exceeding the quantity of available print material in sheer number of bytes. 3. The main problem for researchers is no longer a paucity of AV but how to locate the material of in- terest in the vast quantity available, and how to organise material once collected. 4. Metadata and tagging continue to be important to facilitate search. Standards for metadata for AV do exist but are not yet widely adopted. 5. Content-based search is becoming possible for speech, but is still beyond the horizon for music, and even more distant for video and film. Mixed speech, music and noise is very hard to search. 6. Copyright protection hampers research with AV, and digital rights management systems (DRM) threaten to prevent research altogether. 7. Once AV has been located and accessed, much research proceeds by annotation, for which many tools exist. Systems for reuse and sharing of annotations are in their infancy, however.
    [Show full text]
  • Transforming Television
    TRANSFORMING TELEVISION: STRATEGIES FOR CONVERGENCE TRC IS AN INDEPENDENT CHARITY WORKING IN PARTNERSHIP WITH INTERNATIONAL AND UK BROADCASTERS, PRODUCERS AND AGENCIES TO PROVIDE TRAINING AND RESEARCH TO THE CREATIVE CONTENT INDUSTRY Foreword This publication brings together a number of the most important recent insights into how, why and at what pace the UK television industry is changing. It is intended primarily to support the thinking of small and medium-sized independent production companies during this period of intense change as they position themselves for the new demands of the digital age. The collection includes contributions from leading broadcasters on how their strategies are evolving in response to the new platforms and opportunities. If 2006 was the year when convergence stopped being a concept and became instead a corporate priority, then here are some of the early results from that transformation. A few emerging trends of digital convergence are becoming clearer, even if the outcomes are not. One is the changing nature of the relationship between content providers and their consumers. Broadcasters know that audiences are now less passive, more like participants or partners in content creation. To some extent they might even become competitors. Several of our contributors look at the implications of this shift. The public service operators realise the importance of maintaining their distinctiveness even as they extend their availability. Mark Thompson for the BBC and Andy Duncan for Channel 4 outline the unique brand strengths which they believe will give them a competitive edge in an increasingly crowded and confusing world of platforms and programmes. Even as they face the uncertainties of all this change, most of our contributors strike a note of optimism, preferring to dwell on the opportunities rather than the threats created by the transfer of choice and control away from broadcasters to producers and audiences.
    [Show full text]
  • BBC Studios' Lines of Business
    BBC Studios’ lines of business BBC Studios’ lines of business BBC Response December 2020 1 BBC Studios’ lines of business Table of contents Table of contents .................................................................................................................................. 2 Executive summary ............................................................................................................................ 3 Context – BBC Studios ...................................................................................................................... 5 Does BBC Studios have access to an “extensive back catalogue of Public Service content” somehow makes it unique in the market? ....................................... 7 The extent to which others have access to an equivalent back catalogue .. 8 BBC Studios access to ‘Public Service content’ or ‘IP owned by the Public Service’ ............................................................................................................................................ 12 BBC Studios profitability from distribution of BBC IP ......................................... 14 Ofcom’s new proposed reporting requirements ............................................................... 20 New notification requirements around lines of business ................................... 20 Provision of information on achieved rates of return .......................................... 22 Other comments on proposed new requirements ................................................... 25 2 BBC Studios’
    [Show full text]
  • Bbc Annual Plan 2021/22
    BBC ANNUAL PLAN 2021/22 March 2021 1 TABLE OF CONTENTS 1. FOREWORD ........................................................................................................................................................... 3 2. THE IMPACT OF COVID-19 ON THE BBC, AUDIENCES AND INDUSTRY ..................................................................... 5 3. THE BBC’S STRATEGIC AND CREATIVE PRIORITIES ................................................................................................ 15 4. THE BBC’S FINANCIAL CONTEXT AND 2021/22 OUTLINE BUDGET ......................................................................... 36 5. POTENTIAL CHANGES TO THE BBC’S PUBLIC AND COMMERCIAL SERVICES ........................................................... 40 ANNEX 1: MEASURING THE PERFORMANCE OF THE BBC .......................................................................................... 42 ANNEX 2: THE BBC’S COMMITMENT TO DELIVERING ITS PUBLIC PURPOSES ............................................................ 46 ANNEX 3: GOVERNANCE AND GENERAL DUTIES ....................................................................................................... 63 2 1. FOREWORD As we publish this year’s BBC Annual Plan the lockdown restrictions put in place to combat the Covid pandemic have begun to be eased across the country. We, like the rest of the UK, are hopeful that something close to normality will return in the coming months, and that friends, families and communities will be reunited after a hard year apart. The Covid pandemic
    [Show full text]
  • CBBC, Cbeebies, Knowledge & Learning, TV & Iplayer, Radio & Music, the Homepage and Search
    BBC Executive summary workplan for 2012/13 May 2012 Statement from the Senior Independent Director This is the second published annual workplan from the BBC Executive. It summarises the BBC's strategy, objectives and outline budget for the year ahead together with noteworthy developments. The publication of this workplan is part of the BBC’s commitment to openness and transparency, both to the BBC Trust and to licence fee payers. The document is also an important part of the way that the Non-Executive Directors on the BBC’s Executive Board ensure that the BBC meets its strategy and fulfils its obligations to the satisfaction of the BBC Trust and licence fee payers. This document is not a blueprint for the year ahead. Plans must and no doubt will change in certain areas to accommodate events. The BBC has, however, a clear strategy in Delivering Quality First and its priority is to implement and deliver that strategy. Whenever our plans change they must remain focussed on delivering against this strategy within our budget. This annual workplan should be seen as reconciling our regular affairs with these long-term aims. The Non-Executive Directors look forward to working with the Director-General and the rest of the BBC Executive Board to deliver the contents of this workplan and I commend it to the BBC Trust. Marcus Agius Senior Independent Director BBC BBC Summary Workplan 2012/13 Contents 1. Introduction ............................................................................................ 1 2. Strategic overview of the year .............................................................. 2 3. BBC budget 2012/13 ............................................................................. 17 4. Statements of programme policy ....................................................... 22 BBC Summary Workplan 2012/13 1.
    [Show full text]
  • Bringing Us Closer
    BRINGING US CLOSER BBC ANNUAL PLAN 2020/21 May 2020 TABLE OF CONTENTS FOREWORD .......................................................................................................................................................................... 1 1. PUBLIC SERVICE BROADCASTING IN A TIME OF NATIONAL CRISIS ........................................................ 3 2. THE BBC’S TWO-YEAR PLAN .............................................................................................................................. 20 3. THE BBC’S CREATIVE REMIT ............................................................................................................................... 30 4. RESPONDING TO OFCOM’S REVIEWS ............................................................................................................. 43 5. THE BBC’S FINANCIAL CONTEXT AND 2020/21 OUTLINE BUDGET ..................................................... 53 6. POTENTIAL CHANGES TO THE BBC’S UK PUBLIC SERVICES .................................................................. 57 ANNEX 1: MEASURING BBC PERFORMANCE ......................................................................................................... 58 ANNEX 2: BBC SERVICES’ CONTRIBUTION TO DISTINCTIVENESS .................................................................. 59 ANNEX 3: GOVERNANCE AND GENERAL DUTIES ................................................................................................ 70 FOREWORD This Annual Plan is being published in extraordinary circumstances. Everything
    [Show full text]
  • Mediatique Report: State of the Markets in Which BBC Studios Operates
    State of the markets in which BBC Studios operates A report for Ofcom October 2020 Mediatique Limited 65 Chandos Place London WC2N 4HG www.mediatique.co.uk State of the markets in which BBC Studios operates Executive summary . Ofcom is seeking to better understand the state of the markets in which BBC Studios (‘BBCS’) operates, as part of the regulator’s responsibilities to ensure that the BBC’s commercial activities do not, as a result of their relationship with the UK Public Services, distort the market or gain an unfair competitive advantage. BBCS undertakes a number of activities in the media landscape, both in the UK and internationally, across four broad areas1; it - Invests in and/or produces content2 in the UK and selected countries globally; - Distributes content and format rights on behalf of the BBC and third parties in the UK and internationally; - Owns or co-owns branded TV channels (e.g., UKTV in the UK, BBC America in the US and selected brands in other international markets) and jointly owns (with ITV) the North American variant of BritBox, the subscription video on demand (‘SVOD’) service; and - Distributes physical content – e.g., digital versatile discs (‘DVDs’) – and supplies content for retail via Electronic Sell-through (‘EST’) digital stores operated by companies such as Amazon and Apple. The markets in which the BBC operates are subject to a range of dynamics in technology, consumer behaviour and competitor strategies that have effects across all relevant geographies. In particular, the pace of change in audience engagement (including take-up of connected devices and multi-platform access to content) is accelerating in most markets internationally; as a consequence, companies highly exposed to traditional (historically high margin) broadcasting, like BBCS, are facing challenges.
    [Show full text]