Martoska, FFV1 and FLAV for Audio

Total Page：16

File Type：pdf, Size：1020Kb

Martoska, FFV1 and FLAC Table of Contents for Audio-Visual Preservation acronyms «raw» formats • Y′CBCR 4:2:2 Reto Kromer • AV Preservation by reto.ch • RGB or R′G′B′ 4:4:4 International Archives Day CERN, Geneva, 2017–06–09 1 2 Standardisation IETF SMPTE Internet Engineering Task Force • CineForm/VC-5, ProRes, AXF • voluntary Internet standards ISO • open standard organisation • TI/A • volunteers IETF • EBML, Matroska, FFV1 und FLAC ➔ https://www.ietf.org 3 4 CELLAR EBML Codec Encoding for LossLess Archiving and Extensible Binary Meta Language Realtime transmission binary XML format EBML • • open source • Matroska • FFV1 and FLAC • ➔ https://github.com/Matroska-Org/ ebml-specification ➔ https://datatracker.ietf.org/wg/cellar/ 5 6 Matroska (.mkv) FFV1 • «extensible media container» FFmpeg Video codec 1 [FF = Fast Forward] based on EBML «simple and efficient lossless intra-frame • • only video codec» • open source • open source ➔ https://github.com/Matroska-Org matroska-specification ➔ https://github.com/ffmpeg/ffv1 7 8 FLAC Free Lossless Audio Codec «fastest and most widely supported • lossless audio codec» Data is anything • open source but «raw». ➔ https://github.com/privatezero/ flac_markdown 9 10 Y′CBCR 4:2:2 RGB or R′G′B′ 4:4:4 from: from: • MOV / 10 or 8 bit «uncompressed» • folder, TAR or ZIP / TIFF 16 bit • AVI / 10 or 8 bit «uncompressed» • MXF / DPX 16, 12 or 10 bit • MP4 / 10 or 8 bit «uncompressed» • AXF / JPEG 2000 to: to: • Matroska / FFV1 • Matroska / FFV1 11 12 What is inside my DPX? Today: Archive Master • log neg encoding Film • log RGB encoding, quasi-log encoding • folder, TIFF, 2K, RGB, 4:4:4, 16 bit • TAR, DPX, 2K, R′G′B′, 4:4:4, 10 bit • gamma encoding, power function encoding Video scene-linear encoding • • AVI, Y′CBCR, HD, 4:2:2, 10 bit • Matroska, FFV1, HD, Y′CBCR, 4:2:2, 10 bit Sound • BWF, 96 kHz, 24 bit • WAVE, 96 kHz, 24 bit 13 14 Today: Mezzanine Today: Access Video MP4 • HD, Apple ProRes 4444 Video • HD, Apple ProRes 422 HQ • HD, H.264, yuv420p, «lossy» • HD, Avid DNxHD 175x Sound Sound • AAC, 44.1 kHz, 16 bit • BWF, 48 kHz, 24 bit • WAVE, 48 kHz, 24 bit 15 16 Archive [and Mezzanine] Access Film WebM (a subset of Matroska) • Matroska, FFV1, 2K, «RGB», 4:4:4, 16 bit Video Video • HD, «H.264», yuv420p • Matroska, FFV1, HD, Y′CBCR, 4:2:2, 10 bit Sound Sound «WAV», 48 kHz, 16 bit • Matroska, FLAC, 96 kHz, 24 bit • 17 18 Reading AV Preservation by reto.ch Reto Kromer: «Matroska and FFV1: One chemin du Suchet 5 • File Format for Film and Video Archiving?», 1024 Écublens in «Journal of Film Preservation», n. 96 Switzerland (April 2017), FIAF, Brussels, Belgium, p. 41–45 Web: reto.ch Twitter: @retoch Email: [email protected] ➔ https://retokromer.ch/publications/ JFP_96.html 19 20.

Copy Link

Recommended publications

On Audio-Visual File Formats
On Audio-Visual File Formats Summary • digital audio and digital video • container, codec, raw data • different formats for different purposes Reto Kromer • AV Preservation by reto.ch • audio-visual data transformations Film Preservation and Restoration Hyderabad, India 8–15 December 2019 1 2 Digital Audio • sampling Digital Audio • quantisation 3 4 Sampling • 44.1 kHz • 48 kHz • 96 kHz • 192 kHz digitisation = sampling + quantisation 5 6 Quantisation • 16 bit (216 = 65 536) • 24 bit (224 = 16 777 216) • 32 bit (232 = 4 294 967 296) Digital Video 7 8 Digital Video Resolution • resolution • SD 480i / SD 576i • bit depth • HD 720p / HD 1080i • linear, power, logarithmic • 2K / HD 1080p • colour model • 4K / UHD-1 • chroma subsampling • 8K / UHD-2 • illuminant 9 10 Bit Depth Linear, Power, Logarithmic • 8 bit (28 = 256) «medium grey» • 10 bit (210 = 1 024) • linear: 18% • 12 bit (212 = 4 096) • power: 50% • 16 bit (216 = 65 536) • logarithmic: 50% • 24 bit (224 = 16 777 216) 11 12 Colour Model • XYZ, L*a*b* • RGB / R′G′B′ / CMY / C′M′Y′ • Y′IQ / Y′UV / Y′DBDR • Y′CBCR / Y′COCG • Y′PBPR 13 14 15 16 17 18 RGB24 00000000 11111111 00000000 00000000 00000000 00000000 11111111 00000000 00000000 00000000 00000000 11111111 00000000 11111111 11111111 11111111 11111111 00000000 11111111 11111111 11111111 11111111 00000000 11111111 19 20 Compression Uncompressed • uncompressed + data simpler to process • lossless compression + software runs faster • lossy compression – bigger files • chroma subsampling – slower writing, transmission and reading • born
[Show full text]
Shop Fullcompass.Com Today! for Expert Advice - Call: 800-356-5844 M-F: 9:00-5:30 Central 412 VIDEO PLAYERS / RECORDERS
DVD / BLU-RAY PLAYERS AND RECORDERS DVD / BLU-RAYVIDEO PLAY PLAYERSE RASND / RECORDERS 411 NEW! ATOMOS ATOMOS NINJA STAR POCKET- SIZE APPLE PRORES RECORDER AND TASCAM DV-D01U RACKMOUNTABLE SINGLE DISC DVD PLAYER DECK Designed for action cameras, drones The DV-D01U is a rackmountable single-disc player with a powered loading tray. and mirrorless DSLR’s, this pocket-size Apple The player reads DVD video, DVD audio (2-channel only), video CD, CD-DA, MP3, ProRes recorder delivers better quality (no MPEG compression) and huge WMA, .WAV, JPEG, ASF, MPEG-2/MPEG-1, and DivX. It is capable of playing back workflow timesavings. Ultra-long battery life with tiny size and weight make this properly finalized DVD +R/+RW discs. Outputs consist of HDMI audio/video unit ideal for situations requiring portability, reliability and long power draws. out and composite, S-Video, and component video outputs. Rear panel stereo Captures video in select HD/SD recording formats via HDMI, with 2-channel audio outputs are unbalanced (RCA) and digital outputs are optical. Digital outputs can from camera and/or analog input. Edit-ready media files are recorded directly to pass Dolby Digital and DTS surround streams for later decoding. The DV-D01U CFast 1.0 memory card. Standard mounting plate included. provides extensive bi-directional RS232 serial control and an I/R remote control ITEM DESCRIPTION PRICE is included. ATO-NINJA-STAR........ Pocket-Size ProRes Recorder & Deck ........................................... 295.00 ITEM DESCRIPTION PRICE ATO-MCFT064 ........... 64GB CFast Memory Card ........................................................... 159.00 DVD01U ..................... Rackmountable DVD player, 1RU ................................................ 369.99 ATO-MCFT128 ..........
[Show full text]
Prices 06-2021
Prices (exc. VAT) -June 2021 1 - Contents 2 - 4K HDR color grading 3 - 5.1 mixing 4 - Subtitling 5 - 2K/4K/3D DCPs 6 - Broadcast-ready files / IMF Package / Dolby E 7 - DVD & 2D/3D/4K Blu-ray authoring 8 - DVD duplication 9 - Blu-ray duplication 10 - Dailies management / 3D & HDR encoding 11 - LTO archiving and restore Have a question or want a quote? Write to us: [email protected] Registration: 492432703 - VAT ID: FR52492432703 4K HDR color grading Color grading station Half-day (4h) Full day (8h) Week (5d) Rental of 4K HDR DaVinci Resolve station with senior colorist's services € 550 € 990 € 4 900 Rental of 4K HDR DaVinci Resolve station without senior colorist's services € 270 € 500 € 2 450 Delivery of DaVinci Resolve source project to customer Included Video export Apple ProRes or DNxHR Included Color grading peripherals Week (5d) Rental of HDR Eizo CG3145 Prominence monitor € 900 Rental of DaVinci Resolve Mini Panel € 300 Transport costs (both ways, mandatory, only available in Paris, Hauts-de-Seine, Seine-Saint-Denis and Val-de-Marne) € 100 Roundtrip workflow Final Cut Pro Media Composer Premiere Pro Organisation of the timeline and export to Final Cut Pro 7/X, Avid Media Composer or Adobe Premiere Pro Offline reference clip with burned-in timecode after export € 90 / hour Project import and check on DaVinci Resolve The powerful color grading station: Blackmagic Design's DaVinci Resolve Studio 17 on Linux (+Neat plugin) AMD Ryzen Threadripper 64 cores / nVidia RTX 3090 24 GB Best 4K DCI 10-bit HDR mastering display monitor on an Eizo CG3145 Prominence (meeting Dolby Vision and Netflix standards) Display calibration by a VTCAM expert to Rec.
[Show full text]
Capabilities of the Horchow Auditorium and the Orientation
Performance Capabilities of Horchow Auditorium and Atrium at the Dallas Museum of Art Horchow Auditorium Capacity and Stage: The auditorium seats 333 people (with a 12 removable chair option in the back), maxing out the capacity at 345). The stage is 45’ X 18’and the screen is 27’ X 14’. A height adjustable podium, microphone, podium clock and light are standard equipment available. Installed/Available Equipment Sound: Lighting: 24 channel sound board 24 fixed lights 4 stage monitors (with up to 4 Mixes) 5 movers (these give a wide array of lighting looks) 6 hardwired microphones 4 wireless lavaliere microphones 2 handheld wireless microphones (with headphone option) 9-foot Steinway Concert Grand Piano 3 Bose towers (these have been requested by Acoustic performers before and work very well) Music stands Projection Panasonic PTRQ32 4K 20,000 Lumen Laser Projector Preferred Video Formats in Horchow Blu Ray DVD Apple ProRes 4:2:2 Standard in a .mov wrapper H.264 in a .mov wrapper Formats we can use, but are not optimal MPEG-1/2 Dirac / VC-2 DivX® (1/2/3/4/5/6) MJPEG (A/B) MPEG-4 ASP WMV 1/2 XviD WMV 3 / WMV-9 / VC-1 3ivX D4 Sorenson 1/3 H.261/H.263 / H.263i DV H.264 / MPEG-4 AVC On2 VP3/VP5/VP6 Cinepak Indeo Video v3 (IV32) Theora Real Video (1/2/3/4) Atrium Capacity and Stage: The Atrium seats up to 500 people (chair rental required). The stage available to be installed in the Atrium is 16’ x 12’ x 1’.
[Show full text]
© 2019 Jimi Jones
© 2019 Jimi Jones SO MANY STANDARDS, SO LITTLE TIME: A HISTORY AND ANALYSIS OF FOUR DIGITAL VIDEO STANDARDS BY JIMI JONES DISSERTATION Submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy in Library and Information Science in the Graduate College of the University of Illinois at Urbana-Champaign, 2019 Urbana, Illinois Doctoral Committee: Associate Professor Jerome McDonough, Chair Associate Professor Lori Kendall Assistant Professor Peter Darch Professor Howard Besser, New York University ABSTRACT This dissertation focuses on standards for digital video - the social aspects of their design and the sociotechnical forces that drive their development and adoption. This work is a history and analysis of how the MXF, JPEG 2000, FFV1 and Matroska standards have been adopted and/or adapted by libraries and archives of different sizes. Well-funded institutions often have the resources to develop tailor-made specifications for the digitization of their analog video objects. Digital video standards and specifications of this kind are often derived from the needs of the cinema production and television broadcast realms in the United States and may be unsuitable for smaller memory institutions that are resource-poor and/or lack staff with the knowledge to implement these technologies. This research seeks to provide insight into how moving image preservation professionals work with - and sometimes against - broadcast and film production industries in order to produce and/or implement standards governing video formats and encodings. This dissertation describes the transition of four digital video standards from niches to widespread use in libraries and archives. It also examines the effects these standards produce on cultural heritage video preservation by interviewing people who implement the standards as well as people who develop them.
[Show full text]
(A/V Codecs) REDCODE RAW (.R3D) ARRIRAW
What is a Codec? Codec is a portmanteau of either "Compressor-Decompressor" or "Coder-Decoder," which describes a device or program capable of performing transformations on a data stream or signal. Codecs encode a stream or signal for transmission, storage or encryption and decode it for viewing or editing. Codecs are often used in videoconferencing and streaming media solutions. A video codec converts analog video signals from a video camera into digital signals for transmission. It then converts the digital signals back to analog for display. An audio codec converts analog audio signals from a microphone into digital signals for transmission. It then converts the digital signals back to analog for playing. The raw encoded form of audio and video data is often called essence, to distinguish it from the metadata information that together make up the information content of the stream and any "wrapper" data that is then added to aid access to or improve the robustness of the stream. Most codecs are lossy, in order to get a reasonably small file size. There are lossless codecs as well, but for most purposes the almost imperceptible increase in quality is not worth the considerable increase in data size. The main exception is if the data will undergo more processing in the future, in which case the repeated lossy encoding would damage the eventual quality too much. Many multimedia data streams need to contain both audio and video data, and often some form of metadata that permits synchronization of the audio and video. Each of these three streams may be handled by different programs, processes, or hardware; but for the multimedia data stream to be useful in stored or transmitted form, they must be encapsulated together in a container format.
[Show full text]
Opus, a Free, High-Quality Speech and Audio Codec
Opus, a free, high-quality speech and audio codec Jean-Marc Valin, Koen Vos, Timothy B. Terriberry, Gregory Maxwell 29 January 2014 Xiph.Org & Mozilla What is Opus? ● New highly-flexible speech and audio codec – Works for most audio applications ● Completely free – Royalty-free licensing – Open-source implementation ● IETF RFC 6716 (Sep. 2012) Xiph.Org & Mozilla Why a New Audio Codec? http://xkcd.com/927/ http://imgs.xkcd.com/comics/standards.png Xiph.Org & Mozilla Why Should You Care? ● Best-in-class performance within a wide range of bitrates and applications ● Adaptability to varying network conditions ● Will be deployed as part of WebRTC ● No licensing costs ● No incompatible flavours Xiph.Org & Mozilla History ● Jan. 2007: SILK project started at Skype ● Nov. 2007: CELT project started ● Mar. 2009: Skype asks IETF to create a WG ● Feb. 2010: WG created ● Jul. 2010: First prototype of SILK+CELT codec ● Dec 2011: Opus surpasses Vorbis and AAC ● Sep. 2012: Opus becomes RFC 6716 ● Dec. 2013: Version 1.1 of libopus released Xiph.Org & Mozilla Applications and Standards (2010) Application Codec VoIP with PSTN AMR-NB Wideband VoIP/videoconference AMR-WB High-quality videoconference G.719 Low-bitrate music streaming HE-AAC High-quality music streaming AAC-LC Low-delay broadcast AAC-ELD Network music performance Xiph.Org & Mozilla Applications and Standards (2013) Application Codec VoIP with PSTN Opus Wideband VoIP/videoconference Opus High-quality videoconference Opus Low-bitrate music streaming Opus High-quality music streaming Opus Low-delay
[Show full text]
FFV1, Matroska, LPCM (And More)
MediaConch Implementation and policy checking on FFV1, Matroska, LPCM (and more) Jérôme Martinez, MediaArea Innovation Workshop ‑ March 2017 What is MediaConch? MediaConch is a conformance checker Implementation checker Policy checker Reporter Fixer What is MediaConch? Implementation and Policy reporter What is MediaConch? Implementation report: Policy report: What is MediaConch? General information about your files What is MediaConch? Inspect your files What is MediaConch? Policy editor What is MediaConch? Public policies What is MediaConch? Fixer Segment sizes in Matroska Matroska “bit flip” correction FFV1 “bit flip” correction Integration Archivematica is an integrated suite of open‑source software tools that allows users to process digital objects from ingest to access in compliance with the ISO‑OAIS functional model MediaConch interfaces Graphical interface Web interface Command line Server (REST API) (Work in progress) a library (.dll/.so/.dylib) MediaConch output formats XML (native format) Text HTML (Work in progress) PDF Tweakable! (with XSL) Open source GPLv3+ and MPLv2+ Relies on MediaInfo (metadata extraction tool) Use well‑known open source libraries: Qt, sqlite, libevent, libxml2, libxslt, libexslt... Supported formats Priorities for the implementation checker Matroska FFV1 PCM Can accept any format supported by MediaInfo for the policy checker MXF + JP2k QuickTime/MOV Audio files (WAV, BWF, AIFF...) ... Supported formats Can be expanded By plugins Support of PDF checker: VeraPDF plugin Support of TIFF checker: DPF Manager plugin You use another checker? Let us know By internal development More tests on your preferred format is possible It depends on you! Versatile Several input formats are accepted FFV1 from MOV or AVI Matroska with other video formats (Work in progress) Extraction of a PDF or TIFF aachement from a Matroska container and analyze with a plugin (e.g.
[Show full text]
Recommended File Formats for Long-Term Archiving and for Web Dissemination in Phaidra
Recommended file formats for long-term archiving and for web dissemination in Phaidra Edited by Gianluca Drago May 2019 License: https://creativecommons.org/licenses/by-nc-sa/4.0/ Premise This document is intended to provide an overview of the file formats to be used depending on two possible destinations of the digital document: long-term archiving uploading to Phaidra and subsequent web dissemination When the document uploaded to Phaidra is also the only saved file, the two destinations end up coinciding, but in general one will probably want to produce two different files, in two different formats, so as to meet the differences in requirements and use in the final destinations. In the following tables, the recommendations for long-term archiving are distinct from those for dissemination in Phaidra. There are no absolute criteria for choosing the file format. The choice is always dependent on different evaluations that the person who is carrying out the archiving will have to make on a case by case basis and will often result in a compromise between the best achievable quality and the limits imposed by the costs of production, processing and storage of files, as well as, for the preceding, by the opportunity of a conversion to a new format. 1 This choice is particularly significant from the perspective of long-term archiving, for which a quality that respects the authenticity and integrity of the original document and a format that guarantees long-term access to data are desirable. This document should be seen more as an aid to the reasoned choice of the person carrying out the archiving than as a list of guidelines to be followed to the letter.
[Show full text]
Format Support
Episode 6 Format Support FILE FORMAT CODEC Episode Episode Episode Pro EngineCOMMENTS Adaptive bitrate streaming Microsoft Smooth Streaming H.264 (AAC audio) O Windows OS only. Available with Episode Engine License. Apple HLS H.264 (AAC audio) O Available with Episode Engine License. Windows Media WMV, ASF VC-1 O O O WM9 I/O I/O I/O WMV7 and 8 through F4M component on Mac WMA I/O I/O I/O WMA Pro I/O I/O I/O Flash FLV Flash 8 (VP6s/VP6e) I/O I/O I/O SWF Flash 8 (VP6s/VP6e) I/O I/O I/O MOV/MP4/F4V Flash 9 (H.264) I/O I/O I/O F4V as extension to MP4 WebM WebM VP8 O O O Vorbis O O O 3GPP 3GPP AAC I/O I/O I/O H.263 I/O I/O I/O H.264 I/O I/O I/O MainConcept and x264 MPEG-4 I/O I/O I/O 3GPP2 3GPP2 AAC I/O I/O I/O H.263 I/O I/O I/O H.264 I/O I/O I/O MainConcept and x264 MPEG-4 I/O I/O I/O MPEG Elementary Streams MPEG-1 Elementary Stream MPEG-1 (video) I/O I/O I/O MPEG-2 Elementary Stream MPEG-2 I/O I/O I/O MPEG Program Streams PS AAC O O O MainConcept and x264 H.264 I/O I/O I/O MPEG-1/2 (audio) I/O I/O I/O MPEG-2 I/O I/O I/O MPEG-4 I/O I/O I/O MPEG Transport Streams TS AAC I O O AES I I/O I/O H.264 I I/O I/O MainConcept and x264 AVCHD I I I HDV I I/O I/O MPEG - 1/2 (audio) I I/O I/O MPEG - 2 I I/O I/O MPEG - 4 I I/O I/O PCM I I I Matrox MAX H.264 I/O I/O I/O QT codec (*output possible via QT), Requires Matrox MAX hardware - Mac OS X only MPEG System Streams M1A MPEG-1 (audio) I/O I/O I/O M1V MPEG-1 (audio) I/O I/O I/O Episode 6 Format Support Format Support FILE FORMAT CODEC Episode Episode Episode Pro EngineCOMMENTS MPEG-4 MP4 AAC I/O I/O I/O
[Show full text]
FFV1 Video Codec Specification
FFV1 Video Codec Specification by Michael Niedermayer [email protected] Contents 1 Introduction 2 2 Terms and Definitions 2 2.1 Terms ................................................. 2 2.2 Definitions ............................................... 2 3 Conventions 3 3.1 Arithmetic operators ......................................... 3 3.2 Assignment operators ........................................ 3 3.3 Comparison operators ........................................ 3 3.4 Order of operation precedence .................................... 4 3.5 Range ................................................. 4 3.6 Bitstream functions .......................................... 4 4 General Description 5 4.1 Border ................................................. 5 4.2 Median predictor ........................................... 5 4.3 Context ................................................ 5 4.4 Quantization ............................................. 5 4.5 Colorspace ............................................... 6 4.5.1 JPEG2000-RCT ....................................... 6 4.6 Coding of the sample difference ................................... 6 4.6.1 Range coding mode ..................................... 6 4.6.2 Huffman coding mode .................................... 9 5 Bitstream 10 5.1 Configuration Record ......................................... 10 5.1.1 In AVI File Format ...................................... 11 5.1.2 In ISO/IEC 14496-12 (MP4 File Format) ......................... 11 5.1.3 In NUT File Format ....................................
[Show full text]
Pragmatic Audiovisual Preservation
http://doi.org/10.7207/twr20-10 Pragmatic Audiovisual Preservation Ashley Blewer DPC Technology Watch Report October 2020 © Digital Preservation Coalition 2020 and Ashley Blewer 2020 ISSN: 2048-7916 DOI: http://doi.org/10.7207/twr20-10 All rights reserved. No part of this publication may be reproduced, stored in a retrieval system, or transmitted, in any form or by any means, without prior permission in writing from the publisher. The moral rights of the author have been asserted. First published in Great Britain in 2020 by the Digital Preservation Coalition. Pragmatic Audiovisual Preservation Foreword The Digital Preservation Coalition (DPC) is an advocate and catalyst for digital preservation, ensuring our members can deliver resilient long-term access to digital content and services. It is a not-for- profit membership organization whose primary objective is to raise awareness of the importance of the preservation of digital material and the attendant strategic, cultural and technological issues. It supports its members through knowledge exchange, capacity building, assurance, advocacy and partnership. The DPC’s vision is to make our digital memory accessible tomorrow. The DPC Technology Watch Reports identify, delineate, monitor and address topics that have a major bearing on ensuring our collected digital memory will be for the future. They provide an advanced introduction in order to support those charged with ensuring a robust digital memory, and they are of general interest to a wide and international audience with interests in computing, information management, collections management and technology. The reports are commissioned after consultation among DPC members about shared priorities and challenges; they are commissioned from experts; and they are thoroughly scrutinized by peers before being released.
[Show full text]