Technical Advisory Service for Images Advice Paper Choosing a File Format

Total Page:16

File Type:pdf, Size:1020Kb

Technical Advisory Service for Images Advice Paper Choosing a File Format Technical Advisory Service for Images Advice Paper Choosing a File Format Introduction Over the years, there have been a number of image file formats that have been proposed and used. Of course, every year, this choice gets larger and larger as new file formats are introduced and it is not always immediately clear which file format is the best one to use in any particular case. The choice will depend on a number of factors, which will vary according to how you intend to use the file. Each stage of the process, from capture through to delivery, has its own requirements that may affect this choice. This report provides a brief look at some of these factors and provides guidelines to making the best choice from what is available. For a full introduction to the file formats themselves, see the TASI Advice Document File Formats and Compression - http://www.tasi.ac.uk/advice/creating/fformat.html. Choose a non-proprietary open ‘standard’ Despite the large range of available file formats, choosing one should not be too hard as only a very few of them are normally recommended for digitisation projects. Any digitisation project will need to consider the long-term usefulness and accessibility of the images and this means choosing a file that is both an established industry ‘standard’ as well as a non-proprietary format. This limits the range to a much more easily considered number that includes the most common four below: • Tagged Image File Format (TIFF) • Portable Network Graphics (PNG) • Joint Photographic Experts Group File Interchange Format (JPEG or JFIF) • Graphic Interchange Format (GIF) Copyright © TASI www.tasi.ac.uk advice – training – resources Last reviewed May 2006 Page 1 of 10 There can be good reasons why a project might wish or need to use another file format at some part of their project, such as some of the proprietary formats including: • Adobe Acrobat File (PDF) • Adobe Photoshop Image File (PSD) • The camera’s native RAW file However this is likely to come about because of some specific need of a particular project and cannot be covered here. For details of these file types and many others, please see the TASI Advice Document File Formats and Compression - http://www.tasi.ac.uk/advice/creating/fformat.html. File Formats for Capture This is the first step in the digitisation process. When capturing images, it is important that they are all created at the highest possible quality and at a size appropriate for all subsequent uses. Errors at this point will certainly compromise the quality of the whole project and the only recovery option will be to go back and re-capture the original. All digital capture devices originally capture values of Red, Green and Blue. The number of different describable colours (or tones of grey) will depend upon the ‘bit-depth’ of the device. Any modern device will be able to capture in at least 24-bit colour (or 8-bit B&W) (see the TASI Advice Document The Digital Image - http://www.tasi.ac.uk/advice/creating/image.html), although some modern devices can capture at higher bit depths, right up to 48-bit. Some of the more advanced cameras offer their own un-processed RAW formats. These files contain all of the original data as captured by the sensor without alteration. These images are then processed on the computer where fine adjustments can be made to the white balance, exposure and sharpness before saving in a non-proprietary format. RAW files usually contain higher bit depths than the equivalent JPEGs and TIFFs produced by the camera. Once the capture device has created the image, it must be saved for later use. Format Requirements A file format should be chosen that: • Retains all information that was created by the capture device. This will mean using a file format that can store the image in at least the same colour depth as it was created. 24-bit for colour and 8-bit for B&W should be considered the minimum although files captured with a larger bit-depth should really be archived with this information Copyright © TASI www.tasi.ac.uk advice – training – resources Last reviewed May 2006 Page 2 of 10 • Retains any capture device colour management information (ICC profile) • Uses (or can be set up to use) no compression The suggested format here is: TIFF or the proprietary format of capture device. Although it is normally advisable to avoid all proprietary file formats, there can be an argument for the temporary use of a proprietary format within the scanning software if it is able to offer some level of additional functionality. However it would still need to be converted to another open standard format before being archived. When we mention or specify TIFF, it is important to realise that the TIFF file format comes in a range of types, supporting different functionality, such as multipages and even a choice of compressions including JPEG. So when we specify TIFF for archival purposes we always mean an uncompressed Baseline TIFF v6 with Intel byte order (PC option). File Formats for Master Archive There are two possible methodologies for creating a Master Archive and both have advantages, depending on the project. Method 1 – Archive all data exactly as created by the capture device. The Master Archive contains a copy of each image in a form as close as possible to the original captured data. This enables the project to go back to the archive knowing that they have an exact copy of everything that was originally created by the capture device for the project. It should be realised that as images are pre-optimisation, they might not look as good as those archived using Method 2. They will be in a totally original form but not necessarily the highest visual quality. With this approach, it is important to use a colour space that in no way compromises the colour gamut of the original data. This will often mean leaving the image within the capture device’s own colour space, but could mean using a larger or unbounded colour space such as CIE Lab. See the TASI Advice Document on Colour Management – http://www.tasi.ac.uk/advice/creating/colour.html. Method 2 – Archive an optimised version of image file. The Master Archive contains a copy of each image after it has been prepared and optimised for use at its highest quality (see Basic Guidelines for Image Capture and Optimisation - http://www.tasi.ac.uk/advice/creating/img_capt.html). This has the advantage of archiving the image in a ready-to-use state. The optimisation need only be done once, and all images can be handled in a consistent way. However it is inevitable that some data will have been lost in the process and if the optimisation (see Basic Guidelines for Image Capture and Copyright © TASI www.tasi.ac.uk advice – training – resources Last reviewed May 2006 Page 3 of 10 Optimisation - http://www.tasi.ac.uk/advice/creating/img_capt.html) is in any way inappropriate or badly undertaken then the project will be unable to go back to the original data and work from there. For this approach it would make sense to save the image in a colour space appropriate for the intended use of the image in the future. (Adobe RGB 1998 would be advised for print/Web, but sRGB could be used if the only delivery medium was going to be the Web). Format Requirements The requirements of a file format for archiving are the same as for creation except that it should also: • Be an open standard file format - proprietary formats should not be used, as there is uncertainty about the ability to open the file in the future. A possible exception to this might be the Adobe Photoshop format - see below • Preferably not use any compression, although lossless compression may be acceptable. Be aware that one of the most common lossless compressions is LZW, which is based upon patented technology and should therefore be avoided. Suggested formats: • Method 1 DNG, TIFF, PNG • Method 2 TIFF, PNG or possibly PSD One way around the question of whether to archive before or after optimisation is to use the ‘layers’ features of Photoshop and save the image as a PSD file. This proprietary file format allows both the original image (un-optimised) and any optimisation to be stored within the same file. This effectively allows both states of the file to be archived within the same file. The PSD file is however a ‘Proprietary’ format and its use should therefore be approached with great care. File Formats for Optimisation and Manipulation All image optimisation and manipulation is undertaken within image processing software. Whilst carrying out this work, it can be useful to save the image in the proprietary format of the image processing software. Editing can be a time consuming process and the proprietary formats offer increased functionality that enable extra information (e.g. layers, masks and channels) to be stored. This enables subsequent editing to resume from where the last session finished without having to recreate any prior work. Unfortunately using a proprietary file format in this way conflicts with the preservation requirements of our archive images. This is where archiving after optimisation can have an advantage. Copyright © TASI www.tasi.ac.uk advice – training – resources Last reviewed May 2006 Page 4 of 10 On the other hand, if the image is going to require a lot of manipulation or will be made for a specific use then it can be helpful to have access to the original file before any other processing has been undertaken.
Recommended publications
  • File Formats
    Electronic Records Management Guidelines - File Formats Rapid changes in technology mean that file formats can become obsolete quickly and cause problems for your records management strategy. A long-term view and careful planning can overcome this risk and ensure that you can meet your legal and operational requirements. Legally, your records must be authentic, complete, accessible, legally admissible in court, and durable for as long as your approved records retention schedules require. For example, you can convert a record to another, more durable format (e.g., from a nearly obsolete software program to a text file). That copy, as long as it is created in a trustworthy manner, is legally acceptable. The software in which a file is created usually has a default format, often indicated by a file name suffix (e.g., *.PDF for portable document format). Most software allows authors to select from a variety of formats when they save a file (e.g., document [DOC], Rich Text Format [RTF], text [TXT] in Microsoft Word). Some software, such as Adobe Acrobat, is designed to convert files from one format to another. Legal Framework: Key Concepts As you consider the file format options available to you, you will need to be familiar with the following concepts: Proprietary and non-proprietary file formats File format types Preservation: conversion and migration Compression Importance of planning File Format Decisions and Electronic Records Management Goals Proprietary and Non-proprietary File Formats A file format is usually described as either proprietary or non-proprietary: Proprietary formats. Proprietary file formats are controlled and supported by just one software developer, or can only be read by a limited number of other programs.
    [Show full text]
  • File Format Guidelines for Management and Long-Term Retention of Electronic Records
    FILE FORMAT GUIDELINES FOR MANAGEMENT AND LONG-TERM RETENTION OF ELECTRONIC RECORDS 9/10/2012 State Archives of North Carolina File Format Guidelines for Management and Long-Term Retention of Electronic records Table of Contents 1. GUIDELINES AND RECOMMENDATIONS .................................................................................. 3 2. DESCRIPTION OF FORMATS RECOMMENDED FOR LONG-TERM RETENTION ......................... 7 2.1 Word Processing Documents ...................................................................................................................... 7 2.1.1 PDF/A-1a (.pdf) (ISO 19005-1 compliant PDF/A) ........................................................................ 7 2.1.2 OpenDocument Text (.odt) ................................................................................................................... 3 2.1.3 Special Note on Google Docs™ .......................................................................................................... 4 2.2 Plain Text Documents ................................................................................................................................... 5 2.2.1 Plain Text (.txt) US-ASCII or UTF-8 encoding ................................................................................... 6 2.2.2 Comma-separated file (.csv) US-ASCII or UTF-8 encoding ........................................................... 7 2.2.3 Tab-delimited file (.txt) US-ASCII or UTF-8 encoding .................................................................... 8 2.3
    [Show full text]
  • "Digital Video and Graphics for Planetaria and Exhibits" © Jeff Bowen
    3924 Pendleton Way • Indianapolis, IN• 46226• 317-536-1283 www.bowentechnovation.com "Digital Video and Graphics for Planetaria and Exhibits" © Jeff Bowen. June 25, 2004 [email protected] Section 1.0 Workshop Synopsis As we are heading into an era in which all visual media in the planetarium will be digital, attendees will learn what are current and forthcoming visual file formats and production methodologies. What is MPEG...DVI...when do you import an avi or mov? What are SD files...is 16:9 HD? Why is editing MPEG a bad idea? How do you archive and access digital files? What formats will soon be obsolete and which new ones will stay? Which of the new DVD formats will stick around? Jeff Bowen will share his extensive experience in producing award-winning digital media for education, planetariums, exhibits and broadcast. Section 2.0 Qualification of Attendees Number who have worked with video editing? Number who have worked with Photoshop? Number who have worked with digital video editing? Number who use digital playback in the dome? Number who have worked with digital audio editing? Number who have worked with digital editing? Created by Jeff Bowen Page 1 7/6/2004 Section 3.0 Digital Video Terminology and Specs Analog Video is represented as a continuous (time varying) signal. Digital Video is represented as a sequence of digital images. NTSC Video- 525 scan lines per frame, 30 frames per second (or be exact, 29.97 fps, 33.37 msec/frame) Interlaced, each frame is divided into 2 fields, 262.5 lines/field.
    [Show full text]
  • File Formatsformats
    FILEFILE FORMATSFORMATS Summary records created or formatted electronically are Rapid changes in technology mean that file formats covered under the act. can become obsolete quickly and cause problems for Proprietary, Non-proprietary, Open your records management strategy. A long-term view Standard and Open Source File Formats and careful planning can overcome this risk and ◆ ensure that you can meet your legal and operational Proprietary formats. Proprietary file formats are requirements. controlled and supported by just one software developer. Microsoft Word (.DOC) format is an Legally, your records must be trustworthy, complete, example. accessible, admissible in court, and durable for as ◆ Non-proprietary formats. These formats are long as your approved records retention schedules supported by more than one developer and can require. For example, you can convert a record to be accessed with different software systems. For another, more durable format (e.g., from a nearly example, eXtensible Markup Language (XML) is obsolete software program to a text file). That copy, becoming an increasingly popular non-proprietary as long as it is created in a trustworthy manner, is format. legally acceptable. ◆ Open Source formats. In general, open source The software in which a file is created usually has a refers to any program whose source code is made default format, often indicated by a file name suffix available for use or modification as users or other (e.g., *.PDF for portable document format). Most developers see fit. Open source software may be software allows authors to select from a variety of developed, modified and distributed by formats when they save a file (e.g., document independent software companies for profit.
    [Show full text]
  • Email Attachments: Best Practices
    Email Attachments: Best Practices Students, staff and faculty now communicate very well by email. There are simple things you can do to use email even more effectively to get your message across1. 1 Sending Email Attachments 1. Send the message in the body, not in an attachment. Avoid using attachments if you can send the message in the body instead. Some email reading tools do not handle attachments well. Using attachments makes the recipient take extra steps to read your message. Attachments are the primary way viruses are transmitted. Attachments are often in a proprietary format (such as Word, Word Perfect, Excel, and so on) that the recipient might not have the software to read. That software can be expensive, and might not work on every operating system. Reading attachments in proprietary formats is especially hard for recipients who use Unix or GNU/Linux or who lack the funds to upgrade proprietary software annually. 2. Use non-proprietary formats. If you want more formatting than a simple email message can provide, consider using a non-proprietary format such as HTML (.htm, .html), Rich Text Format (.rtf), or Portable Document Format (.pdf) in preference to proprietary formats such as Word (.doc). More people will be able to read your message; there is a smaller chance you will inadvertently transmit a virus; there is a smaller chance you will compromise your own privacy acci- dentally; and you will save University resources—the files are much smaller. You can use your usual word processor to write documents but still save them in a more accessible, compact and safer format to send them by email.
    [Show full text]
  • Library of Congress Recommended Formats Statement 2017-2018
    Library of Congress Recommended Formats Statement 2017-2018 Introduction Categories of creative content: I. Textual Works and Musical Compositions i. Textual Works – Print ii. Textual Works – Digital iii. Textual works – Electronic Serials iv. Digital Musical Compositions (score-based representations) II. Still Image Works i. Photographs – Print ii. Photographs – Digital iii. Other Graphic Images – Print iv. Other Graphic Images – Digital v. Microforms III. Audio Works i. Audio – On Tangible Medium (digital and analog) ii. Audio – Media-independent (digital) IV. Moving Image Works i. Motion Pictures – Digital and Physical Media ii. Video – File-Based and Physical Media V. Software and Electronic Gaming and Learning VI. Datasets/Databases i. Datasets ii. Geospatial Data iii. Databases VII. Websites LOC Recommended Formats Statement 2017-2018 Introduction to the 2017-2018 revision Throughout its history, the Library of Congress has been committed to the goal best described in its mission statement to provide “the American people with a rich, diverse, and enduring source of knowledge that can be relied upon to inform, inspire, and engage them, and support their intellectual and creative endeavors”. At its core, this source of knowledge is best expressed in the Library’s unparalleled collection of creative works. The quality of the collection reflects the Library's care in selecting materials and the effort it invests in preserving them and making them accessible to the American people for the long term. To build such a substantial and wide-ranging collection and to ensure that it will be available for successive generations, the Library relies upon many things. In order to maximize the scope and scale of the content in the collection, the Library calls upon the wealth of expertise in languages, subject matter and trends in publishing and content creation provided by the specialists who identify and acquire material for the Library’s collection.
    [Show full text]
  • PDF/A in a Nutshell 2.0 PDF for Long-Term Archiving
    PDF/A in a Nutshell 2.0 PDF for long-term archiving Alexandra Oettler ■ The history of the ISO standard ■ All versions – from PDF/A-1 to PDF/A-3 ■ How users benefit from PDF/A ■ The technical background ■ Tools for creating PDF/A files ■ Validating PDF/A files ■ PDF/A in law and administration ■ PDF/A in finance and industry PDF/A in a Nutshell 2.0 PDF for long-term archiving The ISO Standard – from PDF/A-1 to PDF/A-3 This work, including all its component parts, is copyright protected. All rights based thereupon are reserved, including those of translation, reprinting, presentation, extraction of illustrations or tables, broadcasting, microfilming or reproduction by any other means, or storage in any data-processing device, in whole or in part. Reproduction of this work or any part of this work is only permitted where legally specified in the Copyright Act of the Federal Republic of Germany dated the 9th of September 1965. © 2013 Association for Digital Document Standards e. V., Berlin [email protected] Printed in Germany The use of any names, trade names, trade descriptions etc. in this work, even those not specially identified as such, does not justify the assumption that these names are free according to trademark protection law and thus usable by anyone. Text: Alexandra Oettler Layout, cover design, design and composition: Alexandra Oettler Cover image: Paulgeor, Dreamstime.com Picture credits: Page 5: Photocase; Page 6: Sepp Huberbauer, Photocase; Page 8: aoe; Page 13: EU Publications Office; Page 14: Rui Frias, Istockphoto.com; Page 15: MBPHOTO, Istockphoto.com; Page 18: Photocase.
    [Show full text]
  • File Formats
    Electronic Records Management Guidelines File Formats File Formats Summary Rapid changes in technology mean that file formats can become obsolete quickly and cause problems for your records management strategy. A long-term view and careful planning can overcome this risk and ensure that you can meet your legal and operational requirements. Legally, your records must be trustworthy, complete, accessible, legally admissible in court, and durable for as long as your approved records retention schedules require. For example, you can convert a record to another, more durable format (e.g., from a nearly obsolete software program to a text file) and that copy, as long as it is created in a trustworthy manner, is legally acceptable. The software in which a file is created usually uses a default format when the file is saved. This is indicated by the file name suffix (e.g., .PDF for portable document format). However, most software allows authors to select from a variety of formats when they save a file. For example, Microsoft Word allows the author to select document [DOC], Rich Text Format [RTF], or text [TXT], as well as other format options. Some software, such as Adobe Acrobat, is designed to convert files from one format to another. The format you choose will affect your long-term records management abilities. Legal Framework For more information on the legal framework you must consider when developing a file format policy refer to the Legal Framework chapter of these guidelines and the Minnesota State Archives’ Preserving and Disposing of Government Records1. Key Concepts As you consider the file format options available to you, you will need to be familiar with the following concepts: Proprietary, Non-Proprietary, Open-Source, and Open Standard File Formats File Types and their Associated Formats Preservation Options: Conversion and Migration Compression Importance of Planning 1 Minnesota Historical Society.
    [Show full text]
  • General Study 11 Final Report: Selecting Digital File Formats for Long-Term Preservation
    Title: General Study 11 Final Report: Selecting Digital File Formats for Long-Term Preservation Status: Final (public) Version: 1.1 Submission Date: December 2006 Release Date: March 2007 Author: The InterPARES 2 Project Writer(s): Evelyn Peters McLellan, Insurance Corporation of British Columbia Project Unit: Domain 3 URL: http://www.interpares.org/display_file.cfm?doc= ip2_file_formats(complete).pdf [English] http://www.interpares.org/display_file.cfm?doc= ip2_file_formats_fichiers_numériques.pdf [French] General Study 11 Final Report: Selecting Digital File Formats for Long-Term Preservation E. McLellan Table of Contents Introduction ......................................................................................................... 1 1. Terminology .................................................................................................... 1 1.1 What is a file format? ................................................................................... 1 1.2 “Open” file formats ....................................................................................... 3 1.3 “Standard” file formats ................................................................................. 4 1.4 “Stable” file formats ..................................................................................... 5 1.5 Standardizing terms .................................................................................... 5 2. Selection criteria ............................................................................................. 6 2.1 Widespread
    [Show full text]
  • Graphic-File-Formats.Pdf
    Digital Preservation Guidance Note: 4 Graphics File Formats Digital Preservation Guidance Note 4: Graphics file formats Document Control Author: Adrian Brown, Head of Digital Preservation Research Document Reference: DPGN-04 Issue: 2 Issue Date: August 2008 ©THE NATIONAL ARCHIVES 2008 Page 2 of 15 Digital Preservation Guidance Note 4: Graphics file formats Contents 1 INTRODUCTION .....................................................................................................................4 2 TYPES OF GRAPHICS FORMAT........................................................................................4 2.1 Raster Graphics ...............................................................................................................4 2.1.1 Colour Depth ............................................................................................................5 2.1.2 Colour Spaces and Palettes ..................................................................................5 2.1.3 Transparency............................................................................................................6 2.1.4 Interlacing..................................................................................................................6 2.1.5 Compression ............................................................................................................7 2.2 Vector Graphics ...............................................................................................................7 2.3 Metafiles............................................................................................................................7
    [Show full text]
  • Universal Design for Learning
    Universal Design for Learning Bryon Kluesner Adaptive Technology Coordinator UTC – Disability Resource Center Universal Design • Defined as … “The design of products and environments to be usable by all people, to the greatest extent possible, without the need for special accommodations.” -Center for Universal Design at North Carolina State University Why think about Universal Design? • In line with the UTC mission to embrace diversity • Ensures equal access to the educational environment for all learners • Celebrates human differences and promotes an inclusion based approach to our culture • Research has shown that this approach helps increase GPA and increase retention of all students Microsoft Word, Universally Designed • Purpose • This module outlines the benefits—to you and your readers—of using Universal Design for Learning (UDL) principles to create Word documents that are more understandable, usable, and flexible. Many of these benefits can be achieved using Word’s built-in tools and features, such organizing content in outline view, formatting with styles, employing best practices for page elements like images and tables, and saving your final work in multiple formats. Presenting Information in Multiple Ways • One of the hallmarks of UDL is its insistence on multiple forms of presentation—visual, oral, and textual. Providing information in a variety of modalities can help you reach a wider and more diverse audience. When this inclusive principle is applied to the preparation of Word documents, the need for supplementing visual elements, like images and tables, with text descriptions becomes clear. Images • An image can convey information quickly and powerfully—assuming it can been seen and understood. However, some readers may not understand the context of the image; others may not be able to see the image due to visual impairment, personal viewing preferences (especially on the web), or technological limitations.
    [Show full text]
  • Sustainable Digital File Formats for Creating and Using Records
    Sustainable Digital File Formats For Creating and Using Records Version 1.0 April 2020 Sustainable Digital Formats for Creating and Using Records 2 Copyright © Australasian Digital Recordkeeping Initiative 2020 The Australasian Digital Recordkeeping Initiative (ADRI) is composed of representatives from all state and national archival authorities in Australia and New Zealand. ADRI is a Working Group of the Council of Australasian Archives and Records Authorities (CAARA). ADRI gives no warranty that the information in this version is correct or complete, error free or contains no omissions. ADRI shall not be liable for any loss howsoever caused whether due to negligence or otherwise arising from the use of this document. Sustainable Digital Formats for Creating and Using Records 3 Table of Contents 1 Introduction 4 1.1 About this document 4 1.2 How should you use sustainable digital formats? 4 1.3 Why have we made these recommendations? 5 1.4 Who made these recommendations? 6 2 Recommended formats (summary) 7 3 Recommended formats (detail) 8 3.1 Plain Text Files 8 3.2 Data 9 3.3 Office Documents (Word Processing) 10 3.4 Office Documents (Spreadsheet) 11 3.5 Office Documents (Presentation) 12 3.6 Project Planning 12 3.7 Graphic Design/Drawings 12 3.8 Email 13 3.9 Website 14 3.10 Website (archival) 15 3.11 Audio 16 3.12 Image (Raster) 17 3.13 Image (Vector) 18 3.14 Image (Scanned Documents) 19 3.15 Image (Graphic Metafiles) 19 3.16 Video (Bare) 20 3.17 Video (Container) 21 3.18 Electronic Publications 22 3.19 Encapsulation 23 3.20 CAD 24 3.21 Geospatial 25 4 Long term sustainable format criteria 28 4.1 Ubiquitous 28 4.2 Unrestricted 28 4.3 Well Documented 29 4.4 Stable 29 4.5 Implementation Independent 29 4.6 Uncompressed 29 4.7 Supported 30 4.8 Incorporated Metadata 30 Sustainable Digital Formats for Creating and Using Records 4 1 Introduction 1.1 About this document This document provides guidance for Australian government agencies on lowering the risk of losing information because the format in which it is stored has become unreadable.
    [Show full text]