Remote Sensing: Data Formats and Software Packages

Total Page:16

File Type:pdf, Size:1020Kb

Remote Sensing: Data Formats and Software Packages Remote sensing: Data formats and software packages Rüdiger Gens What is this presentation is about y broad overview about x most common data formats used in remote sensing x software packages dealing with those formats y starting point for further studies Data formats and software packages 2 What this presentation is NOT about y the conclusive answer to all the questions about data formats you ever had y an attempt to cover every remote sensing data format under the sun y a sales pitch for any of the software packages y a tutorial on the different image products Data formats and software packages 3 Common remote sensing data y Optical x Landsat, Aster, AVHRR, MODIS, SPOT y SAR x Radarsat, ERS, JERS-1 y DEMs x GTOPO30, SDTS, NED, SRTM y Vector data x ESRI shape files Data formats and software packages y Models x netCDF 4 Flat binary multi-band formats y most basic form of storing raster data y usually accompanied by metadata file (ASCII or XML) y three common format x BIL – band interleaved by line x BIP – band interleaved by pixel x BSQ – band sequential Data formats and software packages 5 HDF-EOS format y standard data format for all NASA Earth Observing System (EOS) data products x multi-object file format developed at the National Center for Supercomputing Applications (NCSA) y standard HDF objects: images, tables, text, and data arrays y three additional data types based on HDF objects: grid, point, and swath Data formats and software packages y self-describing format 6 GeoTIFF format y extension of the regular TIFF format y uses a small set of reserved TIFF tags to store a broad range of georeferencing information y only commonly used generic image format that can handle geolocation information y available in all standard remote sensing and GIS packages Data formats and software packages 7 ERDAS Imagine y .lan format x old ERDAS Imagine 7.5 format x around for long time: most packages can read it y .img format x one of the standard remote sensing format x plays well with ArcGIS (Arc/Info) Data formats and software packages 8 CEOS format y standard data format for radar data x Radarsat, ERS, JERS-1 y comes in a large variety of flavors y contents depends on processing facility y usually requires software tools to read and convert into different format y interface for ASF data available in next version Data formats and software packages of ERDAS Imagine 9 MrSID format y stands for Multi-resolution Seamless Image Database y wavelet based image encoder, viewer and file format: compression efficient y main format of USGS scanning products x topo maps x aerial photographs y regularly used in GIS applications Data formats and software packages 10 Landsat data y available formats x HDF-EOS x GeoTIFF x Fast L7 • each band is self-contained in its own file • header file containing three ASCII metadata records (administrative, radiometric, and geometric) Data formats and software packages 11 Terra / Aqua data y large variety of products y Terra instruments x ASTER, CERES, MISR, MODIS, MOPITT y Aqua instruments x AIRS, AMSR-E, CERES, HSB, MODIS y number of software packages with interfaces y available formats Data formats and software packages x HDF-EOS 12 AVHRR data y number of software package interfaces available y available formats x Level 1b 8-bit/10-bit/16-bit HRPT/LAC x Level 1b 8-bit/10-bit/16-bit GAC x Dartcom 16-bit HRPT x Satlantic 16-bit HRPT x Quorum Qtrack 16-bit HRPT x 16-bit HRPT Minor Frame x Dundee 16-bit HRPT x AVHRR CEOS (Raw AVHRR CCT Image Format) Data formats and software packages 13 SPOT data y SPOT 1-4: CAP format y SPOT 5 and later: DIMAP format y usually requires software package with SPOT data interface Data formats and software packages 14 Digital Orthophoto Quadrangle (DOQ) y computer-generated image of an aerial photograph x image displacement caused by terrain relief and camera tilt has been removed x combines the image characteristics of the original photograph with the georeferenced qualities of a map y available formats Data formats and software packages x native (viewer and conversion tools available) x GeoTIFF 15 GTOPO30 y global topographic data (30 arc seconds) y format x DEM – digital elevation model data (flat binary) x HDR – header file for DEM (ASCII) x DMW – world file (ASCII) x STX – statistics file (ASCII) x PRJ – projection information file (ASCII) x GIF – shaded relief image (GIF format) Data formats and software packages x SRC – source map (8-bit binary) x SCH – header file for source map (ASCII) 16 SDTS format y stands for Spatial Data Transfer Standard y used by USGS for providing DEMs x SDTS was ratified by the National Institute of Standards and Technology (NIST) as a Federal Information Processing Standard (FIPS 173). x Compliance with FIPS 173 by federal agencies became mandatory in 1994 Data formats and software packages 17 National Elevation Dataset (NED) y provided by USGS using the Seamless Data Distribution System y available formats x ArcGrid (integer data) x GeoTIFF x GridFloat (Arc floating point data) x BIL (flat binary – band interleaved by line) Data formats and software packages 18 SRTM data y distributed by the USGS EROS Data Center y available formats x ArcGrid (integer data) x BIL (flat binary – band interleaved by line) x GeoTIFF Data formats and software packages 19 ESRI shape files y standard for vector data y basis of what GIS is all about y support point, line and area features y attributes stored in dBase format Data formats and software packages 20 netCDF format y stands for network Common Data Form y an interface for array-oriented data access y a library that provides an implementation of the interface y main format for atmospheric models y marine Geophysics data (gravity, magnetics and bathymetry) Data formats and software packages 21 Software packages Data formats and software packages 22 ArcGIS y comprehensive GIS package y graphical user interface to Arc/Info y developed by ESRI y runs on Windows y handles raster formats x GRID x GeoTIFF x JPEG Data formats and software packages x MrSID x ERDAS Imagine 23 ENVI 4.1 y originally developed for hyperspectral data y developed by Research Systems Inc. y image processing package y runs on all major platforms (Windows, Linux, Mac, various Unix flavors) y handles all major raster and vector formats y interfaces to all common remote sensing data Data formats and software packages 24 ERDAS Imagine 8.7 y full-blown remote sensing package y developed by Leica Geosystems y runs on Windows and Solaris y handles all major raster and vector formats y interfaces to all common remote sensing data y next version supports ASF CEOS format Data formats and software packages 25 ER Mapper 6.4 y mapping and image processing package y developed by Earth Resource Mapping y runs on Windows y handles most common raster and vector formats y interfaces for some remote sensing data Data formats and software packages 26 Geomatica 9.1 y remote sensing package y developed by PCI y runs on Windows, Linux, Solaris and Irix y handles all major raster and vector formats y interfaces to common remote sensing data Data formats and software packages 27 GeoMedia 5.2 y focus on mapping and geospatial solutions y strong link to Open GIS Consortium (OGC) y developed by Intergraph y runs on Windows Data formats and software packages 28 GRASS 5.3 y Geographic Resources Analysis Support System y GIS package with image processing functionality y handles common GIS formats and a few remote sensing formats y runs on Linux, Mac, various flavors of Unix Data formats and software packages y freeware 29 ILWIS 3.2 y stands for Integrated Land and Water Information System y developed at ITC, the Netherlands y remote sensing and GIS package y runs on Windows y shareware Data formats and software packages 30 IDRISI Kilimanjaro y focus on environmental decision making with GIS y developed by Clark Labs in Worcester, Massachusetts y GIS and image processing package y handles common data formats y interfaces to selected remote sensing data Data formats and software packages y runs on Windows 31 Nifty little helpers y free viewing tool (ERDAS) providing basic image viewing and manipulation capabilities y supports a variety of raster formats x Arc/Info BIL, BIP, BSQ x ER Mapper x ERDAS Imagine Data formats and software packages x JPEG x MrSID 32 Nifty little helpers y free viewing and mapping tool (ERDAS) y supports raster and vector formats x ERDAS Imagine Files x ESRI Shape Files x Tagged Image File Format (TIFF) x MrSID Data formats and software packages x JPEG 33 Nifty little helpers y ExpressView Browser Plug-in (MrSID) x for Internet Explorer and Netscape x ability to natively display MrSid and JPEG2000 Data formats and software packages 34 Nifty little helpers y HDF-EOS tools x HDF-EOS to GeoTIFF converter x General Coordinate Transformation Package (GCTP) x HDF Explorer – viewer for HDF-EOS and netCDF Data formats and software packages 35 Nifty little helpers y free image viewing tool (PCI) y Geomatica FreeView x handles all common remote sensing data formats x basic image viewing and analysis functions Data formats and software packages 36 Nifty little helpers y free image viewing tool (ER Mapper) y basic image viewing functions y supports raster formats x ER Mapper (incl. compressed) x GeoTIFF x ESRI BIL Data formats and software packages x USGS Digital Ortho Quad x JPEG 37 Take home message y there is a lot of stuff out there x no silver bullet that does it all x look at your needs x look around – solutions don't have to be expensive y trend towards data integration x image processing and enhanced analysis x GIS is the keyword y data format of the moment: GeoTIFF Data formats and software packages x generic data format x meets most user's needs 38 List of useful URLs http://www.asf.alaska.edu/~rgens/teaching/data_sw.html Data formats and software packages 39.
Recommended publications
  • Need to Clip an Image?
    Hands On Need to Clip an Image? ArcGIS supplies several methods of clipping image data. In addition to using the Clip tool in the Raster toolbox in ArcToolbox, there are Use the Get Data other ways to quickly output a clipped raster. For ArcPad wizard Here are two simple interactive methods—using in the ArcPad the ArcPad toolbar that comes with ArcMap and toolbar in ArcMap exporting an image with the spatial extent of the to export an image current view that has the information available to clipped to the georeference it. current view or a specified spatial ArcPad Extraction Option extent. Use the ArcPad toolbar in ArcMap to extract an image. Clicking on the Get Data For ArcPad button in the toolbar will invoke a wizard for extracting data from the current map document and placing it in a checkout folder. This wizard writes vector features to new shapefiles and compresses raster images and saves them in MrSID format. The Get Data For ArcPad wizard contains several panels for defining properties related to the data being extracted. The layers 4. In the Export Map dialog box, choose a place The TIFF file format can also store in the map that will be extracted are specified to save the exported file and type a File name for georeferencing information internally. These files in the first pane. For this use of the extraction the export file. are called GeoTIFFs. ArcGIS can write GeoTIFF utility, check only the image layer to be clipped. 5. From the Save as Type drop-down box, tags for images exported from the Data View.
    [Show full text]
  • Understanding Compression of Geospatial Raster Imagery
    Understanding Compression of Geospatial Raster Imagery Document Overview This document was created for the North Carolina Geographic Information and Coordinating Council (GICC), http://ncgicc.com, by the GIS Technical Advisory Committee (TAC). Its purpose is to serve as a best practice or guidance document for GIS professionals that are compressing raster images. This document only addresses compressing geospatial raster data and specifically aerial or orthorectified imagery. It does not address compressing LiDAR data. Compression Overview Compression is the process of making data more compact so it occupies less disk storage space. The primary benefit of compressing raster data is reduction in file size. An added benefit is greatly improved performance over a network, because the user is transferring less data from a server to an application; however, compressed data must be decompressed to display in GIS software. The result may be slower raster display in GIS software than data that is not compressed. Compressed data can also increase CPU requirements on the server or desktop. Glossary of Common Terms Raster is a spatial data model made of rows and columns of cells. Each cell contains an attribute value identifying its color and location coordinate. Geospatial raster data like satellite images and aerial photographs are typically larger on average than vector data (predominately points, lines, or polygons). Compression is the process of making a (raster) file smaller while preserving all or most of the data it contains. Imagery compression enables storage of more data (image files) on a disk than if they were uncompressed. Compression ratio is the amount or degree of reduction of an image's file size.
    [Show full text]
  • Forcepoint DLP Supported File Formats and Size Limits
    Forcepoint DLP Supported File Formats and Size Limits Supported File Formats and Size Limits | Forcepoint DLP | v8.8.1 This article provides a list of the file formats that can be analyzed by Forcepoint DLP, file formats from which content and meta data can be extracted, and the file size limits for network, endpoint, and discovery functions. See: ● Supported File Formats ● File Size Limits © 2021 Forcepoint LLC Supported File Formats Supported File Formats and Size Limits | Forcepoint DLP | v8.8.1 The following tables lists the file formats supported by Forcepoint DLP. File formats are in alphabetical order by format group. ● Archive For mats, page 3 ● Backup Formats, page 7 ● Business Intelligence (BI) and Analysis Formats, page 8 ● Computer-Aided Design Formats, page 9 ● Cryptography Formats, page 12 ● Database Formats, page 14 ● Desktop publishing formats, page 16 ● eBook/Audio book formats, page 17 ● Executable formats, page 18 ● Font formats, page 20 ● Graphics formats - general, page 21 ● Graphics formats - vector graphics, page 26 ● Library formats, page 29 ● Log formats, page 30 ● Mail formats, page 31 ● Multimedia formats, page 32 ● Object formats, page 37 ● Presentation formats, page 38 ● Project management formats, page 40 ● Spreadsheet formats, page 41 ● Text and markup formats, page 43 ● Word processing formats, page 45 ● Miscellaneous formats, page 53 Supported file formats are added and updated frequently. Key to support tables Symbol Description Y The format is supported N The format is not supported P Partial metadata
    [Show full text]
  • Various Raster and Vector Image File Formats
    ISSN (Online) 2278-1021 ISSN (Print) 2319-5940 International Journal of Advanced Research in Computer and Communication Engineering Vol. 4, Issue 3, March 2015 Various Raster and Vector Image File Formats Sakshica1, Dr. Kusum Gupta2 Banasthali Vidyapith, Jaipur campus (Jaipur)1,2 Abstract: Image File Format is one of the standardized ways of storing digital images, with a large number of image file formats available it would be very difficult and challenging for the user to select appropriate image format for storing the images. Choosing the proper image file format according to the demand of the project or according to a specific parameter is of vital importance. Therefore, in this paper we provide a brief review on most common and different image file formats in order to ease the user to choose appropriate file formats while working with files. Keywords: Graphics Interchange Format (GIF), Joint Photographic Expert Group(JPEG), Portable Network Graphics(PNG), Tagged Image File Format(TIFF), Encapsulated PostScript (ESP), Portable Document Format (PDF), Adobe Illustrator (AI), Drawing eXchange Format (DXF). I. INTRODUCTION Images are an important part of today's digital world. File A. Resolution formats are essential when it comes to compatibility and Raster graphics depend upon having a resolution, which is storing images. An image file format is a standard way to counted in .dpi (dots per inch).The lower the resolution the organize and store image data. It defines how the data is smaller the file size [6]. arranged and the type of compression (if any) to be used. Low-resolution raster graphics would normally be set to There are several dozens of different image file formats 72 dpi and are used very often for web sites and presenta- [1].
    [Show full text]
  • GDAL/OGR User Docs GDAL Utilities
    GDAL/OGR user docs GDAL Utilities.............................................................................................................................................................1 Creating New Files.........................................................................................................................................1 General Command Line Switches..................................................................................................................2 gdalinfo.........................................................................................................................................................................3 SYNOPSIS......................................................................................................................................................3 DESCRIPTION..............................................................................................................................................3 EXAMPLE......................................................................................................................................................4 gdal_translate..............................................................................................................................................................5 SYNOPSIS......................................................................................................................................................5 DESCRIPTION..............................................................................................................................................5
    [Show full text]
  • Preferred Formats
    Preferred formats September 2015, version 3.0 >>> Preferred formats Contents 1. Selecting file formats ............................................................................. 2 2. Preferred and acceptable file formats ....................................................... 3 2.1 Overview ......................................................................................... 3 2.2 Text documents................................................................................ 5 2.3 Plain text ......................................................................................... 5 2.4 Markup language .............................................................................. 5 2.5 Spreadsheets ................................................................................... 7 2.6 Databases ....................................................................................... 8 2.7 Statistical data ............................................................................... 10 2.8 Raster images ................................................................................ 10 2.9 Vector images ................................................................................ 12 2.10 Audio .......................................................................................... 12 2.11 Video .......................................................................................... 13 2.12 Computer Aided Design (CAD) ........................................................ 13 2.13 Geographical information (GIS)......................................................
    [Show full text]
  • Georeferencing with QGIS
    Georeferencing with QGIS Author Attribution Major contributors to this curriculum include (alphabetical): Maria Fernandez Michael Hamel Quentin Lewis Maili Page James Peters Charlie Schweik Alexander Stepanov Module Licensing Information Version 1.0. This tutorial is licensed under a Creative Commons Attribution-No Derivative Works 3.0 License (http://creativecommons.org/licenses/by-nd/3.0/). This means that users are free to copy and share this material with others. Requests for creating new derivatives should be sent to the primary author. Reviewed by Scan the map section - important note needs a second look, should not be advising to scan as jpeg if QGIS still can't handle them. (3 Feb 2007) In linux (ubuntu) .8 crashes when I try to refresh after setting the projection for the two layers. (4 Feb 2007) Michael Hamel Overview A common GIS development task is the need to digitize data off of a paper map. There are two main ways to do this: 1. Digitize using a digitizing tablet. 2. On-screen digitizing from a background (scanned) image of the map. This document describes part of the process for on-screen (#2) digitizing: Getting a background image georeferenced so that you can do online digitizing using it, or simply use it as another GIS (raster) layer. 1. First, you must identify the map you want to digitize and check it for metadata. 1. Check for georeferencing coordinates (are there long/lat lines on the map? UTM coordinates? What kind of datum/map projection is it in?) (See Appendix A for an example from a USGS topomap).
    [Show full text]
  • Geoviewer User Manual
    Legal notices Copyright © 2014–2021 Celartem, Inc., doing business as Extensis. This document and the software described in it are copyrighted with all rights reserved. This document or the software described may not be copied, in whole or part, without the written consent of Extensis, except in the normal use of the software, or to make a backup copy of the software. This exception does not allow copies to be made for others. Licensed under U.S. patents issued and pending. Celartem, Extensis, MrSID, NetPublish, Portfolio Flow, Portfolio NetPublish, Portfolio Server, Suitcase Fusion, Type Server, TurboSync, TeamSync, and Universal Type Server are registered trademarks of Celartem, Inc. The Celartem logo, Extensis logos, Extensis Portfolio, Font Sense, Font Vault, FontLink, QuickFind, QuickMatch, QuickType, Suitcase, Suitcase Attaché, Universal Type, Universal Type Client, and Universal Type Core are trademarks of Celartem, Inc. Adobe, Acrobat, After Effects, Creative Cloud, Illustrator, InCopy, InDesign, Photoshop, PostScript, and XMP are either registered trademarks or trademarks of Adobe Systems Incorporated in the United States and/or other countries. Apache Tika, Apache Tomcat and Tomcat are trademarks of the Apache Software Foundation. Apple, Bonjour, the Bonjour logo, Finder, iPhone, Mac, the Mac logo, Mac OS, OS X, Safari, and TrueType are trademarks of Apple Inc., registered in the U.S. and other countries. macOS is a trademark of Apple Inc. App Store is a service mark of Apple Inc. IOS is a trademark or registered trademark of Cisco in the U.S. and other countries and is used under license. Elasticsearch is a trademark of Elasticsearch BV, registered in the U.S.
    [Show full text]
  • System: Direct Use of Geodata Files
    System Direct Use of Geodata Files The TNT products can directly select and use geodata files in the wide variety of formats listed below. The name of any geodata file in a format that is listed here for direct use will automatically appear in the standard Select Objects window along with any TNT Project File names. If the name of a file does not appear in this list it is not in a format that can be directly used and must first be imported into a raster or geometric object in a Project File and perhaps subsequently georeferenced. Double-clicking on the name of any TNT supported geodata file can also be used to open it in a new 2D Display group. RASTER format extension description Arc Binary Grid *.adf Arc/Info Binary "Grid" Format, developed by ESRI BSB Nautical Chart *.kap BSB — Maptech/NOAA BSB Nautical Chart format DOQQ *.doq Digital Orthophoto Quarter-Quadrangle *.dt0 Digital Terrain Elevation Data format (Data File Level 0), developed by NGA DTED *.dt1 Digital Terrain Elevation Data format (Data File Level 1) *.dt2 Digital Terrain Elevation Data format (Data File Level 2) Envisat *.n1 Envisat Image Product format *.img ERDAS IMAGINE image format, developed by Leica Geosystems ERDAS *.lan ERDAS IMAGINE LAN sensor data an effort by over 160 different remote sensing, GIS, cartographic, and surveying related GeoTIFF *.tif companies and organizations to establish a TIFF-based interchange format for georeferenced raster imagery GIF *.gif Graphics Interchange Format GRASS *.hdr GRASS raster format *.mpr ILWIS raster map format ILWIS *.mpl
    [Show full text]
  • A Tool to Write ECW Or JPEG 2000
    GEOcompressor: A tool to write ECW or JPEG 2000 Do you need to compress your image data into ECW or JPEG 2000? GEOcompressor is an easy to use, stand-alone tool at a very affordable price! GEOcompressor compresses image data files of un limi ted size within seconds into tiny ECW or JPEG 2000 data. GEOcompressor maintains all geo-information, supports batch mode and alpha channel transparency. Boasts an easy to use yet so phisti cated user interface. GEOcompressor is based on the ERDAS® ECW/JP2 SDK 4.2 and has been developed by GEOSYSTEMS GmbH in Germany. Features High speed compression • Provides versatile batch mode allowing the • Converts raster data to ECW and JPEG 2000 compression of hundreds of images (e.g. as fast as up to 1 GB per minute. all files within one directory) with only one command. • Writes ECW (8-bit) and JPEG 2000 (8-/16-bit). • GUI can be localized. Current version supports • Supports the latest ECW format including the English and German. spatial reference system. • Stand-alone tool based on the ERDAS ECW/ • Alpha channel transparency is supported for JP2 SDK 4.2. both ECW and JPEG 2000. • Image data in TIFF + world file are compressed Easy to use stand-alone tool to GeoJPEG 2000 or ECW including the • Simple yet sophisticated graphical user complete projection information. interface with optional extended settings including batch mode. Flexible handling • Features a fast image viewer for raster • Supports any kind of raster format as input images and data streams (ECWP) including (TIFF, NITF, JPG, PNG, IMG, GIF, BMP, ECW, zooming/roaming/panning, data scaling, band JPEG 2000 and many more).
    [Show full text]
  • Workshop: Raster and Vector Processing with GDAL Table Of
    Workshop: Raster and vector processing with GDAL Table of Contents 1Introduction........................................................................................................................................2 2Raster operations................................................................................................................................3 2.1Getting metadata about a raster / gdalinfo..................................................................................3 2.1.1Introduction.........................................................................................................................3 2.1.2Common and basic information..........................................................................................3 2.1.3Getting those information with Python...............................................................................6 2.1.4General form of the geo-transformation matrix..................................................................6 2.1.5GCPs, subdatasets, geolocation arrays................................................................................8 GCPs.......................................................................................................................................9 Subdatasets...........................................................................................................................10 Geolocation array.................................................................................................................10 2.1.6Statistics, histogram,
    [Show full text]
  • Geoexpress Command Line User Manual
    LizardTech GeoExpress 9.5 Command Line User Manual Copyright © 2009–2017 Celartem, Inc., doing business as LizardTech. All rights reserved. Information in this document is subject to change without notice. The software described in this document is furnished under a license agreement or nondisclosure agreement. The software may be used or copied only in accordance with the terms of those agreements. No part of this publication may be reproduced, stored in a retrieval system, or transmitted in any form or any means electronic or mechanical, including photocopying and recording for any purpose other than the purchaser's personal use without the written permission of LizardTech. LizardTech, MrSID, GeoExpress and Express Server are registered trademarks in the United States and the LizardTech, GeoExpress, Express Server, ExpressView and GeoViewer logos are trademarks, and all are the property of Celartem Inc., doing business as LizardTech. Unauthorized use is prohibited. LizardTech acknowledges and thanks the many individuals and organizations whose efforts have made our products possible. A full list of copyright, trademark and credit information is available in the document “Copyrights, Trademarks, and Credits” installed automatically with your product. LizardTech 1008 Western Avenue, Suite 403 Seattle, Washington, USA 98104 206-652-5211 www.lizardtech.com - ii - Preface The GeoExpress Command Line User Manual is written for geographic information system (GIS) professionals that want to compress and manipulate geospatial imagery with GeoExpress. This guide assumes that you have basic knowledge of GIS, including mosaics, coordinate reference systems, and multispectral imagery. This guide describes how to install and operate the command line version of GeoExpress.For installation instructions and other information about the graphical version of GeoExpress, see the GeoExpress User Manual.
    [Show full text]