Imagery Management and Accessibility in ArcGIS Pro and ArcGIS Excalibur
Adam Tomlin and Justine Woulfe Agenda
• Introduction • Managing Imagery • Sharing Imagery • Accessing Imagery • Best Practices • Questions 5 Key Imagery Capabilities of ArcGIS
Visualization & Exploitation Management
Analysis Map Production
Content Terminology Understanding Key Concepts
• Raster format – defines how pixels are stored - Ex. TIFF, MrSID, ECW, CRF • Raster type – defines the metadata to be read and used for processing - Ex. Raster Dataset, IKONOS, Table • Raster function – on-the-fly processing of pixels - Ex. NDVI • Mosaic dataset – data model in a geodatabase for managing imagery • Image service – data model for accessing mosaic datasets as a web service Image Management and Dissemination Making Imagery Accessible
ArcGIS Pro – Authoring of Mosaic Datasets Extensive tools for Image Management
• ArcGIS Image Server – Scaling Imagery On Premises and Cloud • Imagery Hosting • Dynamic Image Services
• Raster Analytics
• Ortho Mapping
A System of Record for Imagery Managing Imagery Justine Woulfe Image Management And so much more… Image Management Using Mosaic Datasets ArcGIS Imagery Information Model Aerial Satellite • Supports multiple raster sources
• Supports many raster formats Elevation Imagery • Maintains image quality LiDAR Drone • Handles overlap and disparate datasets • Supports over 50 sensor types Scanned Maps • Supports Image Services
Categorical What is a Mosaic Dataset? ArcGIS Imagery Information Model
• A Catalog: - References Imagery - Associated metadata - Processing functions can be applied • Stored in Geodatabase • Created using ArcGIS for Desktop • Provides: - Dynamic Mosaicking - On-the-fly processing
Highly scalable… from small to large volumes of imagery Creating a Mosaic Dataset in ArcGIS Pro A brief summary
1. Create Geodatabase (File or Enterprise) 2. Create Mosaic Dataset 3. Add Rasters 4. Generate Overviews (optional) Add Rasters Adding data to your mosaic dataset
• Specify parameters • Crawls for imagery according to the raster type • Defines the initial processing Supported Imagery Supports over 50 sensor types!
• Format: TIFF, JPEG, JPEG 2000, MRF, CRF, IMAGINE, NITF, netCDF, HDR, GRIB, MrSID… • Data Structure: Bands, Bits, Tiling, Pyramids, NoData • Compression: Lossless, Lossy, Limited Error • Georeferencing: Spatial reference systems • Metadata: Acquisition Date, Color Map, Source, Copyright, Band wavelengths Overviews Why can’t I see my data?
• Like pyramids for a Mosaic Dataset • Used for faster display at smaller scales (when zoomed out) • Optional - if not created, imagery may not appear when zoomed out • May also consider adding smaller scale imagery Creating and Configuring a Mosaic Dataset Adam Tomlin Mosaic Dataset Properties From the Catalog Pane
• General - General properties relating to the data structure (number of bands, bit depth) - Source Type: Generic → Processed • Defaults - Direct the use of a Mosaic Dataset when Published - Sets some limits on Publishing Mosaic Dataset Processing For easy and efficient visualization and exploration
• Initial Raster Function Chain defined by Raster Type • Apply additional processing a) To items in mosaic dataset b) By adding to raster function chain c) By attaching to mosaic dataset • Persists when shared What are Raster Functions? Image processing instructions
Operations that apply processing directly to the pixels of imagery and raster datasets
• No new dataset created
• Fast and efficient; processing on-the-fly
• Easily view and edit raster function history
• Create and use custom raster functions
• Save sets of raster functions as templates
• String processes together for complex New functions in Pro 2.4 modeling Euclidean back direction Flow length • Generate and share processing templates for Sink image services Snap pour point Stream order Cost path as polyline Adding Raster Functions to a Mosaic Dataset Adam Tomlin Sharing Imagery Justine Woulfe What is ArcGIS Image Server? The Enterprise solution to imagery sharing
• Part of ArcGIS Enterprise Image service • Serves large collection of data for analytical processing • Allows users to assemble, process, analyze and manage large collection of imagery
Source images Mosaic dataset ArcGIS Image Server ArcGIS Image Server Key Capabilities
• Dynamic image services - Web accessible imagery which can have processing applied on-the-fly • Raster Analytics - Quickly process and persist data to create new information products • Ortho mapping - Processing of satellite, aerial or drone imagery into digital elevation models and ortho mosaics • Imagery hosting - Enables users within organization to upload imagery into ArcGIS Enterprise and serve it as dynamic imagery layers ArcGIS Image Server What is an image service?
• An Image Service is the primary information model for imagery on ArcGIS Online - Single Images - Large collections via mosaic datasets
• Puts valuable imagery to use quickly
• Serves multiple views using the original imagery
• Access the records that make up the mosaic dataset
• Can be used to perform on-the-fly image processing and explore temporal changes Sharing imagery from ArcGIS Pro How to publish an image service
• Must invoke the wizard from Catalog pane - not Contents pane
• Share by Reference or Share by Value
• Define processing to be applied by the server
• Option to allow downloads
• Can enable WMS (Web Map Service) and WCS (Web Coverage Service) capabilities
• Can publish to ArcGIS Online, Portal and standalone ArcGIS Server (new feature of ArcGIS Pro 2.4) Publishing an Image Service from ArcGIS Pro Adam Tomlin Using Imagery Justine Woulfe Image Visualization and Exploitation Integrating imagery into dynamic applications to aid understanding
ArcGIS Pro • ArcGIS Image Analyst - Image Space, Mensuration - Stereo - Motion Video - Oriented Imagery
• Web - ArcGIS Excalibur - Map Viewer – Imagery features - Image Configurable Apps (Image Viewer / Mask / Visit) - WABIS – WebAppBuilder Widgets for Image Services - Oriented Imagery
• Mobile - Focused Apps ArcGIS Excalibur What is it?
• For: Analysts, Imagery Specialists, and Imagery/GIS Managers
• Who: Need to discover, analyze, and report information derived from imagery analysis or exploitation.
• The Solution: a cloud-based application
• That Provides: a simple and intuitive design to search for and work with imagery and reference data in a project-based experience. The results are shared in dynamic information products across your organization.
ArcGIS Excalibur is an intuitive project- based image analytics and exploitation web application. What is Required for ArcGIS Excalibur? System Components
+ +
Base ArcGIS ArcGIS Excalibur Enterprise 10.7 or ArcGIS Image Server (separate Installer + above Deployment separate license per user) ArcGIS Excalibur Image Management Image Management Interactive Search and Discovery Simplified Access to Imagery Exploitation On-the-Fly Processing Dynamic Visualization • Image Management Multi-View Oblique Imagery “Image Space” Support - Interactive search and discovery - Simplified access to imagery through numerous experiences Imagery Projects Organized, Task Based Workflows - User defined search settings to refine Focused Experiences results
• Imagery Projects Imagery Derived Products Interactive Briefing Products - Focused workflows to organize and Traceable Analytic Assessments accomplish image-based tasks Dynamic Analysis Layers
Query, locate and find imagery quickly ArcGIS Excalibur Image Utilization Image Management Interactive Search and Discovery Simplified Access to Imagery Exploitation On-the-Fly Processing Dynamic Visualization • Exploitation Multi-View Oblique Imagery “Image Space” Support - Tools for on-the-fly processing - Side-by-side visualization of oblique and orthorectified imagery Imagery Projects Organized, Task Based Workflows - Image annotations automatically and Focused Experiences accurately transformed to geographic features • Imagery Derived Products Imagery Derived Products - Create products for interactive briefings or Interactive Briefing Products Traceable Analytic Assessments web applications Dynamic Analysis Layers
Query, locate and find imagery quickly ArcGIS Excalibur Demonstration Adam Tomlin Configurable Apps For Imagery
• Imagery Web Apps provide: - Functionality, polish and context beyond the basic Map Viewer More - Basic tools for interacting with imagery Customization - Ease of use with configurable apps and widgets; customization options with Web AppBuilder and JavaScript API JavaScript API - Easy access from any web-enabled device (3.x or 4.x) Web AppBuilder (Developer Edition)
Web AppBuilder (Core)
Configurable app templates
Easier to implement Configurable App Templates Designed for Imagery
• Imagery Viewer - Visualize and interpret imagery layers through time and space • Image Mask - Calculate and visualize change between two images - Highlight an area of interest that meets a user-defined threshold for common spectral indices • Image Visit - Review attributes for a predetermined sequence of locations
Extract meaning from imagery Best Practices Justine Woulfe Best Practices …are data specific!
• Imagery Workflows website has best practices and recommended workflows
Elevation Imagery Categorical Scanned Maps LiDAR
https://doc.arcgis.com/en/imagery/workflows/ Satellite Aerial Drone Best Practices for Managing Imagery Storing source images and data
• Store each collection of image files in a separate directory • Try to keep the number of files per directory under 1,000 • One mosaic dataset per geodatabase, or at least a small number of them • Store metadata files in the same directory as your data • Use a consistent naming convention Best Practices for Managing Imagery Pre-processing and preparation
• Build pyramids for source images • Identify NoData values • Familiarize yourself with your data • Verify the units of measurement Best Practices for Managing Imagery Creating and Improving Mosaic Datasets
• Default values are your friends! • Set the appropriate raster type • Pay attention to metadata • Use a mask or build footprints to clip the data - Use Radiometry option OR Geometry option + clip to mask Best Practices for Managing Imagery Creating and Publishing Image Services
• Publish using share by reference method (instead of copying data to server) • Caching is recommended for services which will serve as basemap imagery • Suggest to cache services that were published with low performing or highly compressed formats Summary
• Mosaic Dataset - Primary information model to manage imagery - Supports dynamic mosaicking and on-the-fly processing - Can be configured to fit your data - Can be accessed across the ArcGIS platform when shared as a web service • ArcGIS Image Server • dynamic image services • ArcGIS Online or Portal • make imagery accessible • Use best practices specific to your data Questions?
Adam Tomlin Justine Woulfe [email protected] [email protected] Session Rating © 2019 Esri Canada Limited. All rights reserved. Trademarks for Esri products are provided under license from Environmental Systems Research Institute, Inc. Other product & company names mentioned herein may be trademarks or registered trademarks of their respective owners. Errors & omissions excepted. Esri materials are copyrighted. Please request permission to use software, images or text. Which Font Should You Use For Your Presentation?
Arial Please use Arial at all times for your PowerPoint presentation. Using Arial gives your PowerPoint presentation the flexibility to be used by many people on various machines without the risk of font compatibility and changing the look of your layout.
Use of Arial Ensures… Multiple users are able to view the font / Presentation distributed to others picks up the font Presentation can be used on multiple computers Did you know?
To quickly update any current presentation Copy and paste your slides from your current deck into the newest template. The title and ending logo slide will update automatically.
Videos not working? For video in PowerPoint, animated GIF is recommended. AVI and WMV (native PC files) will work best on a PC platform. H.264 MP4 will work only on PowerPoint 2013 and later.
Esri Corporate Template-Dark v3.4 16:9 version – January 29, 2017 Aspect Ratio Test
If this shape does not appear as a perfect circle, adjust the aspect ratio of your display until it does. Try the resolution 1920x1080 for 16:9 displays.
Esri Corporate Template-Dark v3.4 16:9 version – January 29, 2017