Imagery Management and Accessibility in ArcGIS Pro and ArcGIS Excalibur Adam Tomlin and Justine Woulfe Agenda • Introduction • Managing Imagery • Sharing Imagery • Accessing Imagery • Best Practices • Questions 5 Key Imagery Capabilities of ArcGIS Visualization & Exploitation Management Analysis Map Production Content Terminology Understanding Key Concepts • Raster format – defines how pixels are stored - Ex. TIFF, MrSID, ECW, CRF • Raster type – defines the metadata to be read and used for processing - Ex. Raster Dataset, IKONOS, Table • Raster function – on-the-fly processing of pixels - Ex. NDVI • Mosaic dataset – data model in a geodatabase for managing imagery • Image service – data model for accessing mosaic datasets as a web service Image Management and Dissemination Making Imagery Accessible ArcGIS Pro – Authoring of Mosaic Datasets Extensive tools for Image Management • ArcGIS Image Server – Scaling Imagery On Premises and Cloud • Imagery Hosting • Dynamic Image Services • Raster Analytics • Ortho Mapping A System of Record for Imagery Managing Imagery Justine Woulfe Image Management And so much more… Image Management Using Mosaic Datasets ArcGIS Imagery Information Model Aerial Satellite • Supports multiple raster sources • Supports many raster formats Elevation Imagery • Maintains image quality LiDAR Drone • Handles overlap and disparate datasets • Supports over 50 sensor types Scanned Maps • Supports Image Services Categorical What is a Mosaic Dataset? ArcGIS Imagery Information Model • A Catalog: - References Imagery - Associated metadata - Processing functions can be applied • Stored in Geodatabase • Created using ArcGIS for Desktop • Provides: - Dynamic Mosaicking - On-the-fly processing Highly scalable… from small to large volumes of imagery Creating a Mosaic Dataset in ArcGIS Pro A brief summary 1. Create Geodatabase (File or Enterprise) 2. Create Mosaic Dataset 3. Add Rasters 4. Generate Overviews (optional) Add Rasters Adding data to your mosaic dataset • Specify parameters • Crawls for imagery according to the raster type • Defines the initial processing Supported Imagery Supports over 50 sensor types! • Format: TIFF, JPEG, JPEG 2000, MRF, CRF, IMAGINE, NITF, netCDF, HDR, GRIB, MrSID… • Data Structure: Bands, Bits, Tiling, Pyramids, NoData • Compression: Lossless, Lossy, Limited Error • Georeferencing: Spatial reference systems • Metadata: Acquisition Date, Color Map, Source, Copyright, Band wavelengths Overviews Why can’t I see my data? • Like pyramids for a Mosaic Dataset • Used for faster display at smaller scales (when zoomed out) • Optional - if not created, imagery may not appear when zoomed out • May also consider adding smaller scale imagery Creating and Configuring a Mosaic Dataset Adam Tomlin Mosaic Dataset Properties From the Catalog Pane • General - General properties relating to the data structure (number of bands, bit depth) - Source Type: Generic → Processed • Defaults - Direct the use of a Mosaic Dataset when Published - Sets some limits on Publishing Mosaic Dataset Processing For easy and efficient visualization and exploration • Initial Raster Function Chain defined by Raster Type • Apply additional processing a) To items in mosaic dataset b) By adding to raster function chain c) By attaching to mosaic dataset • Persists when shared What are Raster Functions? Image processing instructions Operations that apply processing directly to the pixels of imagery and raster datasets • No new dataset created • Fast and efficient; processing on-the-fly • Easily view and edit raster function history • Create and use custom raster functions • Save sets of raster functions as templates • String processes together for complex New functions in Pro 2.4 modeling Euclidean back direction Flow length • Generate and share processing templates for Sink image services Snap pour point Stream order Cost path as polyline Adding Raster Functions to a Mosaic Dataset Adam Tomlin Sharing Imagery Justine Woulfe What is ArcGIS Image Server? The Enterprise solution to imagery sharing • Part of ArcGIS Enterprise Image service • Serves large collection of data for analytical processing • Allows users to assemble, process, analyze and manage large collection of imagery Source images Mosaic dataset ArcGIS Image Server ArcGIS Image Server Key Capabilities • Dynamic image services - Web accessible imagery which can have processing applied on-the-fly • Raster Analytics - Quickly process and persist data to create new information products • Ortho mapping - Processing of satellite, aerial or drone imagery into digital elevation models and ortho mosaics • Imagery hosting - Enables users within organization to upload imagery into ArcGIS Enterprise and serve it as dynamic imagery layers ArcGIS Image Server What is an image service? • An Image Service is the primary information model for imagery on ArcGIS Online - Single Images - Large collections via mosaic datasets • Puts valuable imagery to use quickly • Serves multiple views using the original imagery • Access the records that make up the mosaic dataset • Can be used to perform on-the-fly image processing and explore temporal changes Sharing imagery from ArcGIS Pro How to publish an image service • Must invoke the wizard from Catalog pane - not Contents pane • Share by Reference or Share by Value • Define processing to be applied by the server • Option to allow downloads • Can enable WMS (Web Map Service) and WCS (Web Coverage Service) capabilities • Can publish to ArcGIS Online, Portal and standalone ArcGIS Server (new feature of ArcGIS Pro 2.4) Publishing an Image Service from ArcGIS Pro Adam Tomlin Using Imagery Justine Woulfe Image Visualization and Exploitation Integrating imagery into dynamic applications to aid understanding ArcGIS Pro • ArcGIS Image Analyst - Image Space, Mensuration - Stereo - Motion Video - Oriented Imagery • Web - ArcGIS Excalibur - Map Viewer – Imagery features - Image Configurable Apps (Image Viewer / Mask / Visit) - WABIS – WebAppBuilder Widgets for Image Services - Oriented Imagery • Mobile - Focused Apps ArcGIS Excalibur What is it? • For: Analysts, Imagery Specialists, and Imagery/GIS Managers • Who: Need to discover, analyze, and report information derived from imagery analysis or exploitation. • The Solution: a cloud-based application • That Provides: a simple and intuitive design to search for and work with imagery and reference data in a project-based experience. The results are shared in dynamic information products across your organization. ArcGIS Excalibur is an intuitive project- based image analytics and exploitation web application. What is Required for ArcGIS Excalibur? System Components + + Base ArcGIS ArcGIS Excalibur Enterprise 10.7 or ArcGIS Image Server (separate Installer + above Deployment separate license per user) ArcGIS Excalibur Image Management Image Management Interactive Search and Discovery Simplified Access to Imagery Exploitation On-the-Fly Processing Dynamic Visualization • Image Management Multi-View Oblique Imagery “Image Space” Support - Interactive search and discovery - Simplified access to imagery through numerous experiences Imagery Projects Organized, Task Based Workflows - User defined search settings to refine Focused Experiences results • Imagery Projects Imagery Derived Products Interactive Briefing Products - Focused workflows to organize and Traceable Analytic Assessments accomplish image-based tasks Dynamic Analysis Layers Query, locate and find imagery quickly ArcGIS Excalibur Image Utilization Image Management Interactive Search and Discovery Simplified Access to Imagery Exploitation On-the-Fly Processing Dynamic Visualization • Exploitation Multi-View Oblique Imagery “Image Space” Support - Tools for on-the-fly processing - Side-by-side visualization of oblique and orthorectified imagery Imagery Projects Organized, Task Based Workflows - Image annotations automatically and Focused Experiences accurately transformed to geographic features • Imagery Derived Products Imagery Derived Products - Create products for interactive briefings or Interactive Briefing Products Traceable Analytic Assessments web applications Dynamic Analysis Layers Query, locate and find imagery quickly ArcGIS Excalibur Demonstration Adam Tomlin Configurable Apps For Imagery • Imagery Web Apps provide: - Functionality, polish and context beyond the basic Map Viewer More - Basic tools for interacting with imagery Customization - Ease of use with configurable apps and widgets; customization options with Web AppBuilder and JavaScript API JavaScript API - Easy access from any web-enabled device (3.x or 4.x) Web AppBuilder (Developer Edition) Web AppBuilder (Core) Configurable app templates Easier to implement Configurable App Templates Designed for Imagery • Imagery Viewer - Visualize and interpret imagery layers through time and space • Image Mask - Calculate and visualize change between two images - Highlight an area of interest that meets a user-defined threshold for common spectral indices • Image Visit - Review attributes for a predetermined sequence of locations Extract meaning from imagery Best Practices Justine Woulfe Best Practices …are data specific! • Imagery Workflows website has best practices and recommended workflows Elevation Imagery Categorical Scanned Maps LiDAR https://doc.arcgis.com/en/imagery/workflows/ Satellite Aerial Drone Best Practices for Managing Imagery Storing source images and data • Store each collection of image files in a separate directory • Try to keep the number of files per directory under