Esri Mapping & Imagery Technology Exposition Krishna , Partha, Pugal WELCOME
Esri Mapping & Imagery Technology Exposition ArcGIS is a Modern GIS ArcGIS 10.5 Can Access and Integrate All Data Types From Distributed Computers Anywhere 3D Real-Time Data (IoT)
Lidar / Elevation Abstracting and Organizing Any Content . . .
Vector Big Data
Raster / Image Tabular
Enabling Dynamic Data Fusion and Analysis ArcGIS is a Comprehensive Imagery Platform Empowering users to make informed decisions
System of Engagement
System of Insight Share imagery products and information to those that need it Professional Imagery & Geospatial Analysts System of Record Extract Information from Imagery Server Content: ArcGISOnline Partners, Your Org
Manage and process all your imagery Leveraging ArcGIS For maximum business value and impact Analytics
Developer IoT / Capabilities Real-Time
ArcGIS
Community Mobility Engagement
Mapping & Collaboration Living Atlas of the World Hydro Soils
Land Cover Demographics
Habitats Imagery Elevation Landscape Basemaps Boundaries
Oceans
Observations Weather
Hazards Terrain Historical Transportation Urban Systems Esri Content
MODIS
NAIP (NDVI) Landsat 8 Land Cover Oceans
Behaviors Income Elevation
Access Traffic Earthquakes Warnings
Boundaries Vector Basemaps Terrain with Labels Streets with Relief
Topographic Light Gray Canvas
Imagery Hybrid Navigation
Dark Gray Canvas
Streets Streets at Night
Multivendor Basemap in ArcMAP
Would you like to displays maps from Air Quality Index, AutoNavi, Baidu, Bing, CartoDB, Daum, GIS Cloud, Humanitarian OpenStreetMap (HOT), IsHowChina, Klokan Technologies, Kosmosnimki, Mapbox, National Georegister (PDOK), National Library of Scotland (NLS), Nokia HERE, Naver, New York City Maps, NZ MapsPast, OpenStreetMap, OpenRailwayMap, OpenWeatherMap, OpenSeaMap, OSM2Vectortiles, Stamen, Sputnik, Strava, Taobao, Thunderforest, Tianditu, TomTom, VWorld, Yandex Move from Drones to Maps Unmanned Aerial Systems support for ArcGIS Esri Products for Working with Drone Data
• Drone2Map for ArcGIS - App for End-to-end workflow to process still frame drone imagery - Rapidly produce orthomosaics, point clouds, 3D meshes
• Full Motion Video (FMV) - ArcGIS Desktop add-in - View, Organize, and Analyze streaming or recorded video Operational Patterns: Geography binds them all together
2D Mapping 3D Mapping Inspection Monitoring
ImageryMosaics Elevation Products Oblique Images &Video MotionImagery
Static Aerial Imagery Video Drone2Map FMV Tools Drone2Map Supports Complete Workflows for:
• 2D Mapping - For interpretation and analysis E.g. Map updating, agriculture, site monitoring
• 3D Mapping - For 3D visualization and modeling E.g. Urban planning, building reconstruction
• Inspections - For review of fine details E.g. Industrial and utility management Input is a folder of frame imagery with approx. GPS coordinates and sufficient overlap All products integrate into the ArcGIS platform for further visualization and analysis A New Window on theWorld Personal Mapping for Micro-Geographies
Low-Cost High Quality
Accurate Simple Results UAS for project management and monitoring
Measure Map
Model Output to ArcGIS Enterprise One button publishing to the web
Full Motion Video in ArcGIS Full Motion Video (FMV) Make your maps come alive
• Analyze videos from: - Drones (UAS,UAV) - Aerial (helicopters, fixed wing, persistent surveillance) - Terrestrial (fixed and mobile cameras) - Hand held mobile devices - Satellites
For: Defense, Public Safety, Emergency Management, Border Patrol, Oil, Utilities, Local and Federal Governments, and more! Use the ArcGIS FMV Capability to: Quickly Access Accurate Video
• Direct connect to live video streams • Play supported video source (.mpg, and more!)
• With FMV you can: - Organize and search for video files - Synchronize video with your map - Analyze and extract information Analyze and Organize Your Videos Video that’s easy to manage, use, and view
• Export important clips • Record live video streams • Extract video metadata • Summarize video coverage • Search based on metadata, location, and time • Create maps as Mosaic Datasets and image services Analyze Your Videos With Powerful Tools Easy to do analysis
• Georeference video frames to your maps • Generate PowerPoint reports with one click • Digitize video with enhanced accuracy (DEM/DTED) • Bookmark critical locations • Synchronize with time-aware data • Measure linear distances directly within your videos
Importance Of Managing Mapping Workflow Automate Processes • Process Documentation - Ensure work is done the right way - Enforce standards • Reduce Errors Processes and Data - Geometry - Attributes • Increase productivity and Reduce Cost Esri Mapping Product Architecture
Esri Mapping Solution
Esri Production Mapping
Editing Extensions Cartography ArcGIS Data Reviewer ArcGIS Workflow Product for Desktop Manager for Desktop Library Server Extensions
ArcGIS Data Reviewer for ArcGIS Workflow Manager for Production Mapping Server Server Server (PoDS) Optimize Resources • Limited Resources • Variation in skills
• Geographically dispersed offices
Enhance Communication
• Alerts and notifications • Status updates • Transparent processes • Reporting to stakeholders General Production Workflow
Edit (Workflow Manager)
Capture Review
Geodatabase
(GIS Data ReViewer)
Create
output Data Maps Esri Geoportal Server Enabling discovery and use of geospatial resources in heterogeneous environments • Search and view geospatial resources • Manage, publish, and store metadata • View live map services • Download data • Open Source - On GitHub - Apache 2.0 - 34,000+ downloads - 150 countries Geoportal Server Catalog
• Standard based Opensource data discovery • Elastic search • Supports OGC CSW and OpenSearch • Web AppBuilder Map Viewer app • Search Widget for Web AppBuilder
https://github.com/Esri/geoportal-server-catalog Geoportal Server Harvester
• Harvest from - OGC CSW 2.0.2 - CKAN 1.1 - ArcGIS Server services - Portal for ArcGIS/ArcGIS Online - Geoportal Server 1.x (Migration tool) and 2.x - Web Accessible Folder or UNC Paths • Harvest to - Folder - Geoportal Server - ArcGIS Online/Portal for ArcGIS • Extensible • Web Application or Command LineInterface https://github.com/Esri/geoportal-server-harvester Widgets for Web AppBuilder Enable discovery across ArcGIS platform • Federated Search Widget • Add to Map Widget • OGC Context Widget
• ArcGIS Layers • Koop Feature Services • OGC Support - WMS - WCS - WFS - KML - Context Documents
User Talk
Dr. Parag Madhukar Dhakate, is a conservator of forests, Western Circle, Haldwani, Nainital . A doctorate in Genetics from Indian Agricultural Research Institute (IARI), with a Vast teaching experience & resource person at reputed national institutes like ICFRE, IGNFA, WII, CASFOS etc. He has got expertise in the field of ecological restoration of degraded areas and Human-Wildlife Conflict Mitigation Workflow Manager
Allows users to:
• Plan and create workflows efficiently Plan & Create • Execute and manage standardized workflows
• Evaluate and improve performance continuously
Evaluate & Improve Execute & Manage
A framework for continuous process improvement Top 10 Capabilities 1a. Workflows
Documentation
• Document and automate processes Step Collect data - Outline steps Path Load Data - Connect steps with paths
- Update step and path properties Edit Data and Map • Graphical representation of the work Perform Quality Check
More Edits?
Create Output 1b. Workflows
Workflow Organization
• Workflows are organized as jobs! Descriptive • Examples: Information - Create data packet for field data
collection Activity Log Resource - Updating data for vegetation boundaries - Creating maps of specific scale Workflow
in various areas. Geodatabase Geographical Version/ Area of Interest Geospatial Data 2. Job Discovery
• Queries • Search • Grid/Map view 3. Work Allocation
• Automatically route work Collect data GIS Analyst • Manage large workforces • Target specific groups Load Data Jim Smith
Edit Data • Varying staff skills and Map Cartographer
Perform Quality Check QC Analyst
More Edits?
Create Output Cartographer 4. Area of Interest
• Spatial orientation of all work • Restrict work to a spatial extent 5. Documentation
Relationships – holds and dependencies
• Restrict or suspend workflow execution • Models relationships between jobs - parent/child jobs
Job Closed
Job A
Job B
Job B cannot be started until job A is closed. 6. Communication
Notifications and History
• Enhance communication - Emails - Automation of tasks • Increase accountability - Log actions on job • Real time updates 7. Geographically Dispersed Workforces
Filters and Replication
• Distribute Workflows • Create And Manage Work 8. Reporting
Per job or entire system
• Tracking • Reporting on work
Estimate Data Secure Start Project Validation Collect data Budget Cost Required
Generate Edit Data Packet and Map
Synchronize Alert All Stop Stakeholders Databases
Preparation Analysis Implementation Complete 9. Reporting Centralized repository
• One stop shop for all job information • Built-in reporting capabilities • Database tables - Support additional reporting tools
Workflow System Tables 10a. Enterprise Offering
• Non-GIS staff • Ready to use web apps • No programming
Organization-wide Workflow System User Talk
Dr. Pankaj Jaiswal, Director GSI, has Masters Degree from University of Delhi and a PhD Degree from University of Twente. He has been working in the area of different landslides within Geological Survey of India and today he is a expert in the field.
His classic work on quantitative estimation of landslide risk along transportation corridors using information derived from historical records was a exceptional one. ArcGIS 3D Basemap Multi-scale global 3D maps
Global
Landscape
City
Building Data Collection
A unique approach • Low Cost Scanners – Imagery • Quickly Document and build 3D environments • Outputs point clouds, meshes, and images • End goal is to integrate scans as 3D GIS layers Variety of Scanners
Examples that can be used • Lidar • Handheld Devices • Mobile
Paracosm Scanner
Lidar by Plane Lynx – Mobile Mapping System ArcGIS Pro Used to create a multipatch feature class and 3D editing tools ArcGIS Pro Finished Interior Model Demo – Indoor Mapping ArcGIS Pro Image Processing Derived information products from a mosaic dataset
Mosaic Dataset Hillshade f(x) f(x) f(x)
Slope map Source Raster
Aspect map Demo
Mosaic Dataset Processing Templates Multiple information products from a single mosaic dataset
Analyze
Share ENVI is a Platform for Imagery Analysis
Ingest data from virtually any sensor
Advanced spectral processing routines
Image analysis workflows
Robust ArcGIS interoperability
Extensible platform via IDL ENVI Supports advanced analytics for many data types…
Synthetic Aperture Multispectral Hyperspectral Thermal Radar (SAR)
Elevation LiDAR Aerial ENVI Image Analysis Platform
Atmospheric ENVI Correction OneButton
DEM ENVI Extraction
Photo- grammetry
Feature SARscape Extraction Suite of Tools
NITF Data ENVI Services Engine
IDL Extensibility Harris and Esri Partnership ENVI and ArcGIS together offer a complete GIS, remote sensing, geospatial solution
ENVI
ArcGIS®
Makes it easy to add information to a GIS for better decision making IDL - Python Bridge
• Bi-directional bridge lets you easily call Python from IDL or run IDL from Python across platforms • Enabled with Python module numpy • One-to-one mapping of major datatypes
Python Code Snippet IDL Code Example ENVI – ArcGIS Integration
• Integration allows users to analyze imagery and easily share data between ENVI and ArcGIS
- Geodatabase create/read/write capabilities - ArcGIS map projection engine - Esri layer support - ENVI Esri basemaps - ArcGIS map layout view
- ENVI to ArcMap link - ENVI file format read/write - ENVI ModelBuilder Integration - IDL-PythonArcGIS Bridge bi-directional - ENVI tools for ArcGIS / ArcGIS Server
User Talk
A. K. Pathak working as Scientist - G at BSI. did his B. Tech and M.Tech from Pantnagar University and served at College of Technology there as faculty for six years. Then he joined a multinational company as senior executive in a production environment. He joined Botanical Survey of India (BSI) as Scientist (IT) in 1992 and also served Forest Survey of India on deputation as System Manager in National Forest Data Management Center. Discover Analytics What is Raster Analytics?
A new way to create and execute spatial analysis models and raster processing chains which leverages distributed storage and analytics
• Works with your existing imagery, rasters and GIS data - Register your local data, use mosaic datasets or image services - Optionally import data into distributed storage - Process single massive rasters or large collections
• Enable massive distributed processing and analysis - Persist dynamic imagery products - Run spatial analysis as predefined models
• Integrate Analytics into your workflows - Use ArcGIS Pro to Author models - Outputs are rasters or features layers on your portal Raster Analytics Foundational Concepts
• Raster Analytics adds to existing ArcGIS foundational concepts
Dynamic Raster Geoprocessing Server-based Distributed Raster Analytics with Web GIS Layers Models Models Distributed Raster Data Storage
Portal
(persistent) distributed analytics with optional distributed storage for even greater scalability
more more new extends Raster Analytics Conceptual Overview
Raster Analytics can power systems that need to execute spatial analysis and image processing models in a distributed and scalable environment. It is Portal designed for users, developers, and system integrators. ArcGIS Pro
(Users, Analysts, Researchers) New Web GIS Layers
analysis results as a new Web GIS Layers
Web GIS Layers
Design & Run Model
Model Execution Distribution Portal UX
Results are stored in distributed storage and are immediately available as new Web GIS Layers which are already optimized for further analytics distributed raster analytics cluster
Developers & System Integration
import and optimize ArcGIS Services WCS Services Files (optional) Gdb distributed raster datastore GIS Data & Imagery Raster Analytics Test Case: Terrain Suitability global terrain suitability raster
terrain suitability model • compute slope • compute aspect • remap • overlay
790 800 13.12 hours
700
600
500 425
Global SRTM 90m 400 80 minutes Minutes 300 252
200 126 80 100
0 1 2 4 8 16 esri virtual machine Raster Analytics Processors • 16GB RAM, 8 cores, NAS storage Raster Analytics Test Case: Landsat Processing
Infrastructure Input Collection Processing Output
(foreach) input scene
mask ArcGIS Enterprise on AWS no data
Landsat GLS 1990 top of atmosphere Thematic Rasters correction • 7422 Multispectral Scenes • 7422 Thematic Rasters • S3 storage • Distributed Raster Datastore
modified soil adjusted vegetation index
Distributed Raster Analytics Cluster
• single node remap to classes • AWS c3.8xlarge 2 hours 48 minutes • 60GB RAM, 32 cores, 500GB SSD 44 scenes per minute • 200 Raster Analytics Processors ¾ scene per second output thematic raster 360b pixels What is GeoAnalytics Server?
ArcGIS has a new way of processing vector and tabular data with both spatial (location) and temporal (time) components that is designed for fast distributed analytics and storage Go From Noise to Intelligence