Geobia: a Bridge Between Remote Sensing and GIS Problem

Problem Statement

• How do we take daily multi-terabyte acquisitions of remote sensing earth observation (EO) data (and their increasingly vast archives) and turn it into useful geo- Geobia: A Bridge Between Remote Sensing information products? and GIS

Darryl Murdock, Ph.D. ESRI

Issues Role of Remote Sensing

• Remote Sensing (RS) promise still unfulfilled • Surrogate for phenomenologies –Geographic Information Systems (GIS) users • RS data is just that – data, NOT information are data starved • Information is derived from analysis –RS data volumes are growing exponentially –Immediate viewing and interpretation • AFE results must be quick and readily ingested into a –Image processing geodatabase –Digitization (old school – or is it?) • Data Models and Metadata Standardization are needed

Role of GIS ArcGIS Supports All Spatial Data Types

• Provides a unifying SOA environment for users to In Relational 107’ analyze, visualize, and predict. Tables & Files Vectors • For some activities, such as natural disaster response, Topology Dimensions time-to-analysis is the most critical component. GIS allows fast multi-source integration and analysis Surveys

• Thus, for time-sensitive activities the true power of GIS ABC is realized by combining real-time or near real-time EO Networks data, feature extracted vectors and other existing data Images Annotation CAD Drawings GEOBIA can be the connection between RS and GIS by 27 Main St. Terrain providing additional timely content 3D Objects Addresses Attributes

With Rules That Define Relationships and Behavior 6 ArcGIS Supports All Spatial Data Types Geoprocessing Models “Best Practices” Can Be Scripted

In Relational GEOBIA 107’ Tables & Files Vectors Topology Dimensions

Surveys

GEOBIA ABC Networks Images Annotation CAD Drawings 27 Main St.

Terrain 3D Objects Addresses Attributes . . . And Shared With Rules That Define Relationships and Behavior . . . And Shared 7 8

Integration of Geospatial Workflows Integration of Geospatial Workflows in the Enterprise in the Enterprise

Sensor Data Manager Sensor Data Manager Manager Manager ArcCatalog ArcCatalog AGI - STK ArcGIS Desktop AGI - STK ArcGIS Desktop GIS Consumers GIS Consumers ArcGIS Explorer ArcGIS Explorer Data Management Google Data Management Google ArcGIS Server Virtual Earth ArcGIS Server Virtual Earth Imagery Web Apps Imagery Web Apps Desktop Desktop GeoDB Services Mobile GeoDB Services Mobile Geoprocessing Data Maps/Globes Imagery Geoprocessing Data Maps/Globes Imagery

Image Image Geospatial Image Image Geospatial Scientist Analyst Analyst Scientist Analyst Analyst ENVI ENVI Zoom & Fx GEOBIAENVI ENVI Zoom & Fx SocetSet RemoteView ArcGIS SocetSet RemoteView ArcGIS

UC2008 Pre-conference Seminars 9 UC2008 Pre-conference Seminars 10

Integration of Geospatial Workflows Integration of Geospatial Workflows in the Enterprise in the Enterprise

Image Image Geospatial Image Image Geospatial Analyst Analyst Scientist GEOBIA Analyst Scientist Analyst ENVI ENVI Zoom & Fx ENVI ENVI Zoom & Fx GEOBIA SocetSet RemoteView ArcGIS SocetSet RemoteView ArcGIS

UC2008 Pre-conference Seminars 11 UC2008 Pre-conference Seminars 12 Integration of Geospatial Workflows Integration of Geospatial Workflows in the Enterprise in the Enterprise

Sensor Data Manager Sensor Data Manager Manager GEOBIA Manager ArcCatalog ArcCatalog AGI - STK ArcGIS Desktop AGI - STK ArcGIS Desktop GIS Consumers GIS Consumers ArcGIS Explorer ArcGIS Explorer Data Management Google Data Management Google Imagery ArcGIS Server Virtual Earth Imagery ArcGIS Server Virtual Earth Web Apps GEOBIA Web Apps Desktop Desktop GeoDB Services Mobile GeoDB Services Mobile Geoprocessing Data Maps/Globes Imagery Geoprocessing Data Maps/Globes Imagery

Image Image Geospatial Image Image Geospatial Scientist Analyst Analyst Scientist Analyst Analyst ENVI ENVI Zoom & F x ENVI ENVI Zoom & F x SocetSet RemoteView ArcGIS SocetSet RemoteView ArcGIS

UC2008 Pre-conference Seminars 13 UC2008 Pre-conference Seminars 14

Publish ArcGIS content to Virtual Earth Integration of Geospatial Workflows Publish ArcGIS content to Virtual Earth ArcGIS Server VE Extender Js and Rest API – Mashups in the Enterprise

Sensor Data Manager Manager GEOBIA Web Browser ArcCatalog AGI - STK ArcGIS Desktop GIS Consumers ArcGIS Explorer “Mash-Up” In web page on Data Management Google In web page on Imagery ArcGIS Server Virtual Earth WWW server GEOBIA Web Apps Desktop GeoDB Services Mobile Geoprocessing Data Maps/Globes Imagery ArcGIS Server Internet 9.3 Other ArcGIS Servers Image Image Geospatial & ArcGIS Online Scientist Analyst Analyst ENVI ENVI Zoom & Fx GEOBIA GEOBIA GEOBIA SocetSet RemoteView ArcGIS User Data

UC2008 Pre-conference Seminars 15 VE Web Service

Publish ArcGIS content to Google Maps Characteristics of a Good Geobia System ArcGISArcGIS ServerServer GoogleGoogle MapsMaps ExtenderExtender JSJS andand RESTREST APIAPI –– Mashups Mashups

• Ability to accurately • Results readily written extract features to a geodatabase Web Browser • User-definable Features • Ability to embed results • Repeatable results directly within existing • Batch processing GIS models and • Batch processing simulation routines “Mash-Up” capability In web page on • Provide feedback WWW server • Fast processing time • Fast processing time mechanisms to user (secs per and data collector scene/image/GB) and data collector • Excellent metadata – ArcGIS Server • Ability to share results Internet 9.3 RS, Geobia processing with others RS, Geobia processing Other ArcGIS Servers and GIS metadata all & ArcGIS Online • SOA enabled preserved, readily exposed and available

User Data

Google Maps Web Service Who Is the Geobia Practitioner? •Intel world analogy

• RS analyst –1st phase: “I need it NOW” • GIS practitioner –2nd phase: “I have a little bit of time” (1-10 • IT professional (coder) days) • SME (RS/GIS/IT generalist) • SME (RS/GIS/IT generalist) –3rd phase: “I need to fully understand” (weeks to months)

Geobia techniques applicable

UC2008 Technical Workshop 20

Example: USDA Myanmar Flooding

ITT VIS ENVI Fx Examples

• Desktop Functionality and Geodatabase Interoperability ENVI Fx: Spatial Feature Extraction Module Spatial Feature Extraction Workflow

The new ENVI Feature Extraction Module provides an Segmentation easy to use workflow for extracting important information from high resolution Panchromatic and information from high resolution Panchromatic and Object Multispectral data Multispectral data Generation

• Vehicles Classification • Airplanes, Tanks, Cars, Ships Feature • Buildings • Buildings Definition • Building Outlines, Residential Rooftops • Transportation • Roads, Bridges, Airports, Harbors • Natural Features • Rivers, Lakes, Forest, Fields Features

Example: Impervious Surfaces (0.6m MS) Example: Wetlands (1m CIR)

Example: Forestry (0.6m MS) ENVI and ArcGIS Interoperability

•ENVI users can: •Access and read from ArcGIS Geodatabases •Write out to geodatabases •Launch ArcMap and create map compositions directly from ENVI •Supports enterprise, personal, and file Geodatabase types VLS Feature Analyst Examples Bare Earth, 3D Building Extraction from LiDAR Data

• LiDAR - a different type of RS data

Feature Analyst Definiens Connector to ArcGIS Image Server Feature Modeler tool Examples

• How do we maintain metadata for image services?

Definiens position within the ESRI framework Processing ArcGIS Image Services in ArcMap

The Definiens eCognition Server can be fully integrated either as stand alone component or in an OEM version. A comprehensive set of APIs allows a seamless integration on the workflow as well as Step 1 the data exchange side. Definiens Analysis can be requested directly through ArcGIS clients or from • Load image service web clients via the ArcGIS Image Server. • Load vector layers

ArcGIS Desktop Clients Web Clients Load image service Load / save data Analyze raster data Analyze image service

Load data Definiens Request analysis ArcGIS Image ArcGIS Server eCognition Service Layer Server Store dataServer Load image service

Load data Load data Load data Store data

Data Layer

Geo Database File System Processing ArcGIS Image Services in ArcMap Processing ArcGIS Image Services in ArcMap

Step 2 Step 3 • Select area to analyze Define analysis

Processing ArcGIS Image Services in ArcMap Processing ArcGIS Image Services in ArcMap

Step 4 Step 5 Wait while processing Review results

Processing ArcGIS Image Services in ArcMap Barriers to Geobia adoption as an accepted discipline Step 5 Review results • Cross-discipline language challenges • Existing/missing data/information standards • Neither “fish nor fowl” perception of Geobia within the geospatial community • How do we create Geobia and expose services? • Need for SMEs for each use of Geobia • Crossover between RS, GIS and IT. Who owns it (philosophically)? Possible Solution Standards for GIS

• Because GEOBIA is “geographically based” existing • Information Technology Standards ISO, FGDC, and other metadata standards could be –DBMS: RDBMS & SQL adopted. –Web Services: J2EE, .NET, XML/SOAP –Computing Platforms: Windows, Unix –Development Languages: C++, Java, Visual Basic • Domain Standards –Industry, ISO, Military, OGC standards –Data and Metadata formats –Web Service APIs • User Community/Organizational Standards

FGDC Organization: Thematic focus Standards Based Interoperability ArcGIS Supports OGC Standards

ArcMap ArcExplorer 9.0 9.x 9.0 9.x WMS WFS WCS WMS WFS WCS

GML

9.0 9.x

WMS WFS WCS Catalog

ArcIMS/ArcGIS Server

Simple Feature Standard Source: http://www.fgdc.gov/organization . . . Ensuring an Open Platform UC2008 Technical Workshop 45 46

Recommendations Summary

• GEOBIA practitioners create a viable standards straw • We need better methods of integrating massive RS man for feature-extracted datasets and present to the data volumes with GIS – Geobia can help following standards bodies • Geobia results must be readily consumable into a GIS –International Standards Organization (ISO) – • GIS can be the unifying platform for all Geobia ISO/TC21 practioners, allowing modeling, programming and http://www.isotc211.org/ AFE within a common environment –Federal Geographic Data Committee (FGDC) • Fragmented Geobia Practioner Base – who will advance the art for everyone? http://www.fgdc.gov/organization • Metadata Straw Man needed to ensure Geobia data –Open Geospatial Consortium: also maintains information about its Remote Sensing http://www.opengeospatial.org/standards heritage Acknowledgements Questions?

• USDA – Burma (Myanmar) Examples Contact Information: • Dr. Jeff Hay (U. of Calgary) • Pete Macintosh (ITT VIS) Darryl Murdock, Ph.D. • Gregory Willhauck (Definiens) 8615 Westwood Center Drive • James Blondell (VLS) Vienna, VA 20191 703-506-8515 x 8112 [email protected]