Executive Workshop on Enterprise Geospatial Systems Geospatial Infrastructure Demands
Dave Peters July 15,2004
J8338 1of 55 What is the challenge? Develop Enterprise support for GIS Operations Important Business Drivers: - Mature and growing GIS Operations - Rapidly expanding GIS Data Infrastructure - Evolving IT Infrastructure DOI Enterprise GIS Challenges - Define requirements for a scalable architecture - Connecting User Applications with Data Sources - GIS: Understand the proper architecture strategy - IT: Establish an Actionable Infrastructure Blueprint that supports business needs (GIS Operational Requirements)
J8338 2of 55 GIS Software Evolution Overview
GIS Department Desktop Viewers Distributed Internet Enterprise Federated Professional Query and Analysis Operations GIS Operations GIS Operations GIS Operations Remote Users Data Development Project Research Specific Operations Internet Desktop Interface Web Search Engines Data Maintenance Ad Hoc Mapping Work Management Map Products Enterprise GIS Collaborative Operations GIS Projects General Operations Delivery Routing Data Publishing Personal GIS Mapping Services Map Production Emergency Response Data Integration Query / Analysis Web Commerce Embedded Applications
ArcInfo ArcView GIS MapObjects ArcView IMS ArcGIS Desktop ArcInfo ODE - ArcInfo 1999 Geography Network 1982 1992 MapObjects IMS - ArcEditor 2000 1996 - ArcView X-Emulation ArcIMS ArcGIS 9 - ArcEngine Windows Terminal Clients 1997 - ArcGIS Server 2004 Web Data Sources ArcInfo Shapefiles Spatial Database Engine Intelligent Data Coverage/ ArcStorm 1997 ArcSDE Distributed Librarian Map Servers 1999 Geodatabase Application Servers Web Servers Local Area Networks Terminal Servers GIS File Servers Wide Area Networks
J8338 3of 55 Department GIS
Department File Servers
GIS User GIS User LAN
GIS User GIS User
J8338 4of 55 Organizational GIS
Department File Servers Centralized Data Warehouse Utilities IT Utilities Parks ArcSDE
Parks Assessor WAN Assessor WAN Arc Desktops Arc Desktops Distributed Client/Server Centralized Database Data Warehouse Departmental GIS IT Departmental GIS Operations Utilities ArcSDE ArcIMS/WTS Centralized Data Sharing (server consolidation) Parks
Assessor WAN
ArcTerminals/Browsers Centralized Database Enterprise GIS Operations Centralized Data Administration
J8338 5of 55 Community GIS
Centralized Database IT Geography Network Utilities ArcSDE ArcIMS/WTS GIS Data Marts ArcSDE WWW Company GIS ArcIMS Arc Desktops Parks County GIS Assessor WAN
ArcTerminals/Browsers Arc Desktops WWW Enterprise GIS Operations Arc Terminals/Browsers Department and Central Database Data Integration City GIS Application Service Providers Regional ArcSDE Metadata ArcIMS/ Internet GIS Operations Terminal Servers Shared Database Environments Data Integration Federated GIS
J8338 6of 55 System Architecture Options Data Resources G.NET Architecture Files Attributes -Coverages ArcSDE -Customers -Shapes -Georelational -Facilities -Images -GeoDatabase -Documentation
Storage Area Network Regional Geography Network Metadata ArcIMS File/Image WTS Web Server
ArcSDE DBMS WWW Server Server Remote Sites 100 Mbps Ethernet WAN PDA Arc Desktops Cell Arc Browsers Web Browsers -Analysis -Map Products -Data Download -Maintenance -Analysis Arc Terminals -Maps on Demand -Operations Arc 8 Laptops -Operations -Analysis -Data Shipping -Studies -Studies -Data Updates -Maintenance -Analysis -Operations Arc 8 Mobile Users -Studies -Data Updates ArcGIS Architecture -Analysis
J8338 7of 55 System Design Strategies
GIS Product Architecture
J8338 8of 55 ArcGIS System ------ArcGIS Desktop ------ArcInfo ArcEditor ArcView Terminals ------ArcEngine ------ArcExplorer Browser
Terminal Services Web Services ArcGIS Desktop ArcIMS ArcEngine ArcGIS Server
ArcSDE
Files Databases
J8338 9of 55 System Design Strategies
GIS User Needs
J8338 10 of 55 GIS Business Planning Optimizing your Benefits (Prerequisite for purchasing hardware)
Data Requirements Business Processes (Information resources) Application Needs (User workflows) Infrastructure Requirements (User productivity tools) System Design Strategic Deployment Plan
Planning
PlanningPlanning withwith regularregular commitmentscommitments leadsleads toto successsuccess
J8338 11 of 55 System Architecture Design What Is System Architecture Design?
User Needs Hardware Specifications
Data Resources
Network Design
People Hardware
Applications
J8338 12 of 55 System Design Process
GIS Needs Assessment User Workflows Information Products Data Requirements System Architecture Design Application Needs Technology Overview Implementation Strategy Existing Environment GIS Workflow Analyst GIS User Needs Overview (Customer Business Processes) System Configuration Alternatives System Design Components System Loads Analysis Hardware Sizing/Selection Implementation Strategy GIS System Design Consultant (Customer System Design)
J8338 13 of 55 Software Technology Options Desktop Applications or Web Services? GIS Data Source
File Server DBMS Server
Internet Service
Web Server Map Server WTS LAN PDA MobileCell Services -ArcPAD Browser Workstations WAN -Tablet PC Desktop Applications Web Services -ArcIMS -ArcGIS Server Browser Terminals
J8338 14 of 55 City of Rome Planning Work Flow Analysis – Year 1
User Needs Templates – Year 1
J8338 15 of 55 City of Rome Planning Work Flow Analysis – Year 2
J8338 User Needs Templates – Year 2 16 of 55 City of Rome User Application Requirements
User Needs System Architecture Design Overview J8338 17 of 55 Database Configuration Options Centralized Computing Environment
LAN Phase 1 Site 1 City Hall Backbone Fibre 4th4th FlFlooroor Site 2
3rd3rd FlFlooroor Operations Facility Police Dept LAN 22nndd FloorFloor 22nndd FloorFloor Central IT Dept Central IT Dept 1st1st FloFlooorr T1 T1 ArcSDE WANWAN 911/Dispatch911/Dispatch Office Server Office WTS ArcIMS T1 StaffStaff T1 Firewall SiteSite 33 FreebeFreebergrg InternetInternet T1 T1 BrowBrowserssers T1 T1 SiteSite 44 56 Kbps T1 PSAP Willsberg 56 Kbps PSAP Wireless Willsberg Wireless SiteSite 77 SiteSite 55 JacksonJackson SiteSite 66 PerthPerth PolicePolice EmeEmerrgencygency WaWawwaashsh VehiclesVehicles Phase 2 VehiclesVehicles
T1 = 1.54 Mbps Roger Tomlinson, Managing an GIS Seminar, July 2003 J8338 18 of 55 Platform Loads Central Computing Environment
J8338 19 of 55 Database Configuration Options Distributed Computing Environment
LAN Phase 1 Site 2 Site 1 City Hall Backbone Fibre Operations Facility 4th4th FlFlooroor LAN 22nndd FloorFloor 3rd Floor Police Dept 3rd Floor 1st1st FloFlooorr 2nd Floor 2nd Floor 911/Dispatch Replication Replication 911/Dispatch ArcSDE CentrCentraall ITIT DeptDept ArcSDE Server T1 T1 WAN Server ArcSDE WAN WTS ArcIMS Office Server Office WTS ArcIMS T1 StaffStaff T1 Firewall SiteSite 33 FreebeFreebergrg InternetInternet T1 ArcIMS T1 BrowBrowserssers T1 T1 SiteSite 44 56 Kbps T1 PSAP Willsberg 56 Kbps PSAP Wireless Willsberg Wireless SiteSite 77 SiteSite 55 JacksonJackson SiteSite 66 PerthPerth PolicePolice EmeEmerrgencygency WaWawwaashsh VehiclesVehicles Phase 2 VehiclesVehicles
T1 = 1.54 Mbps Roger Tomlinson, Managing an GIS Seminar, July 2003 J8338 20 of 55 Platform Loads Distributed Computing Environment
Platform Loads Analysis
J8338 21 of 55 System Design Strategies
Network Communications
J8338 22 of 55 GIS Applications Network Impact
What GIS Does ... • Graphic Data Representation (Maps) • Large Quantity of Data Analysis • Lots of Network Traffic
J8338 23 of 55 Network Design Guidelines
J8338 24 of 55 ArcIMS Network Performance
J8338 25 of 55 Data Download Performance
J8338 26 of 55 ArcGIS Desktop Network Design Planning Factors
J8338 27 of 55 Network Loads Central Computing Environment
ArcSDE /ArcIMS for all offices and Public
ArcSDE for local clients / dialup for remote patrol cars
Terminal WAN access for local clients / Internet access for remote vehicles
Terminal WAN access to City Hall
Terminal Internet VPN Internet access to City Hall Network Loads Analysis
J8338 28 of 55 Network Suitability Year 1 Centralized Computing Environment
Combine Convert
Network Design Factors (0.028) (0.5) TOTAL Exceed
Network Design Factors (0.028) (0.5) TOTAL Network Design Factors (0.028) (0.5) TOTAL High
J8338 29 of 55 Network Suitability Year 2 Centralized Computing Environment
Combine Convert
Network Design Factors (0.028) (0.5) TOTAL
Exceed Network Design Factors (0.028) (0.5) TOTAL Network Design Factors (0.028) (0.5) TOTAL High
J8338 30 of 55 System Design Strategies
Data Administration
J8338 31 of 55 Database Configuration Options Centralized Computing Environment Central Data Center Geographic Date Resources Consolidation File Server ArcSDE Server Attribute Server
Web Server Map Server WTS LAN
WHYWHY CONSOLIDATE? CONSOLIDATE? ••ReduceReduce HW HW cost cost Browser Workstations WAN ••ReduceReduce admin admin cost cost ••LowLow implementation implementation risk risk ••IntegratedIntegrated operations operations ••ImprovedImproved data data access access ••ImprovedImproved security security Browser •Reduce network traffic Terminals •Reduce network traffic
J8338 32 of 55 Database Configuration Options Distributed Computing Environment
Why use distributed architecture? Why use distributed architecture? •Organizational Precedence •Organizational Precedence •Management Confidence Central •Management Confidence •Physical Security •Physical Security on Data D ti at •Infrastructure Limitations ica Server a •Infrastructure Limitations pl Re Re pl a ica at ti D on
Regional Regional Data Data Server ArcInfo or ArcView GIS Server Clients
ArcInfo or ArcView GIS DISTRIBUTED DATA SOLUTIONS ArcInfo or ArcView GIS Clients DISTRIBUTED DATA SOLUTIONS Clients •Increase•Increase HW HW cost cost •Increase•Increase ad adminmin cost cost •High•High implementation implementation r irsiksk •Disconnected•Disconnected operation operationss •Limited•Limited data data access access •Reduced•Reduced security security •Increased•Increased n netwetworkork traffic traffic J8338 33 of 55 ArcSDE Single-generation Replication (Personal Geodatabase Checkout – ArcGIS 8.3+)
Disconnected Editing – Personal Geodatabase Checkout
Check-in Version Updates Single DBMS V1 Single Check-out/Check-inCheck-out/Check-in Edit loads Check-out TransactionTransaction Personal Disk Geodatabase PGD V Laptop Field Editor Editing Desktop Primary Editor Viewers
PGD V1 Laptop Editor
J8338 34 of 55 Geodatabase Single- generation Replication (Database Checkout – ArcGIS 8.3+) Disconnected Editing – Database Checkout Corporate
Single V-1 Single Check-in Regional Version updates Check-out/Check-inCheck-out/Check-in ArcSDE Transaction Check-out Transaction Regional Reconcile and post Database Regional updates Corporate Editor Region
V1a ArcSDE V1d
Disconnected Disconnected Regional Editing Regional Editing Editor Editor
PGD PGD V1aRegional V1bRegional Editor Editor
J8338 35 of 55 Geodatabase Multi-generation Replication ( ArcGIS 9.1)
Corporate Reconcile and post Corporate updates Reconcile and post Corporate updates Download Corporate Version updates Download Corporate Version updates CV-1 CV-2 Upload Regional Version updates Upload Regional Version updates ArcSDE Check-out Check-out Reconcile and post Reconcile and post Regional Regional Regional updates Regional updates Database Database Corporate Region 1 Editor Region 2
ArcSDE V1 ArcSDE V2 V1 V2 UnlimitedUnlimited Disconnected Disconnected Update Regional Regional Editing Regional Update Regional Editing Editor Editor Editor Editor TransactionsTransactions
PGD PGD V1 Regional V1 Regional Editor Editor
J8338 36 of 55 System Design Strategies
Performance Sizing Fundamentals
J8338 37 of 55 Planning for System Performance Performance Chain
Reduce Cost Improve Productivity
Balanced System Design Servers Network DBMS GeoDatabase
Storage Clients ArcSDE Application
Hardware Infrastructure Database Design User Workflow
System Architecture Design Framework for Productive Operations
J8338 38 of 55 Understanding the Technology System Performance Factors How do we address performance sizing? Hardware performance User Workflow allocation GeoDatabase Design Display layers/features/complexity (tables, dependencies, relationships) Client Applications Database Technology $Market$ (DBMS, Data Types, Indexing, Tuning) GIS Software Performance Bar ArcSDE Connection Technology Wide Area Network Workstation Performance Wide Area Network Server Performance/Capacity BandwBandwidthidth Storage (user productivity) (single server) Peak Client Loads Hardware Specifications Network Communications Bandwidth
Balanced Loads InInternetternet BandwBandwidthidth System Architecture Design
J8338 39 of 55 System Design Strategies
System Sizing Tools
J8338 40 of 55 User Performance Expectations ArcInfo Platform Selections • ArcInfo 7.0.2 (Sept. 1994) – Sun SPARCstation 10 Model 40, 32 MB Memory • ArcInfo 7.0.4 (Feb. 1996) – Sun SPARCstation 20 Model 71, 64 MB Memory • ArcInfo 7.1.1 (Feb. 1997) – Pentium Pro 200 MHz, 64 MB Memory • ArcInfo 7.2.1 (April 1998) – Pentium II 300 MHz, 128 MB Memory • ArcInfo 8 (July 1999) – Pentium III 500 MHz, 128 MB Memory • ArcInfo 8.0.2 (July 2000) – Pentium III 733 MHz, 256 MB Memory • ArcInfo 8.1 (July 2001) – Pentium III 900 MHz, 256 MB Memory • ArcInfo 8.2 (July 2002) – Pentium 4 1.5 GHz, 512 MB Memory • ArcInfo 8.3 (July 2003) – Intel Pentium 2.4 GHz, 512 MB Memory • ArcInfo 9.0 (May 2004) – Intel Xeon 3.2 GHz, 512 MB Memory
J8338 41 of 55 PC Intel Platform Performance 1800 Sint2000 1700 Arc04 = 2004 Single ArcInfo Sfp2000 1600 User Workstation Performance Arc04 1500 Arc03 = 2003 Single ArcInfo 1400 User Workstation Performance 1300 e c 1200 Arc02 = 2002 Single ArcInfo 1100 User Workstation Performance
orman 1000 f Arc01 = 2001 Single ArcInfo 900 User Workstation Performance 800 Arc03 ve Per
ti 700 Arc00 = 2000 Single ArcInfo a l User Workstation Performance
e 600
R 500 Arc02 Arc99 = 1999 Single ArcInfo 400 User Workstation Performance Arc01 300 Arc00 200 Arc99 100 Arc98 0 0 0 0 0 3 0 6 0 3 0 5 00 00 5 0 3 0 6 0 3 o 200 II 233 II 266 II 300 II 333 II 350 II 400 II 450 III 10 III 12 Pr m m m ium III 6 ium III 7 ium III 7 ium III 8 ium III 8 ium III 9 ium III 9 ium III 5 ium III 5 t t t t t t t t u u u t i n nti nti e Pentium Pentium Pentium Pentium Pentium Pentium Pentium Pen Pen Pen Pen Pen Pen Pen Intel Xeon 1400 Intel Xeon 1500 Intel Xeon 1600 Intel Xeon 1700 Intel Xeon 2000 Intel Xeon 2400 Intel Xeon 2800 Intel Xeon 3000 Intel Xeon 3200 Pen P Pe Pe Pent J8338 42 of 55 2003 Hardware Life Cycles
(Months)
Technology Current Useful Obsolete Non-functional
Network Infrastructure • Local area networks 24-36 37-84 85-120 120+ • Wide area networks* 12-24 25-60 61-84 84+ Computer Hardware • Data Servers 12-18 19-48 49-72 72+ • Application Servers 6-12 13-48 49-72 72+ • Desktop Workstations 6-12 13-36 37-60 60+ • Laptop Workstations 6-12 13-34 25-48 48+ • Terminal clients 24-36 37-60 61-72 72+ * Internet bandwidth increasing at 300% per year
J8338 43 of 55 Terminal Server Performance Terminal Server Performance Model
File Server ArcSDE Server
Terminal Terminal Server Server (6 ArcInfo Users/CPU) (7.5 ArcInfo Users/CPU)
Terminal Clients Terminal Clients
J8338 44 of 55 Windows Terminal Server ArcSDE Server Data Source
90 Arc04 12 GB Memory 80 WTS User Processing Equivalents Batch process = 7.5 GIS clients 8 GB Memory 70 Arc03
60 6 GB Intel Xeon MP 4-3000 MHz Memory 57.2
50 Arc02
4 GB
rate_int2000 40 Memory Arc01 C Intel Xeon 2-3200 MHz 34.0 SPE 31.4 30 Intel Xeon MP 2-3000 MHz 2 GB 20 Memory Intel Xeon 2-2400 MHz 17.5
10
0 0 5 10 15 20 25 30 35 40 Total Concurrent Users
J8338 45 of 55 ArcIMS Server Performance
ArcSDE Server File Server
Map Server Map Server 0.6-sec average service time 0.3-sec average service time
BasedBased on on 2004 2004 PerformancePerformance Baseline Baseline IntelIntel Xeon Xeon 3.2 3.2 GHz GHz WAN
WAN
Browser Clients Browser Clients 3,000 Requests per hour/CPU 6,000 Requests per hour/CPU
J8338 46 of 55 Web Application Transactions ( Simple 9.0 Map Server Application)
ArcSDE Server
AGS Map Server Map Server SOC 0.6-sec average service time
Instances
Web Server 0.3-sec average service time ArcGIS Desktop (additional 50% of SOC load)
ArcGIS Engine *** ADF *** Java Application (J2SE/J2EE) SingleSingle Platform Platform 0.9-sec0.9-sec aver averageage servi servicec etime time Based on 2004 Based on 2004 WAN PerformancePerformance Baseline Baseline IntelIntel Xeon Xeon 3.2 3.2 GHz GHz
Browser Clients
6,0006,000 Requ Requestsests per per hou hour/CPUr/CPU (Single(Single Platform: Platform: 4,000 4,000 Requests Requests p perer hour/CPU) hour/CPU) J8338 47 of 55 Internet Map Server Performance ArcIMS Map Servers 100 Web Service Equivalents AGS Services Geoprocessing consumes a CPU (ArcIMS File data source) 90 AGS + Web Apps
80 ArcIMS (ArcSDE data source) 70
60 2000 t Intel Xeon 4-3000 MHz 57.2 n 50
40
SPECrate_i Intel Xeon 2-3200 MHz 34 30 SunFire280R 2-1200 MHz 23.6 20 Arc04 Baseline Intel Xeon 2-2400 MHz 17.5
10
0 0 6,000 12,000 18,000 24,000 30,000 36,000 42,000 48,000 54,000 60,000 Peak Transactions per Hour
J8338 48 of 55 ArcIMS/AGS Data Server Loading
50,000 Translation based on data server technology ArcIMS ArcIMS data server load = Map Requests per Hr / 1,600 45,000 AGS data server load = Map Requests per Hr / 800
40,000 AGS Services 35,000
our 30,000 H r
pe 25,000 s
t 24,000 s
20,000 que e R 15,000 12,000 10,000
6,000 5,000 3,000 0 5 101520253035404550 Data Server Client Load
J8338 49 of 55 ArcSDE Server Performance Server Loading Model
ArcSDE Servers
One server batch process = 30 ArcSDE clients
ArcSDE Server (30 ArcSDE Clients/CPU)
Workstations
OR
J8338 50 of 55 Workgroup GIS Data Server (ArcSDE and File Server)
120 Arc04 ArcSDE Server Processing Equivalents 18.0 10 GB 110 Include IMS peak map server loads Memory Arc03 8 GB 9.0 Batch server process = 30 GIS clients Memory 100
90 Unisys ES7000 8-3000 88.4
80 Arc02 IBM x445 8-2800 6 GB IBM p650 8-1450 MHz 75.5 Memory 6.3 70
SunFire 4800 8-1200 MHz Arc01 61.4 60 5.1 Intel Xeon MP 4-3000 MHz 57.2 50 4 GB ECrate_int2000 Memory SP 40 IBM p630 4-1450 MHz 37 Intel Xeon 2-3200 MHz 34 30 2 GB Intel Xeon MP 2-2800 MHz 27 Memory 20
10
0 0 50 100 150 200 250 Peak Concurrent Clients
J8338 51 of 55 Enterprise GIS Data Server (ArcSDE Server)
500
ArcSDE Server Processing Equivalents 28 GB Arc04 450 Include IMS peak map server loads Mem Batch server process = 30 GIS clients 26 GB 400 Mem 22 GB 350 Arc03 Mem IBM p690 32-1700 339
0 18 GB 0 Win2003 Data Center 32-3000 MHz 310 0 300 Mem nt2 250 te_i 14 GB Win2003 Data Center 24-3000 MHArcz 02 240 Mem 200 Arc01 10GB SunFire 6800 24-1200 MHz SPECra 180 8GB Mem IBM p670 16-1500 156 150 Mem 6GB 122 4GB Mem SunFire 4800 16-1200 MHz 100 Mem Win2003 Data Center 8-3000 88.4 2GB 50 Mem SunFire 4800 8-1200 MHz 61.4 Intel Xeon MP 4-3000 MHz 57.2
0 0 50 100 150 200 250 300 350 400 450 500 550 600 650 700 750 800 Peak Concurrent Clients
J8338 52 of 55 Phased Implementation Strategy
ManagingManaging TechnologyTechnology ChangeChange
2003-2005 Strategic Plan 2004-2006 Strategic Plan
2002 Deployment Authorization 2003 Deployment Authorization
J8338 53 of 55 Systems Integration Support Efforts
System Design Strategies White Paper (http://www.esri.com/library/whitepapers/pdfs/sysdesig.pdf)
System Architecture Design Workbook System Design Support • Hardware Sales Support (sihelp@esri.com) • Technical White Papers • System Integration Test Reports • System Installation Reports System Architecture Design Training (ESRI Training Class) (Technology Exchange Workshops) System Architecture Design Consulting (Professional Consulting for Enterprise GIS) Enterprise Systems Lab (Internet Demonstration Site – (http://eslims.esri.com) Performance Validation Testing ArcIMS Architecture Design Consulting (Professional Consulting for ArcIMS Deployment)
J8338 54 of 55