Google Compu ng and the Development of ClimateEngine.org
Katherine Hegewisch, Donovan VanSant, John Abatzoglou Department of Geography, University of Idaho Outline
Google Resources: ¥ Google Cloud Storage – raster data storage ¥ Google Earth Engine – data processing ¥ Google Maps – base map, geocoding • Google Fusion Tables– vector data storage • Google App Engine - web hos ng
Non-Google Resources: ¥ GitHub- code development ¥ Python • Twi er Bootstrap - web framework • Highcharts, d3- SVG
ClimateEngine.org Tool: ¥ Remote sensing and meteorological datasets ¥ Mapping and Time Series ¥ Customizable views How We Got Started
● White House Data Ini a ve: connec ng decision makers with data-driven tools ● Google commitment: 1 petabyte of storage for climate and remote sensing datasets and cloud compu ng resources ● Google Faculty Award: integra on of datasets for drought monitoring
Tyler Erickson Google Google Cloud Google’s storage for popular raster data Google takes care of processing so ‘science’ can be started earlier
Data catalog and workspace: h ps://earthengine.google.org/
Ge ng datasets on cloud: ● demonstrate wide appeal/use for data ● Crea ve Commons License Google Earth Engine Google’s processing power
¥ 1000s of Earth Engine Processors with Direct connec on to data on Google Cloud=high speed ¥ Javascript/Python API and a User’s Guide h ps://developers.google.com/earth-engine/
Playground Environment h ps://ee-api.appspot.com/
Get an Account: h ps://developers.google.com/earth-engine/ service_account
Google Maps Google’s mapping service
Google Maps
● Base Maps ● KML Layers ● Point Markers ● Geo Loca on
Google Maps Api V3: https://developers.google.com/maps/documentation/javascript/ Google Fusion Tables Google’s storage for vector data
Crea ng a Fusion table
¥ Users upload their vector data(.csv,.kml,ods,.xls) h ps://support.google.com/fusiontables/answer/2571232 ¥ User retrieve the fusion table id
Javascript Code to Put Fusion Table on Google Map pointerFT.setOp ons({ query: { select: 'geometry', from: ‘1AOrGgpc4pCQLjmQTY5bHiivT-7h3dcIKdcCSyioz’, where: ” ’Name' CONTAINS ’California’ ", }, map:pointerMap, }); Google App Engine Google’s web hos ng
Web Hos ng ¥ Pla orm as a Service (PaaS) Web hos ng on appspot.com ¥ Availability: trusted developers, free for academic/non-profit ¥ Developer Console: h ps://console.developers.google.com/project
GitHub and TeamWork Server Side Code Back End Development
● Python 2.7 ● webapp2: Python Web Framework ● Oauth2.0: authen ca on to GEE ● Jinja2: python templa ng ● Modules: numpy,json,date me, logging and threading Client Side Code Front End Development
● Twi er Bootstrap: CSS framework, responsive design ● jQuery: JavaScript Library, cross-browser stability ● Javascript Library for SVG: ○ Highcharts= - me series ○ d3.js - colorbars CLIMATEENGINE.ORG
Desert Research Ins tute, University of Idaho ClimateEngine.org Mapping Interface
Desert Research Ins tute, University of Idaho ClimateEngine.org Time Series Interface
Desert Research Ins tute, University of Idaho ClimateEngine.org Google Cloud Datasets
Google Cloud Datasets Accessed
● Landsat Remote Sensing ● MODIS Remote Sensing ● METDATA Gridded Meteorological ● CFS Reanalysis ● CHIRPS Precipita on
Desert Research Ins tute, University of Idaho ClimateEngine.org Variables Accessed
Types of Variables Accessed
● Precipita on, Temperature ● Humidity, Wind, Radia on ● Fire Indices ● Vegeta on Indices ● Drought Indices ● Snow Cover
Desert Research Ins tute, University of Idaho ClimateEngine.org Custom Interface
Custom Calcula ons Custom Sta s cs
Custom Date Ranges
Desert Research Ins tute, University of Idaho ClimateEngine.org Applica on: 2015 Sierra Nevada Snowpack
Desert Research Ins tute, University of Idaho ClimateEngine.org Applica on: 2015 California Drought
Desert Research Ins tute, University of Idaho ClimateEngine.org Point Loca ons
Desert Research Ins tute, University of Idaho ClimateEngine.org Time Series Analysis
Mul ple-Region Comparisons Mul ple-Year Comparisons
Intra-Year Comparisons
Desert Research Ins tute, University of Idaho ClimateEngine.org