Ecoinformatics Climate Change Demonstrator

DEPARTMENT OF PRIMARY INDUSTRIES

Stage 1 - Evaluation Report

Prepared by

Joanne McNeill Christopher Pettit

Published by: Department of Primary Industries, 2008 Primary Industries Research Victoria Parkville September 2008

Also published on http://www.dpi.vic.gov.au

This publication is copyright. No part may be reproduced by any process except in accordance with the provisions of the Copyright Act 1968.

Authorised by the Victorian Government, 1 Spring Street, Melbourne, Victoria.

The National Library of Australia Cataloguing-in-Publication entry:

ISBN: 978-1-74217-287-3 (print) ISBN: 978-1-74217-288-0 (CD-ROM)

This publication may be of assistance to you but the State of Victoria and its employees do not guarantee that the publication is without flaw of any kind or is wholly appropriate for your particular purposes and therefore disclaims all liability for any error, loss or other consequence which may arise from you relying on any information in this publication.

TABLE OF CONTENTS

ACKNOWLEDGMENTS ...... III

GLOSSARY OF TERMS...... V

EXECUTIVE SUMMARY ...... VI

1. INTRODUCTION ...... 1 1.1 ECOINFORMATICS VISION ...... 1 1.2 THE CLIMATE CHANGE DEMONSTRATOR...... 2 1.3 PARTNER ORGANISATIONS...... 3 1.4 THE e-RESOURCE CENTRE ...... 3 1.5 3D VISUALISATION ...... 4 2. PROJECT ACTIVITIES ...... 5

3. KEY EVALUATION QUESTIONS ...... 7 3.1 THREE DIMENSIONAL VISUALISATION ...... 7 3.2 THE e-RESOURCE CENTRE ...... 13 4. CLIMATE CHANGE DEMONSTRATOR COMMUNICATION ACTIVITIES REPORT ...... 20 4.1 PURPOSE ...... 20 4.2 PROMOTION...... 20 4.3 CONCLUSION...... 21 5. SUMMARY AND CONCLUSIONS ...... 22

6. NEXT STEPS ...... 23

7. REFERENCES ...... 24

APPENDICES...... 25

i TABLE OF FIGURES

Figure 1 Visualisation leading to enhanced capability for effective distribution and communication of scientific knowledge (Pettit et al 2006) ...... 1 Figure 2 Vision for the Climate Change Demonstrator ...... 3 Figure 3 Employment type for Demonstrator Launch technical session survey participants.....7 Figure 4 Example of virtual farm images developed for the Futurescapes launch ...... 8 Figure 5 Does 3D visualisation technology make climate change research easier to understand? ...... 8 Figure 6 How does the visualisation technology impact the credibility of the research? ...... 9 Figure 7 How would you like research results presented in the future? ...... 9 Figure 8 How useful is 3D visualisation technology for a range of different activities? ...... 11 Figure 9 How useful are the SIEVE virtual farm environment and virtual meeting for communicating climate change scenarios?...... 11 Figure 10 Perceived usefulness of different features of the SIEVE virtual environment...... 12 Figure 11 Potential users preference for how the SIEVE is made available for use...... 12 Figure 12 How confident are potential users of the SIEVE in using the technology themselves? ...... 12 Figure 13 Perceived level of SIEVE user training and support required...... 13 Figure 14 Perceived useability of different features of the SIEVE virtual environment...... 13 Figure 15 The e-Resource Centre (previously known as the VRC), February 2008 ...... 14 Figure 16 The e-Resource Centre revised format, August 2008...... 15 Figure 17 The Victorian Climate Change Adaptation Program workspace, February 2008 ...... 15 Figure 18 The Victorian Climate Change Adaptation Program workspace revised format August 2008 ...... 16 Figure 19 Current e-RC user groups ...... 17 Figure 20 Files stored on the e-RC...... 17 Figure 21 Will the e-RC lead to more effective collaboration within research projects?...... 18 Figure 22 Is the e-RC potentially a useful extension tool?...... 18 Figure 23 Is the e-RC a useful platform for sharing climate change research? ...... 19 Figure 24 Would it be useful to develop this technology further?...... 19

ii ACKNOWLEDGMENTS

Funding for this project has been provided by the Department of Sustainability and Environment, the Department of Primary Industries and in-kind support from Multimedia Victoria (Victorian eResearch Strategic Initiative), Monash University, University of Melbourne and La Trobe University.

DPI Ecoinformatics Core Project Team

Alex Sawicki – Stakeholder Communications & Relationship Management Amanda Keogh –Scientist Christopher Pettit – Principal Research Scientist Deborah Jenkins – Project Officer Efraim Taranto – former Project Manager Falak Sheth – Research Scientist Jean-Philippe Aurambout – Research Scientist Joanne McNeill – Scientist Lisa Borthwick – Divisional Communications Stephen Zelez – Project Communications Tony Michael – Project Manager

Other Contributors to the Ecoinformatics Project

DPI Bruce Kefford - Deputy Secretary Agriculture and Fisheries Garry O’Leary – Principal Research Scientist Gordon Caris - Chief Information Officer Martin Bluml – Key Project Manager Richard Eckard – Principal Research Scientist Ron Prestidge - Executive Director Future Farming Systems Research Steve Williams – Senior Research Scientist Victor Sposito – Principal Research Scientist

DSE Bruce Thompson - Deputy Chief Information Officer Ian Mansergh - Senior Policy Officer, Environmental Policy & Climate Change Rod Anderson - Policy Analyst Greenhouse, Environmental Policy & Climate Change T.O. Chan - Principal Spatial Policy Officer

VeRSI Ann Borda - Executive Director A.B.M. Russel – eResearch Project Leader Gaby Bright - eResearch Communications Paul Davis - Advisor

iii Melbourne University Abbas Rajabifard - Director, Centre for Spatial Data Infrastructure & Land Administration Christian Stock - Research Fellow David Karoly – ARC Federation Fellow Ian Bishop – Head of Department of Geomatics Jim Falk - Director, Australian Centre for Science, Innovation and Society

Monash University Amanda Lynch - Federation Fellow/Head, Climate Change Program Anthony Beitz - DART Integration Project Manager David Griggs - Director, Monash Sustainability Institute Jason Beringer - Associate Professor Paul Bonnington - Director, Monash e-Research Centre Petteri Uotila - Research Fellow Rob Cook - Special Adviser – eResearch

La Trobe University Mark Kosten - eResearch Director Paul Pigram - Associate Professor/Head, Science, Technology and Engineering Phil Suter - Associate Professor/Head of Department, Department of Environmental Management & Ecology

iv GLOSSARY OF TERMS

AARNET Australian Academic Research Network ALUM Australian Land Use Management APSIM Agricultural Production Systems Simulator ARC Australian Research Council CALP Collaborative Advanced Landscape Planning CAT Catchment Assessment Tool CMA Catchment Management Authority CenITex Centre of IT excellence

CO2 Carbon Dioxide DEM Digital Elevation Model DPI Department of Primary Industries DSE Department of Sustainability and Environment e-RC e-Resource Centre EVC Ecological Vegetation Class GIS Geographical Information Systems ICT Information Communication and Technology LSA Land Suitability Analysis MMV Multimedia Victoria SIEVE Spatial Information Exploration Visualisation Environment SGS Pasture Model Sunstainable Grazing Systems Pasture Model 3D Three Dimensional Visualisation VCCAP Victorian Climate Change Adaptation Program VeRSI Victorian eResearch Strategic Initiative VO Virtual Organisation

v EXECUTIVE SUMMARY

This report provides an overview and evaluation of the first twelve months of the three year Ecoinformatics climate change demonstrator project. The DPI Future Farming Systems Research Division is undertaking this project in collaboration with a number of partner organisations, with significant contribution from the Victorian eResearch Strategic Initiative.

Ecoinformatics is an innovative approach to e-Science which focuses on the concept of online collaboration for managing and sharing environmental data and information products across organisations. The significance of Ecoinformatics is it provides an integrated technology systems approach for supporting multi-disciplinary research in addressing complex problems. The demonstrator project focuses on one such critical problem domain, namely climate change and its impact on the South West Victoria region. The DPI Victorian Climate Change Adaptation Program (VCCAP) constitutes the test bed for formulating and evaluating an array of e-Science tools and protocols. The intention is to make these technologies available for use in the wider research community once the development and testing phase of the project is complete. The e-Science tools which have initially been developed and tested include:

(i) An online one-stop-shop for Climate Change Adaptation research in Victorian, known as the e-Resource Centre (e-RC).

(ii) Geographical Visualisation platforms for modelling existing landscape and farm conditions and future scenarios under a range of climate change forecasts.

Initial feedback obtained from users in training sessions, online statistics, and results of a questionnaire administered at the Futurescapes launch event held in Portland in August 2008, and follow up email questionnaire, have been collated as part of the evaluation of the Ecoinformatics climate change demonstrator project. The results from the evaluation indicate an overwhelming positive response for the e-RC component of the Ecoinformatics platform infrastructure. A number of senior policy advisors in Government have requested access to the e-RC. A number of planners and land managers from municipalities, catchment management authorise and farmers within South West Victoria have also requested access to the e-RC. The challenge now is to address the level of access and support that the e-RC can provide to a growing user base and identify how this online platform for collaboration can be supported beyond the life of the demonstrator.

Initial feedback on the visualisation tools presented internationally, nationally, state-wide and to stakeholders within the South West region has also been predominantly positive. A number of users from policy-makers to land managers have requested access to the three- dimensional (3D) visual products developed for South West Victoria. The challenge for the next phase of the Ecoinformatics project will be to make these tools more accessible to users and to enhance the communication of key climate change adaptation research outcomes to bring about accelerated learning and responses to this critical issue in the context of Victoria. Improving the ‘realism’ of the visualisations, and ensuring that the visualisations are backed by scientific research, were priorities identified from the feedback. These issues will also be addressed in the next phase of the Ecoinformatics project.

The Ecoinformatics demonstrator project shows how cross-organisational and multi- disciplinary research can be better supported through platforms for collaboration. e-Science tools such as the e-RC and visualisation interfaces can bring people and technology together for addressing critical and complex questions. Importantly, the next steps of the project will need to establish real-time connectivity between the partner organisations including: Monash University, Melbourne University, Latrobe University and DPI. This is a critical step for research organisations to share data, information, models and expertise to reduce duplication of effort, retain corporate knowledge and ensure policy and decision makers have access to the best available information when they need it.

In conclusion, some of the key messages and possible benefits for the State of Victoria resulting from the Ecoinformatics climate change demonstrator include:

vi • Better access for agriculture and forestry industries, farmers, extension officers, State and Local Governments and Catchment Management Authorities to data, models, results and analyses. • Integration of ‘hard’ and ‘soft’ knowledge into visual futures to help further understand and plan for a low-carbon economy. • Important vehicle for the communication of significant policies such as the Future Farming Strategy (2008) – Productive, Competitive and Sustainable. • Opportunity for land managers to make more informed decisions on how to adapt to climate change.

vii 1. INTRODUCTION

The purpose of this report is to provide a brief overview of the Ecoinformatics climate change demonstrator project and to evaluate the research and development undertaken for the first twelve months of this three year initiative.

The objectives of the Ecoinformatics project are to:

1. To develop and evaluate the Ecoinformatics platform concept in collaboration with 5 agencies, through a demonstrator based on climate change adaptation research in South West Victoria, under the auspices of VCCAP. 2. To establish a virtual research collaborative workspace (data/modelling/ information) between government and university researchers (initially in climate change adaptation research), providing benefits of reduced overheads (costs) and seamless partner access.

1.1 ECOINFORMATICS VISION

The vision for Ecoinformatics in Victoria is a platform which provides policy and public access to and interrogation of Victorian natural resource data, information and knowledge products through a web-enabled interface. Ecoinformatics datasets include land use, soils, water, biodiversity/ecological, climate (historical and forecasts), cadastral, aquatic and marine. Specifically, the platform will use e-Science technologies to allow shared access and provision of data and models for research development and policy/community applications. This environment will enable collaborating teams to share data and translational tools, providing an enduring legacy of data re-use (efficiency), transparency and value-added products. Wherever possible toolsets available in the open source environment will be identified and integrated into the platform.

The project will create an environment to enhance:

a) Research efficiency, b) Appropriate collaboration, and c) Data/information management, transparency and accessibility.

Figure 1 represents how visualisation will offer enhanced capability to contribute to the effective distribution and communication of scientific knowledge to community, and industry groups and influence the development of public policy. Visualisation is considered an enabling technology for accelerated learning and for communicating complex scientific information to a range of end users including community, industry and policy-makers.

Community Public & Industry Policy Engagement

Visualisation

Scientific Knowledge

Scientists

Figure 1 Visualisation leading to enhanced capability for effective distribution and communication of scientific knowledge (Pettit et al 2006)

1 1.2 THE CLIMATE CHANGE DEMONSTRATOR

In recognition of the magnitude of the task of creating a fully integrated ecoinformatics platform, an initial demonstrator project has been established, which focuses on the theme of climate change. The climate change demonstrator deploys e-Science collaboration tools and technologies to assist in climate change research on the likely land use impact and adaptation scenarios for South West Victoria. The Victorian Government policy drivers for this work are based on the Victorian Greenhouse strategy, the DSE policy initiative “Our Environment, Our Future” (DSE 2005) through the Environmentally Sustainable Action Plan, and DPI’s “Priorities for Action: Greenhouse and Agriculture” (DPI 2005).

The ecoinformatics platform developed will be generic so that it can support additional natural resource management and farming systems Research, Development and Extension (RD & E) theme areas including (i) soil, plant and animal health (ii) biodiversity (iii) water use (iv) community engagement, and (v) monitoring and evaluation reporting.

The Ecoinformatics climate change demonstrator will provide a common platform for the various climate change project team members to contribute and access: computational resources, datasets, climate and biophysical models and scenarios, analytical frameworks and 3D visualisation outputs produced by VCCAP, the Ecoinformatics project team and partners. In particular, it will provide:

1. Access to climate change datasets that are needed where ever and however they are stored. 2. The ability to store results from climate modelling, predictions and data analysis and to make these results available for further processing and visualisation. 3. An extensible platform that can be expanded to include new datasets and access and storage requirements as the project is broadened to accommodate additional Ecoinformatics applications and uses. 4. Uniform access to different but related datasets through recording and accessing information through geo-coded metadata.

Figure 2 outlines the vision for the climate change demonstrator within the context of other informatics platforms. The Ecoinformatics technology stack includes: socio-economic, topographical, biophysical and climatic data which are necessary to derive a number of climate and land use impact risk models. The outputs from these complex climate and risk models are then visualised using technologies such as digital globes (Google Earth) and collaborative virtual environments (Spatial Information Exploration Virtual Environment - SIEVE) Stock et al. (2008). All data, models and visualisation outputs are accessible and can be shared via a collaboration platform where different levels of access and authorisation are given to a broad range of end users.

2 Information Publications & Interactive 3D visualisation Research Risk management Portal/ video/ decision support scenarios footprint Channels broadcasting

Climate Change Demonstrator

BIOLOGICAL WATER CLIMATE SOIL OTHER INFORMATICS INFORMATICS INFORMATICS INFORMATICS

Collaboration

Visualisation

Risk models

Climate models

Climate data

Expertise + Technology

Figure 2 Vision for the Climate Change Demonstrator

1.3 PARTNER ORGANISATIONS

There are a number of partner organisations involved in the Ecoinformatics climate change demonstrator project. These are:

• Department of Primary Industries • Department of Sustainability and Environment • Victorian eResearch Strategic Initiative (VeRSI) • Climate Research Centre, Monash University • Monash eResearch Centre, Monash University • Department of Geomatics, University of Melbourne • Climate Adaptation Science Policy Initiative, University of Melbourne • Environmental Management and Ecology, La Trobe University

1.4 THE e-RESOURCE CENTRE

A key component of the Ecoinformatics climate change demonstrator project is the development of a virtual collaborative workspace (e-Resource Centre) dedicated to climate change adaptation research for government and university researchers. The virtual collaborative workspace offers the benefits of reduced cost and administrative overheads and seamless partner access. The objectives for this component of the project are to:

• Develop a prototype e-Resource Centre (e-RC) and populate with VCCAP and VeRSI documents, reports and data products as a proof of concept, • Provide training for VCCAP and partner users, and • Maintain and upgrade the e-RC as required.

3 1.5 3D VISUALISATION

The second component of the Ecoinformatics climate change demonstrator project focuses on the development and application of visualisation technology as a window to climate change adaptation scenarios. Visualisation products are being developed to enhance the communication of biophysical and social research outcomes from the VCCAP and VeRSI projects and encourage greater involvement in strategy development for climate change. The objectives for this component of the project are to:

• Develop proof of concept visualisation products for the pilot region (South West Victoria). • Work with modellers across DPI, Melbourne University and Monash University to visualise climate change and biophysical modelling output. • Showcase visualisation products developed by DPI and Melbourne University and obtain feedback on how to refine products to best communicate climate change adaptation research findings.

4 2. PROJECT ACTIVITIES

Key activities undertaken in the Ecoinformatics project to date include:

• Development and implementation of the e-RC for use by the VCCAP and VeRSI partner project teams as a proof of concept. • Development of a range of visualisation tools and capacity within both DPI and University of Melbourne. • Demonstration of visualisation products developed using DPI, Monash University and Melbourne University model outputs. • Development and population of an Object Library to support visualisation activities. • Launch of the Climate Change Demonstrator in Portland. • Presentations, workshops and training (statewide, national and international).

For a full list of project activities, refer to Appendix 1.

The Futurescapes Launch

The Ecoinformatics climate change demonstrator was launched in Portland on the 27th of August, 2008 under the banner of Futurescapes. The launch was officially opened with a presentation by Dr Bruce Kefford, the Deputy Secretary of Agriculture and Fisheries. Approximately 52 people attended the launch. In the afternoon, a technical session was held to provide participants with greater detail about the science underpinning the climate change demonstrator. Refer to Appendix 2 for the launch agenda and Appendix 3 for the technical session agenda. The technical session was an opportunity for the project team to solicit feedback from participants to understand their perceptions and level of knowledge regarding the 3D technologies being developed. Refer to Appendix 3 for the technical session agenda and Appendix 4 for the evaluation survey.

Overview of e-Resource Centre Activities

An online project space for the DPI VCCAP and VeRSI project teams was develop on the ProjectForum wiki (http://www.projectforum.com/pf/wiki.html) in July 2007 to support collaborative research and project governance as was initially known as the Virtual Resource Centre (version 1). The security and functionality of the ProjectForum technology solution was found to be insufficient to the support the project team’s requirements. Consequently a dedicated Virtual Organisation1 (VO) was built on the Atlassian confluence wiki platform (http://www.atlassian.com/software/confluence/) by experts working within the Victorian eResearch Strategic Initiative (VeRSI) - VRC version 2. After initial training and subsequent feedback from end users substantial changes were made to the VRC platform including a name change to e-Resource Centre (e-RC). The e-RC was released to end users in September 2008.

Organisations that are utilising the e-RC include Monash University, the University of Melbourne, La Trobe University, DPI and DSE. The e-RC supports the VCCAP project team members and partners have been extended to include DPI Climate Change Policy team, who are end users of climate change adaptation research. The e-RC has been populated with over 1000 documents, reports and data products and there are over 60 users subscribed to the online collaborative workspace. Work is on-going in training and supporting the end user group and refining the functionality and look and feel of this cross-organisation e-Science workspace.

Overview of Visualisation Activities

A range of visualisation tools have been developed, as well as a number of demonstration visualisation products, including downscaling of climate change models and changes in

1 A Virtual Organisation (VO) is a group of people and/or organisations who share resources and skills to achieve a common goal (Pettit & Russel, 2008).

5 agricultural productivity. Suitability and productivity modelling outputs from the DPI VCCAP modelling theme have been visualised using a number of interfaces including Google Earth, the Collaborative Advanced Landscape Planning (CALP) Scenario Viewer from University of British Columbia and the SIEVE computer game engine from University of Melbourne. A 3D object library is also being developed representing fauna, flora, buildings and other farm objects within the South West Victoria. All visualisation products are available on the e-RC for the DPI VCCAP project team and partners to access and use.

Data and model outputs that have been linked to visualisation products so far include:

• Climate change daily projections for key climatic variables - temperature, rainfall, solar radiation, carbon dioxide concentrations (CO2) - at Hamilton (centre on Weather Station). • Soils information and attributes (e.g. pH, depth to bedrock; organic matter; water holding capacity; drainage). • Existing land use classified according to Australian Land Use and Management (ALUM) Classification. • Topography (Digital Elevation Model – DEM). • Hydrology / Rivers system (network). • Native vegetation (Ecological Vegetation Classes – EVCs), modelled for 1750 and current status. • Wind and water erosion. • Land Suitability Analysis (LSA) models for Pastures (Ryegrass/sub-clover; Phalaris; Lucerne); Grains (wheat, oats and barley); forestry (Blue gum and Radiata Pine) developed and applied at the strategic regional level. • Uncertainty Analysis estimates for LSA. • Hydrological modelling using CAT.

• APSIM for grain crops, with and without enhanced CO2 levels, developed and applied at Hamilton. • SGS Model for pastures (Ryegrass/Sub-clover and Phalaris) with and without enhanced CO2 levels, developed and applied at Hamilton.

6 3. KEY EVALUATION QUESTIONS

The evaluation is structured in two sections: the e-RC, and 3D Visualisation. Within each section, a number of key evaluation questions are addressed. The key evaluation questions were designed to assess progress made towards achieving the Ecoinformatics climate change demonstrator project objectives. Data for the evaluation was collected through the following methods:

• Survey of attendees at the Climate Change Demonstrator launch and technical session. • Feedback collected during e-RC training and supporting activities. • e-RC user statistics.

3.1 THREE DIMENSIONAL VISUALISATION

An email survey of attendees at the Ecoinformatics climate change demonstrator Launch in August was undertaken post event, and a survey of participants at the technical session was undertaken on the day. The results from both surveys were used to address the key evaluation questions for 3D visualisation. A diverse audience was included in the evaluation through the combination of the two surveys. Attendees at the launch were mostly high level leaders and decision makers, whereas attendees at the technical session were more of a mix of natural resource management practitioners, CMA officers, and planners.

Launch Survey

An email communication was sent to all launch attendees requesting that they participate in a short online survey with five questions (Appendix 4). Attendees at the launch included high level managers of state and regionally based organisations including CMA’s, local government and private corporations, policy advisors, planners, DPI and DSE. Of the 75 people sent the email via the online survey, 48 people started the survey with 26 of these completing all questions.

Technical Session Survey

23 respondents completed the technical session survey (refer to Appendix 5), which was approximately 51% of participants. Attendees at the technical session comprised planners, CMA officers and researchers (Figure ). The participants comprised a combination of project stakeholders and potential end users of the 3D visualisation technology.

6 Number

0 Planners - Managers CMA Officers Research Private Sector GIS Operator Local and NR Managers Regional Employment Type

Figure 3 Employment type for Demonstrator Launch technical session survey participants

In order to gauge participants experience with traditional mapping visualisation technologies, respondents were asked how often they currently use traditional two dimensional maps to help their decision making. 64% of participants responded that they routinely use maps for decision making, 13% responded they use maps whenever they are available, and 23% said they use maps occasionally. These results indicate that the majority of the participants routinely refer to traditional two dimensional maps to help with decision making, which gives them the appropriate background to be able to compare the 3D visualisation technologies presented at the technical session to their experiences with traditional 2D map outputs.

Key Evaluation Question: Is the visualisation technology perceived by key stakeholders and potential users as a valuable tool for communicating climate change research?

A number of suitability and productivity modelling outputs from the DPI VCCAP modelling theme were presented at the launch. They were visualised using a number of interfaces including Google Earth, 360 panoramas created in 3D Studio Max software and the SIEVE computer game engine from University of Melbourne.

Figure 4 Example of virtual farm images developed for the Futurescapes launch

Technical session survey participants were asked a number of questions to identify their perceptions of the value of the visualisation technology for communicating climate change research. Respondents were asked if they thought the 3D visualisation technology:

• Made the climate change data and models easier to understand than when the results were presented as traditional 2D maps and graphs, • Impacted on the credibility of the research, and • How they would like to see climate change research presented in the future.

The survey results for the three questions are presented in Figure . The results indicate that the majority of respondents perceived the visualisation technology to be a valuable tool for communicating climate change research, but would prefer the research to be presented as a combination of traditional maps, graphs and 3D visualisation technology to aid in the understanding of climate change research.

Not Sure 32% Yes 45%

No 23%

Figure 5 Does 3D visualisation technology make climate change research easier to understand?

8 No Response More Credible 14% 50%

No Effect 27%

Less Credible 9%

Figure 6 How does the visualisation technology impact the credibility of the research?

5% 0% 5%

Combination of Traditional Maps and 3D Visualisation Traditional maps only

3D visualisation only

No Res pons e

90%

Figure 7 How would you like research results presented in the future?

These findings are supported by comments made by respondents of the technical session survey and the launch online survey, which include:

“High quality, realistic 3D images will greatly enhance the opportunity to understand traditional maps and graphs.” “The potential to link in with Dairy Australia and Corangamite Catchment Management Authority soil health data is significant.” “Yes, 3D gives a different perspective that certainly aids communication if done well.” “This sort of technology would be valuable for communicating more than just climate change. I can see how it could be used in instances such as emergency events where emergency services might be able to ‘walk’ around the area in a virtual world before going in on foot.” “Yes, we need to be able to provide as much info as possible. There’s still far too much confusion in the community as to what we’re actually facing with climate change.”

Feedback was also received regarding issues that need to be addressed in order to increase the perceived value of the 3D visualisation technology. This feedback will be addressed in future development activities. Feedback included:

“The 3D models look ‘too rough’ and will be difficult for the pragmatic user to adjust to. The more realistic the better, particularly when dealing with climate change issues that are hotly debated and often dismissed for all of the wrong reasons.” “This is not a realistic scenario and cannot be taken seriously. Large jumps in change underestimate or communicate real effort and risk involved in this investment. It is more likely to score people off or convey an impression that this program is out of touch with farmers.”

9 “Needs to be utterly seamless – less clunky.” “Visualisation does not mean validity – visualisations must reflect reality in order to be relevant. Comprehension and spatial awareness is important but confidence in underlying assumptions is vital to engender trust in predictions.”

Key Evaluation Question: Is the 3D visualisation technology useful for communicating climate change research to a range of different audiences?

The launch online survey participants were asked what type of audience would benefit most from visualisation of climate change impacts, and why. Survey responses indicate that visualisation is thought to be useful for a wide range of audiences, including:

• general public, • farmers, • community groups, • bank advisors, • councillors, • CMA staff, • staff in local government, • farm business advisors, • public presentations, • decision makers, • scientific community, • industry, and • planners, • government bureaucrats (including local government). • policy (government and regional),

Specific comments included:

“With a capacity to be more interactive at the demonstration this would be good for both farmer groups and related people – farm business advisors, CMA field staff, bank advisors, etc.” “All users respond best to visual information. Will ultimately provide users with more visual information concerning sites of interest than can presently be seen from site inspection.” “I don’t think this benefits any single audience. It would be useful for all levels.”

The technical session survey participants were asked a series of questions related to their perceptions of the usefulness of the SIEVE 3D technology for a range of different activities and about the usefulness of specific features and characteristics of the SIEVE gaming engine that were presented.

The results illustrated in Figure 8 indicate that the majority of respondents thought the SIEVE gaming engine would be useful for assisting science based policy and planning, communicating climate change research to farmer groups and getting farmer participation in discussions about climate change adaptation. Other groups identified by respondents as potentially benefiting from this technology included: emergency response, community groups, industry, and the general public.

“Would have been more useful to see how taking a particular step actually affects the outcome.” “Need to test this with a wide range of farmers – also take into consideration computer technology capacity and farmer capability in rural locations.”

10 60

50 Assisting science based policy and planning

40 Communicating climate change research to farmer groups 30 Getting farmer participation in discussions about Number % climate change adaptation 20 Other groups

0 Very Useful Not Useful Undecided Very Un- No useful useful Response Response

Figure 8 How useful is 3D visualisation technology for a range of different activities?

Whilst the majority of respondents thought the SIEVE gaming engine technology would be useful for a range of communication and collaboration activities, there was a varied response to the questions on the usefulness of specific features of the SIEVE, such as the Virtual Farm and Virtual Meeting functionality presented at the technical session. Figure 9 shows that over 30% of respondents thought that the virtual farm functionality was not useful for communicating climate change scenarios, whilst only 27% thought it would be useful and 18% thought it would be very useful. 23% of respondents were undecided. Additional comments in this section of the survey indicate that some survey participants found the virtual farm functionality to be a ‘fanciful scenario” and “unrealistic”, impacting the perceived usefulness of the technology. Potentially if more realistic scenarios are presented in future, perceptions of the usefulness of these aspects of the technology might change.

30 SIEVE Virtual farm functionality 25

20 SIEVE Virtual

Number % Number meeting 15 functionality

0 Very useful Useful Not Useful Undecided Very Un- No useful Response Response

Figure 9 How useful are the SIEVE virtual farm environment and virtual meeting for communicating climate change scenarios?

Figure 10 illustrates a mixed response for the survey question relating to the usefulness of chat window, realism, symbology and the overall virtual reality experience. Additional comments indicate that the quality of the graphics was an issue for some participants, impacting on the perceived usefulness of the technology.

“Quality of graphics too comical to be taken seriously. Program was too difficult for expert to operate with ease… a less experienced or less skilled person will not be able to use it.”

11 70

40 The Chat Window 30 Realism Number % Virtual Environment 20 Symbols

0 Very useful Useful Not Useful Undecided Very Un- No useful Response Response

Figure 10 Perceived usefulness of different features of the SIEVE virtual environment

Key Evaluation Question: Do potential users think that they will be able to use the technology themselves or do they see it as an ‘expert user’ tool?

The technical session survey results as illustrated in Figure 11 indicate that 67% of users would like to use the SIEVE gaming technology themselves, with 23% preferring to have a regional expert facilitate their use, and 5% wanting to have some one else use it and report back.

Have someone else Not use it No response use it and report Use the technology 0% 5% back myself 5% 67%

Have regional experts facilitate my use 23%

Figure 11 Potential users preference for how the SIEVE is made available for use

Figure 12 illustrates that 80% of respondents felt moderately to very confident of their ability to use the technology themselves. However, as illustrated in Figure 13 there is the perceived learning curve is quite considerable. 77% of respondents rated the level of training and support required to operate the technology as moderate (54%) to high (23%). This is not necessarily a surprising outcome as a lot of software applications are perceived as difficult to learn.

Cant see myself using it Not Confident 9% Very Confident 9% 32%

Moderately Confident 50%

Figure 12 How confident are potential users of the SIEVE in using the technology themselves?

High Minimal 23% 23%

Moderate 54%

Figure 13 Perceived level of SIEVE user training and support required

Figure 14 illustrates that mixed results were received for the question relating to useability of different aspects of the SIEVE, with quite a high proportion of respondents remaining undecided about how useable selected features were. Additional comments received for this section of the survey indicated that potentially the participants needed more time to familiarise themselves with the new technology before they could make an informed decision about the useability of particular features of the SIEVE gaming engine.

“Too early to provide useful answers.” “Hard to assess without a longer demo.”

25 The Chat Window 20 Realism Number % Number Virtual Environment 15 Symbols 10

0 Very Easy Easy to Use Undecided Challenging Very No to Use to Use Challenging Response Response

Figure 14 Perceived useability of different features of the SIEVE virtual environment

3.2 THE e-RESOURCE CENTRE

Key Evaluation Question: Has an e-Resource Centre been developed and operationalised for the DPI VCCAP research team?

What Has Been Developed

A prototype e-RC has been developed for the DPI VCCAP project to demonstrate the application of this technology to assist climate change research. The first version of the e- RC, called the Virtual Resource Centre (VRC), came on line in July 2007. Since Version 1 was released; significant effort has been spent in developing the look and feel, extending the functionality of the e-RC, as well as engagement, training and support of the VCCAP research user group.

Four workspaces have been developed related to the Ecoinformatics climate change demonstrator project. These are:

13 1. DPI VCCAP workspace 2. VeRSI Technical Advisory Committee (TAC) workspace 3. VeRSI Steering Group (SG) workspace 4. Futurescapes Launch workspace

Interface Design

Feedback was received from a number of users of the DPI VCCAP workspace in March 2008 after the first round of training was undertaken. Initial feedback indicated that the e-RC was difficult to navigate and time consuming to use. Subsequently, further development of the e- RC was targeted at improving the look and feel of the site to enable the user to easily access, navigate and edit the workspaces. Figure 15 and 16 show the change of the e-RC web interface between February and August 2008 respectively. Figure show the change of the web interface for the DPI VCCAP workspace during that same time period.

Figure 15 The e-Resource Centre (previously known as the VRC), February 2008

Figure 16 The e-Resource Centre revised format, August 2008

Figure 17 The Victorian Climate Change Adaptation Program workspace, February 2008

Figure 18 The Victorian Climate Change Adaptation Program workspace revised format, August 2008

Functionality

Functionality that has been developed and is currently available on the e-RC in the DPI VCCAP workspace includes:

• Navigation directory system • Virtual library for all relevant climate change literature • Interactive event calendar listing upcoming seminars, presentations, workshops and project meetings • Team notice board for posting new information and alerts (currently under development) • Customisable team work spaces to store working documents, datasets, modelling outputs, maps, audio / video content and presentations • Project management repository for storing draft, interim and final reports • Google maps - to interactively view and share maps developed by the VCCAP team • Online Chat (text only) • Auto updating list of what’s new on the workspace • Tag cloud search facility • Key word search • Secure and protected access to the e-RC is provided using advanced security and encryption technologies.

16 Key Evaluation Question: Is the e-RC being used by the DPI VCCAP research team to store and share project information?

User Statistics

The e-RC currently has 66 registered users, an increase from 54 registered users in February 2008. The main user groups are the Ecoinformatics Steering Group, Technical Advisory Committee and the DPI VCAAP team. Other users include VeRSI system developers, administrative support and DPI Policy. The DPI VCCAP team make up 41% of registered users.

Other 12%

SG DPI VCCAP 14% 41%

TAC 33%

Figure 19 Current e-RC user groups (SG - Steering Group, TAC – Technical Advisory Committee)

Information Stored on the e-RC

Over 3 gigabytes of DPI VCCAP information is now stored on the e-RC, with the number of files increasing significantly since February, from 313 files to over 1000 individual files. Files stored on the e-RC comprise of:

• Approximately 350 maps, images and data files • Approximately 250 model files (scripts and code) • Approximately 400 Microsoft Word and Adobe PDF documents

500

400

300

200 Number 100

0 Maps, images and Model files Word and PDF data documents

Type

Figure 20 Files stored on the e-RC

Key Evaluation Question: Is the e-RC perceived by potential users as a valuable project resource that enhances collaboration and communication between research team members?

An evaluation survey was undertaken of participants at the Futurescapes Technical session in Portland to get an indication of the perceived value of the e-RC in relation to climate change research. Participants were asked to fill in a questionnaire regarding their perceptions of the e-RC based on presentations made by A.B.M Russel (VeRSI) and Joanne McNeill (DPI). Participants were asked if they thought the e-RC would:

17 • Lead to more effective collaboration within research projects, • Be a potentially useful extension tool, • Be a useful platform for sharing climate change research, and • Be useful to develop further.

The majority of participants responded positively to all four questions, refer to Figures 21,22,23 and 24 respectively for a graphical representation of the survey results for each of the four questions. The survey results indicate that the e-RC was generally perceived to be a valuable project resource that does enhance the potential for collaboration and communication between research team members, researchers and members of the public.

Another indicator of the perceived value of the e-RC by potential users was the level of interest by the technical session participants in having access to the e-RC. A number of participants enquired about being given access to the e-RC and expressed their approval of the e-RC concept as a tool for sharing climate change information between groups.

Written feedback from participants at the Technical Session regarding the e-RC included comments such as:

“This is a great concept and complementary to the Corangamite CMA knowledge base through the Wimmera, Glenelg and Corangamite (WGC) Sustainability Research Network. Access by myself and some key CCMA staff will greatly enhance the management/capacity to mange the impacts of climate change.” “This is obviously the direction the technology is taking us. We need to have a conversation about access.” “Very interested in gaining access for Glenelg Shire.” “We (Warrnambool City Council) would be interested in discussions about future access for local government - with all tools demonstrated.”

No response 5% Not sure 27%

No 0% Yes 68%

Figure 21 Will the e-RC lead to more effective collaboration within research projects?

No response Not sure 5% 5% No 0%

Yes 90%

Figure 22 Is the e-RC potentially a useful extension tool?

18 No response Not sure 0% 14%

No 0%

Yes 86%

Figure 23 Is the e-RC a useful platform for sharing climate change research?

No response Not sure 5% 5%

No 0%

Yes 90%

Figure 24 Would it be useful to develop this technology further?

19 4. CLIMATE CHANGE DEMONSTRATOR COMMUNICATION ACTIVITIES REPORT

As part of the Ecoinformatics climate change demonstrator project a number of communication activities have been undertaken to raise the awareness of the project and to obtain initial feedback. Preliminary research outputs from the Ecoinformatics climate change demonstrator project has been presented at a number of workshops and conferences, Statewide, nationally and internationally as outlined in Section 2, under the list of project activities for 2007/2008.

This section includes additional communication information associated with the Futurescapes launch event held in Portland in August 2008, provided by Lisa Borthwick, Senior Communication Advisor for Divisional Communication.

4.1 PURPOSE

To assess the success of the media and communications activities undertaken for the Futurescapes launch.

4.2 PROMOTION

A media plan was developed for the launch and a number of potential media opportunities were identified.

Planned Media The Result

The media release was offered to science Offer the story to The Age in advance of journalist Chee Chee Leung from the Age but she launch date (publication to coincide with declined to write the story as she was already launch – the same day – either environment or covering a DPI story regarding gold discovery that science reporters) involved the Minerals and Petroleum Division Local south-west papers – The two major south- Local south west papers west papers turned up to the launch and ran positive stories about the launch of Futurescapes Win TV – Despite the journalist not following our brief the story still was quite favourable and contained some good messages. The take away Television: Catalyst (ABC) & WIN TV news learning from this exercise is that our messages (regional Victoria) & Landline (ABC) need to be put in the most simplest language to limit the margin for misinterpretation by the media

Science media list Media release distributed to list

Media release to VeRSI network contacts at Melbourne, Monash and La Trobe Universities Media release distributed to VeRSI partners for website and publications Written and published on Monday 15 September DPI News article edition of DPI news

Total Media Achieved

• Win9 News (TV) – Win News Ballarat 21/8/2008 (31,085 viewers), Win News Bendigo 27/8/2008 (24,408 viewers), Win News Albury 27/8/2008 (15,780 viewers) • Portland Observer (circ. 3726) – 29/8/2008 page 28 • Warrnambool Standard (circ. 13,124) – 28/08/2008 page 6

Tool/Channel Frequency Key Messages Audience Positive/negative

Demographics Overall the broadcast was ABs: 5550 21/8/2008 positive and GBs: 17454 Win9 News (TV) – included some 6:33pm - 1 min 35 Male 16+: 15282 Win News Ballarat good general key seconds Some but not all, Female 16+: 15803 messages. including: All People 16+: However the story 31085 Launch of a cutting was not edge 3D pilot Demographics representative of technology to the information ABs: 1791 27/8/2008 highlight the provided and was Win News Bendigo impacts of climate GBs: 13850 manipulated into a (24,408 viewers) 6:34pm - 1 min 35 change Male 16+: 13274 climate change seconds Female 16+: 11134 Victorian winner and loser’s All People 16+: story rather than a government funded 24408 initiative launch. Technology brings Despite this the overall coverage south west Demographics research together and the wide reach ABs: 540 of some of the 27/8/2008 Win News Albury Early adaptation to GBs: 9640 messaging was a 27/8/2008 (15,780 6:39pm - 1 min 35 climate change is Male 16+: 8155 positive for both viewers) seconds the key Female 16+: 7625 the project and DPI All People 16+: as a research 15780 agency in the climate change space. All- Chris P 28/08/2008 page provided an Significant south- Very positive, Warrnambool 6, editorial and interview to west Victorian balanced article Standard picture of Chris attending readership and good key Pettit journalist at the (circ. 13,124) messages launch

29/8/2008 page Reasonable south- Very positive, All - Article ran 28, editorial and west Victorian balanced article Portland Observer word for word from picture of Chris coastal readership and good key the release Pettit (circ. 3726) messages

Total exposure to campaign key messages: 88,123 people* *Based on coverage and circulation figures provided by Media Monitors

4.3 CONCLUSION

Overall the Futurescapes launch media campaign was successful in profiling both the technology and the launch with audiences in the South West of Victoria.

21 5. SUMMARY AND CONCLUSIONS

Overall, the first stage in developing the Ecoinformatics climate change demonstrator project has been considered a success based on the results of the evaluation, which included feedback solicited from participants who attended the Futurescapes launch in August 2008, and e-RC end user statistics. Key messages derived from the evaluation which will be used to inform future work on the project are:

1. The e-Resource Centre is considered by current and potential users to be a valuable project resource that enhances collaboration and communication. There is significant interest from various organisations regarding gaining access to the e-RC in future. 2. Visualisation technology is predominantly considered a valuable tool for communicating climate change research in combination with traditional maps and graphs. However, the 3D models and visualisation scenarios require refinement and need to be more closely aligned to scientific research outcomes. 3. Visualisation technology is considered useful for assisting science based policy, planning and communicating climate change research to a wide range of audiences. This includes the participation of farmers and community groups in climate change adaptation discussions. However, further refinement of the technology is required for potential users to feel comfortable with the idea of using the technology for specific applications. 4. Visualisation technology is perceived to have the potential of being applied to a number of different use cases and issues including emergency response and forestry. 5. Potential users of visualisation technology would prefer to use the technology themselves, providing there was adequate support and training. 6. e-Science offers a suite of collaboration tools which can better connect researchers across organisations and ultimately support better policy and decision making.

In the first twelve months of the Ecoinformatics climate change demonstrator emphasis has been placed on developing a platform for collaboration, known as the e-RC, which comprises both a technology and people element. The e-RC has been developed as an online resource to support collaboration within VCCAP as well as with partner research organisation including: University of Melbourne, Monash University, Latrobe University and DSE. The e-RC has been developed using the Confluence open source platform with support from the VeRSI project team. The e-RC is an evolving technology platform which provides secure and protected access to a range of users wishing to share data, information, models and visualisation outputs initially focused on climate change adaptation research being undertaken in South West Victoria as led by VCCAP.

Visualisation is considered an extremely important e-Science tool for enhancing the communication of complex climate change data and models. In the first twelve months of the Ecoinformatics climate change demonstrator project a number of proof of concept visualisation interfaces have been developed and tested. Such visualisation interfaces developed to date include: Digital Globes (Google Earth), interactive spatial viewers (CALP scenario viewer), Panoramas (3D Studio Max) and Collaborative Virtual Environments (SIEVE game engine), which provide a window to complex climate and biophysical models. Initial feedback on these visualisation interfaces is quite promising with a broad range of end users keen to utilise such technology to better understand climate change adaptation scenarios.

The development and evaluation of both the e-RC and visualisation components to date has been driven by the underlying research question: What are the climate change adaptation and mitigation options for South West Victoria looking to 2050? In order to address such a question, the cooperation of research organisations across both Government and University sectors is critical. In order for successful collaboration across organisations and science disciplines both technology and people issues will need to be addressed. An e-Science platform which better supports research across the research continuum from strategic to applied research and which also provides policy and decision makers better access to the latest research outcomes will enable society to better respond to complex Ecoinformatics related issues such as climate change.

22 6. NEXT STEPS

Reflecting on the feedback from users and participants in the Ecoinformatics climate change demonstrator project to date, there are a number of issues and next steps which the project needs to focus on including:

Address the issue ICT connectivity limitations. Currently there is no high bandwidth network connectivity between Government and Universities. Multimedia Victoria (MMV) has made available seed funding to assist DPI with establishing connectivity to the AARNET to support the Ecoinformatics climate change demonstrator project. At this stage a solution for high bandwidth connectivity that links government and university researchers has yet to be developed and implemented. An important next step for the project is for the Knowledge and Information and Technology Branch within DPI to manage the development and implementation of a connectivity solution to support the Ecoinformatics climate change demonstrator project. This will need to be negotiated and worked through with CenITex, MMV, DPI, VeRSI and participating partners including Monash University, University of Melbourne and La Trobe University.

Implementation of the next phase of e-RC training for VCCAP end users. This will involve regional visits by the e-RC project team to assist end users in loading and accessing e-RC data, information, models and visualisation outputs. Further consultation with additional users from within the South West Victoria region will also be an important next step.

The formulation of a maintenance and migration plan for the e-RC platform to move beyond the VeRSI phase II infrastructure is a critical next step for supporting on-going climate change adaptation research being undertaken by VCCAP.

Development of a suite of visualisation products for an existing farm within South West Victoria. In the first year a fictitious future farm was modelled in 3D to demonstrate the visualisation capability. In the ensuing 12-24 months an existing dairy farm will be visualised using a range of technologies including: digital globes, panoramas, fly-through movies and interactive gaming engines. Scientific evaluation of these visualisation tools and outputs will be undertaken to determine which tools are best suited for communicating to a specific audience. This will be an important outcome as the target audience will include policy developers, planners, decision makers, land managers, extension staff and farmers

23 7. REFERENCES

Department of Primary Industries (2008) Future Farming - Productive, Competitive and Sustainable. The State of Victoria, Melbourne.

Stock, C., Bishop, I.D., O'Connor, A. Chen, T. C., Pettit, C.J. and Aurambout, J-P. (2008) SIEVE: collaborative decision-making in an immersive online environment, Cartography and Geographic Information Science 35:133-144.

Pettit, C.J. and Russel A.B.M. (2008) A Spatial Decision Support System Framework For Climate Change Adaptation In Victoria. In proceedings of XXI Congress of the International Society for Photogrammetry and Remote Sensing (ISPRS), Beijing, China, 3-11 July.

Pettit, C., Cartwright, W. and Berry, M. (2006) Geographical Visualisation a Participatory Planning Support Tool for Imagining Landscape Futures, Applied GIS, 2(3): 22.1-22.17.

Department of Primary Industries (2005) Priorities for action: greenhouse and agriculture 2005-2008. The State of Victoria, Melbourne.

Department of Sustainability and Environment (2005) Our Environment, Our Future: Victoria’s Environmental Sustainability Framework. The State of Victoria, Melbourne, Victoria.

CSIRO (2001) Understanding climate change: Victorian greenhouse strategy. Department of Natural Resources and Environment, East Melbourne.

24 APPENDICES

Description Attachment Appendix 1 List of Ecoinformatics project activities for 2007-2008 Project Activities 2007-2008.doc

Appendix 2 Futurescapes Launch Agenda Futurescapes Launch Agenda.pdf

Appendix 3 Futurescapes Technical Session Agenda Futurescapes Tech Session Agenda.pdf

Appendix 4 Futurescapes Launch Online Survey Futurescapes Launch online survey.doc

Appendix 5 Futurescapes Technical Session Evaluation Survey Tech Session Survey final.doc

Appendix 6 Mediaportal Report 28/08/2008 including Futurescapes article published in the Warrnambool Standard on Mediaportal Report.pdf 28/08/2008 Appendix 7 WIN TV (Ballarat) - Future of farming – 21/08/2008 WIN Ballarat.wmv

Appendix 8 Futurescapes article - Portland Observer 29/08/2008 Portland Observer.pdf

Appendix 9 DPI News Article September 15th 2008 DPI news.doc

Appendix 10 Futurescapes Fact Sheet Demonstrator Fact Sheet.doc

Appendix 11 DPI VCCAP Visualisation Fact Sheet VCCAP fact sheet.pdf

25 Description Attachment Appendix 12 DPI VCCAP e-Resource Centre Fact Sheet eRC fact sheet.pdf

Appendix 13 International Society for Photogrammetry and Remote Sensing (ISPRS) Conference Paper – “A Spatial Decision Pettit&Russel.pdf Support System Framework for Climate Change Adaptation in Victoria” Appendix 14 DPI Media Release 20/08/2008 Futurescapes Media Release.doc