Field-level insights from developing and deploying AI-driven system for disaster early warning in -Leste.

Natural Disaster, Threats, and Readiness in Timor-Leste

On the 4th of April, 2021, SEROJA formed over the (eastern , bordering Timor-Leste), and after passing, the Government of Timor-Leste (GoTL) reported 48 fatalities and 15,876 displaced persons in the capital city () alone1. Despite availability of limited data, the impact was presumably widespread, including the loss of lives and properties in other areas of the Country2. This is not an isolated event in Timor-Leste. According to ReliefWeb3, Timor-Leste is located

1 Relief Web. 2021. https://reliefweb.int/report/timor-leste/timor-leste-floods-situation-report-no-10-18-june-2021 2 UN-News. 2021. UN steps up response, as thousands impacted by Timor-Leste floods. Available at: https://news.un.org/en/story/2021/04/1089012 3 Reliefweb, 2019. Timor-Leste: Disaster Management Reference Handbook (October 2019). https://reliefweb.int/report/timor- leste/timor-leste-disaster-management-reference-handbook-october-2019

MERCY CORPS AI for Early Warning on Natural Disasters 1 near one of the most active tectonic plate boundaries in the world, therefore, the high seismic activity and exposure to frequent earthquakes causes significant damage, including triggering landslides with devastating impact on citizen’s lives, livestock, roads, infrastructure, and property. In March 2018, the UN mission reported that the country had experienced 793 disaster events between 2002 and 2013. While the disasters are relatively small scale and have resulted in few deaths, close to 20% of the entire population of Timor-Leste has been affected (221,730 people).

Although Timor-Leste has a medium exposure to hazards, it is the seventh most disaster-prone country in the world due to poor coping and adaptive strategies. The country is prone to severe and recurrent windstorms, drought, flooding, tropical cyclones, earthquakes, and tsunamis. Timor-Leste currently lacks the institutional and technological capacities to prepare for natural disaster risks or mitigate impact of disaster events. Multiple severe, isolated windstorms have occurred Figure 1: Map of Timor-Leste each year for the last three years destroying homes and entire crops of maize. Drought can be a problem during the dry season, exacerbating the country’s food security problem, as 36% of Timor-Leste’s population still faces moderate to severe chronic food insecurity and 85% of women and children still consume inadequately diversified diets. Windstorms and droughts also increase the probability of large fires, especially as farmers commonly use slash-and-burn methods. Floods have resulted in decreased agricultural production, damage to infrastructure, and, particularly in heavily flood-affected locations, displacement of communities and loss of property and livelihoods. The country experiences cyclical effects of the El Niño/Southern Oscillation (ENSO)-related weather anomalies and there is now substantial evidence to indicate that the changes in weather conditions associated with climate change will increase the likelihood and intensity of recurrent natural disasters throughout the country.

There is currently no functional national-level end-to-end early warning system to help communities prepare for and respond to these frequent disasters. The collection of hydro-meteorological data is uncoordinated and sharing of data across government ministries for use in early warning system (EWS) is still a challenge. Although weather (forecast) information is available at the national level from neighboring countries and a regional hydro-meteorology service provider, it is rarely linked with preparation and response mechanisms from the national to the community level.

Early warning system (EWS) and Mercy Corps’ Role

A national-level early warning system is in the very early stages of development in Timor-Leste. Mercy Corps Country Team in Timor-Leste assisted GoTL, UNDP, and a private service provider, Similie, to

MERCY CORPS AI for Early Warning on Natural Disasters 2 develop a standard operating procedure (SOP) and thresholds for various disaster risks which can enable the triggering of disaster alerts in Timor-Leste. The goal is to establish thresholds for communicating early actions and protocols to community disaster management officials. However, hydro- meteorological data is both spatially and temporally sporadic and it is plagued with substantial data quality issues. While efforts are underway to install additional hardware for data collection in the country, these are insufficient to fill the data gaps that is required to guide the establishment of effective thresholds. As an alternative solution, it is common practice for countries to use global models and datasets to provide alerts based on forecasted weather events. These valuable sources of data are often limited by coarseness of their resolution (or minimum size of unit land-area covered) and the lack of ground-truth data, especially in geographically small countries with highly mountainous topography and significant spatial variability of weather which are often not represented in the models.

In January 2020, Mercy Corp Team envisioned and initiated a collaborative pilot project with Similie to strengthen the development of an early warning system for Timor-Leste. The goal of the project is to deploy and test state-of-the-art artificial intelligence (AI) algorithm to improve thresholds for alerts that can support Timor-Leste communities to prepare for and respond to the impacts of natural disasters. Leveraging the existing warning system, the project team envisioned a co-installation of hardware sensors to generate additional data flow that can support the selection of optimal parameters and threshold settings for early warning system alerts. The AI-based system (and technology) is expected to disrupt and empower disaster risk reduction practitioners to address the spatial and temporal paucity of historical data and poor representation of downscaled global models for early warning systems.

Developing an AI-driven system: Old problem-New Solution The implementation of this project was divided into 2 stages. The first stage focused on model development and testing based on legacy/historical weather data while the second stage focused on installing a monitoring sensor to improve robustness of data flow from a major river catchment in Timor-Leste. Both stages address problems related to inexistence of best- fit predictive model and limited availability of data to advance meaningful intelligence on trends and thresholds of disaster risks.

Figure 2: Simplified workflow for the development of AI-driven model and thresholds for early warning on water-related natural disaster in Timor-Leste.

MERCY CORPS AI for Early Warning on Natural Disasters 3 AI Platform Built and integrated into ONE-EWS Platform

Similie, a social enterprise, based in Timor-Leste, was contracted to build and deploy an AI Platform that combines data from existing weather stations with global and satellite datasets to optimize the setting of thresholds that will trigger early warning alerts to communities. The contractor followed a stepwise process that leverages contextual knowledge, legacy data, and emerging tools for high precision and predictive performance (Fig 2). ONE-EWS was developed by Similie to advance early warning surveillance and alert systems for use by public and private entities in Timor-Leste.

At the onset of the project, a collaborative workshop was organized to discuss objectives, discuss priority needs with stakeholders, and map relevant entry points for access to data and relevant authorities in the Country. After initial interaction and gathering of insights and data from stakeholders, available meteorological data were synthesized and subject to various processing, including spatial kriging to generate continuous data trend across the target geography.

To build the AI-enabled platform and integrate with ONE-EWS, a decision-tree-based ensemble machine learning modeling framework was adapted and deployed, which include time-series hierarchical clustering (unsupervised learning) and cluster-labeling with a gradient boosting framework (XGBoost) – a supervised machine learning approach. This modeling approach was based on Cluster days with a higher risk of flood (i.e. Time Series Hierarchical Clustering) and, predicted the likelihood of a flood within an hour interval (using the XGBoost tool). Due to the limitation of observation data points on weather and hydrology (n=1,198), it was difficult to clearly define the timing of flood occurrence or apply more complex approach, such as deep learning model. To enhance the model accuracy and account for trends and seasonality, Similie generated several lagged features for each variable that was used in the model, and calculated the average values of temperature and humidity over the previous 3, 7, 30 and 90 days, and the precipitation accumulation for the same period. The variable importance metric shows that the total amount of rain over the last week is the most significant predictor, followed by the total rain over the last three months, and by the average humidity over the previous three months highlighting the strong importance of the local climate conditions. Overall, the model’s prediction output shows an accuracy of 98%, specificity of 0.86, and sensitivity of 0.98.

Based on the positive outcome of the AI model set-up, parameterization, and fine-tuning, the model has been integrated into the ‘backend’ of One EWS (Fig. 3), the evolving national early warning platform for Timor-Leste. As further iteration of the model is implemented in the future, Similie will develop a front- end user interface that can be accessible to the public. Similie plans to test this model with regular and reliable data that are generated from both meteorological and river height sensors across locations in Timor-Leste.

MERCY CORPS AI for Early Warning on Natural Disasters 4 Figure 3: Back-end dashboard visualization for AI-driven thresholding of flooding alerts within Timor- Leste’s One Early Warning System (EWS)

Enhancing Data Flow: River level monitoring sensor at the Belulic River Catchment

AI-driven model and overall EWS cannot deliver actionable intelligence on natural disaster risks without robust ground-level data on weather and hydrological variables. In principle, densification of monitoring stations (as a real-time data-source) in the EWS system can enable better prediction for the communities. Therefore, Mercy Corps (and Similie) installed one flood detection device in the Belulic River Catchment. This was intended to complement the three monitoring stations that the Government already installed for meteorological and soil moisture observations. As a proprietary tool (from Similie), based on internet of things (IoT), similar monitoring device has been previously deployed in other locations across Timor-Leste for flash flood, meteorology, and Figure 4: Installation of river monitoring device at smart metering of community water supply Luetelu, Belulic river catchment in Timor-Leste. systems.

MERCY CORPS AI for Early Warning on Natural Disasters 5 However, the survey revealed that only one site, Leutelu had cellular network coverage which is a critical requirement for real-time data flow from the river monitoring device. Following successful installation of the device in January 2021, it has been recording data each minute, with over 85,000 data records already generated and fed into One EWS.

Challenges for Implementation of AI-driven National Early Warning and Action

The set-up and testing of AI-driven system is expected to support unprecedented delivery of accurate, timely and locally relevant early warning system alerts to communities that are vulnerable to climate change induced natural disasters in Timor-Leste and enhance national action for preparedness. Yet, this pilot reveals inherent challenges associated with various aspects of implementing the envisioned innovation for national resilience.

The government’s historical meteorological station data was periodically defective resulting in missing or anomalous values. Where possible, erroneous datapoints were filtered and the daily averages were calculated for each station. In instances where there were major temporal gaps, future values were predicted using a time series model based on the K Nearest Neighbors algorithm. Given the short temporal range of the data that were available from the stations, additional lagged features were generated to account for the variation and impact of rain, humidity and temperature over time, while runoff estimate was set as a monthly invariant factor to control for seasonality in hydrological and climate conditions over time. To compensate for the paucity of historical meteorological data, some satellite data sources (including NASA Power and Google Earth Engine) were prepared and included in the model development.

Further, upon review of the national disaster event database, seven historical flood events were identified in the Belulic catchment between 2010-2017. However, none of these events were correlated with the available meteorological datasets. Given the unreliability of the data and the time range, this information was eventually excluded from the AI model. Potentially useable river height data from other monitoring sites were not included in the AI-model because of non-overlap with meteorological data set or poor resolution of satellite data which limits the interest to generate localised and downscaled model outputs.

The installation of river height monitoring device enabled the continuous acquisition of useable data records for future optimization of the AI algorithm, but real-time access to the data has been limited by frequent cellular network interruptions/downtime in Timor-Leste. Initially, the team planned to source real-time meteorological data from Government-owned meteorological stations, however, CoVID travel restrictions constrained routine maintenance of these stations and the anticipated data feeds eventually failed. Similie is now exploring the development of a scalable AI algorithm that relies on the local meteorological and river height datasets, to predict the probability of river height changes as a result from local rainfall events.

MERCY CORPS AI for Early Warning on Natural Disasters 6 Key Take-aways and Recommendations

The AI model is an initial step towards defining a more advanced and reliable tool to predict flood risk in Timor-Leste. Future advances in functionality of meteorological stations and improvements in quality if river level data can enhance the robustness of the EWS and support national action and planning for water-related disasters. While the AI model has been developed based on data from specific region of Timor-Leste, it can be swiftly adapted to other catchments or regions that are vulnerable to flooding risk. Evidently, the AI model was developed with minimal local monitoring data, however, it can be further refined, with more robust training and validation data, to improve representativeness of the contextual conditions (and generate more reliable predictions). Based on the performance of the initial AI model set-up, it can be adapted and applied at other locations in Timor-Leste where longer (and improved quality) time series data is available. This includes Mercy Corps’ urban flooding project (named “PREPARADU” funded by the Korea International Cooperation Agency, or KOICA) which was recently commissioned to deploy devices across 4-6 river systems within the capital of Dili. Under the KOICA partnership, there is potential to include local additional environmental data, such as soil moisture, and global forecasting products that in the modeling framework.

On the front-end of the system, it will be valuable to secure further support from related initiatives to enhance the visualization and user experience of the data dashboard, and facilitate broader public access and use. The reliability of the AI-driven ONE-EWS can be improved by evaluating and communicating model uncertainties based on sensitivity analyses of model performance relative to various parameters.

Other ongoing programs at Mercy Corps (such as M-RED) will continue using the piloted system to monitor the Belulic River Catchment, while collaborating with Similie to recalibrate the model next year (2022) when more data would have been acquired during the rainy season. Further, the team plans to ensure that communities receive relevant training to understand alerts. This was an aspect of the initial pilot project implementation plan, however, COVID-related lockdown precluded any direct community interaction. As COVID restriction recedes, the in-country team plans to leverage both Mercy Corps M- RED and PREPARADU programs to engage relevant national ministries and enhance capacity for uptake and maintenance of the system, and develop functional communication workflow for flooding EWS under a government-coordinated framework.

MERCY CORPS AI for Early Warning on Natural Disasters 7 Where to learn more

FTTP Program Julius Adewopo

Project Manager Kirsten Mandala

Country Director Jules Keane

Project Vendor Similie

Digital Library Link to This Document <>

Author

Julius Adewopo Advisor, Emerging Technology (T4D) [email protected]

Acknowledgement The author thanks Alicia Morrison for her review of the texts.

About Mercy Corps Mercy Corps is a leading global organization powered by the belief that a better world is possible. In disaster, in hardship, in more than 40 countries around the world, we partner to put bold solutions into action — helping people triumph over adversity and build stronger communities from within. Now, and for the future.

45 SW Ankeny Street Portland, Oregon 97204

888.842.0842 mercycorps.org

MERCY CORPS AI for Early Warning on Natural Disasters 8