The Applicability of Mathematical Morphology Algorithm for Tropical Cyclone Eye and Water Body Boundary Extraction in SAR Data
By Ke Wang
A thesis in fulfilment of the requirements for the degree of Master of Engineering
Surveying and Geospatial Engineering School of Civil & Environmental Engineering Faculty of Engineering The University of New South Wales
September 2014
PLEASE TYPE THE UNIVERSITY OF NEW SOUTH WALES Thesis/Dissertation Sheet
Surname or Fam ily name: Wang
First name: Ke Other name/s: Isabella
Abbreviation for degree as given in the University calendar: ME (Master of Engineering)
School: School of Civil &Environmental Engineering (CVEN) Faculty: Faculty of Engineering
Title: The applicability of mathematical morphology algorithm for tropical cyclone eye and water body boundary extraction in SAR data
Abstract 350 words maximum: (PLEASE TYPE)
Tropical cyclone (TC) and flooding are global catastrophes, devastating natural disasters. Synthetic aperture radar (SAR) satellite images present unique capabilities of cloud penetration, from signal response of sea/ground surface backscatter. The availability of high spatial resolution SAR satellite imagery shows potential for new metrological and environmental applications. This thesis presents two major case studies detailing efficient approaches in TC eye extraction and water body detection, using data from spaceborne Radarsat-1 , En vi sat ASAR and airborne Interferometric Synthetic Aperture Radar (IFSAR).
In the case study of TCs, using the relationship between normalized radar cross section (NRCS) and backscatter for the roughness of sea surface, SAR images enable the measurement of the areas of TC eyes as an identifiable result. The size and shape of TC eyes strongly corresponds with its evolution and strength. It can play a vital role in monitoring and forecasting the behaviour of TCs by introducing mathematical morphology methods. Skeleton pruning based on discrete curve evolution (DCE) was used to ensure global and local preservation of the TC eye shape, by reducing redundant skeletons caused by speckle noise along the edges of the TC eye. These morphological-based analyses have been employed explicitly for six representative ocean SAR images with different TC patterns. The results demonstrate a high degree of agreement with the area of coverage derived from reference data based on NOAA's manual work.
The second case study for water body detection involves pattern recognition with respect to digital image segmentation. Morphological watershed algorithm is applicable for image segmentation, albeit excessively sensitive to speckle noise in SAR images, leading to over-segmentation and thus a reduction in efficiency. This thesis presents a novel approach for water body extraction from SAR images by applying marker-controlled watershed combined with top-hat transformation. The purpose of this case study is to improve the efficiency of watershed techniques compared with Canny edge detection results for fine resolution I FAR images, and to yield an intuitive and well segmented image for mapping of water body boundaries.
Declaration relating to disposition of project thesis/dissertation
I hereby grant to the University of New South Wales or its agents the right to archive and to make available my thesis or dissertation in whole or in part in the University libraries in all forms of media, now or here after known , subject to the provisions of the Copyright Act 1968. I retain all property rights, such as patent rights. I also retain the right to use in future works (such as articles or books) all or part of this thesis or dissertation.
I also authorise University Microfilms to use the 350 word abstract of my thesis in Dissertation Abstracts International (this is applicable to doctoral theses only).
r?~l.t?~! .~. O. . ' '?. ··· ·· · ·· · ····· · ·· ~Signature · · ···· · · · · · · · · · · ··· Date
The University recogn ises that there may be exceptional circumstances requiring restrictions on copying or conditions on use. Requests for restriction for a period of up to 2 years must be made in writing. Requests for a longer period of restriction may be considered in exceptional circumstances and re uire the a roval of the Dean of Graduate Research .
FOR OFFICE USE ONLY Date of completion of requirements for Award:
THIS SHEET IS TO BE GLUED TO THE INSIDE FRONT COVER OF THE THESIS COPYRIGHT STATEMENT
'I hereby grant the University of New South Wales or its agents the right to archive and to make available my thesis or dissertation in whole or part in the University libraries in all forms of media, now or here after known, subject to the provisions of the Copyright Act 1968. I retain all proprietary rights, such as patent rights. I also retain the right to use in future works (such as articles or books) all or part of this thesis or dissertation. I also authorise University Microfilms to use the 350 word abstract of my thesis in Dissertation Abstract International (this is applicable to doctoral theses only). I have either used no substantial portions of copyright material in my thesis or I have obtained permission to use copyright material; where permission has not been granted I have applied/will apply for a partial restriction of the digital copy of my thesis or dissertation.'
Signed ····· ······· ··· ~ ······ · ·· · ·· · · · · · ·· ·· ···· ·············
Date ...... P~/p;;,./:k?J? ......
AUTHENTICITY STATEMENT
'I certify that the Library deposit digital copy is a direct equivalent of the final officially approved version of my thesis. No emendation of content has occurred and if there are any minor variations in formatting, they are the result of the conversion to digital format.'
Signed ...... ~ ......
Date ...... r:?.~/ ~. ~• ./ . .?.1.?.! .$.'...... ORIGINALITY STATEMENT
'I hereby declare that this submission is my own work and to the best of my knowledge it contains no materials previously published or written by another person, or substantial proportions of material which have been accepted for the award of any other degree or diploma at UNSW or any other educational institution, except where due acknowledgement is made in the thesis. Any contribution made to the research by others, with whom I have worked at UNSW or elsewhere, is explicitly acknowledged in the thesis. I also declare that the intellectual content of this thesis is the product of my own work, except to the extent that assistance from others in the project's design and conception or in style, presentation and linguistic expression is acknowledged.'
Signed ...... ~ ......
Date ...... P.Y..'?.k/~ . ~5 ...... Abstract
Tropical cyclone (TC) and flooding are global catastrophes, devastating natural disasters.
Synthetic aperture radar (SAR) satellite images present unique capabilities of cloud penetration, from signal response of sea/ground surface backscatter. The availability of high spatial resolution SAR satellite imagery shows potential for new metrological and environmental applications. This thesis presents two major case studies detailing efficient approaches in TC eye extraction and water body detection, using data from spaceborne Radarsat-1, Envisat ASAR and airborne Interferometric Synthetic Aperture Radar (IFSAR).
In the case study of TCs, using the relationship between normalized radar cross section (NRCS) and backscatter for the roughness of sea surface, SAR images enable the measurement of the areas of TC eyes as an identifiable result. The size and shape of TC eyes strongly corresponds with its evolution and strength. It can play a vital role in monitoring and forecasting the behaviour of TCs by introducing mathematical morphology methods. Skeleton pruning based on discrete curve evolution (DCE) was used to ensure global and local preservation of the TC eye shape, by reducing redundant skeletons caused by speckle noise along the edges of the TC eye. These morphological-based analyses have been employed explicitly for six representative ocean SAR images with different TC patterns. The results demonstrate a high degree of agreement with the area of coverage derived from reference data based on NOAA’s manual work.
The second case study for water body detection involves pattern recognition with respect to digital image segmentation. Morphological watershed algorithm is applicable for image segmentation, albeit excessively sensitive to speckle noise in SAR images, leading to over- segmentation and thus a reduction in efficiency. This thesis presents a novel approach for water body extraction from SAR images by applying marker-controlled watershed combined with top- hat transformation. The purpose of this case study is to improve the efficiency of watershed i techniques compared with Canny edge detection results for fine resolution IFAR images, and to yield an intuitive and well segmented image for mapping of water body boundaries.
ii
Acknowledgement
Foremost, I would like to express my deepest thanks to my supervisors, Professor John C. Trinder, he has been a mentor to me in a way. This spirit of mentorship has pervaded every step of my research, and I would like to thank him for offering thorough and excellent feedback on every version of this thesis even during his holiday. Literally, I am truly grateful for his selfless dedication to both my personal and academic development, as I consider myself extremely fortunate to have him as my supervisor at UNSW, even whose maddening attention to detail drove me to finally learn to punctuate my winding sentences. But most importantly, his immense academic knowledge and guidance has made this a thoughtful and rewarding journey.
I am eternally gratefully to all my family for all their love to support me in all my pursuits †
I would also like to thank:
Dr. Xiaofeng Li, without your strong support and expertise I would not have a chance to complete the research of tropical cyclone case study, I’m truly appreciate your patience and help in resolving the problem I have met during study;
Dr. Scott Hensley, I really appreciate that the marvellous lecture you gave and your great patience in answering all my questions with respect to Radar principle;
Dr. Xianwen Ding, I truly thank for your great help and consideration during IGRASS 2014 conference;
A/Prof. Samsung Lim, as my co-supervisor the useful advice you provided through consultation and coordination is highly appreciated;
Dr. Hossein Aghighi, your diligence is a role model for me to learn from, and I am grateful for my inclusion in your research.
Last but not least I would like to thank the “Thesis Posse” that I have formed with the numerous individuals over the past few years that have inspired, supported and encouraged me along the way, without which I would not have enjoyed this thesis as much as I have.
Mr. Allan Hong Zhang & Ms. Xue Hua Zhang, Dr. Bo Jin, Ms Boya Wang, Mr.Chao Zhou, Dr. Hwan Choi, Dr. Ke Xu, Dr. Ligaya Leah Figueroa, Dr. Shi Zhan, Dr. Siyuan Chen, Dr. Yaobin Sheng, Dr. Yiping Jiang, Mr. Yuqiang Chu, Dr. Zeyu Li.
iii
Glossary
ALOS : Advanced Land Observing Satellite
AVHRR : Advanced Very High Resolution Radiometer
ASAR : Advanced Synthetic Aperture Radar (Envisat)
ASI : Italian Space Agency
ASTER : Advanced Spaceborne Thermal Emission and Refection Radiometer.
Aqua (EOS PM) : is a multi-national NASA scientific research satellite in orbit around the Earth, studying the precipitation, evaporation, and cycling of water.
BCS : Backscatter Cross Section
Tropical Cyclone Category : Category is rated in five categories according to their strongest wind speed, Category 4-5 are very destructive winds with typical gusts over open flat land of 225 - 279 km/h or more than 280 km/h.
CCRS : Canadian Centre for Remote Sensing
CMOD4 : C-Band Model Function
CNES : Centre National D'études Spatiale
COSMO-SkyMed: : (COnstellation of small Satellites for the Mediterranean basin Observation) is an Earth observation satellite system funded by the Italian Ministry of Research and Ministry of Defence and conducted by the Italian Space Agency (ASI), intended for both military and civilian use.
CPHC : Central Pacific Hurricane Centre
DCE : Discrete Curve Evolution
DEM : Digital Elevation Models
DLR : German Aerospace Centre
DoE : Difference of Estimates
EMR : Electromagnetic Radiation
ESA : European Space Agency
ESRIN : ESA Centre for Earth Observation
iv
ERS : European Respiratory Society
FIR : Finite Impulse Response
GIS : Geographic Information System
GMES : Global Monitoring For Environment and Security
GMF : Geophysical Model Function
GNSS : Global Navigation Satellite System
HF : High Frequency
IFSAR : Interferometric Synthetic Aperture Radar
IIR : Infinite Impulse Response
INS : Immigration and Naturalization Service
JTWC : Joint Typhoon Warning Center
LOG : Laplacian-of-Gaussian
MAT : Medial Axis Transform
MM : Mathematical Morphology
MODIS : Moderate-Resolution Imaging Spectroradiometer
MSS : Multi-Spectral Scanner
NIR : Near Infrared
NOAA : National Oceanic and Atmospheric Administration
NRCS : Normalized Radar Cross Section
OLI : Operational Land Imager
PASAR : Phased Array Synthetic-Aperture Radar
PAZ (Hisdesat) : is the first Spanish Synthetic Aperture Radar in X band , designed as a dual use (military and civilian) mission to meet operational requirements in the field of high resolution (up to 1 meter) observation.
POES : Polar Orbiting Spaceborne
PRF : Pulse Repetition Frequency
Radarsat-1 : is Canada's first commercial Earth observation satellite , developed under the management of the Canadian Space Agency (CSA) in co-operation with Canadian provincial governments and the private sector. v
RAR : Real Aperture Radar
RCM : Radarsat Constellation Mission
RCS : Radar Cross-Section
RDP : Relative Dielectric Permittivity
RISAT-1 : is an Indian remote sensing satellite which was built and is operated by the Indian Space Research Organisation (ISRO). RPI : Repeat Pass Interferometry.
SAR : Synthetic Aperture Radar
SAT : Symmetry Axis Transform
SE : Structuring Element
SLAR : Side-Looking Airborne Radar
SNR : Signal to Noise Ratio
SPI : Single Pass Interferometry
SPOT : Satellite Pour l'Observation de la Terre
TanDEM-X : TerraSAR-X add-on for Digital Elevation Measurement, is the name of TerraSAR-X's twin satellite.
TerraSAR-X : A radar Earth observation satellite with its twin satellite TanDEM-X launched June 21, 2010 is a joint venture being carried out under a public-private-partnership between the German Aerospace Center (DLR) and EADS Astrium.
Terra : Formerly EOS (Earth Observing System) AM-1 is a multi- national NASA scientific research satellite in a Sun- synchronous orbit around the Earth.
TC : Tropical Cyclones
TIRS : Thermal Infrared Sensor
TM : Thematic Mapper
TRMM : Tropical Rainfall Measuring Mission
TPC/NHC : Tropical Prediction Center/National Hurricane Center
UAF : University of New South Wales Adaptive Filter
UAV : Unmanned Aerial Vehicle
UHF : Ultra High Frequency
vi
VHF : Very High Frequency
WFO : Weather Forecast Office
WMO : World Meteorological Organization
vii
Table of Contents
Abstract i Acknowledgement iii Glossary iv Table of Contents viii List of Figures xii List of Tables xvi List of Publications xvii
Chapter 1. Introduction
1.1 Background Information 1 1.2 Problem Statement and Justification 2 1.3 Objectives and Contributions of Research 4 1.4 Thesis Organization 6
Chapter 2. Principles of Synthetic Aperture Radar (SAR) System
2.1 Basic Principles of Imaging Radar Systems 9 2.1.1 SAR Wavelength 13 2.1.2 Spatial Resolution 16 2.1.2.1 Resolution in Range (Cross-track) 16 2.1.2.2 Resolution in Azimuth (Along-track) 17 2.1.3 Polarization 18 2.1.4 Scattering Mechanisms 19 2.2 SAR System Parameters and Properties 20 2.2.1 Radar Equation 20 2.2.2 Backscatter (Surface Roughness, Dielectric Properties) 22 2.2.3 Incidence Angle, Azimuth and Look Direction 24 2.2.4 Geometric Effects 25 2.2.4.1 Radar Shadows 26 2.2.4.2 Radar Layover 27 2.2.4.3 Foreshortening 27 2.2.5 Speckle Effect and Filtering 28 2.3 Interferometric Synthetic Aperture Radar (IFSAR) 29
viii
Chapter 3. Image Processing for the Extraction of Features in Images
3.1 Introduction 32 3.2 Brief History of Mathematical Morphology 32 3.3 Morphological Structuring Element 33 3.4 Binary Erosion and Dilation 34 3.5 Binary Opening and Closing 37 3.6 Top-hat Transform 38 3.7 Skeletonization 41 3.7.1 Skeleton Based on Medial Axis 41 3.7.2 Skeleton Representation 42 3.7.3 Shape Reconstruction 44 3.8 Pruning with Discrete Curve Evolution (DCE) 46 3.9 Watershed Segmentation 49 3.9.1 Implementation of Traditional Watershed Segmentation 51 3.9.2 Oversegmentation and Its Remedy 54 3.10 Classic Edge Detectors 55 3.10.1 Introduction 55 3.10.2 Gradient 57 3.10.3 Edge Detection Using Classical Edge Detectors 59 3.10.3.1 Roberts Edge Detectors 59 3.10.3.2 Sobel Edge Detectors 60 3.10.3.3 Prewitt Edge Detectors 60 3.10.3.4 Laplacian-of-Gaussian (LOG) Edge Detectors 61 3.10.3.5 Canny Edge Detector 63 3.11 Speckle Noise Filtering 65 3.11.1 UNSW (University of New South Wales) Adaptive Filter (UAF) 65 3.11.2 Median Filter 66
Chapter 4. Applications of Remote Sensing Data for Tropical Cyclone Studies and
Flood Mapping
4.1 Introduction 69 4.2 Approaches of Tropical Cyclone Study 70 4.2.1 Introduction 70 4.2.2 TC Identification Tropical Cyclone Characteristics Using Dvorak Technique 71 4.2.3 Data Acquisition and Analysis 72
ix
4.2.4 Ocean Surface Wind Speed Retrieval Model 74 4.2.4.1 Multisource for Wind Speed Retrieval 74 4.2.4.2 SAR Wind Speed Retrieval 75 4.2.5 Tropical Cyclone Eyes Detection and Location 77 4.3 Approaches of Water Body/Flood Mapping 78 4.3.1 Introduction 78 4.3.2 Flood Monitoring with Passive Remote Sensing System 79 4.3.3 Flood Mapping and Monitoring from Radar Images 82 4.3.4 Flood Mapping and Monitoring Using Radar Coherence 86 4.3.5 A Combination of Optical and Radar Data 89 4.3.6 Flood Detection Using GIS and Remote Sensing 89 4.3.6.1 Digital Elevation Models (DEM) 89 4.3.6.2 Light Detecting and Ranging (LIDAR) 90 4.4 Summary 90
Chapter 5. Processing of SAR Images for Case Studies
5.1 Tropical Cyclone Eyes 93 5.1.1 Introduction 93 5.1.2 Extraction of Tropical Cyclone Eyes 95 5.1.2.1 Using Adaptive Filters UAF for SAR Speckle Reduction 95 5.1.2.2 Image Enhancement 96 5.1.2.3 Morphological Skeleton Extraction 98 5.1.2.4 Skeleton Pruning with Discrete Curve Evolution (DCE) 99 5.1.2.5 Reconstruction Algorithm 100 5.1.3 Study Area and Dataset 100 5.1.4 Experimental Results and Discussion 104 5.1.5 Analysis of Results of Extraction of TC Eyes 107 5.2 Water Body Boundary Detection 111 5.2.1 Introduction 111 5.2.2 Water Body Extraction 112 5.2.2.1 Creating Gradient Image 112 5.2.2.2 Top-hat Transformation 113 5.2.3 Watershed Algorithm 114 5.2.4 Study Area and Dataset 115 5.2.5 Experimental Results and Discussion 116 5.2.6 Analysis of Results of Water Body Detection 121
x
Chapter 6. Concluding Remarks and Future Research
6.1 Concluding Remarks 124 6.1.1 Conclusion of Tropical Cyclone Case Study 124 6.1.2 Conclusion of Water Body Detection Case Study 126 6.2 Recommendations for Future Research 127
Reference s 129
xi
List of Figures
Figure 1.1 : Demonstration of different types and numbers of natural disasters : 2013 1 versus 2003-2012 Figure 1.2 : Percent share of reported occurrence by disaster sub-group and continent in 2 2013 Figure 2.1 : (a ) Illustration of a spaceborne SAR viewing geometry; (b) Principle of 10 SAR systems. Object points , and on the ground are less frequently viewed at near range than from far range. Hence, point has a proportional
shorter effective antenna length, > > Figure 2.2 : Illustration of marginal atmospheric effects in Advanced Synthetic 13 Aperture Radar (ASAR) Figure 2.3 : Impulse response to a point target 17 Figure 2.4 : Polarization of electromagnetic signal 19 Figure 2.5 : Scattering mechanisms of surface scattering 20 Figure 2.6 : Demonstration of surface and volume scattering 20 Figure 2.7 : Demonstration of corner reflection 20 Figure 2.8 : Scattering mechanisms of water and land surfaces under different 21 conditions Figure 2.9 : Typical radar backscatter as a function of incidence angle for 23 representative surfaces Figure 2.10 : Geometry of different radar angles 24 Figure 2.11 : Relationship of radar incidence angle and corresponding backscatter 25 intensity Figure 2.12 : Foreshortening, layover, and shadow; the three-dimensional world is 26 collapsed to two dimensions in conventional SAR imaging Figure 2.13 : Geometric distortions in SLAR imaging radar system 26 Figure 2.14 : Radar Layover effect of terrain feature 27 Figure 2.15 : Radar foreshortening effect of terrain feature 28 Figure 2.16 : Illustration of single pass interferometry (left) and repeat pass 29 interferometry (right) Figure 3.1 : A non-flat structuring elements (left) and a flat structuring elements 34 (right) are used in a 1D image for dilation. Dash line is the result of dilation from original shape which presents as solid line (Dot points shown in the SE and are used as the centre of the structuring
xii
element) Figure 3.2 Dilation by a structuring element circle on shape X, and the result of 34
expansion of X is shown as ( ) Figure 3.3 : Erosion by a structuring element circle on shape X, and the result of 35
reduction of X is shown as ( ) Figure 3.4 : Demonstration of dilation result of the images using different structuring 36 elements. The first column indicates the different shapes of original images, and the first row represents 5 types of structuring elements (SE). Each of the second to fourth rows shows the result dilated by each SE from the first row, which varies with the shape of SEs. The orange squares were used as the centre of the SEs Figure 3.5 : Demonstration of erosion result of the images using different structuring 37 elements. The first column indicates the different shapes of original images, and the first row represents 5 types of structuring elements (SE). Each of the second to fourth row shows the result eroded by each SE from the first row, which varies from the shape of SEs. The orange squares were used as the centre of the SEs Figure 3.6 : Opening of a discrete binary image X (13 × 10 ) shown in (a) by a 37 structuring element B (2 × 2) shown in (b), resulting in the grey pixels with the white background pixels (c) Figure 3.7 : Closing of a discrete binary image X (13 × 10 ) shown in (a) by a 37 structuring element B (2 × 2) shown in (b), resulting in the grey pixels with the white background pixels (c) Figure 3.8 : Demonstration of opening or white top-hat transformation 40 Figure 3.9 : Demonstration of closing or black top-hat/bottom-hat 40 Figure 3.10 : Indication of the geometric relationship between a point on a 1D medial 42 axis and its corresponding boundary points. The tangent circle shrinks along with the boundary, so the boundary is perpendicular to its radius vector. Also, the medial axis splits the two radius vectors. The media axis indicated in the rectangle defines the centres of maximal discs. Figure 3.11 : A robust skeleton extraction and a rectangle with boundary disturbance 46 Figure 3.12 : Illustration of immersion analogy 49 Figure 3.13 : Illustration of watershed segmentation in topographic surface 52 Figure 3.14 : Two examples of the watershed transform applied to a one dimensional 55 signal are presented. Chart A) When three markers or labels are assigned at the three local minima, three segmented areas are produced by
xiii
watershed lines as the boundaries which are separated at the local maxima between each two basins; Chart B) When only two markers are located, segment 2 is flooded over a small peak and into the adjacent minima until a watershed line is shaped with segment 1. Figure 3.15 : The 2-D Laplacian of Gaussian (LOG) function, where and axes are 62 marked in standard deviations ( ) Figure 3.16 : (Left) Demonstration of the robust skeleton for rectangle, (Middle) 66 (Right) the sub-branches in the skeletons are generated by noise over the boundary of the rectangle Figure 4.1 : Illustration of T-Numbers of the Dvorak technique 71 Figure 4.2 : Illustration of pattern strength based on Dvorak technique 71 Figure 4.3 : Illustration of tropical cyclones observation 74 Figure 4.4 : Illustration of TC structure in vertical slice through the centre of a mature 78 TC Figure 4.5 : Scattering mechanisms of a non-flooded forest (left column) and flooded 84 forest (middle and right column) Figure 5.1 : ENVISAT satellite imagery of hurricane Katrina collected on 28 August 94 2005 from MERIS (UTC 15:50) Figure 5.2 : ENVISAT satellite imagery of hurricane Katrina collected on 28 August 94 2005 from ASAR (UTC 17:00) Figure 5.3 : ASAR image overlaid on the Terra/MODIS optical image (Hurricane 94 Katrina 2005 UTC 17:00) Figure 5.4 : Demonstration of original SAR image (Left) of hurricane Dean acquired 96 on 08/19/2007 with speckle noise, (Right) the denoised image after exploiting UAF adaptive filter Figure 5.5 : Illustration of denoising SAR image (Left) and image enhancement based 98 on Ostu’method (Right) Figure 5.6 : Illustration of original ocean SAR image (time series hurricane Katrina 113 27/08/2005 and 28/08/2005 Figure 5.7 : Illustration of original ocean SAR image (time series hurricane Dean 113 17/08/2007 and 19/08/2007) Figure 5.8 : Illustration of original ocean SAR image (hurricane Earl and Rita, 114 02/09/2010 and 22/09/2005) Figure 5.9 : (a) Original SAR image I, (b) pre-processing SAR image I 114 Figure 5.10 : (a) Original SAR image II, (b) pre-processing SAR image II 114 Figure 5.11 : Demonstration of IFSAR image (acquisition time: UTM 21:51 22 Oct 116
xiv
2013) Figure 5.12 ; (a) Oversegmentation of SAR image I, (b) watershed of processed SAR 117 image I (c) marker-controlled watershed of processed SAR image I Figure 5.13 : (a) Oversegmentation of SAR image II, (b) watershed of SAR image II, 117 (c) marker-controlled watershed of SAR image II Figure 5.14 : (a) Original SAR image III overlaid with reference map in yellow solid 119 line as the river edge (b) Canny edge detection example 1 (c) Canny edge detection outcome example 1 overlaid with the watershed transformation result Figure 5.15 : (a) Original SAR image IV overlaid with reference map in yellow solid 119 line as the river edge (b) Canny edge detection example 2 (c) Canny edge detection outcome example 2 overlaid with the watershed transformation result Figure 5.16 : (a) Original SAR image IV overlaid with reference map in yellow solid 120 line as the river edge (b) Canny edge detection example 3 (c) Canny edge detection outcome example 3 overlaid watershed transformation result Figure 5.17 : (a) Original SAR image V overlaid with reference map in yellow solid 120 line as the river edge (b) Canny edge detection example 4 (c) Canny edge detection outcome example 4 overlaid watershed transformation result
xv
List of Tables
Table 2.1 : Frequency and wavelength relationships 11 Table 2.2 : Electromagnetic (EMR) spectrum of interest to remote sensing 12 Table 2.3 : Common radar remote sensing bands and their characteristics 14 Table 2.4 : The major commercial Radar remote sensing satellites 15 Table 2.5 : The typical values of backscatter coefficients and corresponding ground 23 features Table 5.1 : Imagery information of hurricane event 101 Table 5.2 : Wind speed information of TC area 101 Table 5.3 : Illustration of morphological reconstruction compared to the skeleton 105 pruning result Table 5.4 : Demonstration of denoised TC images for morphological reconstruction 106 after skeleton and pruning Table 5.5 : Evaluation of shape extraction for tropical cyclone coverage 108 Table 5.6 : Estimation of area extraction for tropical cyclone by wavelet analysis 109 Table 5.7 : Analysis of initial watershed segmentation (oversegmentation) and 118 marker-controlled watershed result
xvi
List of Publications
Conference Papers:
Ke Wang , Xiaojing Li, Linlin Ge, “Locating Tropical Cyclones with Integrated SAR and Optical Satellite Imagery”, IEEE International Geoscience and Remote Sensing Symposium , TUP.P15, July, 2013 (in press)
Ke Wang , John C. Trinder, “Applied Watershed Segmentation Algorithm for Water Body Extraction in Airborne SAR Image”, EuSAR 2014:10th European Conference on Synthetic Aperture Radar , 2013 (in press)
Ke Wang , Xiaofeng Li, John C. Trinder, “Mathematical Morphological Analysis of Tropical Cyclone Eyes on Ocean SAR”, IEEE International Geoscience and Remote Sensing Symposium , 2014 (in press)
Journal Paper:
Ke Wang , Ali Shamsoddini, Xiaofeng Li, John C. Trinder, “Extracting Hurricane Eyes in Spaceborne SAR Images Using Morphological Analysis”, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing , 2014 (Submitted)
Peer-reviewed Paper:
Hossien Aghighi, John C. Trinder, Ke Wang , Yuliya Tarabalka and Sumsang Lim, “Smoothing Parameter Estimation for MRF Classification of Non-Gaussian Distribution Image”, ISPRS - International Society for Photogrammetry and Remote Sensing, Commission VII, WG VII/4, 2014 (in press)
xvii
Chapter Introduction
Chapter 1 Introduction
Chapter Introduction
1 Introduction
1.1 Background Information
Reports of the occurrence of natural disasters over the past few decades are illustrated below
(Figures 1.1and 1.2). Earthquakes, floods and tropical cyclones (TC), are showing an upward trend, giving rise to an increased public consciousness of the impacts of various disastrous events. Most of the time, the impacts of such catastrophic events are inevitable even with immediate rescue activities, whereas establishing systematic climate change monitoring institutions, as well as post-disaster management or reconstruction may have significant long term benefits. In addition, in order to understand and possibly alleviate the impacts of some of these disastrous events on human beings and their environment, research in terms of meteorological and hydrological monitoring is being undertaken for each of the characteristic stages of such events, i.e. prior to the event (early warning systems, disaster preparedness), the instance when the event happens (disaster alert systems, disaster assistance), and after the event
(emergency response and risk assessment).
Figure 1.1 has been removed due to Copyright restrictions.
Figure 1.1 Demonstration of different types and numbers of natural disasters: 2013 versus 2003-2012 (Guha-Sapir et al., 2014)
Natural disasters are defined as events not brought about by human activity that have significant negative impacts on people, infrastructure, and the environment. From 2003 to 2013, 718 natural disasters worldwide were registered to have affected more than 2,256 million victims, causing US$118.6 billion of economic damage (Guha-Sapir et al., 2014). Amongst the various types of disasters, hydrological and meteorological events (such as flooding and tropical cyclones) account for the largest share. Inundation disasters were the most frequently occurring disasters on average annually, for the years 2003 to 2013(Figure 1.2).
1
Chapter Introduction
Figure 1.2 has been removed due to Copyright restrictions.
Figure 1.2 Percent share of reported occurrence by disaster sub-group and continent in 2013
(Guha-Sapir et al., 2014)
At present, Tropical Cyclones (TC) (also referred to as hurricanes and typhoons) have received close attention from policymakers and the scientific community. For instance, in America TCs are monitored by several federal governmental organizations under the leadership of the
National Oceanic and Atmospheric Administration (NOAA), including the Tropical Prediction
Center/National Hurricane Center (TPC/NHC), Central Pacific Hurricane Center (CPHC),
Weather Forecast Office (WFO), and Joint Typhoon Warning Center (JTWC). These authorities are all trying to predict cyclone or hurricane paths and intensities to issue accurate and timely warnings to the public in harm’s way.
Rapid damage assessment after catastrophes is vital for launching effective emergency rescue actions. The crucial and prompt geospatial information about areas affected can be provided by remote sensing satellites features optical and SAR imaging sensors. With the development of satellite mission technology, satellite images can be used for rapid mapping of regions of interest, with a high geometric positional accuracy. Some operational aspects of the use of earth observation information for integration of data for disaster preparedness and risk assessment are emphasized in this research. The demand for emergency response crisis information on civil endangerment has considerably increased in recent years on a global scale.
1.2 Problem Statement and Justification
The casualties and property losses caused by TCs are the most damaging natural hazards for coastal residents. The difficulties of locating and monitoring the eyes of TCs in the previous research are caused by thick cloud obstructions for optical images, especially during the formation stage of a TC, which is of importance in determining the evolution process. Simple
2
Chapter Introduction sketchy information makes it difficult to know where TCs are likely to make landfall. The public should be able to be warned of the significance of the potential danger of a TC. Detailed descriptions of TC eye, such as location, size and shape, are the crucial information that provide meteorologists with adequate evidence to interpret and predict its intensity and strength variation, and thus determine where TCs might head next, as well the prediction of the Category.
If it attains Category 5, the highest state of weather alert should be issued. Extracting TC eye areas automatically is challenging and critical to determining the trend in the TC wavenumber or category. The reason for this is that the evolution of TC’s category is highly correlated with its intensity, which corresponds to its destructive effect (Li et al., 2013, Li et al., 2012).
In the TC case study of this thesis, exploiting mathematical morphological methods to efficiently improve the accuracy of TC eye extraction is a major objective concerned for comparison with wavelet analysis in charactering TC eyes (Du and Vachon, 2003) in Chapter 5.
Although, the proposed morphological method that aims at extracting TC eye areas has been widely employed for image recognition and analysis for calculating the geometric features of shape and structure, its limitations cannot be avoided because of the sensitivity of speckle noise in SAR image. The noise along the edges of TC eyes generates redundant skeleton branches, resulting in extra erroneous areas in the shape reconstruction step. Therefore an effective technique is required to overcome this instability of the skeleton with the purpose of drastically reducing these redundant segments while preserving the significant skeleton information, in order to present an accurate final shape outcome.
Floods are some of the most devastating, worldwide and frequent disasters, and hence are responsible for enormous financial loss and personal casualty. With its long coastline, Australia is more accessible and susceptible to the influences of extreme weather, such as tropical cyclones developed over the oceans. Coastal residents suffer from huge destruction from cyclones; indeed a large portion of tropical cyclones usually give rise to flooding as well. The thesis will investigate the application of satellite image data for defining the boundaries of water bodies that would be suitable for investigating the extent of flood disasters. 3
Chapter Introduction
Remote sensing is a technology that is potentially well-suited to the provision of spatial information and knowledge in a timely fashion by assisting disaster risk management and assessment. Nevertheless, in the past the spatial resolution constraints have limited the usefulness of SAR imagery for monitoring water bodies and extracting their edges. First of all, a number of studies have been conducted into the use of SAR data for mapping water bodies and the extent of flood events; however those studies have in general been based on relatively low resolution SAR imagery compared with fine resolution optical data.
Secondly, image enhancement is another problem needing addressing, because it will produce a poor result in SAR image when the boundaries of flood areas are extracted based on the proposed watershed transformation. When image contrast is inferior, detailed edge information cannot be maintained, while it may also result in oversegmentation with a great number of trivial areas. By contrast, overly high contrast ratios will yield appropriate segmentation at the expense of edge detail loss. Thus, a suitable image enhancement approach is required to be implemented in the pre-processing step.
Thirdly, a common issue with the proposed application of watershed segmentation is oversegmentation, thanks to the inevitable SAR speckle noise. Moreover, the oversegmentation, presented as enormous redundant classified regions, may also result from the irregularities of the gradient image generated from SAR image.
1.3 Objectives and Contributions of Research
In this research novel techniques are presented to support emergency response after catastrophic events in an automatic way, using different SAR sensor imagery to investigate the visible water body over ocean surface and inland areas.
The expected benefits of the research and major contributions are listed as follows:
4
Chapter Introduction
1. For the TC case study, to detect the TC eyes areas, two satellite imaging radar sensors intended for this purpose are Radarsat-1 (launched in November 1995, provided by Canada
Space Agency) and Envisat ASAR (Advanced Synthetic Aperture Radar, launched in 1 March
2002). Medium spatial resolution data products from these sensors have been studied to assess, and in particular to establish the most appropriate system characteristics for their potential application for representing and extraction of the characteristics of TC eye areas on the ocean surface.
In Chapter 5, adaptive filters UAF is used for suppress the speckle noise in the SAR data, and the textural information is well-maintained. Classic Otsu automatic threshold selection is implemented by separating the TC eye and non-eye areas of followed by noise reduction as a simple but effective image enhancement approach. The skeletons produced by morphological skeleton are solved by applying skeleton pruning based on discrete curve evolution (DCE) on ocean SAR images with meaningful branches preserved. The key contribution of this TC case study is to achieve a better estimate of TC eye extraction with relative accuracy of 92% (six ocean SAR hurricane events included) and have been compared with the previous methods of extracting TC eye areas.
2. For the water body detection case study, airborne IFSAR system consists of SAR sensor with two radar antennas and the GNSS/INS components, with high spatial resolution of 63 cm and is used primarily for the improving the accuracy of the detected river edge. The water body areas of interest are located in Mildura, Victoria, Australia. In the pre-processing, introducing median filter reduces the high frequency noise with the IFSAR image without losing corresponding textural information of water body boundary. In this case study, morphological top-hat transformation is exploited as a pre-processing technique to improve segmentation quality in the following steps.
Furthermore, introducing a marker-controlled morphological watershed segmentation method is used to address the oversegmentation problem by labelling the inner and outer marking
5
Chapter Introduction constraints, providing an automatic extraction method under an unsupervised situation with better accuracy of extraction of water body boundaries. The major contribution of this case study is to provide an efficiency comparison of marked-controlled watershed algorithm and
Canny edge detection with purpose of generating an appropriate segmented map associated with detection of water body edges.
1.4 Thesis Organization
By identifying key problems in TC eye extraction and water body detection based on different mathematical morphology methods, this thesis presents corresponding solutions in each chapter.
The structure of this thesis is organized as follows:
Chapter 2
This chapter is an overview of basic principles of active remote sensing systems, with regard to spatial resolution, characteristics of radar backscattering and speckle noise reduction. It is essential to review these fundamentals, since the data pre-processing is mainly dependent on understanding the characteristics of SAR images. Based on the knowledge of SAR system, this chapter examines SAR data carefully by analysing the texture characteristics, contrast of grey scales and coherent speckle noise.
Chapter 3
Fundamentally, mathematical morphology has been used extensively for image analysis in remote sensing for computing geometric shape and structure of features. Mathematical morphology focuses on the geometric characteristics of an object, by setting the proper structure element. The rest of this chapter introduces the mathematical morphology methods consisting of
6
Chapter Introduction skeletonization, pruning, shape reconstruction and watershed transformation. Also a comparison of different classic edge detection methods is given in this chapter.
Chapter 4
Furthermore, the literature review concentrates on previous research methods of water body detection over ocean tropical cyclones and inland flood mapping methodologies. By reviewing the research concerns of previous studies, advantages and limitations are presented with the aim of seeking knowledge gaps in the current work.
Chapter 5
Optimization of pattern recognition is the major issue that has to be address in order to increase the accuracy rate of conventional classification approaches. Two case studies, the methodologies of TC study and water body detection is examined in detail, and as well as the experimental results of each case study will be discussed in this chapter. The proposed results can achieve higher accuracies compared with general image classification approaches.
Chapter 6
This chapter draws conclusion of this study by carefully examining the experimental results and validation. The advantage of the methodology is discussed in detail with statistical estimations derived from the previous chapters. The main idea is to demonstrate the advantages of computer vision and pattern recognition methods for extracting areas of interest over the active and passive remote sensing images. Also, some limitations of this study are described to provide research directions for future work.
7
Chapter Principles of Synthetic Aperture Radar (SAR) System
Chapter 2 Principles of Synthetic
Aperture Radar (SAR) System
Chapter Principles of Synthetic Aperture Radar (SAR) System
2. Principles of Synthetic Aperture Radar (SAR) System
2.1 Basic Principles of Imaging Radar Systems
Radar is an abbreviation for Radio Detection and Ranging, which is an active technique in remote sensing that: transmits microwave pulses of electromagnetic energy at a high pulse repetition frequency (PRF), records the echoes of the returned pulses from a target by an antenna and displays the echoes as an image (Fernandes et al., 2013). Remote sensing radars can be divided into imaging or non-imaging radars, i.e. microwave radiometer, microwave altimeter and laser etc. In this chapter, imaging radar systems are the main focus.
Imaging radar systems, being active sensors, transmit their own microwave illumination and measure the return energy from a target, whilst optical sensors are passive and depend on illumination from sun or thermal radiation sources. The measurement of the round trip travel time of the microwave pulses from and back to the antenna is used to determine the distance to the target (Figure 2.1). The scanning of the Earth’s surface is accomplished to the side of the platform, either an aircraft or satellite, at right angles to the flight line.
Imaging radar systems provide a two-dimensional representation of the returned signal from the ground surface, which differs from data acquired by radar altimeters and scatterometers in non- imaging radar systems. For instance, radar altimeters look straight down at nadir below the platform and measure altitude or elevation by transmitting short microwave pulses and calculating the round trip time delay to objects. They are typically carried on aircraft for altitude determination, or on aircraft and satellites for topographic mapping and sea surface height estimation. Scatterometers record one-dimensional measurements of the radar energy backscatter cross section (BCS) of an object on the earth’s surface with precise quantitative measurements of energy backscattered from objects. The amount of energy backscattered is dependent on the surface properties, such as surface roughness, and the angle at which the microwave energy strikes the object . 9
Chapter Principles of Synthetic Aperture Radar (SAR) System
Figure 2.1 has been removed due to Copyright restrictions.
Figure 2.1 (a) Illustration of a spaceborne SAR viewing geometry; (b) Principle of SAR systems. Object points , and on the ground are less frequently viewed at near range than from far range. Hence, point has a proportional shorter effective antenna length, . (image credit: NASA/JPL)
Initially, imaging radar systems were based on so-called real aperture side-looking airborne systems (SLAR), but the physical size of the antenna was the determining factor of azimuth (in flight direction) resolution in such systems. Therefore a very long antenna was required to achieve high azimuth resolution. Therefore, synthetic aperture radar (SAR) systems were designed to overcome the azimuth resolution problem. SAR systems synthesize a very long antenna, by continuously receiving the reflected signals from the same target as the platform progresses over the terrain. Using Doppler shifts of the received signals the azimuth resolution of SAR images can be shown to be approximately equal to /2, where L is the actual length of the antenna on the platform. This means that the resolution of the images will improve as the antenna increases in size. In addition, the resolution is independent of the elevation of the platform and the frequency of propagation. The azimuth resolution is constrained by the complexity of the radar system. For spaceborne SAR sensors the footprint is a constrained area or swath scanned by the signal. Successive swaths enable imaging of the area of interest.
The range of wavelengths covered by radar remote sensing systems varies from about 0.75 cm to 1 m. Radar systems are divided into several categories according to their wavelengths (shown in Table 2.1). Each band has its own characteristics with respect to ground feature detection. X-,
C- and L-bands are typically used on spaceborne radar systems. Owing to the fact that shorter wavelength microwave signals can be transmitted more effectively through the atmosphere and especially clouds, radar sensors with C- and L-band are suitable for earth observation purposes
(Aguirre-Salado et al., 2012). This property also applies to X-band radar, except in the case when precipitation occurs, such as in the case of heavy rain or hailstorms etc. (Bueno et al.,
2012). 10
Chapter Principles of Synthetic Aperture Radar (SAR) System
Table 2.1 Frequency and wavelength relationships (Hensley and Madsen, 2007). Frequency Band (MHz) Wavelength Range (cm) Band Identification
26,500 – 40,000 1.13 – 0.75 Ka
18,000 - 26,500 1.66 – 1.13 K
12,500 – 18,000 2.4 – 1.66 Ku
8,000 - 12,500 3.75 – 2.4 X
4,000- 8,000 7.5 – 3.75 C
2,000 - 4,000 15 – 7.5 S
1,000 - 2,000 30 – 15 L
300 - 900 100 -33 P or UHF *
30 - 300 1,000 – 100 VHF *
3 - 30 10, 000 – 1,000 HF *
* UHF (Ultra High Frequency); VHF (Very High Frequency); HF (High Frequency)
It is relevant to compare imaging radar systems with optical remote sensing sensors, also namely passive sensors, which detect the reflected or emitted electromagnetic radiation from natural sources. Passive sensors acquire high resolution optical images in the visible and near infrared regions of the electromagnetic spectrum, which can be used for many remote sensing applications including the detection of water bodies and flood extents which is one of the focusses of this thesis. The extraction of surface characteristics depends on the detection of images covering different ranges of wavelengths as summarized briefly in the in the Table 2.2.
Studies have verified the effectiveness of radar images for mapping flood areas as described in
Chapter 4.
11
Chapter Principles of Synthetic Aperture Radar (SAR) System
Table 2.2 Electromagnetic (EMR) spectrum of interest to remote sensing
Electromagnetic Principle Use and Some Characteristics Imaging Systems Spectrum region Blue (0.455-0.492 µm), water body penetration and forest-type mapping
Green (0.492-0.577µm), green reflectance peak in Optical imagery, vegetation; plant vigour assessment panchromatic, Visible colour and false 0.4–0.7 µm Red (0.62-0.78µm), chlorophyll absorption, colour image, discrimination of vegetation type and man-made features,
such as buildings and roads.
High atmospheric scattering effect. Most EMR is reflected solar radiation therefore only used in day-light. High reflectance of vegetation. Discrimination of Near Infrared (NIR) Infrared imagery. vegetation type, density and biomass content; water 0.7–3.0 µm absorption and degree of soil moisture; NIR image can detect minerals in the 2.2 to 2.4 µm region. Medium Infrared As above Vegetation moisture content and soil moisture (MIR) 3.0–8.0 µm Vegetation stress analysis and soil moisture Thermal discrimination As above 8.0–15.0 µm Predominantly radiation emitted by the earth and atmosphere. Major areas of application in this thesis are to use sensors at different frequencies for land and ocean using C-band (5.3GHz, wavelength of 5.6cm) ocean SAR image and X-band (wavelength of 3cm) IFSAR image. Radar, Side Looking Microwave Air-borne Radar Inland the microwave sensors can be used for studying 1 mm–100 cm (SLAR), radiometer water bodies, snow and ice, crops, forest cover, soil moisture and soil types. For ocean applications, radar SAR images can be used for determination of ocean waves, wind vector and direction, sea ice extent and motion and sea surface temperature, etc.
The capabilities of SAR sensors therefore surpass those of passive sensor-based imagery in certain conditions because of:
(1) Their all -weather capability (small sensitivity to clouds and light rain) as well as day
and night operations (independence of sun illumination), and increasing availability of
satellite missions, enable mapping of large areas for multi -purpose tasks.
(2) The response in the different radar wavelengths corresponds to different surface
roughness (i.e. biomass, water bodies and land) and sensitivity to dielectric constants,
thus enabling the interpretation of terrain cover characteristics.
12
Chapter Principles of Synthetic Aperture Radar (SAR) System
(3) Different polarizations of SAR images, which are a function of the design of the
antenna, can enable the acquisition of images with different polarizations thus providing
more information about the earth’s surface characteristics with accurate measurements
of distance.
Although, there are unique capabilities of SAR sensors as mentioned above, there are still the drawbacks listed below, that will be discussed in the following sections:
• Complex interactions (marginal atmospheric effects Figure 2.2)
• Speckle effects (difficulty in visual interpretation)
• Topographic effects (the side looking SAR is extremely sensible to the relief)
• Effect of surface roughness
Figure 2.2 has been removed due to Copyright restrictions.
Figure 2.2 Illustration of marginal atmospheric effects in Advanced Synthetic Aperture Radar (ASAR) (Agent, 2000)
2.1.1 SAR Wavelength
The wavelength of a SAR system is the determining factor for backscattering characteristics of pulsed signal transmission (Lillesand et al., 2004). The relationship between wavelength (cm) and frequency (Hz), the primary parameters in radar imaging systems, (Table 2.1), is defined by: