CHEN Lifu,LONG Fengqi,LI Zhenhong,et al.Multi-level Feature Attention Fusion Network for Water Extraction from Multi-source SAR Images[J].Geomatics and Information Science of Wuhan University,2025,50(7):1339-1345.
CHEN Lifu,LONG Fengqi,LI Zhenhong,et al.Multi-level Feature Attention Fusion Network for Water Extraction from Multi-source SAR Images[J].Geomatics and Information Science of Wuhan University,2025,50(7):1339-1345.DOI:10.13203/j.whugis20230041
Multi-level Feature Attention Fusion Network for Water Extraction from Multi-source SAR Images
water extraction from single frequency-band synthetic aperture radar (SAR) images has achieved great success. However
due to the large differences in the characteristics of water bodies and other surface targets in SAR images with different frequency-bands
deep learning network designed for single frequency-band has poor extraction accuracy when applied to SAR images with different frequency bands. So
how to achieve excellent extraction performance for water automatically from multi-source SAR images is still a challenge.
Methods
2
We propose a new network framework
namely multi-level feature attention fusion network (MFAFNet). The network consists of encoder and decoder. The encoder utilizes ResNet-101 to generate four-level features with different resolutions
which are then processed in parallel by the intermediate level feature fusion module and efficient channel atrous spatial pyramid pooling module
and the intermediate and high-level features are output after deep fusion. The attention modulation module attention mechanism is introduced into decoder to distribute the weight of low-level features
then which are further fused with the high-level features from the encoder to obtain the water extraction results.
Results
2
Experiments are carried out on SAR images with different frequency bands and resolutions (Sentinel-1
TerraSAR and Gaofen-3)
and three good networks have been compared. The results show that the MFAFNet extraction effect is obviously better than other networks
with an average pixel accuracy of 87% and an average intersection over union of 0.80.
Conclusions
2
The water body extraction from multi-band and multi-resolution SAR images is achieved
which promotes the practical application value of deep learning network in water body detection.
关键词
Keywords
references
MARTINIS S , GROTH S , WIELAND M , et al . Towards a Global Seasonal and Permanent Reference Water Product from Sentinel-1/2 Data for Improved Flood Mapping [J]. Remote Sensing of Environment , 2022 , 278 : 113077 .
CHEN L F , ZHANG P , XING J , et al . A Multi-scale Deep Neural Network for Water Detection from SAR Images in the Mountainous Areas [J]. Remote Sensing , 2020 , 12 ( 19 ): 3205 .
ZHANG P , CHEN L F , XING J , et al . Water and Shadow Extraction in SAR Image Based on a New Deep Learning Network [J]. Sensors , 2019 , 19 ( 6 ): 3576 .
XIE C , HUANG X , ZENG W X , et al . A Novel Water Index for Urban High-Resolution Eight-Band WorldView-2 Imagery [J]. International Journal of Digital Earth , 2016 , 9 ( 10 ): 925 - 941 .
YAO F F , WANG C , DONG D , et al . High-Resolution Mapping of Urban Surface Water Using ZY-3 Multi-spectral Imagery [J]. Remote Sensing , 2015 , 7 ( 9 ): 12336 - 12355 .
LECUN Y , BENGIO Y , HINTON G . Deep Learning [J]. Nature , 2015 , 521 ( 7553 ): 436 - 444 .
LI Z Y , WANG R , ZHANG W , et al . Multiscale Features Supported DeepLabV3+ Optimization Scheme for Accurate Water Semantic Segmentation [J]. IEEE Access , 2019 , 7 : 155787 - 155804 .
DUAN L H , HU X Y . Multiscale Refinement Network for Water-Body Segmentation in High-Resolution Satellite Imagery [J]. IEEE Geoscience and Remote Sensing Letters , 2020 , 17 ( 4 ): 686 - 690 .
LI Y S , DANG B , ZHANG Y J , et al . Water Body Classification from High-Resolution Optical Remote Sensing Imagery: Achievements and Perspectives [J]. ISPRS Journal of Photogrammetry and Remote Sensing , 2022 , 187 : 306 - 327 .
CHU Z Q , TIAN T , FENG R Y , et al . Sea-Land Segmentation with ResUNet and Fully Connected CRF [C]// IEEE International Geoscience and Remote Sensing Symposium , Yokohama, Japan , 2019 .
QIN Xingli , YANG Jie , LI Pingxiang , et al . Water Body Extraction from Multi-temporal Polarimetric SAR Images Based on Transfer Learning [J]. Geomatics and Information Science of Wuhan University , 2022 , 47 ( 7 ): 1093 - 1102 .
SUI Haigang , CHEN Guang , HU Chuanwen , et al . Integrated Segmentation, Registration and Extraction Method for Water-Body Using Optical Remote Sensing Images and GIS Data [J]. Geomatics and Information Science of Wuhan University , 2016 , 41 ( 9 ): 1145 - 1150 .
HE K M , ZHANG X Y , REN S Q , et al . Deep Residual Learning for Image Recognition [C]// IEEE Conference on Computer Vision and Pattern Recognition , Las Vegas, USA , 2016 .
WANG Q L , WU B G , ZHU P F , et al . ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networks [C]//IEEE/CVF Conferen‑ce on Computer Vision and Pattern Recognition, Seattle, WA, USA , 2020 .
CAI X M , CHEN L F , XING J , et al . Automatic Extraction of Layover from InSAR Imagery Based on Multilayer Feature Fusion Attention Mechanism [J]. IEEE Geoscience and Remote Sensing Letters , 2021 , 19 : 4017705 .
CHEN L F , LUO R , XING J , et al . Geospatial Transformer Is What You Need for Aircraft Detection in SAR Imagery [J]. IEEE Transactions on Geoscience and Remote Sensing , 2022 , 60 : 5225715 .
LUO R , CHEN L F , XING J , et al . A Fast Aircraft Detection Method for SAR Images Based on Efficient Bidirectional Path Aggregated Attention Network [J]. Remote Sensing , 2021 , 13 ( 15 ): 2940 .
QIN J , WU J , XIAO X F , et al . Activation Modulation and Recalibration Scheme for Weakly Supervised Semantic Segmentation [J]. Proceedings of the AAAI Conference on Artificial Intelligence , 2022 , 36 ( 2 ): 2117 - 2125 .
CHEN L C , ZHU Y K , PAPANDREOU G , et al . Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation [C]// The European Conference on Computer Vision , Munich, Germany , 2018 .
XIE E Z , WANG W H , YU Z D , et al . SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers [J]. Advances in Neural Information Processing Systems , 2021 , 34 : 12077 - 12090 .