1.北京石油化工学院,北京,102617
2.武汉大学遥感信息工程学院,湖北 武汉,430079
3.北京市水利规划设计研究院,北京,100048
虞欣,博士,教授,研究方向为影像解译、人工智能和贝叶斯统计等。china_yuxin@163.com
李林宜,博士,副教授。lilinyi@whu.edu.cn
收稿:2023-05-25,
纸质出版:2025-07-05
移动端阅览
虞欣,王鑫,郑肇葆,等.融合尺度注意力机制的高分辨率遥感影像水体提取网络[J].武汉大学学报(信息科学版),2025,50(7):1328-1338.
YU Xin,WANG Xin,ZHENG Zhaobao,et al.Water Extraction of High Spatial Resolution Remote Sensing Image Fusing Scale Attention Mechanism[J].Geomatics and Information Science of Wuhan University,2025,50(7):1328-1338.
虞欣,王鑫,郑肇葆,等.融合尺度注意力机制的高分辨率遥感影像水体提取网络[J].武汉大学学报(信息科学版),2025,50(7):1328-1338. DOI:10.13203/j.whugis20230079
YU Xin,WANG Xin,ZHENG Zhaobao,et al.Water Extraction of High Spatial Resolution Remote Sensing Image Fusing Scale Attention Mechanism[J].Geomatics and Information Science of Wuhan University,2025,50(7):1328-1338. DOI:10.13203/j.whugis20230079
近年来,水资源短缺等一系列问题日益严重,需要对水资源的数量和变化进行及时准确的监测。从遥感影像上提取的水体信息不仅可以为水体生态分析和后续的相关风险预警提供数据支撑,还可以用于缓解日益严峻的生态环境问题,并有助于所研究流域的环境演变监测、水资源保护和开发以及生态资源的可持续发展。随着机器学习和人工智能的发展,基于机器学习的水体提取方法应运而生,特别是深度学习方法具有强大的特征表征能力,它的发展给计算机视觉和影像识别等领域带来了巨大的冲击。全卷积神经网络(fully convolutional networks
FCN)作为第一个端到端的像素级预测的全卷积网络,拉开了像素级别的语义分割序幕,其他语义分割模型都是在其基础之上发展起来的。然而,在利用FCN及其变种方法进行水体提取时仍然普遍存在水陆边界不清晰等问题。针对上述问题,提出了融合尺度注意力机制的高分辨率遥感影像水体提取加权FCN(squeeze-and-excitation weighted FCN,SE-wFCN)。该方法将注意力机制应用于不同层次或尺度的语义信息来更好地融合不同层次或尺度的特征,尽可能地减少水体边界像素的误分和漏分;考虑到FCN模型的复杂性和过拟合等问题,在FCN中引入辅助分类器,进一步降低深度学习模型在学习训练阶段过拟合发生的可能性;顾及水陆边界的像素位置信息对水体提取的重要性,在损失计算中,对水体边界像素与水体内部像素的损失赋予不同的权重,引导尺度注意力机制和FCN模型更好地关注并学习水陆边界的特征信息,进而可以进一步地提高水陆边界的提取精度。以高分辨率高分一号卫星遥感影像为研究对象,将该网络与目前主流的语义分割网络进行了对比实验,结果表明,SE-wFCN比当前主流的方法(如DeepLabV3、U-Net、U2Net、MECNet、MSResNet和SADA-Net等)在水陆边界上取得了更加满意的水体提取结果。
Objectives
2
Recently
it is gradually becoming important to timely monitor the accurate distribution and change of water resource on the earth due to the shortage of water resource globally. Water extraction from remotely sensed image not only is able to provide data support for water ecosystem analysis and risk prediction
but also can alleviate the currently serious ecosystem environment and contribute to sustainable development of water resource and environment protection. Because of its powerful feature representation
deep learning has an important influence on computer vision and image recognition domains. Fully convolutional networks (FCN) is the first end-to-end fully convolutional network for image pixel-wise prediction and starts the image semantic segmentation. Hereafter
other variants of image semantic segmentation based on FCN are also put up. However
the border region between water and land is still misclassified during water extracting based on FCN or its variants. Therefore
we put up water extraction of high spatial resolution remotely sensed image fusing scale attention mechanism based on squeeze-and-excitation weighted FCN (SE-wFCN).
Methods
2
We utilize GF-1 remotely sensed image to do some experiments by comparing with FCN and its variants. The proposed method has the following contribution of three aspects: (1) In order to take advantage of attention mechanism
this method applies it to features of different scales and then fuses those features more reasonably and more scientifically to reduce the possibility of misclassification of water pixels as far as possible. (2) Due to the model complexity of FCN and its possibility of overfitting
we add one auxiliary classifier module to FCN model as one branch during the training phase
which is able to help to reduce the possibility of overfitting. (3) Considering that the border pixel's position between water and land is very important to water extraction and the position information is actually ignored when computing the loss during training phase
we pay more attention to the border pixel by putting more weight in the loss function.
Results
2
Experimental analysis shows that the proposed method is feasible and effective.
Conclusions
2
It can achieve the more satisfying of water extraction than these current popular deep learning models (i.e. DeeplLabV3
U-Net
U2Net
MECNet
MSResNet and SADA-Net)
especially in the border between water and land.
CHEN S T , LIU Y , ZHANG C . Water-Body Segmentation for Multi-spectral Remote Sensing Images by Feature Pyramid Enhancement and Pixel Pair Matching [J]. International Journal of Remote Sensing , 2021 , 42 ( 13 ): 5025 - 5043 .
吴庆双 , 汪明秀 , 申茜 , 等 . Sentinel-2遥感图像的细小水体提取 [J]. 遥感学报 , 2022 , 26 ( 4 ): 781 - 794 .
WU Qingshuang , WANG Mingxiu , SHEN Qian , et al . Small Water Body Extraction Method Based on Sentinel-2 Satellite Multi-spectral Remote Sensing Image [J]. National Remote Sensing Bulletin , 2022 , 26 ( 4 ): 781 - 794 .
眭海刚 , 陈光 , 胡传文 , 等 . 光学遥感影像与GIS数据一体化的水体分割、配准与提取方法 [J]. 武汉大学学报(信息科学版) , 2016 , 41 ( 9 ): 1145 - 1150 .
SUI Haigang , CHEN Guang , HU Chuanwen , et al . Integrated Segmentation, Registration and Extraction Method for Water-Body Using Optical Remote Sensing Images and GIS Data [J]. Geomatics and Information Science of Wuhan University , 2016 , 41 ( 9 ): 1145 - 1150 .
王小鹏 , 文昊天 , 王伟 , 等 . 形态学边缘检测和区域生长相结合的遥感图像水体分割 [J]. 测绘科学技术学报 , 2019 , 36 ( 2 ): 149 - 154 .
WANG Xiaopeng , WEN Haotian , WANG Wei , et al . Water Segmentation of Remote Sensing Image Using Morphological Edge Detection and Region Growing [J]. Journal of Geomatics Science and Technology , 2019 , 36 ( 2 ): 149 - 154 .
LÜ Y L , TIAN S W , YU L , et al . Water Body Semantic Information Description and Recognition Based on Multimodal Models [J]. International Journal of Computational Intelligence and Applications , 2019 , 18 ( 2 ): 1950015 .
SUN J Y , WANG G Z , HE G J , et al . Study on the Water Body Extraction Using GF-1 Data Based on Adaboost Integrated Learning Algorithm [J]. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences , 2020 , XLII-3/W 10 : 641 - 648 .
WANG E D , JIANG Y M , LI Y , et al . MFCSNet: Multi-scale Deep Features Fusion and Cost-Sensitive Loss Function Based Segmentation Network for Remote Sensing Images [J]. Applied Scien‑ces , 2019 , 9 ( 19 ): 4043 .
DONG S , PANG L , ZHUANG Y , et al . Optical Remote Sensing Water-Land Segmentation Representation Based on Proposed SNS-CNN Network [C]// IEEE International Geoscience and Remote Sensing Symposium , Yokohama, Japan , 2019 .
王小标 , 谢顺平 , 都金康 . 水体指数构建及其在复杂环境下有效性研究 [J]. 遥感学报 , 2018 , 22 ( 2 ): 360 - 372 .
WANG Xiaobiao , XIE Shunping , DU Jinkang . Water Index Formulation and Its Effectiveness Research on the Complicated Surface Water Surroundings [J]. Journal of Remote Sensing , 2018 , 22 ( 2 ): 360 - 372 .
种丹 , 张世强 , 李浩杰 , 等 . 基于光学遥感的湖泊水体信息提取研究进展 [J]. 人民黄河 , 2018 , 40 ( 3 ): 49 - 53 .
CHONG Dan , ZHANG Shiqiang , LI Haojie , et al . Review on the Extraction of Lake Water Body Information from Optics Remote Sensing Data [J]. Yellow River , 2018 , 40 ( 3 ): 49 - 53 .
MCFEETERS S K . The Use of the Normalized Difference Water Index (NDWI) in the Delineation of Open Water Features [J]. International Journal of Remote Sensing , 1996 , 17 ( 7 ): 1425 - 1432 .
XU H Q . Modification of Normalised Difference Water Index (NDWI) to Enhance Open Water Features in Remotely Sensed Imagery [J]. International Journal of Remote Sensing , 2006 , 27 ( 14 ): 3025 - 3033 .
曹荣龙 , 李存军 , 刘良云 , 等 . 基于水体指数的密云水库面积提取及变化监测 [J]. 测绘科学 , 2008 , 33 ( 2 ): 158 - 160 .
CAO Ronglong , LI Cunjun , LIU Liangyun , et al . Extracting Miyun Reservoir’s Water Area and Monitoring Its Change Based on a Revised Normalized Different Water Index [J]. Science of Surveying and Mapping , 2008 , 33 ( 2 ): 158 - 160 .
DANAHER T , COLLETT L . Development,Optimisation and Multi-temporal Application of aA Simple Landsat Based Water Index [C]// The 13th Australasian Remote Sensing and Photogrammetry Conference , Canberra,Australia , 2024 .
FISHER A , FLOOD N , DANAHER T . Comparing Landsat Water Index Methods for Automated Water Classification in Eastern Australia [J]. Remote Sensing of Environment , 2016 , 175 : 167 - 182 .
丁凤 . 基于新型水体指数(NWI)进行水体信息提取的实验研究 [J]. 测绘科学 , 2009 , 34 ( 4 ): 155 - 157 .
DING Feng . Study on Information Extraction of Water Body with a New Water Index(NWI) [J]. Science of Surveying and Mapping , 2009 , 34 ( 4 ): 155 - 157 .
万建鹏 , 官云兰 , 叶素倩 , 等 . 基于综合权重水体指数的水体提取研究: 以鄱阳湖为例 [J]. 东华理工大学学报(自然科学版) , 2015 , 38 ( 2 ): 206 - 211 .
WAN Jianpeng , GUAN Yunlan , YE Suqian , et al . Water Extraction Based on Comprehensive Weight Water Index: A Case Study in Region of Poyang Lake [J]. Journal of East China University of Technology (Natural Science) , 2015 , 38 ( 2 ): 206 - 211 .
FEYISA G L , MEILBY H , FENSHOLT R , et al . Automated Water Extraction Index: A New Technique for Surface Water Mapping Using Landsat Imagery [J]. Remote Sensing of Environment , 2014 , 140 : 23 - 35 .
巫兆聪 , 喻文蕴 . 不同地表覆盖下SPOT-7影像大气校正方法研究 [J]. 测绘地理信息 , 2021 , 46 ( 2 ): 7 - 12 .
DU Jinkang , HUANG Yongsheng , FENG Xuezhi , et al . Study on Water Bodies Extraction and Classification from SPOT Image [J]. Journal of Remote Sensing , 2001 , 5 ( 3 ): 214 - 219 .
WANG B , CHEN Z L , WU L , et al . SADA-Net: A Shape Feature Optimization and Multiscale Context Information-Based Water Body Extraction Method for High-Resolution Remote Sensing Images [J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing , 2022 , 15 : 1744 - 1759 .
洪亮 , 黄雅君 , 杨昆 , 等 . 复杂环境下高分二号遥感影像的城市地表水体提取 [J]. 遥感学报 , 2019 , 23 ( 5 ): 871 - 882 .
HONG Liang , HUANG Yajun , YANG Kun , et al . Study on Urban Surface Water Extraction from Heterogeneous Environments Using GF-2 Remotely Sensed Images [J]. Journal of Remote Sensing , 2019 , 23 ( 5 ): 871 - 882 .
LONG J , SHELHAMER E , DARRELL T . Fully Convolutional Networks for Semantic Segmentation [C]// IEEE Conference on Computer Vision and Pattern Recognition , Boston, MA, USA, 2015 .
BADRINARAYANAN V , KENDALL A , CIPOLLA R . SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence , 2017 , 39 ( 12 ): 2481 - 2495 .
RONNEBERGER O , FISCHER P , BROX T . U-Net: Convolutional Networks for Biomedical Image Segmentation [C]// The 18th International Conferen‑ ce on Medical Image Computing and Computer-Assisted Intervention, Munich, Germany , 2015 .
张兵 . 遥感大数据时代与智能信息提取 [J]. 武汉大学学报(信息科学版) , 2018 , 43 ( 12 ): 1861 - 1871 .
ZHANG Bing . Remotely Sensed Big Data Era and Intelligent Information Extraction [J]. Geomatics and Information Science of Wuhan University , 2018 , 43 ( 12 ): 1861 - 1871 .
陈志坤 , 江俊君 , 姜鑫维 , 等 . 一种基于改进双边滤波的鲁棒高光谱遥感图像特征提取方法 [J]. 武汉大学学报(信息科学版) , 2020 , 45 ( 4 ): 504 - 510 .
CHEN Zhikun , JIANG Junjun , JIANG Xinwei , et al . Robust Hyperspectral Image Feature Extraction Based on Improved Bilateral Filtering [J]. Geomatics and Information Science of Wuhan University , 2020 , 45 ( 4 ): 504 - 510 .
ZHANG Z L , LU M , JI S P , et al . Rich CNN Features for Water-Body Segmentation from very High Resolution Aerial and Satellite Imagery [J]. Remote Sensing , 2021 , 13 ( 10 ): 1912 .
DANG B , LI Y S . MSResNet: Multiscale Residual Network via Self-Supervised Learning for Water-Body Detection in Remote Sensing Imagery [J]. Remote Sensing , 2021 , 13 ( 16 ): 3122 .
陈立福 , 龙凤琪 , 李振洪 , 等 . 面向多源SAR图像的多级特征注意力水体提取网络 [J]. 武汉大学学报(信息科学版) , 2023 , DOI: 10.13203/j.whugis20230041 http://dx.doi.org/10.13203/j.whugis20230041 .
CHEN Lifu , LONG Fengqi , LI Zhenhong , et al . Multi-level Feature Attention Water Body Extraction Network for Multi-source SAR Images [J]. Geomatics and Information Science of Wuhan University , 2023 , DOI: 10.13203/j.whugis20230041 http://dx.doi.org/10.13203/j.whugis20230041 .
覃星力 , 杨杰 , 李平湘 , 等 . 迁移学习用于多时相极化SAR影像的水体提取 [J]. 武汉大学学报(信息科学版) , 2022 , 47 ( 7 ): 1093 - 1102 .
QIN Xingli , YANG Jie , LI Pingxiang , et al . Water Body Extraction from Multi-temporal Polarimetric SAR Images Based on Transfer Learning [J]. Geomatics and Information Science of Wuhan University , 2022 , 47 ( 7 ): 1093 - 1102 .
闫利 , 周建彤 . 单张无人机影像水体高光自动检测与补偿方法 [J]. 武汉大学学报(信息科学版) , 2018 , 43 ( 10 ): 1511 - 1517 .
YAN Li , ZHOU Jiantong . A Method for Automatic Water High Light Detection and Removal in Single UAV Image [J]. Geomatics and Information Science of Wuhan University , 2018 , 43 ( 10 ): 1511 - 1517 .
眭海刚 , 陈光 , 胡传文 , 等 . 光学遥感影像与GIS数据一体化的水体分割、配准与提取方法 [J]. 武汉大学学报(信息科学版) , 2016 , 41 ( 9 ): 1145 - 1150 .
SUI Haigang , CHEN Guang , HU Chuanwen , et al . Integrated Segmentation, Registration and Extraction Method for Water-Body Using Optical Remote Sensing Images and GIS Data [J]. Geomatics and Information Science of Wuhan University , 2016 , 41 ( 9 ): 1145 - 1150 .
徐川 , 华凤 , 眭海刚 , 等 . 多尺度水平集SAR影像水体自动分割方法 [J]. 武汉大学学报(信息科学版) , 2014 , 39 ( 1 ): 27 - 31 .
XU Chuan , HUA Feng , SUI Haigang , et al . Automatic Water Segmentation Method in SAR Images Using Multi-scale Level Set [J]. Geomatics and Information Science of Wuhan University , 2014 , 39 ( 1 ): 27 - 31 .
0
浏览量
0
下载量
0
CSCD
关联资源
相关文章
相关作者
相关机构
京公网安备11010802024621