1.西南交通大学地球科学与工程学院,四川 成都,611756
2.西南交通大学桥梁智能与绿色建造全国重点实验室,四川 成都,611756
朱军,博士,教授,研究方向为虚拟地理环境与灾害场景建模。vgezj@163.com
游继钢,博士。vgeyjg523@my.swjtu.edu.cn
收稿:2025-01-05,
纸质出版:2025-06-05
移动端阅览
朱军,丁永哲,游继钢,等.结构语义特征约束的地震灾害AR场景精准建模方法[J].武汉大学学报(信息科学版),2025,50(6):1126-1136.
ZHU Jun,DING Yongzhe,YOU Jigang,et al.An Accurate Modeling Method of Earthquake Disaster AR Scene Constrained by Structural Semantic Features[J].Geomatics and Information Science of Wuhan University,2025,50(6):1126-1136.
朱军,丁永哲,游继钢,等.结构语义特征约束的地震灾害AR场景精准建模方法[J].武汉大学学报(信息科学版),2025,50(6):1126-1136. DOI:10.13203/j.whugis20240276
ZHU Jun,DING Yongzhe,YOU Jigang,et al.An Accurate Modeling Method of Earthquake Disaster AR Scene Constrained by Structural Semantic Features[J].Geomatics and Information Science of Wuhan University,2025,50(6):1126-1136. DOI:10.13203/j.whugis20240276
地震灾害具有突发性强、环境复杂等特点,增强现实(augmented reality
AR)场景建模对地震灾害应急救援具有重要意义。现有AR场景建模方法在地震灾害场景下存在特征提取不准确、虚实融合建模精度低的问题,难以实现环境复杂的地震灾害现场AR场景精准建模。因此,提出结构语义特征约束的地震灾害AR场景精准建模方法,首先,剖析地震灾害场景特征,构建地震灾害现场结构语义特征库;其次,提出结构语义约束的地震灾害虚实特征提取方法,提高虚实图像特征提取精准度;然后,基于虚实特征提取结果进行地震灾害AR场景虚实建模;最后,选择受损建筑作为实验案例进行分析。实验结果表明,结构语义约束的地震灾害虚实特征提取方法
F
1分数达90%,优化后的AR场
景配准误差较直接建模方法降低了80%。所提方法实现了地震灾害AR场景的精准建模,为地震灾害应急救援提供了数字化场景支撑。
Objectives
2
Earthquake disaster has become one of the natural disasters that pose a great threat to human society
and it puts forward high requirements for the efficiency and accuracy of emergency rescue. Augmented reality (AR) technology can provide more intuitive decision-making support for rescue personnel by integrating virtual information into the real scene. However
the existing AR scene modeling technologies face challenges in the complex environment of earthquake disaster.
Methods
2
This paper proposes an accurate modelling method for earthquake disaster AR scenes with structural semantic feature constraints. First
the characteristics of earthquake disaster scenes are analyzed
and the semantic feature library of earthquake disaster scene structure is constructed. Second
the virtual-real feature extraction of earthquake disasters with structural semantic constraints is proposed to improve the accuracy of virtual-real image feature extraction. Then
the virtual-real modelling of the earthquake disaster AR scene is carried out based on the results of virtual-real feature extraction. Finally
the damaged buildings are selected as the experimental case area for experimental analysis.
Results
2
Experimental results indicate that the proposed method achieves an
F
1 score of 90% for earthquake disaster feature extraction based on structural semantic constraints. The optimized AR scene registration error has been reduced by 80% compared to the direct modeling method.
Conclusions
2
The findings demonstrate that the proposed method can effectively extract and match virtual-real features
leading to accurate AR scene modelling for earthquake disaster scenarios. At the same time
the proposed method has important application potential for improving the accuracy and reliability of AR applied to disaster emergency response
and can assist on-site rescue personnel to obtain more accurate disaster information.
刘恩东 , 陈子豪 . “一带一路” 自然灾害防治和应急管理国际合作机制建设与中国方案 [J]. 中国减灾 , 2024 ( 8 ): 43 - 46 .
LIU Endong , CHEN Zihao . Construction of An International Cooperation Mechanism for Natural Disaster Prevention and Emergency Management on the “Belt and Road” and China's Program [J]. Disaster Reduction in China , 2024 ( 8 ): 43 - 46 .
陆明勇 , 赵晓霞 , 韩珂 , 等 . 分析灾害现场特征提升救援行动效率 [J]. 中国减灾 , 2023 ( 9 ): 51 - 53 .
LU Mingyong , ZHAO Xiaoxia , HAN Ke , et al . Analyze the Characteristics of the Disaster Site to Improve the Efficiency of Rescue Operations [J]. Disaster Reduction in China , 2023 ( 9 ): 51 - 53 .
新华社 . 国务院印发《“十四五” 国家应急体系规划》 [J]. 中国应急管理 , 2022 ( 2 ): 4 .
Xinhua News Agency . The State Council Issued the National Emergency Response System Plan for the Fourteenth Five-Year Plan [J]. China Emergency Management , 2022 ( 2 ): 4 .
朱军 , 付林 , 李维炼 , 等 . 知识引导的滑坡灾害场景动态表达方法 [J]. 武汉大学学报(信息科学版) , 2020 , 45 ( 8 ): 1255 - 1262 .
ZHU Jun , FU Lin , LI Weilian , et al . Knowledge-Guided Dynamic Representation Method of Landslide Disaster Scene [J]. Geomatics and Information Science of Wuhan University , 2020 , 45 ( 8 ): 1255 - 1262 .
李维炼 , 朱军 , 张昀昊 , 等 . 空间语义约束的泥石流灾害VR场景融合建模及交互方法 [J]. 武汉大学学报(信息科学版) , 2020 , 45 ( 7 ): 1073 - 1081 .
LI Weilian , ZHU Jun , ZHANG Yunhao , et al . A Fusion Modeling and Interaction Method with Spatial Semantic Constraint for Debris Flow VR Scene [J]. Geomatics and Information Science of Wuhan University , 2020 , 45 ( 7 ): 1073 - 1081 .
申申 , 龚建华 , 李文航 , 等 . 基于虚拟亲历行为的空间场所认知对比实验研究 [J]. 武汉大学学报(信息科学版) , 2018 , 43 ( 11 ): 1732 - 1738 .
SHEN Shen , GONG Jianhua , LI Wenhang , et al . A Comparative Experiment on Spatial Cognition Based on Virtual Travel Behavior [J]. Geomatics and Information Science of Wuhan University , 2018 , 43 ( 11 ): 1732 - 1738 .
周忠 , 周颐 , 肖江剑 . 虚拟现实增强技术综述 [J]. 中国科学: 信息科学 , 2015 , 45 ( 2 ): 157 - 180 .
ZHOU Zhong , ZHOU Yi , XIAO Jiangjian . Survey on Augmented Virtual Environment and Augmented Reality [J]. Scientia Sinica Informationis , 2015 , 45 ( 2 ): 157 - 180 .
徐静 . 面向应急救援的可穿戴智能装备设计研究 [J]. 包装工程 , 2023 , 44 ( 24 ): 123 - 130 .
XU Jing . Design of Wearable Intelligent Equipment for Emergency Rescue [J]. Packaging Engineering , 2023 , 44 ( 24 ): 123 - 130 .
周东波 , 秦政 , 陈言言 , 等 . 通视受限下视锥剖分的移动增强现实注册策略 [J]. 武汉大学学报(信息科学版) , 2018 , 43 ( 8 ): 1178 - 1184 .
ZHOU Dongbo , QIN Zheng , CHEN Yanyan , et al . Registration Strategy for Mobile Augmented Reality Based on Cone-View Partition Under the Restricted Visibility Environment [J]. Geomatics and Information Science of Wuhan University , 2018 , 43 ( 8 ): 1178 - 1184 .
李新春 . 浅谈SLAM+AR眼镜在远程协助中的应用 [J]. 中国设备工程 , 2020 ( 19 ): 251 - 252 .
LI Xinchun . An Introduction to SLAM+AR Glasses in Remote Assistance [J]. China Plant Engineering , 2020 ( 19 ): 251 - 252 .
陈琼 , 林兴萍 , 舒元昊 , 等 . 融合目标检测和空间投影的增强现实方法 [J]. 计算机系统应用 , 2023 , 32 ( 10 ): 123 - 131 .
CHEN Qiong , LIN Xingping , SHU Yuanhao , et al . Augmented Reality Method Combining Object Detection and Spatial Projection [J]. Computer Systems and Applications , 2023 , 32 ( 10 ): 123 - 131 .
MA W , XIONG H J , DAI X F , et al . An Indoor Scene Recognition-Based 3D Registration Mechanism for Real-Time AR-GIS Visualization in Mobile Applications [J]. ISPRS International Journal of Geo⁃Information , 2018 , 7 ( 3 ): 112 .
曹鹏霞 , 李文新 , 马伟苹 . 增强现实无标识跟踪注册方法研究综述 [J]. 计算机应用与软件 , 2023 , 40 ( 4 ): 1 - 7 .
CAO Pengxia , LI Wenxin , MA Weiping . Survey on Marker-Less Tracking and Registration Methods of Augmented Reality [J]. Computer Applications and Software , 2023 , 40 ( 4 ): 1 - 7 .
RADANOVIC M , KHOSHELHAM K , FRASER C . Aligning the Real and the Virtual World: Mixed Reality Localisation Using Learning-Based 3D Model Registration [J]. Advanced Engineering Informatics , 2023 , 56 : 101960 .
YUE L W , LI H J , ZHENG X W . Distorted Building Image Matching with Automatic Viewpoint Rectification and Fusion [J]. Sensors , 2019 , 19 ( 23 ): 5205 .
侯守明 , 韩吉 , 张煜东 , 等 . 基于视觉的增强现实三维注册技术综述 [J]. 系统仿真学报 , 2019 , 31 ( 11 ): 2206 - 2215 .
HOU Shouming , HAN Ji , ZHANG Yudong , et al . Survey of Vision-Based Augmented Reality 3D Registration Technology [J]. Journal of System Simulation , 2019 , 31 ( 11 ): 2206 - 2215 .
黄碧辉 , 吴勇 , 郑森源 , 等 . 一种改进的户外移动增强现实三维注册方法 [J]. 武汉大学学报(信息科学版) , 2019 , 44 ( 12 ): 1865 - 1873 .
HUANG Bihui , WU Yong , ZHENG Senyuan , et al . An Improved Registration Method for Outdoor Mobile Augmented Reality [J]. Geomatics and Information Science of Wuhan University , 2019 , 44 ( 12 ): 1865 - 1873 .
剌小兆 , 刘新妹 , 殷俊龄 . 基于特征匹配的单目相机姿态解算 [J]. 计算机系统应用 , 2023 , 32 ( 1 ): 310 - 315 .
LA Xiaozhao , LIU Xinmei , YIN Junling . Attitude Algorithm of Monocular Camera Based on Feature Matching [J]. Computer Systems and Applications , 2023 , 32 ( 1 ): 310 - 315 .
巩丹超 , 韩轶龙 , 黄旭 . 线特征约束的建筑物密集匹配边缘全局优化方法 [J]. 测绘学报 , 2021 , 50 ( 6 ): 833 - 846 .
GONG Danchao , HAN Yilong , HUANG Xu . Global Refinement of Building Boundary with Line Feature Constraints for Stereo Dense Image Matching [J]. Acta Geodaetica et Cartographica Sinica , 2021 , 50 ( 6 ): 833 - 846 .
董赛云 , 刘钊 , 李婕 , 等 . 深度学习融合局部聚合向量的增强现实标志物检索研究 [J]. 测绘地理信息 , 2022 , 47 ( S1 ): 157 - 161 .
DONG Saiyun , LIU Zhao , LI Jie , et al . Research on Augmented Reality Marker Retrieval Based on Deep Learning and Vector of Locally Aggregated Descriptors [J]. Journal of Geomatics , 2022 , 47 ( S1 ): 157 - 161 .
AYADI M , SCUTURICI M , BEN AMAR C , et al . A Skyline-Based Approach for Mobile Augmented Reality [J]. The Visual Computer , 2021 , 37 ( 4 ): 789 - 804 .
胡校飞 , 周杨 , 蓝朝桢 , 等 . 结构语义辅助约束的数字孪生场景虚实配准方法 [J]. 地球信息科学学报 , 2023 , 25 ( 5 ): 883 - 895 .
HU Xiaofei , ZHOU Yang , LAN Chaozhen , et al . Virtual Real Registration Assisted by Structural Semantic Constraint for Digital City Scene [J]. Journal of Geo⁃Information Science , 2023 , 25 ( 5 ): 883 - 895 .
邓晨 , 游雄 , 张威巍 , 等 . 基于2D地图的城市户外ARGIS视觉辅助地理配准技术 [J]. 测绘学报 , 2019 , 48 ( 10 ): 1305 - 1319 .
DENG Chen , YOU Xiong , ZHANG Weiwei , et al . A Vision-Aided Geo-Registration Method for Outdoor ARGIS in Urban Environments Based on 2D Maps [J]. Acta Geodaetica et Cartographica Sinica , 2019 , 48 ( 10 ): 1305 - 1319 .
ZHAO K , HAN Q , ZHANG C B , et al . Deep Hough Transform for Semantic Line Detection [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence , 2021 , 44 ( 9 ): 4793 - 4806 .
XUE N , BAI S , WANG F , et al . Learning Attraction Field Representation for Robust Line Segment Detection [C]// IEEE/CVF Conference on Computer Vision and Pattern Recognition , Long Beach, USA , 2019 .
BAYKAL I C , YILMAZ I C . An Extremely Fast Pattern Based Line Detector [C]// The 13th IEEE International Conference on Intelligent Computer Communication and Processing (ICCP) , Cluj-Napoca, Romania , 2017 .
DAN X , GONG Q , ZHANG M , et al . Chessboard Corner Detection Based on EDLines Algorithm [J]. Sensors , 2022 , 22 ( 9 ): 3398 .
AOUTHU S , KOLLATI M , KURAPARTHI S , et al . Robust Video Watermarking with Complex Conjugate Symmetric Sequency Transform Using SURF Feature Matching [J]. Cogent Engineering , 2024 , 11 ( 1 ): 2345851 .
NUSANTIKA R N , XIAO J , HU X . An Enhanced Multiscale Retinex, Oriented FAST and Rotated BRIEF (ORB), and Scale-Invariant Feature Transform (SIFT) Pipeline for Robust Key Point Matching in 3D Monitoring of Power Transmission Line Icing with Binocular Vision [J]. Electronics , 2024 , 13 ( 21 ): 4252 .
RAMLI R , IDRIS I Y M , HASIKIN K , et al . Local Descriptor for Retinal Fundus Image Registration [J]. IET Computer Vision , 2020 , 14 ( 4 ): 144 - 153 .
周艳青 , 薛河儒 , 马学磊 , 等 . 基于RANSAC算法的改进特征匹配方法研究 [J]. 内蒙古农业大学学报(自然科学版) , 2021 , 42 ( 6 ): 8792 .
ZHOU Yanqing , XUE Heru , MA Xuelei , et al . Improved Feature Matching Method Based on RANSAC Algorithm [J]. Journal of Inner Mongolia Agricultural University(Natural Science Edition) , 2021 , 42 ( 6 ): 8792 .
邓晨 , 游雄 , 智梅霞 . 户外增强现实地理配准精度测试评估 [J]. 系统仿真学报 , 2020 , 32 ( 9 ): 1693 - 1704 .
DENG Chen , YOU Xiong , ZHI Meixia . Evaluation on Geo-Registration Accuracy of Outdoor Augmented Reality [J]. Journal of System Simulation , 2020 , 32 ( 9 ): 1693 - 1704 .
0
浏览量
17
下载量
0
CSCD
关联资源
相关文章
相关作者
相关机构
京公网安备11010802024621