Post-hurricane building damage assessment using street-view imagery and structured data: A multi-modal deep learning approach
arxiv(2024)
摘要
Accurately assessing building damage is critical for disaster response and
recovery. However, many existing models for detecting building damage have poor
prediction accuracy due to their limited capabilities of identifying detailed,
comprehensive structural and/or non-structural damage from the street-view
image. Additionally, these models mainly rely on the imagery data for damage
classification, failing to account for other critical information, such as wind
speed, building characteristics, evacuation zones, and distance of the building
to the hurricane track. To address these limitations, in this study, we propose
a novel multi-modal (i.e., imagery and structured data) approach for
post-hurricane building damage classification, named the Multi-Modal Swin
Transformer (MMST). We empirically train and evaluate the proposed MMST using
data collected from the 2022 Hurricane Ian in Florida, USA. Results show that
MMST outperforms all selected state-of-the-art benchmark models and can achieve
an accuracy of 92.67
Visual Geometry Group 16 (VGG-16). In addition to the street-view imagery data,
building value, building age, and wind speed are the most important predictors
for damage level classification. The proposed MMST can be deployed to assist in
rapid damage assessment and guide reconnaissance efforts in future hurricanes.
更多查看译文
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要