Fusing multimodal data of nature-economy-society for large-scale urban building height estimation

作者：Shouhang Du, Shouhang Du, Hao Liu, Jianghe Xing, Shihong Du, Shihong Du · 发表于：International Journal of Applied Earth Observation and Geoinformation · 年份：2024 · DOI：10.1016/j.jag.2024.103809 · 被引用次数：10 · 研究领域：Impact of Light on Environment and Health、Remote Sensing and Land Use、Urban Heat Island Mitigation

The building height holds significant importance for comprehensively understanding urban morphology, enhancing urban planning, and fostering sustainable development. Although many methods using optical and SAR images have been presented for building height estimation, these methods fall short in capturing the influences of economic and social attributes on building height. In this study, we introduced a Nature-Economy-Society (NES) feature model to comprehensively represent building height information, and established a multi-scale One-Dimensional (1-D) Convolutional Neural Network for predicting building heights, referred to as NES-CNN. First, we derived the natural attributes of urban buildings from time-series Sentinel-1 SAR images and Sentinel-2 multispectral images, as well as World Settlement Footprint (WSF) data and Digital Elevation Model (DEM), economic attributes from nighttime light and Gross Domestic Product (GDP) data, and social function attributes from Points of Interest (POI) data. Second, an autoencoder is employed to reduce the dimensionality of the high-dimensional natural attribute features, minimizing data redundancy. Finally, the multi-scale 1-D CNN model is presented to explore the correlations between the multi-source and heterogeneous NES features and building height information, facilitating the prediction of building height. In experiments, we applied the proposed method to estimate building heights in Beijing and Shanghai at a spatial resolution of...