A Dual Branch Multiscale Stereo Matching Network for High-Resolution Satellite Remote Sensing Images

作者：Zhenghui Xu, Yonghua Jiang, Jingxue Wang, Yunming Wang · 发表于：IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · 年份：2024 · DOI：10.1109/jstars.2024.3502842 · 被引用次数：12 · 研究领域：Advanced Vision and Imaging、Advanced Image and Video Retrieval Techniques、Advanced Image Processing Techniques

Accurate disparity estimation of high-resolution satellite remote sensing stereo images serves as a crucial method for generating precise digital surface models. However, the complex intractable regions in satellite images (textureless regions, repeated texture regions, occlusion regions) pose serious challenges for accurate disparity estimation. To enhance the matching accuracy within intractable regions, a dual branch multiscale stereo matching network for high-resolution satellite stereo images is proposed. First, a dual branch feature extraction module is designed, which can perform efficient downsampling. This module can enhance the scene awareness capability of the model, enabling it to extract multiscale feature maps and construct multiscale cost volumes. Then, the cost aggregation process is executed in a coarse-to-fine manner. The method employs a simple hourglass structure and leverages low-scale information to guide the aggregation of high-scale cost volumes. Next, a disparity-channel attention mechanism is proposed for the cost aggregation process to obtain more representative feature information. Finally, a simple disparity refinement module is designed by utilizing both intensity and gradient information of the left image to improve the local details of the disparity map. Experiments are performed separately on the GaoFen-7 and US3D datasets. The experimental results indicate that the proposed method is conducive to improving the matching accuracy within intract...