DSF2-NAS: Dual-Stage Feature Fusion via Network Architecture Search for Classification of Multimodal Remote Sensing Images

作者：Shiyang Feng, Zhaowei Li, Bo Zhang, Tao Chen, Bin Wang · 发表于：IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · 年份：2025 · DOI：10.1109/jstars.2025.3545831 · 被引用次数：5 · 研究领域：Remote-Sensing Image Classification、Advanced Image Fusion Techniques、Remote Sensing and Land Use

Recently, the classification of multimodal remote sensing images (RSIs) has garnered significant attention due to its ability to provide rich information for various scenes on Earth. Compared to traditional feature fusion methods used for the classification of multimodal RSIs, neural architecture search (NAS) is capable of identifying the optimal network structure for multimodal RSIs and downstream tasks. However, due to the diverse spatial resolutions, complex channel dimensions, and drastic foreground scale variations of multimodal RSIs, challenges arise when employing NAS methods for precise classification: 1) Due to the complementary and redundant nature between different modalities in RSIs, determining the features within each modality for fusion becomes quite challenging; 2) the design of fusion operators does not take into account the spatial positions and channel relationships between different modalities of RSIs, making it difficult for the fused features to match downstream tasks. To address these issues, we propose a dual-stage feature fusion framework based on NAS, termed DSF2-NAS, for the classification of multimodal RSIs. It primarily consists of two components: the feature candidate search (FCS) module and the fusion operator search (FOS) module, which execute sequentially. In the FCS module, a feature distance-based regularization approach is proposed to ensure fusion using multimodal features with the highest complementarity. Meanwhile, in the FOS module, a s...