TCIANet: Transformer-Based Context Information Aggregation Network for Remote Sensing Image Change Detection
作者:Xintao Xu, Jinjiang Li, Zheng Chen · 发表于:IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · 年份:2023 · DOI:10.1109/jstars.2023.3241157 · 被引用次数:47 · 研究领域:Remote-Sensing Image Classification、Remote Sensing and Land Use、Remote Sensing in Agriculture
Change detection based on remote sensing data is an important method to detect the earth surface changes. With the development of deep learning, convolutional neural networks have excelled in the field of change detection. However, the existing neural network models are susceptible to external factors in the change detection process, leading to pseudo change and missed detection in the detection results. In order to better achieve the change detection effect and improve the ability to discriminate pseudo-change, this paper proposes a new method, namely, transformer-based context information aggregation network (TCIANet) for remote sensing image change detection. First, we use a filter-based visual tokenizer (FVT) to segment each temporal feature map into multiple visual semantic tokens. Second, the addition of the progressive sampling vision transformer (PS-ViT) not only effectively excludes the interference of irrelevant changes, but also uses the transformer encoder to obtain compact spatio-temporal context information in the token set. Then, the tokens containing rich semantic information are fed into the pixel space and the transformer decoder is used to acquire pixel-level features. In addition, we use the feature fusion module (FFM) to fuse low-level semantic feature information to complete the extraction of coarse contour information of the changed region. Then the semantic relationships between object regions and contours are captured by contour-graph reasoning module...