Gated Multi-Scale Attention Transformer For Few-Shot Medical Image Segmentation

作者：Zhenghao Zhao, Hao Ding, Dawen Cai, Yan Yan · 年份：2024 · DOI：10.1109/isbi56570.2024.10635524 · 被引用次数：4 · 研究领域：Medical Image Segmentation Techniques、Brain Tumor Detection and Classification、Image Processing Techniques and Applications

Few-shot learning has gained a lot of attention in the medical image semantic segmentation field due to the limited availability of annotated medical images. Existing studies use Prototypical Networks (PN) to perform segmentation with a limited number of labeled medical images and have obtained success. However, these approaches overlook pairwise relations between query and support images and the spatial structure in feature maps. Multi-level feature correlations overcome these problems by capturing high-level semantic and low-level geometric cues through aggregation with 4D convolutions. In this paper, we propose a novel network architecture named Gated Multi-scale Attention Transformer (GMAT), which utilizes a 4D convolutional Swin Transformer network with pyramidal aggregation and a gated multi-scale attention mechanism. Extensive experiments on the abdomen CT dataset demonstrate the superiority of our model over existing state-of-the-art methods.