Accurate Whole-Brain Segmentation for Bimodal PET/MR Images via a Cross-Attention Mechanism

作者：Wenbo Li, Zhenxing Huang, Qiyang Zhang, Na Zhang, Wenjie Zhao, Yaping Wu, Jian‐Min Yuan, Yang Yang, Yan Zhang, Yongfeng Yang, Hairong Zheng, Dong Liang, Meiyun Wang, Zhanli Hu · 发表于：IEEE Transactions on Radiation and Plasma Medical Sciences · 年份：2024 · DOI：10.1109/trpms.2024.3413862 · 被引用次数：9 · 研究领域：Medical Imaging Techniques and Applications、Radiomics and Machine Learning in Medical Imaging、Medical Image Segmentation Techniques

The PET/MRI system plays a significant role in the functional and anatomical quantification of the brain, providing accurate diagnostic data for a variety of brain disorders. However, most of the current methods for segmenting the brain are based on unimodal MRI and rarely combine structural and functional dual-modality information. Therefore, we aimed to employ deep-learning techniques to achieve automatic and accurate segmentation of the whole brain while incorporating functional and anatomical information. To leverage dual-modality information, a novel 3-D network with a cross-attention module was proposed to capture the correlation between dual-modality features and improve segmentation accuracy. Moreover, several deep-learning methods were employed as comparison measures to evaluate the model performance, with the dice similarity coefficient (DSC), Jaccard index (JAC), recall, and precision serving as quantitative metrics. Experimental results demonstrated our advantages in whole-brain segmentation, achieving an 85.35% DSC, 77.22% JAC, 88.86% recall, and 84.81% precision, which were better than those comparative methods. In addition, consistent and correlated analyses based on segmentation results also demonstrated that our approach achieved superior performance. In future work, we will try to apply our method to other multimodal tasks, such as PET/CT data analysis.