A Multimodal Deep Learning Approach for White Matter Shape Prediction in Diffusion MRI Tractography

作者：Yui Lo, Yuqian Chen, Dongnan Liu, Leo Zekelman, Jarrett Rushmore, Yogesh Rathi, Nikos Makris, Alexandra J. Golby, Fan Zhang, Weidong Cai, Lauren J. O’Donnell · 发表于：Human Brain Mapping · 年份：2025 · DOI：10.1002/hbm.70396 · 被引用次数：2 · 研究领域：Advanced Neuroimaging Techniques and Applications、Functional Brain Connectivity Studies、Voice and Speech Disorders

Recently, shape measures have emerged as promising descriptors of white matter tractography, offering complementary insights into anatomical variability and associations with cognitive and clinical phenotypes. However, conventional methods for computing shape measures are computationally expensive and time-consuming for large-scale datasets due to reliance on voxel-based representations. To address these limitations, we introduce Tract2Shape, a novel multimodal deep learning framework that integrates geometric streamline features (as point clouds) with scalar data descriptors (as tabular data) from tractography to predict 10 white matter tractography shape measures. We propose a Siamese architecture in which each subnetwork incorporates a dual-encoder design, enabling each encoder to learn modality-specific representations. To enhance model efficiency, we utilize a dimensionality reduction algorithm for the model to predict five primary shape components. The model is trained and evaluated on two independently acquired datasets: the Human Connectome Project minimally preprocessed young adults (HCP-YA) dataset and the Parkinson's Progression Markers Initiative (PPMI) dataset. Tract2Shape is trained and tested on the HCP-YA dataset, with performance compared against state-of-the-art models. To assess robustness and generalization, we further evaluate the model on the unseen PPMI dataset. Tract2Shape outperforms state-of-the-art deep learning models across all 10 shape measures, ...