Multi-contrast Multi-scale vision Transformers (MMT) for MRI Contrast Synthesis

作者：Jiang Liu, Srivathsa Pasumarthi Venkata, Keshav Datta · 发表于：Proceedings on CD-ROM - International Society for Magnetic Resonance in Medicine. Scientific Meeting and Exhibition/Proceedings of the International Society for Magnetic Resonance in Medicine, Scientific Meeting and Exhibition · 年份：2023 · DOI：10.58530/2022/2434 · 研究领域：Advanced Neural Network Applications、Advanced Image and Video Retrieval Techniques、Brain Tumor Detection and Classification

Complementary information from multi-modal MRI is widely used in clinical practice for disease diagnosis. Due to scan time limitations, image corruptions, and different acquisition protocols, one or more contrasts may be missing or unusable. Recently developed CNN models for contrast synthesis are unable to capture the intricate dependencies between input contrasts and are not dynamic to the varying number of inputs. This work proposes a novel Multi-contrast and Multi-scale vision Transformer (MMT) that can take any number and combination of input sequences and synthesize the missing contrasts.