Transfer learning radiomics based on multimodal ultrasound imaging for staging liver fibrosis

作者：Liyun Xue, Zhuoyun Jiang, Tiantian Fu, Qingmin Wang, Yuli Zhu, Meng Dai, Wenping Wang, Jinhua Yu, Hong Ding · 发表于：European Radiology · 年份：2020 · DOI：10.1007/s00330-019-06595-w · 被引用次数：134 · 研究领域：Liver Disease Diagnosis and Treatment、Hepatocellular Carcinoma Treatment and Prognosis、Radiomics and Machine Learning in Medical Imaging

OBJECTIVES: To propose a transfer learning (TL) radiomics model that efficiently combines the information from gray scale and elastogram ultrasound images for accurate liver fibrosis grading. METHODS: Totally 466 patients undergoing partial hepatectomy were enrolled, including 401 with chronic hepatitis B and 65 without fibrosis pathologically. All patients received elastography and got liver stiffness measurement (LSM) 2-3 days before surgery. We proposed a deep convolutional neural network by TL to analyze images of gray scale modality (GM) and elastogram modality (EM). The TL process was used for liver fibrosis classification by Inception-V3 network which pretrained on ImageNet. The diagnostic performance of TL and non-TL was compared. The value of single modalities, including GM and EM alone, and multimodalities, including GM + LSM and GM + EM, was evaluated and compared with that of LSM and serological indexes. Receiver operating characteristic curve analysis was performed to calculate the optimal area under the curve (AUC) for classifying fibrosis of S4, ≥ S3, and ≥ S2. RESULTS: TL in GM and EM demonstrated higher diagnostic accuracy than non-TL, with significantly higher AUCs (all p < .01). Single-modal GM and EM both performed better than LSM and serum indexes (all p < .001). Multimodal GM + EM was the most accurate prediction model (AUCs are 0.950, 0.932, and 0.930 for classifying S4, ≥ S3, and ≥ S2, respectively) compared with GM + LSM, GM and EM alone, LSM, and bio...