LLM-Guided Decoupled Probabilistic Prompt for Continual Learning in Medical Image Diagnosis

作者：Yiwen Luo, Wuyang Li, Cheng Chen, Xiang Li, Tianming Liu, Tianye Niu, Yixuan Yuan · 发表于：IEEE Transactions on Medical Imaging · 年份：2025 · DOI：10.1109/tmi.2025.3566105 · 被引用次数：6 · 研究领域：Domain Adaptation and Few-Shot Learning、COVID-19 diagnosis using AI、Anomaly Detection Techniques and Applications

Deep learning-based traditional diagnostic models typically exhibit limitations when applied to dynamic clinical environments that require handling the emergence of new diseases. Continual learning (CL) offers a promising solution, aiming to learn new knowledge while preserving previously learned knowledge. Though recent rehearsal-free CL methods employing prompt tuning (PT) have shown promise, they rely on deterministic prompts that struggle to handle diverse fine-grained knowledge. Moreover, existing PT methods utilize randomly initialized prompts that are trained under standard classification constraints, impeding expert knowledge integration and optimal performance acquisition. In this paper, we propose an LLM-guided Decoupled Probabilistic Prompt (LDPP) for Continual Learning in medical image diagnosis. Specifically, we develop an Expert Knowledge Generation (EKG) module that leverages LLM to acquire decoupled expert knowledge and comprehensive category descriptions. Then, we introduce a Decoupled Probabilistic Prompt pool (DePP) to construct a shared decoupled probabilistic prompt pool, which constructs a shared prompt pool with probabilistic prompts derived from the expert knowledge set. These prompts dynamically provide diverse and flexible descriptions for input images. Finally, We design a Steering Prompt Pool (SPP) to enhance intra-class compactness and promote model performance by learning non-shared prompts. With extensive experimental validation, LDPP consistent...