Multimodal Learning 相关度: 9/10

Vision-Language Model-Guided Deep Unrolling Enables Personalized, Fast MRI

Fangmao Ju, Yuzhu He, Zhiwen Xue, Chunfeng Lian, Jianhua Ma
arXiv: 2604.06849v1 发布: 2026-04-08 更新: 2026-04-08

AI 摘要

PASS框架利用VLM引导深度展开网络,实现个性化快速MRI,提升图像质量和下游诊断任务。

主要贡献

  • 提出PASS框架,融合VLM与物理模型。
  • 设计了基于VLM的异常感知先验,指导采样和重建。
  • 实现了个性化的k空间轨迹采样.

方法论

该方法利用VLM提取先验信息,指导深度展开网络的采样和重建过程,实现任务导向的快速MRI。

原文摘要

Magnetic Resonance Imaging (MRI) is a cornerstone in medicine and healthcare but suffers from long acquisition times. Traditional accelerated MRI methods optimize for generic image quality, lacking adaptability for specific clinical tasks. To address this, we introduce PASS (Personalized, Anomaly-aware Sampling and reconStruction), an intelligent MRI framework that leverages a Vision-Language Model (VLM) to guide a deep unrolling network for task-oriented, fast imaging. PASS dynamically personalizes the imaging pipeline through three core contributions: (1) a deep unrolled reconstruction network derived from a physics-based MRI model; (2) a sampling module that generates patient-specific $k$-space trajectories; and (3) an anomaly-aware prior, extracted from a pretrained VLM, which steers both sampling and reconstruction toward clinically relevant regions. By integrating the high-level clinical reasoning of a VLM with an interpretable, physics-aware network, PASS achieves superior image quality across diverse anatomies, contrasts, anomalies, and acceleration factors. This enhancement directly translates to improvements in downstream diagnostic tasks, including fine-grained anomaly detection, localization, and diagnosis.

标签

MRI VLM 深度学习 医学图像

arXiv 分类

cs.CV