Multimodal Learning 相关度: 8/10

Leveraging Image Editing Foundation Models for Data-Efficient CT Metal Artifact Reduction

Ahmet Rasim Emirdagi, Süleyman Aslan, Mısra Yavuz, Görkay Aydemir, Yunus Bilge Kurt, Nasrin Rahimi, Burak Can Biner, M. Akın Yılmaz
arXiv: 2604.05934v1 发布: 2026-04-07 更新: 2026-04-07

AI 摘要

利用图像编辑基础模型,通过少量数据有效去除CT图像中的金属伪影。

主要贡献

  • 提出了一种利用视觉-语言扩散基础模型进行金属伪影去除的新范例。
  • 采用参数高效的LoRA方法,显著降低了训练数据需求。
  • 引入多参考条件策略,利用类别特定上下文推断未损坏的解剖结构。

方法论

通过LoRA对视觉-语言扩散模型进行微调,利用多参考条件策略指导图像重建,有效去除CT图像中的金属伪影。

原文摘要

Metal artifacts from high-attenuation implants severely degrade CT image quality, obscuring critical anatomical structures and posing a challenge for standard deep learning methods that require extensive paired training data. We propose a paradigm shift: reframing artifact reduction as an in-context reasoning task by adapting a general-purpose vision-language diffusion foundation model via parameter-efficient Low-Rank Adaptation (LoRA). By leveraging rich visual priors, our approach achieves effective artifact suppression with only 16 to 128 paired training examples reducing data requirements by two orders of magnitude. Crucially, we demonstrate that domain adaptation is essential for hallucination mitigation; without it, foundation models interpret streak artifacts as erroneous natural objects (e.g., waffles or petri dishes). To ground the restoration, we propose a multi-reference conditioning strategy where clean anatomical exemplars from unrelated subjects are provided alongside the corrupted input, enabling the model to exploit category-specific context to infer uncorrupted anatomy. Extensive evaluation on the AAPM CT-MAR benchmark demonstrates that our method achieves state-of-the-art performance on perceptual and radiological-feature metrics . This work establishes that foundation models, when appropriately adapted, offer a scalable alternative for interpretable, data-efficient medical image reconstruction. Code is available at https://github.com/ahmetemirdagi/CT-EditMAR.

标签

CT图像 金属伪影去除 扩散模型 LoRA 医学图像

arXiv 分类

cs.CV eess.IV