Multimodal Learning 相关度: 6/10

Rectified flow-based prediction of post-treatment brain MRI from pre-radiotherapy priors for patients with glioma

Selena Huisman, Nordin Belkacemi, Vera Keil, Joost Verhoeff, Szabolcs David
arXiv: 2603.08385v1 发布: 2026-03-09 更新: 2026-03-09

AI 摘要

该论文提出了一种基于Rectified Flow的AI模型,用于预测脑肿瘤患者放疗后的MRI图像。

主要贡献

  • 提出基于Rectified Flow的脑部MRI图像生成模型
  • 实现快速且真实的放疗后MRI预测
  • 支持基于治疗参数的 counterfactual 模拟

方法论

使用SAILOR数据集,通过Rectified Flow模型,结合预处理MRI和放疗剂量图,预测治疗后的MRI图像。

原文摘要

Purpose/Objective: Brain tumors result in 20 years of lost life on average. Standard therapies induce complex structural changes in the brain that are monitored through MRI. Recent developments in artificial intelligence (AI) enable conditional multimodal image generation from clinical data. In this study, we investigate AI-driven generation of follow-up MRI in patients with in- tracranial tumors through conditional image generation. This approach enables realistic modeling of post-radiotherapy changes, allowing for treatment optimization. Material/Methods: The public SAILOR dataset of 25 patients was used to create a 2D rectified flow model conditioned on axial slices of pre-treatment MRI and RT dose maps. Cross-attention conditioning was used to incorporate temporal and chemotherapy data. The resulting images were validated with structural similarity index measure (SSIM), peak signal-to-noise ratio (PSNR), Dice scores and Jacobian determinants. Results: The resulting model generates realistic follow-up MRI for any time point, while integrating treatment information. Comparing real versus predicted images, SSIM is 0.88, and PSNR is 22.82. Tissue segmentations from real versus predicted MRI result in a mean Dice-Sørensen coefficient (DSC) of 0.91. The rectified flow (RF) model enables up to 250x faster inference than Denoising Diffusion Probabilistic Models (DDPM). Conclusion: The proposed model generates realistic follow-up MRI in real-time, preserving both semantic and visual fidelity as confirmed by image quality metrics and tissue segmentations. Conditional generation allows counterfactual simulations by varying treatment parameters, producing predicted morphological changes. This capability has potential to support adaptive treatment dose planning and personalized outcome prediction for patients with intracranial tumors.

标签

医学图像 图像生成 Rectified Flow 脑肿瘤

arXiv 分类

eess.IV cs.CV