Multimodal Learning 相关度: 8/10

Modeling Spatiotemporal Neural Frames for High Resolution Brain Dynamic

Wanying Qu, Jianxiong Gao, Wei Wang, Yanwei Fu
arXiv: 2603.24176v1 发布: 2026-03-25 更新: 2026-03-25

AI 摘要

提出了一种EEG条件下的fMRI重建框架,实现高分辨率、高时间一致性的动态脑活动建模。

主要贡献

  • 提出EEG条件下的fMRI重建框架
  • 利用null-space中间帧重建解决采样不规则问题
  • 验证了重建fMRI在视觉解码任务中的应用

方法论

利用EEG的毫秒级时间信息,重建具有高空间保真度和强时间一致性的动态fMRI序列。采用null-space中间帧重建,应对fMRI采样不规则性。

原文摘要

Capturing dynamic spatiotemporal neural activity is essential for understanding large-scale brain mechanisms. Functional magnetic resonance imaging (fMRI) provides high-resolution cortical representations that form a strong basis for characterizing fine-grained brain activity patterns. The high acquisition cost of fMRI limits large-scale applications, therefore making high-quality fMRI reconstruction a crucial task. Electroencephalography (EEG) offers millisecond-level temporal cues that complement fMRI. Leveraging this complementarity, we present an EEG-conditioned framework for reconstructing dynamic fMRI as continuous neural sequences with high spatial fidelity and strong temporal coherence at the cortical-vertex level. To address sampling irregularities common in real fMRI acquisitions, we incorporate a null-space intermediate-frame reconstruction, enabling measurement-consistent completion of arbitrary intermediate frames and improving sequence continuity and practical applicability. Experiments on the CineBrain dataset demonstrate superior voxel-wise reconstruction quality and robust temporal consistency across whole-brain and functionally specific regions. The reconstructed fMRI also preserves essential functional information, supporting downstream visual decoding tasks. This work provides a new pathway for estimating high-resolution fMRI dynamics from EEG and advances multimodal neuroimaging toward more dynamic brain activity modeling.

标签

fMRI EEG 脑活动建模 多模态 重建

arXiv 分类

eess.IV cs.CV q-bio.NC