Modeling Spatiotemporal Neural Frames for High Resolution Brain Dynamic
AI 摘要
提出了一种EEG条件下的fMRI重建框架,实现高分辨率、高时间一致性的动态脑活动建模。
主要贡献
- 提出EEG条件下的fMRI重建框架
- 利用null-space中间帧重建解决采样不规则问题
- 验证了重建fMRI在视觉解码任务中的应用
方法论
利用EEG的毫秒级时间信息,重建具有高空间保真度和强时间一致性的动态fMRI序列。采用null-space中间帧重建,应对fMRI采样不规则性。
原文摘要
Capturing dynamic spatiotemporal neural activity is essential for understanding large-scale brain mechanisms. Functional magnetic resonance imaging (fMRI) provides high-resolution cortical representations that form a strong basis for characterizing fine-grained brain activity patterns. The high acquisition cost of fMRI limits large-scale applications, therefore making high-quality fMRI reconstruction a crucial task. Electroencephalography (EEG) offers millisecond-level temporal cues that complement fMRI. Leveraging this complementarity, we present an EEG-conditioned framework for reconstructing dynamic fMRI as continuous neural sequences with high spatial fidelity and strong temporal coherence at the cortical-vertex level. To address sampling irregularities common in real fMRI acquisitions, we incorporate a null-space intermediate-frame reconstruction, enabling measurement-consistent completion of arbitrary intermediate frames and improving sequence continuity and practical applicability. Experiments on the CineBrain dataset demonstrate superior voxel-wise reconstruction quality and robust temporal consistency across whole-brain and functionally specific regions. The reconstructed fMRI also preserves essential functional information, supporting downstream visual decoding tasks. This work provides a new pathway for estimating high-resolution fMRI dynamics from EEG and advances multimodal neuroimaging toward more dynamic brain activity modeling.