Multimodal Learning 相关度: 9/10

NeuroCanvas: VLLM-Powered Robust Seizure Detection by Reformulating Multichannel EEG as Image

Yan Chen, Jie Peng, Moajjem Hossain Chowdhury, Tianlong Chen, Yunmei Liu
arXiv: 2602.04769v1 发布: 2026-02-04 更新: 2026-02-04

AI 摘要

NeuroCanvas利用VLLM将多通道脑电信号转化为图像,实现高效鲁棒的癫痫检测。

主要贡献

  • 提出了NeuroCanvas框架,用于癫痫检测。
  • 引入熵引导通道选择器(ECS)解决多通道异构性问题。
  • 设计神经信号画布(CNS)将EEG信号转化为紧凑的视觉表征。

方法论

将多通道脑电信号转化为图像,利用VLLM进行分析,并通过ECS和CNS优化通道选择和信号表征。

原文摘要

Accurate and timely seizure detection from Electroencephalography (EEG) is critical for clinical intervention, yet manual review of long-term recordings is labor-intensive. Recent efforts to encode EEG signals into large language models (LLMs) show promise in handling neural signals across diverse patients, but two significant challenges remain: (1) multi-channel heterogeneity, as seizure-relevant information varies substantially across EEG channels, and (2) computing inefficiency, as the EEG signals need to be encoded into a massive number of tokens for the prediction. To address these issues, we draw the EEG signal and propose the novel NeuroCanvas framework. Specifically, NeuroCanvas consists of two modules: (i) The Entropy-guided Channel Selector (ECS) selects the seizure-relevant channels input to LLM and (ii) the following Canvas of Neuron Signal (CNS) converts selected multi-channel heterogeneous EEG signals into structured visual representations. The ECS module alleviates the multi-channel heterogeneity issue, and the CNS uses compact visual tokens to represent the EEG signals that improve the computing efficiency. We evaluate NeuroCanvas across multiple seizure detection datasets, demonstrating a significant improvement of $20\%$ in F1 score and reductions of $88\%$ in inference latency. These results highlight NeuroCanvas as a scalable and effective solution for real-time and resource-efficient seizure detection in clinical practice.The code will be released at https://github.com/Yanchen30247/seizure_detect.

标签

癫痫检测 脑电信号 多模态学习 VLLM

arXiv 分类

cs.LG