CAMEL: An ECG Language Model for Forecasting Cardiac Events
AI 摘要
CAMEL是首个用于预测心脏事件的ECG语言模型,优于现有方法。
主要贡献
- 提出首个用于预测心脏事件的ECG语言模型CAMEL
- 引入ECGForecastBench基准测试
- 证明CAMEL在多种任务和数据集上的卓越性能
方法论
使用LLM训练流程,结合LoRA和课程学习,包括ECG分类、指标计算和多轮对话以进行推理。
原文摘要
Electrocardiograms (ECG) are electrical recordings of the heart that are critical for diagnosing cardiovascular conditions. ECG language models (ELMs) have recently emerged as a promising framework for ECG classification accompanied by report generation. However, current models cannot forecast future cardiac events despite the immense clinical value for planning earlier intervention. To address this gap, we propose CAMEL, the first ELM that is capable of inference over longer signal durations which enables its forecasting capability. Our key insight is a specialized ECG encoder which enables cross-understanding of ECG signals with text. We train CAMEL using established LLM training procedures, combining LoRA adaptation with a curriculum learning pipeline. Our curriculum includes ECG classification, metrics calculations, and multi-turn conversations to elicit reasoning. CAMEL demonstrates strong zero-shot performance across 6 tasks and 9 datasets, including ECGForecastBench, a new benchmark that we introduce for forecasting arrhythmias. CAMEL is on par with or surpasses ELMs and fully supervised baselines both in- and out-of-distribution, achieving SOTA results on ECGBench (+7.0% absolute average gain) as well as ECGForecastBench (+12.4% over fully supervised models and +21.1% over zero-shot ELMs).