Multimodal Learning 相关度: 9/10

A Clinical Point Cloud Paradigm for In-Hospital Mortality Prediction from Multi-Level Incomplete Multimodal EHRs

Bohao Li, Tao Zou, Junchen Ye, Yan Gong, Bowen Du
arXiv: 2604.04614v1 发布: 2026-04-06 更新: 2026-04-06

AI 摘要

针对多层不完全多模态EHR,提出HealthPoint框架用于住院死亡率预测,实现SOTA性能。

主要贡献

  • 提出HealthPoint (HP) 框架处理EHR多层不完全性。
  • 引入低秩关系注意力机制捕捉四维度高阶依赖。
  • 设计分层交互和采样策略平衡建模精度和计算效率。

方法论

将EHR事件表示为4D点云,利用低秩关系注意力机制建模点间交互,并结合分层交互和采样策略优化。

原文摘要

Deep learning-based modeling of multimodal Electronic Health Records (EHRs) has become an important approach for clinical diagnosis and risk prediction. However, due to diverse clinical workflows and privacy constraints, raw EHRs are inherently multi-level incomplete, including irregular sampling, missing modalities, and sparse labels. These issues cause temporal misalignment, modality imbalance, and limited supervision. Most existing multimodal methods assume relatively complete data, and even methods designed for incompleteness usually address only one or two of these issues in isolation. As a result, they often rely on rigid temporal/modal alignment or discard incomplete data, which may distort raw clinical semantics. To address this problem, we propose HealthPoint (HP), a unified clinical point cloud paradigm for multi-level incomplete EHRs. HP represents heterogeneous clinical events as points in a continuous 4D space defined by content, time, modality, and case. To model interactions between arbitrary point pairs, we introduce a Low-Rank Relational Attention mechanism that efficiently captures high-order dependencies across these four dimensions. We further develop a hierarchical interaction and sampling strategy to balance fine-grained modeling and computational efficiency. Built on this framework, HP enables flexible event-level interaction and fine-grained self-supervision, supporting robust modality recovery and effective use of unlabeled data. Experiments on large-scale EHR datasets for risk prediction show that HP consistently achieves state-of-the-art performance and strong robustness under varying degrees of incompleteness.

标签

EHR 多模态 不完全数据 深度学习 风险预测

arXiv 分类

cs.LG cs.AI