Multimodal Learning 相关度: 9/10

Probabilistic Feature Imputation and Uncertainty-Aware Multimodal Federated Aggregation

Nafis Fuad Shahid, Maroof Ahmed, Md Akib Haider, Saidur Rahman Sagor, Aashnan Rahman, Md Azam Hossain
arXiv: 2604.12970v1 发布: 2026-04-14 更新: 2026-04-14

AI 摘要

提出P-FIN网络,通过概率特征插补和不确定性感知的联邦聚合,解决多模态联邦学习中的模态异质性问题。

主要贡献

  • 提出Probabilistic Feature Imputation Network (P-FIN)
  • 提出Fed-UQ-Avg聚合策略
  • 利用不确定性估计提高联邦学习性能

方法论

构建概率特征插补网络,输出带有校准的不确定性估计,通过Sigmoid门控和Fed-UQ-Avg策略进行聚合。

原文摘要

Multimodal federated learning enables privacy-preserving collaborative model training across healthcare institutions. However, a fundamental challenge arises from modality heterogeneity: many clinical sites possess only a subset of modalities due to resource constraints or workflow variations. Existing approaches address this through feature imputation networks that synthesize missing modality representations, yet these methods produce point estimates without reliability measures, forcing downstream classifiers to treat all imputed features as equally trustworthy. In safety-critical medical applications, this limitation poses significant risks. We propose the Probabilistic Feature Imputation Network (P-FIN), which outputs calibrated uncertainty estimates alongside imputed features. This uncertainty is leveraged at two levels: (1) locally, through sigmoid gating that attenuates unreliable feature dimensions before classification, and (2) globally, through Fed-UQ-Avg, an aggregation strategy that prioritizes updates from clients with reliable imputation. Experiments on federated chest X-ray classification using CheXpert, NIH Open-I, and PadChest demonstrate consistent improvements over deterministic baselines, with +5.36% AUC gain in the most challenging configuration.

标签

联邦学习 多模态学习 不确定性估计 特征插补 医学影像

arXiv 分类

eess.IV cs.CV