Between Resolution Collapse and Variance Inflation: Weighted Conformal Anomaly Detection in Low-Data Regimes
AI 摘要
提出了连续权重核密度估计方法,解决低数据量下的加权一致性异常检测问题。
主要贡献
- 解决了加权一致性异常检测中分辨率崩溃和方差膨胀的权衡问题
- 提出了基于连续权重核密度估计的推理松弛方法
- 提高了低数据量下的异常检测能力,同时保持有效的边际误差控制
方法论
使用连续加权核密度估计解耦局部适应和尾部解析,从而避免离散化造成的统计能力损失。
原文摘要
Standard conformal anomaly detection provides marginal finite-sample guarantees under the assumption of exchangeability . However, real-world data often exhibit distribution shifts, necessitating a weighted conformal approach to adapt to local non-stationarity. We show that this adaptation induces a critical trade-off between the minimum attainable p-value and its stability. As importance weights localize to relevant calibration instances, the effective sample size decreases. This can render standard conformal p-values overly conservative for effective error control, while the smoothing technique used to mitigate this issue introduces conditional variance, potentially masking anomalies. We propose a continuous inference relaxation that resolves this dilemma by decoupling local adaptation from tail resolution via continuous weighted kernel density estimation. While relaxing finite-sample exactness to asymptotic validity, our method eliminates Monte Carlo variability and recovers the statistical power lost to discretization. Empirical evaluations confirm that our approach not only restores detection capabilities where discrete baselines yield zero discoveries, but outperforms standard methods in statistical power while maintaining valid marginal error control in practice.