LLM Reasoning 相关度: 9/10

Epistemic Blinding: An Inference-Time Protocol for Auditing Prior Contamination in LLM-Assisted Analysis

Michael Cuccarese
arXiv: 2604.06013v1 发布: 2026-04-07 更新: 2026-04-07

AI 摘要

提出了一种评估LLM分析中先验知识污染的方法:认知盲化,并开源了相关工具。

主要贡献

  • 提出认知盲化方法,用于评估LLM输出对先验知识的依赖程度。
  • 开发了开源工具,方便研究者应用认知盲化方法。
  • 通过实验证明了该方法在生物和金融领域的有效性。

方法论

提出了推理时协议,用匿名代码替换实体标识符,然后将输出与未屏蔽的控制进行比较,以测量来自数据和模型参数知识的输出比例。

原文摘要

This paper presents epistemic blinding in the context of an agentic system that uses large language models to reason across multiple biological datasets for drug target prioritization. During development, it became apparent that LLM outputs silently blend data-driven inference with memorized priors about named entities - and the blend is invisible: there is no way to determine, from a single output, how much came from the data on the page and how much came from the model's training memory. Epistemic blinding is a simple inference-time protocol that replaces entity identifiers with anonymous codes before prompting, then compares outputs against an unblinded control. The protocol does not make LLM reasoning deterministic, but it restores one critical axis of auditability: measuring how much of an output came from the supplied data versus the model's parametric knowledge. The complete target identification system is described - including LLM-guided evolutionary optimization of scoring functions and blinded agentic reasoning for target rationalization - with demonstration that both stages operate without access to entity identity. In oncology drug target prioritization across four cancer types, blinding changes 16% of top-20 predictions while preserving identical recovery of validated targets. The contamination problem is shown to generalize beyond biology: in S&P 500 equity screening, brand-recognition bias reshapes 30-40% of top-20 rankings across five random seeds. To lower the barrier to adoption, the protocol is released as an open-source tool and as a Claude Code skill that enables one-command epistemic blinding within agentic workflows. The claim is not that blinded analysis produces better results, but that without blinding, there is no way to know to what degree the agent is adhering to the analytical process the researcher designed.

标签

LLM Auditability Data Contamination Entity Blinding

arXiv 分类

cs.AI cs.CL