LLM Reasoning 相关度: 9/10

Mechanistic Circuit-Based Knowledge Editing in Large Language Models

Tianyi Zhao, Yinhan He, Wendy Zheng, Chen Chen
arXiv: 2604.05876v1 发布: 2026-04-07 更新: 2026-04-07

AI 摘要

MCircKE通过定位并编辑LLM中的因果回路,提升知识编辑在多步推理中的效果。

主要贡献

  • 提出一种基于因果回路的知识编辑方法MCircKE
  • 解决了现有知识编辑方法在多步推理中存在的“推理鸿沟”问题
  • 在MQuAKE-3K基准测试上验证了MCircKE的有效性

方法论

MCircKE首先识别负责特定推理任务的因果回路,然后仅在该回路内更新参数,实现精准编辑。

原文摘要

Deploying Large Language Models (LLMs) in real-world dynamic environments raises the challenge of updating their pre-trained knowledge. While existing knowledge editing methods can reliably patch isolated facts, they frequently suffer from a "Reasoning Gap", where the model recalls the edited fact but fails to utilize it in multi-step reasoning chains. To bridge this gap, we introduce MCircKE (\underline{M}echanistic \underline{Circ}uit-based \underline{K}nowledge \underline{E}diting), a novel framework that enables a precise "map-and-adapt" editing procedure. MCircKE first identifies the causal circuits responsible for a specific reasoning task, capturing both the storage of the fact and the routing of its logical consequences. It then surgically update parameters exclusively within this mapped circuit. Extensive experiments on the MQuAKE-3K benchmark demonstrate the effectiveness of the proposed method for multi-hop reasoning in knowledge editing.

标签

知识编辑 因果回路 多步推理 大语言模型

arXiv 分类

cs.CL