AI Agents 相关度: 9/10

The cognitive companion: a lightweight parallel monitoring architecture for detecting and recovering from reasoning degradation in LLM agents

Rafflesia Khan, Nafiul Islam Khan
arXiv: 2604.13759v1 发布: 2026-04-15 更新: 2026-04-15

AI 摘要

提出一种轻量级并行监控架构,用于检测和恢复LLM Agent的推理退化。

主要贡献

  • 提出 Cognitive Companion 架构,包括LLM-based和Probe-based两种实现
  • 验证了该架构在降低循环重复问题上的有效性
  • 发现 Companion 的效果与任务类型相关

方法论

采用Gemma、Qwen、Llama等模型进行实验,通过并行监控Agent的推理过程来检测和恢复推理退化。

原文摘要

Large language model (LLM) agents on multi-step tasks suffer reasoning degradation, looping, drift, stuck states, at rates up to 30% on hard tasks. Current solutions include hard step limits (abrupt) or LLM-as-judge monitoring (10-15% overhead per step). This paper introduces the Cognitive Companion, a parallel monitoring architecture with two implementations: an LLM-based Companion and a novel zero-overhead Probe-based Companion. We report a three-batch feasibility study centered on Gemma 4 E4B, with an additional exploratory small-model analysis on Qwen 2.5 1.5B and Llama 3.2 1B. In our experiments, the LLM-based Companion reduced repetition on loop-prone tasks by 52-62% with approximately 11% overhead. The Probe-based Companion, trained on hidden states from layer 28, showed a mean effect size of +0.471 at zero measured inference overhead; its strongest probe result achieved cross-validated AUROC 0.840 on a small proxy-labeled dataset. A key empirical finding is that companion benefit appears task-type dependent: companions are most helpful on loop-prone and open-ended tasks, while effects are neutral or negative on more structured tasks. Our small-model experiments also suggest a possible scale boundary: companions did not improve the measured quality proxy on 1B-1.5B models, even when interventions fired. Overall, the paper should be read as a feasibility study rather than a definitive validation. The results provide encouraging evidence that sub-token monitoring may be useful, identify task-type sensitivity as a practical design constraint, and motivate selective companion activation as a promising direction for future work.

标签

LLM Agents Reasoning Monitoring Error Recovery

arXiv 分类

cs.AI cs.LG