SFCoT: Safer Chain-of-Thought via Active Safety Evaluation and Calibration
AI 摘要
SFCoT通过主动安全评估和校准,提升LLM在推理过程中的安全性,有效抵抗对抗性攻击。
主要贡献
- 提出SFCoT框架,实现推理过程中的实时安全评估和校准
- 设计三层安全评分系统和多角度一致性验证机制
- 开发动态干预模块,引导推理轨迹回归安全结果
方法论
SFCoT通过安全评分、一致性验证和动态干预,实时监控和校准推理步骤,降低攻击成功率。
原文摘要
Large language models (LLMs) have demonstrated remarkable capabilities in complex reasoning tasks. However, they remain highly susceptible to jailbreak attacks that undermine their safety alignment. Existing defense mechanisms typically rely on post hoc filtering applied only to the final output, leaving intermediate reasoning steps unmonitored and vulnerable to adversarial manipulation. To address this gap, this paper proposes a SaFer Chain-of-Thought (SFCoT) framework, which proactively evaluates and calibrates potentially unsafe reasoning steps in real time. SFCoT incorporates a three-tier safety scoring system alongside a multi-perspective consistency verification mechanism, designed to detect potential risks throughout the reasoning process. A dynamic intervention module subsequently performs targeted calibration to redirect reasoning trajectories toward safe outcomes. Experimental results demonstrate that SFCoT reduces the attack success rate from $58.97\%$ to $12.31\%$, demonstrating it as an effective and efficient LLM safety enhancement method without a significant decline in general performance.