AI Agents 相关度: 7/10

Information as Structural Alignment: A Dynamical Theory of Continual Learning

Radu Negulescu
arXiv: 2604.07108v1 发布: 2026-04-08 更新: 2026-04-08

AI 摘要

提出Informational Buildup Framework (IBF),基于结构对齐实现持续学习,无需额外记忆模块。

主要贡献

  • 提出IBF框架,基于信息结构对齐而非存储内容
  • 利用运动定律和修正动力学实现记忆和自纠正
  • 在非稳态环境、象棋和CIFAR-100上验证了IBF的有效性

方法论

IBF通过运动定律和修正动力学驱动配置向更高的一致性演进,从而实现持续学习。

原文摘要

Catastrophic forgetting is not an engineering failure. It is a mathematical consequence of storing knowledge as global parameter superposition. Existing methods, such as regularization, replay, and frozen subnetworks, add external mechanisms to a shared-parameter substrate. None derives retention from the learning dynamics themselves. This paper introduces the Informational Buildup Framework (IBF), an alternative substrate for continual learning, based on the premise that information is the achievement of structural alignment rather than stored content. In IBF, two equations govern the dynamics: a Law of Motion that drives configuration toward higher coherence, and Modification Dynamics that persistently deform the coherence landscape in response to localized discrepancies. Memory, agency, and self-correction arise from these dynamics rather than being added as separate modules. We first demonstrate the full lifecycle in a transparent two-dimensional toy model, then validate across three domains: a controlled non-stationary world, chess evaluated independently by Stockfish, and Split-CIFAR-100 with a frozen ViT encoder. Across all three, IBF achieves replay-superior retention without storing raw data. We observe near-zero forgetting on CIFAR-100 (BT = -0.004), positive backward transfer in chess (+38.5 cp), and 43% less forgetting than replay in the controlled domain. In chess, the framework achieves a mean behavioral advantage of +88.9 +/- 2.8 cp under independent evaluation, exceeding MLP and replay baselines.

标签

continual learning catastrophic forgetting structural alignment dynamical systems

arXiv 分类

cs.LG cs.AI