Algorithmic Analysis of Dense Associative Memory: Finite-Size Guarantees and Adversarial Robustness
AI 摘要
论文分析了密集关联记忆(DAM)的算法,提供了有限尺寸保证和对抗鲁棒性。
主要贡献
- 建立了有限N条件下的DAM检索动态几何收敛证明
- 建立了对抗鲁棒性边界,量化了每次扫描可容忍的损坏位数
- 推导了容量保证,在最坏情况下与随机模式集合恢复经典缩放
方法论
通过显式可验证的模式条件,结合分离假设和有界干扰条件,进行算法分析和证明。
原文摘要
Dense Associative Memory (DAM) generalizes Hopfield networks through higher-order interactions and achieves storage capacity that scales as $O(N^{n-1})$ under suitable pattern separation conditions. Existing dynamical analyses primarily study the thermodynamic limit $N\to\infty$ with randomly sampled patterns and therefore do not provide finite-size guarantees or explicit convergence rates. We develop an algorithmic analysis of DAM retrieval dynamics that yields finite-$N$ guarantees under explicit, verifiable pattern conditions. Under a separation assumption and a bounded-interference condition at high loading, we prove geometric convergence of asynchronous retrieval dynamics, which implies $O(\log N)$ convergence time once the trajectory enters the basin of attraction. We further establish adversarial robustness bounds expressed through an explicit margin condition that quantifies the number of corrupted bits tolerable per sweep, and derive capacity guarantees that scale as $Θ(N^{n-1})$ up to polylogarithmic factors in the worst case, while recovering the classical $Θ(N^{n-1})$ scaling for random pattern ensembles. Finally, we show that DAM retrieval dynamics admit a potential-game interpretation that ensures convergence to pure Nash equilibria under asynchronous updates. Complete proofs are provided in the appendices, together with preliminary experiments that illustrate the predicted convergence, robustness, and capacity scaling behavior.