LLM Reasoning 相关度: 8/10

Beyond LLMs, Sparse Distributed Memory, and Neuromorphics <A Hyper-Dimensional SRAM-CAM "VaCoAl" for Ultra-High Speed, Ultra-Low Power, and Low Cost>

Hiroyuki Chuma, Kanji Otsuka, Yoichi Sato
arXiv: 2604.11665v1 发布: 2026-04-13 更新: 2026-04-13

AI 摘要

提出VaCoAl,一种基于超高维SRAM-CAM的确定性超维计算架构,用于超高速、超低功耗的多跳推理。

主要贡献

  • 提出了VaCoAl架构,一种基于超维计算的AI范式。
  • 揭示了确定性超维计算中涌现的类似STDP的语义选择机制。
  • 通过在Wikidata上的实验,展示了VaCoAl在多跳推理中的能力。

方法论

使用Galois域扩散解决高维二元空间中的正交化和检索问题,结合超维捆绑和解绑,通过CR评分进行去噪,进行多跳推理。

原文摘要

This paper reports an unexpected finding: in a deterministic hyperdimensional computing (HDC) architecture based on Galois-field algebra, a path-dependent semantic selection mechanism emerges, equivalent to spike-timing-dependent plasticity (STDP), with magnitude predictable a priori by a closed-form expression matching large-scale measurements. This addresses limitations of modern AI including catastrophic forgetting, learning stagnation, and the Binding Problem at an algebraic level. We propose VaCoAl (Vague Coincident Algorithm) and its Python implementation PyVaCoAl, combining ultra-high-dimensional memory with deterministic logic. Rooted in Sparse Distributed Memory, it resolves orthogonalisation and retrieval in high-dimensional binary spaces via Galois-field diffusion, enabling low-load deployment. VaCoAl is a memory-centric architecture prioritising retrieval and association, enabling reversible composition while preserving element independence and supporting compositional generalisation with a transparent reliability metric (CR score). We evaluated multi-hop reasoning on about 470k mentor-student relations from Wikidata, tracing up to 57 generations (over 25.5M paths). Using HDC bundling and unbinding with CR-based denoising, we quantify concept propagation over DAGs. Results show a reinterpretation of the Newton-Leibniz dispute and a phase transition from sparse convergence to a post-Leibniz "superhighway", from which structural indicators emerge supporting a Kuhnian paradigm shift. Collision-tolerance mechanisms further induce path-based pruning that favors direct paths, yielding emergent semantic selection equivalent to STDP. VaCoAl thus defines a third paradigm, HDC-AI, complementing LLMs with reversible multi-hop reasoning.

标签

超维计算 Sparse Distributed Memory 神经形态计算 知识图谱 推理

arXiv 分类

cs.NE cs.AI