AI Agents 相关度: 9/10

Token Coherence: Adapting MESI Cache Protocols to Minimize Synchronization Overhead in Multi-Agent LLM Systems

Vladyslav Parakhin
arXiv: 2603.15183v1 发布: 2026-03-16 更新: 2026-03-16

AI 摘要

提出ACS系统,借鉴MESI协议优化多智能体LLM系统中的同步开销,实现显著的token节省。

主要贡献

  • 形式化MESI协议到artifact状态的映射
  • Token一致性定理,作为节省的下界
  • TLA+验证的协议,具有三个已证明的不变量

方法论

借鉴MESI缓存一致性协议,构建Artifact Coherence System (ACS),使用TLA+验证协议,并通过模拟评估token节省。

原文摘要

Multi-agent LLM orchestration incurs synchronization costs scaling as O(n x S x |D|) in agents, steps, and artifact size under naive broadcast -- a regime I term broadcast-induced triply-multiplicative overhead. I argue this pathology is a structural residue of full-state rebroadcast, not an inherent property of multi-agent coordination. The central claim: synchronization cost explosion in LLM multi-agent systems maps with formal precision onto the cache coherence problem in shared-memory multiprocessors, and MESI-protocol invalidation transfers to artifact synchronization under minimal structural modification. I construct the Artifact Coherence System (ACS) and prove the Token Coherence Theorem: lazy invalidation attenuates cost by at least S/(n + W(d_i)) when S > n + W(d_i), converting O(n x S x |D|) to O((n + W) x |D|). A TLA+-verified protocol enforces single-writer safety, monotonic versioning, and bounded staleness across ~2,400 explored states. Simulation across four workload configurations yields token savings of 95.0% +/- 1.3% at V=0.05, 92.3% +/- 1.4% at V=0.10, 88.3% +/- 1.5% at V=0.25, and 84.2% +/- 1.3% at V=0.50 -- each exceeding the theorem's conservative lower bounds. Savings of ~81% persist at V=0.9, contrary to the predicted collapse threshold. Contributions: (1) formal MESI-to-artifact state mapping; (2) Token Coherence Theorem as savings lower bound; (3) TLA+-verified protocol with three proven invariants; (4) characterization of conditional artifact access semantics resolving the always-read objection; (5) reference Python implementation integrating with LangGraph, CrewAI, and AutoGen via thin adapter layers.

标签

multi-agent LLM cache coherence synchronization MESI

arXiv 分类

cs.DC cs.AI cs.LG cs.MA