Agent Tuning & Optimization 相关度: 6/10

Adaptive Decentralized Composite Optimization via Three-Operator Splitting

Xiaokai Chen, Ilya Kuruzov, Gesualdo Scutari
arXiv: 2602.17545v1 发布: 2026-02-19 更新: 2026-02-19

AI 摘要

提出了一种自适应去中心化复合优化方法,利用三算子分裂和BCV预处理实现高效优化。

主要贡献

  • 提出自适应步长的去中心化优化方法
  • 利用三算子分裂和BCV预处理
  • 证明了算法的收敛性,包括次线性收敛和线性收敛

方法论

采用三算子分裂分解,结合BCV预处理,以及局部回溯策略调整步长,实现去中心化优化。

原文摘要

The paper studies decentralized optimization over networks, where agents minimize a sum of {\it locally} smooth (strongly) convex losses and plus a nonsmooth convex extended value term. We propose decentralized methods wherein agents {\it adaptively} adjust their stepsize via local backtracking procedures coupled with lightweight min-consensus protocols. Our design stems from a three-operator splitting factorization applied to an equivalent reformulation of the problem. The reformulation is endowed with a new BCV preconditioning metric (Bertsekas-O'Connor-Vandenberghe), which enables efficient decentralized implementation and local stepsize adjustments. We establish robust convergence guarantees. Under mere convexity, the proposed methods converge with a sublinear rate. Under strong convexity of the sum-function, and assuming the nonsmooth component is partly smooth, we further prove linear convergence. Numerical experiments corroborate the theory and highlight the effectiveness of the proposed adaptive stepsize strategy.

标签

去中心化优化 自适应步长 三算子分裂 凸优化

arXiv 分类

math.OC cs.LG cs.MA