Adaptive Decentralized Composite Optimization via Three-Operator Splitting
AI 摘要
提出了一种自适应去中心化复合优化方法,利用三算子分裂和BCV预处理实现高效优化。
主要贡献
- 提出自适应步长的去中心化优化方法
- 利用三算子分裂和BCV预处理
- 证明了算法的收敛性,包括次线性收敛和线性收敛
方法论
采用三算子分裂分解,结合BCV预处理,以及局部回溯策略调整步长,实现去中心化优化。
原文摘要
The paper studies decentralized optimization over networks, where agents minimize a sum of {\it locally} smooth (strongly) convex losses and plus a nonsmooth convex extended value term. We propose decentralized methods wherein agents {\it adaptively} adjust their stepsize via local backtracking procedures coupled with lightweight min-consensus protocols. Our design stems from a three-operator splitting factorization applied to an equivalent reformulation of the problem. The reformulation is endowed with a new BCV preconditioning metric (Bertsekas-O'Connor-Vandenberghe), which enables efficient decentralized implementation and local stepsize adjustments. We establish robust convergence guarantees. Under mere convexity, the proposed methods converge with a sublinear rate. Under strong convexity of the sum-function, and assuming the nonsmooth component is partly smooth, we further prove linear convergence. Numerical experiments corroborate the theory and highlight the effectiveness of the proposed adaptive stepsize strategy.