TY - GEN
T1 - Distributed nonconvex multiagent optimization over time-varying networks
AU - Sun, Ying
AU - Scutari, Gesualdo
AU - Palomar, Daniel
N1 - Publisher Copyright:
© 2016 IEEE.
PY - 2017/3/1
Y1 - 2017/3/1
N2 - We study nonconvex distributed optimization in multiagent networks where the communications between nodes is modeled as a time-varying sequence of arbitrary digraphs. We introduce a novel broadcast-based distributed algorithmic framework for the (constrained) minimization of the sum of a smooth (possibly nonconvex and nonseparable) function, i.e., the agents' sum-utility, plus a convex (possibly nonsmooth and nonseparable) regularizer. The latter is usually employed to enforce some structure in the solution, typically sparsity. The proposed method hinges on Successive Convex Approximation (SCA) techniques coupled with i) a tracking mechanism instrumental to locally estimate the gradients of agents' cost functions; and ii) a novel broadcast protocol to disseminate information and distribute the computation among the agents. Asymptotic convergence to stationary solutions is established. A key feature of the proposed algorithm is that it neither requires the double-stochasticity of the consensus matrices (but only column stochasticity) nor the knowledge of the graph sequence to implement. To the best of our knowledge, the proposed framework is the first broadcast-based distributed algorithm for convex and nonconvex constrained optimization over arbitrary, time-varying digraphs. Numerical results show that our algorithm outperforms current schemes on both convex and nonconvex problems.
AB - We study nonconvex distributed optimization in multiagent networks where the communications between nodes is modeled as a time-varying sequence of arbitrary digraphs. We introduce a novel broadcast-based distributed algorithmic framework for the (constrained) minimization of the sum of a smooth (possibly nonconvex and nonseparable) function, i.e., the agents' sum-utility, plus a convex (possibly nonsmooth and nonseparable) regularizer. The latter is usually employed to enforce some structure in the solution, typically sparsity. The proposed method hinges on Successive Convex Approximation (SCA) techniques coupled with i) a tracking mechanism instrumental to locally estimate the gradients of agents' cost functions; and ii) a novel broadcast protocol to disseminate information and distribute the computation among the agents. Asymptotic convergence to stationary solutions is established. A key feature of the proposed algorithm is that it neither requires the double-stochasticity of the consensus matrices (but only column stochasticity) nor the knowledge of the graph sequence to implement. To the best of our knowledge, the proposed framework is the first broadcast-based distributed algorithm for convex and nonconvex constrained optimization over arbitrary, time-varying digraphs. Numerical results show that our algorithm outperforms current schemes on both convex and nonconvex problems.
UR - http://www.scopus.com/inward/record.url?scp=85016233795&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85016233795&partnerID=8YFLogxK
U2 - 10.1109/ACSSC.2016.7869154
DO - 10.1109/ACSSC.2016.7869154
M3 - Conference contribution
AN - SCOPUS:85016233795
T3 - Conference Record - Asilomar Conference on Signals, Systems and Computers
SP - 788
EP - 794
BT - Conference Record of the 50th Asilomar Conference on Signals, Systems and Computers, ACSSC 2016
A2 - Matthews, Michael B.
PB - IEEE Computer Society
T2 - 50th Asilomar Conference on Signals, Systems and Computers, ACSSC 2016
Y2 - 6 November 2016 through 9 November 2016
ER -