A Fast Row-Stochastic Decentralized Method for Distributed Optimization Over Directed Graphs

Diyako Ghaderyan, Necdet Serhat Aybat, A. Pedro Aguiar, Fernando Lobo Pereira

Research output: Contribution to journalArticlepeer-review


In this article, we introduce a fast row-stochastic decentralized algorithm, referred to as FRSD, to solve consensus optimization problems over directed communication graphs. The proposed algorithm only utilizes row-stochastic weights, leading to certain practical advantages in broadcast communication settings over those requiring column-stochastic weights. Under the assumption that each node-specific function is smooth and strongly convex, we show that the FRSD iterate sequence converges with a linear rate to the optimal consensus solution. In contrast to the existing methods for directed networks, FRSD enjoys linear convergence without employing a gradient tracking (GT) technique explicitly, rather it implements GT implicitly with the use of a novel momentum term, which leads to a significant reduction in communication and storage overhead for each node when FRSD is implemented for solving high-dimensional problems over small-to-medium scale networks. In the numerical tests, we compare FRSD with other state-of-the-art methods, which use row-stochastic and/or column-stochastic weights.

Original languageEnglish (US)
Pages (from-to)275-289
Number of pages15
JournalIEEE Transactions on Automatic Control
Issue number1
StatePublished - Jan 1 2024

All Science Journal Classification (ASJC) codes

  • Control and Systems Engineering
  • Computer Science Applications
  • Electrical and Electronic Engineering


Dive into the research topics of 'A Fast Row-Stochastic Decentralized Method for Distributed Optimization Over Directed Graphs'. Together they form a unique fingerprint.

Cite this