Lightweight Decentralized Federated Learning with Arbitrary Client Participation

Decentralized federated learning (DFL) can greatly reduce communication costs due to its decentralized communication structure compared to traditional centralized federated learning (FL). Existing works on FL with partial client participation often considered idealized scenarios (such as all clients participate in a round with the same probability), or required using clients' past gradient/model information which can be too costly to implement, or focused on centralized FL. In this paper, we study lightweight decentralized federated learning that does not use any client's past gradient/model information. We first present a novel sample-path-based cyclic convergence analysis for lightweight DFL with arbitrary client participation for the non-convex objectives case. The cyclic convergence analysis bounds clients' local model drifts due to partial participation over multiple rounds within a cycle and the cyclic consensus error via a per-cycle descent approach, while capturing the effect of client participation through a single unified term. By analyzing this term, we propose Cyclic Decentralized Federated Learning (CDFL), which enables general cyclic client participation by requiring only that each client performs the same total number of local updates per cycle. Our results show that CDFL achieves a convergence rate that matches existing benchmarks. We further propose a cyclic control framework that is both training-round and energy efficient to adaptively select participating clients and determine their number of local updates. Numerical experiments using real-world datasets verify our theoretical results and demonstrate the effectiveness of CDFL and the adaptive cyclic control framework.