1. Server-side adaptive federated learning over wireless mesh network
- Author
-
Universitat Politècnica de Catalunya. Departament d'Arquitectura de Computadors, Universitat Politècnica de Catalunya. CNDS - Xarxes de Computadors i Sistemes Distribuïts, Freitag, Fèlix, Wei, Lu, Liu, Chun-Hung, Selimi, Mennan, Veiga, Luis, Universitat Politècnica de Catalunya. Departament d'Arquitectura de Computadors, Universitat Politècnica de Catalunya. CNDS - Xarxes de Computadors i Sistemes Distribuïts, Freitag, Fèlix, Wei, Lu, Liu, Chun-Hung, Selimi, Mennan, and Veiga, Luis
- Abstract
In federated learning, distributed nodes train a local machine learning model and exchange it through a central aggregator. In real environments, these training nodes are heterogeneous in computing capacity and bandwidth, thus their specific characteristics influence the performance of the federated learning process. We propose for such situations the design of a federated learning server that is able to adapt dynamically to the heterogeneity of the training nodes. In experiments with real devices deployed in a wireless mesh network, we observed that the designed adaptive federated learning server successfully exploited the idle times of the fast nodes by assigning them larger training workloads, which led to a higher global model performance without increasing the training time., This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 871582 — NGIatlantic.eu and was partially supported by the Spanish Government under contracts PID2019-106774RB-C21, PCI2019-111851-2 (LeadingEdge CHIST-ERA), PCI2019-111850-2 (DiPET CHIST-ERA), and by national funds through FCT, Fundação para a Ciência e a Tecnologia, Portugal, under project UIDB/50021/2020. The work of C.-H. Liu was supported in part by the U.S. National Science Foundation (NSF) under Award CNS-2006453 and in part by Mississippi State University under Grant ORED 253551-060702. The work of L. Wei is supported in part by the U.S. National Science Foundation (#2006612 and #2150486)., Peer Reviewed, Postprint (author's final draft)
- Published
- 2023