To mitigate the multi-access latency in federated edge learning, an efficient broadband analog transmission scheme has been recently proposed, featuring the aggregation of analog modulated gradients via the waveform-superposition property of the wireless medium. However, the assumed linear analog modulation makes it difficult to deploy this technique in modern wireless systems that exclusively use digital modulation. To address this issue, we propose in this work a novel digital version of broadband over-the-air aggregation, called one-bit broadband digital aggregation. The new scheme features one-bit gradient quantization followed by digital modulation at the edge devices and a simple threshold-based decoding at the edge server. We develop a comprehensive analysis framework for quantifying the effects of wireless channel hostilities (channel noise and fading) on the convergence rate. The analysis shows that the hostilities slow down the convergence of the learning process by introducing a scaling factor and a bias term into the gradient norm. However, all the negative effects vanish as the number of devices grows, but at a different rate for each type of channel hostility.
One-Bit Over-the-Air Aggregation for Communication-Efficient Federated Edge Learning / Zhu, G.; Du, Y.; Gunduz, D.; Huang, K.. - (2020), pp. 1-6. (Intervento presentato al convegno 2020 IEEE Global Communications Conference, GLOBECOM 2020 tenutosi a twn nel 2020) [10.1109/GLOBECOM42002.2020.9322334].
One-Bit Over-the-Air Aggregation for Communication-Efficient Federated Edge Learning
Gunduz D.;
2020
Abstract
To mitigate the multi-access latency in federated edge learning, an efficient broadband analog transmission scheme has been recently proposed, featuring the aggregation of analog modulated gradients via the waveform-superposition property of the wireless medium. However, the assumed linear analog modulation makes it difficult to deploy this technique in modern wireless systems that exclusively use digital modulation. To address this issue, we propose in this work a novel digital version of broadband over-the-air aggregation, called one-bit broadband digital aggregation. The new scheme features one-bit gradient quantization followed by digital modulation at the edge devices and a simple threshold-based decoding at the edge server. We develop a comprehensive analysis framework for quantifying the effects of wireless channel hostilities (channel noise and fading) on the convergence rate. The analysis shows that the hostilities slow down the convergence of the learning process by introducing a scaling factor and a bias term into the gradient norm. However, all the negative effects vanish as the number of devices grows, but at a different rate for each type of channel hostility.Pubblicazioni consigliate
I metadati presenti in IRIS UNIMORE sono rilasciati con licenza Creative Commons CC0 1.0 Universal, mentre i file delle pubblicazioni sono rilasciati con licenza Attribuzione 4.0 Internazionale (CC BY 4.0), salvo diversa indicazione.
In caso di violazione di copyright, contattare Supporto Iris