To mitigate the multi-access latency in federated edge learning, an efficient broadband analog transmission scheme has been recently proposed, featuring the aggregation of analog modulated gradients via the waveform-superposition property of the wireless medium. However, the assumed linear analog modulation makes it difficult to deploy this technique in modern wireless systems that exclusively use digital modulation. To address this issue, we propose in this work a novel digital version of broadband over-the-air aggregation, called one-bit broadband digital aggregation. The new scheme features one-bit gradient quantization followed by digital modulation at the edge devices and a simple threshold-based decoding at the edge server. We develop a comprehensive analysis framework for quantifying the effects of wireless channel hostilities (channel noise and fading) on the convergence rate. The analysis shows that the hostilities slow down the convergence of the learning process by introducing a scaling factor and a bias term into the gradient norm. However, all the negative effects vanish as the number of devices grows, but at a different rate for each type of channel hostility.

One-Bit Over-the-Air Aggregation for Communication-Efficient Federated Edge Learning / Zhu, G.; Du, Y.; Gunduz, D.; Huang, K.. - (2020), pp. 1-6. (Intervento presentato al convegno 2020 IEEE Global Communications Conference, GLOBECOM 2020 tenutosi a twn nel 2020) [10.1109/GLOBECOM42002.2020.9322334].

One-Bit Over-the-Air Aggregation for Communication-Efficient Federated Edge Learning

Gunduz D.;
2020

Abstract

To mitigate the multi-access latency in federated edge learning, an efficient broadband analog transmission scheme has been recently proposed, featuring the aggregation of analog modulated gradients via the waveform-superposition property of the wireless medium. However, the assumed linear analog modulation makes it difficult to deploy this technique in modern wireless systems that exclusively use digital modulation. To address this issue, we propose in this work a novel digital version of broadband over-the-air aggregation, called one-bit broadband digital aggregation. The new scheme features one-bit gradient quantization followed by digital modulation at the edge devices and a simple threshold-based decoding at the edge server. We develop a comprehensive analysis framework for quantifying the effects of wireless channel hostilities (channel noise and fading) on the convergence rate. The analysis shows that the hostilities slow down the convergence of the learning process by introducing a scaling factor and a bias term into the gradient norm. However, all the negative effects vanish as the number of devices grows, but at a different rate for each type of channel hostility.
2020
2020 IEEE Global Communications Conference, GLOBECOM 2020
twn
2020
1
6
Zhu, G.; Du, Y.; Gunduz, D.; Huang, K.
One-Bit Over-the-Air Aggregation for Communication-Efficient Federated Edge Learning / Zhu, G.; Du, Y.; Gunduz, D.; Huang, K.. - (2020), pp. 1-6. (Intervento presentato al convegno 2020 IEEE Global Communications Conference, GLOBECOM 2020 tenutosi a twn nel 2020) [10.1109/GLOBECOM42002.2020.9322334].
File in questo prodotto:
Non ci sono file associati a questo prodotto.
Pubblicazioni consigliate

Licenza Creative Commons
I metadati presenti in IRIS UNIMORE sono rilasciati con licenza Creative Commons CC0 1.0 Universal, mentre i file delle pubblicazioni sono rilasciati con licenza Attribuzione 4.0 Internazionale (CC BY 4.0), salvo diversa indicazione.
In caso di violazione di copyright, contattare Supporto Iris

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11380/1247348
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 12
  • ???jsp.display-item.citation.isi??? 2
social impact