The time average expected age of information (AoI) is studied for status updates sent from an energy-harvesting transmitter with a finite-capacity battery. The optimal scheduling policy is first studied under different feedback mechanisms when the channel and energy harvesting statistics are known. For the case of unknown environments, an average-cost reinforcement learning algorithm is proposed that learns the system parameters and the status update policy in real time. The effectiveness of the proposed methods is verified through numerical results.

Reinforcement Learning to Minimize Age of Information with an Energy Harvesting Sensor with HARQ and Sensing Cost / Tugce Ceran, Elif; Gunduz, Deniz; Gyorgy, Andras. - (2019), pp. 656-661. (Intervento presentato al convegno 2019 INFOCOM IEEE Conference on Computer Communications Workshops, INFOCOM WKSHPS 2019 tenutosi a fra nel 2019) [10.1109/INFCOMW.2019.8845182].

Reinforcement Learning to Minimize Age of Information with an Energy Harvesting Sensor with HARQ and Sensing Cost

Deniz Gunduz;
2019

Abstract

The time average expected age of information (AoI) is studied for status updates sent from an energy-harvesting transmitter with a finite-capacity battery. The optimal scheduling policy is first studied under different feedback mechanisms when the channel and energy harvesting statistics are known. For the case of unknown environments, an average-cost reinforcement learning algorithm is proposed that learns the system parameters and the status update policy in real time. The effectiveness of the proposed methods is verified through numerical results.
2019
2019 INFOCOM IEEE Conference on Computer Communications Workshops, INFOCOM WKSHPS 2019
fra
2019
656
661
Tugce Ceran, Elif; Gunduz, Deniz; Gyorgy, Andras
Reinforcement Learning to Minimize Age of Information with an Energy Harvesting Sensor with HARQ and Sensing Cost / Tugce Ceran, Elif; Gunduz, Deniz; Gyorgy, Andras. - (2019), pp. 656-661. (Intervento presentato al convegno 2019 INFOCOM IEEE Conference on Computer Communications Workshops, INFOCOM WKSHPS 2019 tenutosi a fra nel 2019) [10.1109/INFCOMW.2019.8845182].
File in questo prodotto:
Non ci sono file associati a questo prodotto.
Pubblicazioni consigliate

Licenza Creative Commons
I metadati presenti in IRIS UNIMORE sono rilasciati con licenza Creative Commons CC0 1.0 Universal, mentre i file delle pubblicazioni sono rilasciati con licenza Attribuzione 4.0 Internazionale (CC BY 4.0), salvo diversa indicazione.
In caso di violazione di copyright, contattare Supporto Iris

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11380/1202755
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 45
  • ???jsp.display-item.citation.isi??? 36
social impact