We investigate the effective communications problem, in which the goal of the transmitter is to impact the actions of the receiver over a time frame in order to maximize the prescribed reward function. This problem is formulated as a multi-agent partially-observable Markov decision process (MA-POMDP), where one agent can communicate to the other through a noisy communication channel. In this paper, we show that not only should the communication scheme be jointly designed with the underlying learning objective, but the context of the problem can also be exploited to achieve even greater effectiveness. Here, the context refers to a function of the state of the environment that is available to both agents. We then show that, using different communication schemes depending on the context is beneficial to the effectiveness of the solution. We emphasize that this is different from sending different messages at different states; with the proposed context-aware communication scheme, the same message is interpreted differently by the receiver depending on the context, similarly to human communications, where the meaning of a sentence may change depending on the context.

Context-Aware Effective Communications / Tung, T. -Y.; Kobus, S.; Gunduz, D.. - 2021-:(2021), pp. 334-339. (Intervento presentato al convegno 55th Asilomar Conference on Signals, Systems and Computers, ACSSC 2021 tenutosi a Asilomar Hotel and Conference Grounds, usa nel 2021) [10.1109/IEEECONF53345.2021.9723337].

Context-Aware Effective Communications

Gunduz D.
2021

Abstract

We investigate the effective communications problem, in which the goal of the transmitter is to impact the actions of the receiver over a time frame in order to maximize the prescribed reward function. This problem is formulated as a multi-agent partially-observable Markov decision process (MA-POMDP), where one agent can communicate to the other through a noisy communication channel. In this paper, we show that not only should the communication scheme be jointly designed with the underlying learning objective, but the context of the problem can also be exploited to achieve even greater effectiveness. Here, the context refers to a function of the state of the environment that is available to both agents. We then show that, using different communication schemes depending on the context is beneficial to the effectiveness of the solution. We emphasize that this is different from sending different messages at different states; with the proposed context-aware communication scheme, the same message is interpreted differently by the receiver depending on the context, similarly to human communications, where the meaning of a sentence may change depending on the context.
2021
55th Asilomar Conference on Signals, Systems and Computers, ACSSC 2021
Asilomar Hotel and Conference Grounds, usa
2021
2021-
334
339
Tung, T. -Y.; Kobus, S.; Gunduz, D.
Context-Aware Effective Communications / Tung, T. -Y.; Kobus, S.; Gunduz, D.. - 2021-:(2021), pp. 334-339. (Intervento presentato al convegno 55th Asilomar Conference on Signals, Systems and Computers, ACSSC 2021 tenutosi a Asilomar Hotel and Conference Grounds, usa nel 2021) [10.1109/IEEECONF53345.2021.9723337].
File in questo prodotto:
File Dimensione Formato  
Context-Aware_Effective_Communications.pdf

Accesso riservato

Tipologia: Versione pubblicata dall'editore
Dimensione 1.09 MB
Formato Adobe PDF
1.09 MB Adobe PDF   Visualizza/Apri   Richiedi una copia
Pubblicazioni consigliate

Licenza Creative Commons
I metadati presenti in IRIS UNIMORE sono rilasciati con licenza Creative Commons CC0 1.0 Universal, mentre i file delle pubblicazioni sono rilasciati con licenza Attribuzione 4.0 Internazionale (CC BY 4.0), salvo diversa indicazione.
In caso di violazione di copyright, contattare Supporto Iris

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11380/1280115
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 2
  • ???jsp.display-item.citation.isi??? ND
social impact