This paper proposes a novel human–multi-robot-system interaction approach that enjoys two main features: natural interaction and affect-based adaptation of robots behavior. Specifically, the proposed system enables interaction by means of a wrist-worn device, such as a commercial smartwatch, which allows to track user’s movements and heart activity. Thus, on the one side, the proposed system allows the user to intuitively drive the robots by establishing a natural mapping between wrist movements and robots velocity. On the other side, the system estimates user’s mental fatigue during interaction by means of the analysis of heart rate variability. The proposed interaction system adapts then the behavior of the multi-robot system when the interacting user gets overwhelmed with the interaction and control task, which is then simplified. Experimental validation is provided, to show the effectiveness of the proposed system. First, the natural and affect-based interaction are considered separately. Then, the approach is tested considering a complex realistic scenario, which is simulated in virtual reality in order to get an immersive and realistic interaction experience. The results of the experimental validation clearly show that the proposed affect-based adaptive system leads to relieving the user’s fatigue and mental workload.

Humans interacting with multi-robot systems: a natural affect-based approach / Villani, V.; Capelli, B.; Secchi, C.; Fantuzzi, C.; Sabattini, L.. - In: AUTONOMOUS ROBOTS. - ISSN 0929-5593. - 44:3-4(2020), pp. 601-616. [10.1007/s10514-019-09889-6]

Humans interacting with multi-robot systems: a natural affect-based approach

Villani V.
;
Capelli B.;Secchi C.;Fantuzzi C.;Sabattini L.
2020

Abstract

This paper proposes a novel human–multi-robot-system interaction approach that enjoys two main features: natural interaction and affect-based adaptation of robots behavior. Specifically, the proposed system enables interaction by means of a wrist-worn device, such as a commercial smartwatch, which allows to track user’s movements and heart activity. Thus, on the one side, the proposed system allows the user to intuitively drive the robots by establishing a natural mapping between wrist movements and robots velocity. On the other side, the system estimates user’s mental fatigue during interaction by means of the analysis of heart rate variability. The proposed interaction system adapts then the behavior of the multi-robot system when the interacting user gets overwhelmed with the interaction and control task, which is then simplified. Experimental validation is provided, to show the effectiveness of the proposed system. First, the natural and affect-based interaction are considered separately. Then, the approach is tested considering a complex realistic scenario, which is simulated in virtual reality in order to get an immersive and realistic interaction experience. The results of the experimental validation clearly show that the proposed affect-based adaptive system leads to relieving the user’s fatigue and mental workload.
2020
22-ott-2019
44
3-4
601
616
Humans interacting with multi-robot systems: a natural affect-based approach / Villani, V.; Capelli, B.; Secchi, C.; Fantuzzi, C.; Sabattini, L.. - In: AUTONOMOUS ROBOTS. - ISSN 0929-5593. - 44:3-4(2020), pp. 601-616. [10.1007/s10514-019-09889-6]
Villani, V.; Capelli, B.; Secchi, C.; Fantuzzi, C.; Sabattini, L.
File in questo prodotto:
File Dimensione Formato  
2020_AURO_MRS.pdf

Accesso riservato

Tipologia: Versione pubblicata dall'editore
Dimensione 1.53 MB
Formato Adobe PDF
1.53 MB Adobe PDF   Visualizza/Apri   Richiedi una copia
Pubblicazioni consigliate

Licenza Creative Commons
I metadati presenti in IRIS UNIMORE sono rilasciati con licenza Creative Commons CC0 1.0 Universal, mentre i file delle pubblicazioni sono rilasciati con licenza Attribuzione 4.0 Internazionale (CC BY 4.0), salvo diversa indicazione.
In caso di violazione di copyright, contattare Supporto Iris

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11380/1185842
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 10
  • ???jsp.display-item.citation.isi??? 10
social impact