Multimodal interaction generally allows the user to exploit multiple modes of interfacing with a system. A multimodal interface activates multiple sensory channels to achieve deeper user involvement and enhance the communication with the system. Sensory stimulation is one of the most important factors to reach multimodality and represents a challenge in human-computer interaction to realise enriched virtual representations. Furthermore, playing successfully in a virtual system requires synchronisation among the reproduced signals stimulating the different sensory channels. This paper presents the design and implementation of a multimodal tactile interface to create an immersive virtual experience. The proposed system is the evolution of a previous tactile platform; the main novelties regard the introduction of audio and visual feedbacks to a tactile feedback, signals’ synchronisation, and system testing, with the aim to create a robust application to be integrated into novel human-computer interfaces. Tests are carried out to evaluate the degree of synchronism among the three different outputs, system latency, and the quality of multimodal interaction provided based on the ability of users to discriminate different materials by their virtual simulation.

A multimodal tactile interface for immersive virtual experience / Peruzzini, Margherita; Mengoni, Maura; Cavalieri, Lorenzo. - In: INTERNATIONAL JOURNAL OF INTELLIGENT ENGINEERING INFORMATICS. - ISSN 1758-8715. - ELETTRONICO. - 5 (1):(2017), pp. 1-21. [10.1504/IJIEI.2017.082563]

A multimodal tactile interface for immersive virtual experience

PERUZZINI, MARGHERITA;
2017

Abstract

Multimodal interaction generally allows the user to exploit multiple modes of interfacing with a system. A multimodal interface activates multiple sensory channels to achieve deeper user involvement and enhance the communication with the system. Sensory stimulation is one of the most important factors to reach multimodality and represents a challenge in human-computer interaction to realise enriched virtual representations. Furthermore, playing successfully in a virtual system requires synchronisation among the reproduced signals stimulating the different sensory channels. This paper presents the design and implementation of a multimodal tactile interface to create an immersive virtual experience. The proposed system is the evolution of a previous tactile platform; the main novelties regard the introduction of audio and visual feedbacks to a tactile feedback, signals’ synchronisation, and system testing, with the aim to create a robust application to be integrated into novel human-computer interfaces. Tests are carried out to evaluate the degree of synchronism among the three different outputs, system latency, and the quality of multimodal interaction provided based on the ability of users to discriminate different materials by their virtual simulation.
feb-2017
5 (1)
1
21
A multimodal tactile interface for immersive virtual experience / Peruzzini, Margherita; Mengoni, Maura; Cavalieri, Lorenzo. - In: INTERNATIONAL JOURNAL OF INTELLIGENT ENGINEERING INFORMATICS. - ISSN 1758-8715. - ELETTRONICO. - 5 (1):(2017), pp. 1-21. [10.1504/IJIEI.2017.082563]
Peruzzini, Margherita; Mengoni, Maura; Cavalieri, Lorenzo
File in questo prodotto:
Non ci sono file associati a questo prodotto.
Pubblicazioni consigliate

Caricamento pubblicazioni consigliate

Licenza Creative Commons
I metadati presenti in IRIS UNIMORE sono rilasciati con licenza Creative Commons CC0 1.0 Universal, mentre i file delle pubblicazioni sono rilasciati con licenza Attribuzione 4.0 Internazionale (CC BY 4.0), salvo diversa indicazione.
In caso di violazione di copyright, contattare Supporto Iris

Utilizza questo identificativo per citare o creare un link a questo documento: http://hdl.handle.net/11380/1103476
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? 2
social impact