We introduce a novel approach to cultural heritage experience: by means of ego-vision embedded devices we develop a system, which offers a more natural and entertaining way of accessing museum knowledge. Our method is based on distributed self-gesture and artwork recognition, and does not need fixed cameras nor radio-frequency identifications sensors. We propose the use of dense trajectories sampled around the hand region to perform self-gesture recognition, understanding the way a user naturally interacts with an artwork, and demonstrate that our approach can benefit from distributed training. We test our algorithms on publicly available data sets and we extend our experiments to both virtual and real museum scenarios, where our method shows robustness when challenged with real-world data. Furthermore, we run an extensive performance analysis on our ARM-based wearable device.

Gesture Recognition using Wearable Vision Sensors to Enhance Visitors' Museum Experiences / Baraldi, Lorenzo; Paci, Francesco; Serra, Giuseppe; Cucchiara, Rita. - In: IEEE SENSORS JOURNAL. - ISSN 1530-437X. - 15:5(2015), pp. 2705-2714. [10.1109/JSEN.2015.2411994]

Gesture Recognition using Wearable Vision Sensors to Enhance Visitors' Museum Experiences

BARALDI, LORENZO;PACI, FRANCESCO;SERRA, GIUSEPPE;CUCCHIARA, Rita
2015

Abstract

We introduce a novel approach to cultural heritage experience: by means of ego-vision embedded devices we develop a system, which offers a more natural and entertaining way of accessing museum knowledge. Our method is based on distributed self-gesture and artwork recognition, and does not need fixed cameras nor radio-frequency identifications sensors. We propose the use of dense trajectories sampled around the hand region to perform self-gesture recognition, understanding the way a user naturally interacts with an artwork, and demonstrate that our approach can benefit from distributed training. We test our algorithms on publicly available data sets and we extend our experiments to both virtual and real museum scenarios, where our method shows robustness when challenged with real-world data. Furthermore, we run an extensive performance analysis on our ARM-based wearable device.
2015
11-mar-2015
15
5
2705
2714
Gesture Recognition using Wearable Vision Sensors to Enhance Visitors' Museum Experiences / Baraldi, Lorenzo; Paci, Francesco; Serra, Giuseppe; Cucchiara, Rita. - In: IEEE SENSORS JOURNAL. - ISSN 1530-437X. - 15:5(2015), pp. 2705-2714. [10.1109/JSEN.2015.2411994]
Baraldi, Lorenzo; Paci, Francesco; Serra, Giuseppe; Cucchiara, Rita
File in questo prodotto:
File Dimensione Formato  
2015IEEESens.pdf

Accesso riservato

Tipologia: Versione pubblicata dall'editore
Dimensione 2.78 MB
Formato Adobe PDF
2.78 MB Adobe PDF   Visualizza/Apri   Richiedi una copia
gesture_recogn.pdf

Open access

Tipologia: Versione dell'autore revisionata e accettata per la pubblicazione
Dimensione 2.78 MB
Formato Adobe PDF
2.78 MB Adobe PDF Visualizza/Apri
Pubblicazioni consigliate

Licenza Creative Commons
I metadati presenti in IRIS UNIMORE sono rilasciati con licenza Creative Commons CC0 1.0 Universal, mentre i file delle pubblicazioni sono rilasciati con licenza Attribuzione 4.0 Internazionale (CC BY 4.0), salvo diversa indicazione.
In caso di violazione di copyright, contattare Supporto Iris

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11380/1072781
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 42
  • ???jsp.display-item.citation.isi??? 32
social impact