Augmented user experiences in the cultural heritage domain are in increasing demand by the new digital native tourists of 21st century. In this paper, we propose a novel solution that aims at assisting the visitor during an outdoor tour of a cultural site using the unique first person perspective of wearable cameras. In particular, the approach exploits computer vision techniques to retrieve the details by proposing a robust descriptor based on the covariance of local features. Using a lightweight wearable board the solution can localize the user with respect to the 3D point cloud of the historical landmark and provide him with information about the details he is currently looking at. Experimental results validate the method both in terms of accuracy and computational effort. Furthermore, user evaluation based on real-world experiments shows that the proposal is deemed effective in enriching a cultural experience.

Exploring Architectural Details Through aWearable Egocentric Vision Device / Alletto, Stefano; Abati, Davide; Serra, Giuseppe; Cucchiara, Rita. - In: SENSORS. - ISSN 1424-8220. - 16(2)(2016), pp. 1-15. [10.3390/s16020237]

Exploring Architectural Details Through aWearable Egocentric Vision Device

ALLETTO, STEFANO;ABATI, DAVIDE;SERRA, GIUSEPPE;CUCCHIARA, Rita
2016

Abstract

Augmented user experiences in the cultural heritage domain are in increasing demand by the new digital native tourists of 21st century. In this paper, we propose a novel solution that aims at assisting the visitor during an outdoor tour of a cultural site using the unique first person perspective of wearable cameras. In particular, the approach exploits computer vision techniques to retrieve the details by proposing a robust descriptor based on the covariance of local features. Using a lightweight wearable board the solution can localize the user with respect to the 3D point cloud of the historical landmark and provide him with information about the details he is currently looking at. Experimental results validate the method both in terms of accuracy and computational effort. Furthermore, user evaluation based on real-world experiments shows that the proposal is deemed effective in enriching a cultural experience.
16(2)
1
15
Exploring Architectural Details Through aWearable Egocentric Vision Device / Alletto, Stefano; Abati, Davide; Serra, Giuseppe; Cucchiara, Rita. - In: SENSORS. - ISSN 1424-8220. - 16(2)(2016), pp. 1-15. [10.3390/s16020237]
Alletto, Stefano; Abati, Davide; Serra, Giuseppe; Cucchiara, Rita
File in questo prodotto:
File Dimensione Formato  
sensors-16-00237.pdf

accesso aperto

Tipologia: Versione dell'editore (versione pubblicata)
Dimensione 5.75 MB
Formato Adobe PDF
5.75 MB Adobe PDF Visualizza/Apri
Pubblicazioni consigliate

Caricamento pubblicazioni consigliate

Licenza Creative Commons
I metadati presenti in IRIS UNIMORE sono rilasciati con licenza Creative Commons CC0 1.0 Universal, mentre i file delle pubblicazioni sono rilasciati con licenza Attribuzione 4.0 Internazionale (CC BY 4.0), salvo diversa indicazione.
In caso di violazione di copyright, contattare Supporto Iris

Utilizza questo identificativo per citare o creare un link a questo documento: http://hdl.handle.net/11380/1084444
Citazioni
  • ???jsp.display-item.citation.pmc??? 1
  • Scopus 10
  • ???jsp.display-item.citation.isi??? 8
social impact