In this paper we propose a system for human action tracking and recognition using a robust particle filter-based visual tracker and a novel descriptor, to represent spatio-temporal interest points, based on an effective combination of a new 3D gradient descriptor with an optic flow descriptor. These points are used to represent video sequences using a bag of spatio-temporal visual words, following the successful results achieved in object and scene classification. The tracker assigns the points to each individual in a scene, allowing the classification of the action performed by each person. The system has been extensively tested on the standard KTH and Weizmann actions datasets, as well as on real world surveillance videos.

Human Action Recognition and Localization using Spatio-temporal Descriptors and Tracking / L., Ballan; M., Bertini; A., Del Bimbo; L., Seidenari; Serra, Giuseppe. - STAMPA. - (2009), pp. 1-8. (Intervento presentato al convegno AI*IA International Workshop on Pattern Recognition and Artificial Intelligence for Human Behaviour Analysis (PRAI*HBA) tenutosi a Reggio Emilia, Italy nel 2009-Dec).

Human Action Recognition and Localization using Spatio-temporal Descriptors and Tracking

SERRA, GIUSEPPE
2009

Abstract

In this paper we propose a system for human action tracking and recognition using a robust particle filter-based visual tracker and a novel descriptor, to represent spatio-temporal interest points, based on an effective combination of a new 3D gradient descriptor with an optic flow descriptor. These points are used to represent video sequences using a bag of spatio-temporal visual words, following the successful results achieved in object and scene classification. The tracker assigns the points to each individual in a scene, allowing the classification of the action performed by each person. The system has been extensively tested on the standard KTH and Weizmann actions datasets, as well as on real world surveillance videos.
2009
AI*IA International Workshop on Pattern Recognition and Artificial Intelligence for Human Behaviour Analysis (PRAI*HBA)
Reggio Emilia, Italy
2009-Dec
1
8
L., Ballan; M., Bertini; A., Del Bimbo; L., Seidenari; Serra, Giuseppe
Human Action Recognition and Localization using Spatio-temporal Descriptors and Tracking / L., Ballan; M., Bertini; A., Del Bimbo; L., Seidenari; Serra, Giuseppe. - STAMPA. - (2009), pp. 1-8. (Intervento presentato al convegno AI*IA International Workshop on Pattern Recognition and Artificial Intelligence for Human Behaviour Analysis (PRAI*HBA) tenutosi a Reggio Emilia, Italy nel 2009-Dec).
File in questo prodotto:
Non ci sono file associati a questo prodotto.
Pubblicazioni consigliate

Licenza Creative Commons
I metadati presenti in IRIS UNIMORE sono rilasciati con licenza Creative Commons CC0 1.0 Universal, mentre i file delle pubblicazioni sono rilasciati con licenza Attribuzione 4.0 Internazionale (CC BY 4.0), salvo diversa indicazione.
In caso di violazione di copyright, contattare Supporto Iris

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11380/979914
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact