Video annotation is typically performed by classifying video elements according to some pre-defined ontology of the video content domain. Ontologies are defined by establishing relationships between linguistic terms, that specify domain concepts at different abstraction levels. However, although linguistic terms are appropriate to distinguish event and object categories, they are inadequate when they must describe specific patterns of events or video entities. Instead, in these cases, pattern specifications are better expressed through visual prototypes that capture the essence of the event or entity. Pictorially enriched ontologies, that include visual concepts together with linguistic keywords, are therefore needed tosupport video annotation up to the level of detail of pattern specification. This paper presents pictorially enriched ontologies and provide a solution for their implementation in the soccer video domain. The pictorially enriched ontology is used both to directly assign multimedia objects to concepts, providing a more meaningful definition than the linguistics terms, and to extend the initial knowledge of the domain, adding subclasses of highlights or new highlight classes that were not defined in the linguistic ontology. Automatic annotation of soccer clips up to the pattern specification level using a pictorially enriched ontology is discussed.

Video Annotation with Pictorially Enriched Ontologies / C., Torniai; A., DEL BIMBO; Cucchiara, Rita; M., Bertini. - STAMPA. - 2005:(2005), pp. 1428-1431. (Intervento presentato al convegno IEEE International Conference on Multimedia and Expo, ICME 2005 tenutosi a Amsterdam, nld nel 6-8 July 2005) [10.1109/ICME.2005.1521699].

Video Annotation with Pictorially Enriched Ontologies

CUCCHIARA, Rita;
2005

Abstract

Video annotation is typically performed by classifying video elements according to some pre-defined ontology of the video content domain. Ontologies are defined by establishing relationships between linguistic terms, that specify domain concepts at different abstraction levels. However, although linguistic terms are appropriate to distinguish event and object categories, they are inadequate when they must describe specific patterns of events or video entities. Instead, in these cases, pattern specifications are better expressed through visual prototypes that capture the essence of the event or entity. Pictorially enriched ontologies, that include visual concepts together with linguistic keywords, are therefore needed tosupport video annotation up to the level of detail of pattern specification. This paper presents pictorially enriched ontologies and provide a solution for their implementation in the soccer video domain. The pictorially enriched ontology is used both to directly assign multimedia objects to concepts, providing a more meaningful definition than the linguistics terms, and to extend the initial knowledge of the domain, adding subclasses of highlights or new highlight classes that were not defined in the linguistic ontology. Automatic annotation of soccer clips up to the pattern specification level using a pictorially enriched ontology is discussed.
2005
IEEE International Conference on Multimedia and Expo, ICME 2005
Amsterdam, nld
6-8 July 2005
2005
1428
1431
C., Torniai; A., DEL BIMBO; Cucchiara, Rita; M., Bertini
Video Annotation with Pictorially Enriched Ontologies / C., Torniai; A., DEL BIMBO; Cucchiara, Rita; M., Bertini. - STAMPA. - 2005:(2005), pp. 1428-1431. (Intervento presentato al convegno IEEE International Conference on Multimedia and Expo, ICME 2005 tenutosi a Amsterdam, nld nel 6-8 July 2005) [10.1109/ICME.2005.1521699].
File in questo prodotto:
Non ci sono file associati a questo prodotto.
Pubblicazioni consigliate

Licenza Creative Commons
I metadati presenti in IRIS UNIMORE sono rilasciati con licenza Creative Commons CC0 1.0 Universal, mentre i file delle pubblicazioni sono rilasciati con licenza Attribuzione 4.0 Internazionale (CC BY 4.0), salvo diversa indicazione.
In caso di violazione di copyright, contattare Supporto Iris

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11380/464362
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 31
  • ???jsp.display-item.citation.isi??? 8
social impact