Turning Web services into Semantic Web Services (SWS) can be prohibitively expensive for large repositories. In such cases collecting community descriptions in forms of structured tags can be a more affordable approach to describe Web services. However, little is understood about how tagging impacts performance of retrieval. There are neither real structured tagging systems for Web services, nor real corpora of structured tags. To start addressing these issues, in our approach, we motivated taggers to tag services in a partially controlled environment. Specifically, taggers were given application requirements and asked to find and tag services that match the requirements. Tags collected in this way were used for Web service matchmaking and evaluated within the framework of the Cross-Evaluation Track of the Third Semantic Service Selection 2009 contest. As part of the lessons learned, we explain relations between description schema (SWS, tags, flat document) and matchmaking heuristics, and performance of retrieval in different search scenarios. We also analyze reliability of tagging system performance as related to taggers/searchers autonomy. Finally, we identify threats to results credibility stemming from partial control of the tags collection process.

Evaluation of Structured Collaborative Tagging for Web Service Matchmaking / Gawinecki, Maciej; Cabri, Giacomo; Marcin, Paprzycki; Maria, Ganzha. - STAMPA. - (2012), pp. 173-189. [10.1007/978-3-642-28735-0_11]

Evaluation of Structured Collaborative Tagging for Web Service Matchmaking

GAWINECKI, MacieJ;CABRI, Giacomo;
2012

Abstract

Turning Web services into Semantic Web Services (SWS) can be prohibitively expensive for large repositories. In such cases collecting community descriptions in forms of structured tags can be a more affordable approach to describe Web services. However, little is understood about how tagging impacts performance of retrieval. There are neither real structured tagging systems for Web services, nor real corpora of structured tags. To start addressing these issues, in our approach, we motivated taggers to tag services in a partially controlled environment. Specifically, taggers were given application requirements and asked to find and tag services that match the requirements. Tags collected in this way were used for Web service matchmaking and evaluated within the framework of the Cross-Evaluation Track of the Third Semantic Service Selection 2009 contest. As part of the lessons learned, we explain relations between description schema (SWS, tags, flat document) and matchmaking heuristics, and performance of retrieval in different search scenarios. We also analyze reliability of tagging system performance as related to taggers/searchers autonomy. Finally, we identify threats to results credibility stemming from partial control of the tags collection process.
Semantic Web Services: Advancement through Evaluation
9783642287350
Springer
GERMANIA
Evaluation of Structured Collaborative Tagging for Web Service Matchmaking / Gawinecki, Maciej; Cabri, Giacomo; Marcin, Paprzycki; Maria, Ganzha. - STAMPA. - (2012), pp. 173-189. [10.1007/978-3-642-28735-0_11]
Gawinecki, Maciej; Cabri, Giacomo; Marcin, Paprzycki; Maria, Ganzha
File in questo prodotto:
Non ci sono file associati a questo prodotto.
Pubblicazioni consigliate

Caricamento pubblicazioni consigliate

Licenza Creative Commons
I metadati presenti in IRIS UNIMORE sono rilasciati con licenza Creative Commons CC0 1.0 Universal, mentre i file delle pubblicazioni sono rilasciati con licenza Attribuzione 4.0 Internazionale (CC BY 4.0), salvo diversa indicazione.
In caso di violazione di copyright, contattare Supporto Iris

Utilizza questo identificativo per citare o creare un link a questo documento: http://hdl.handle.net/11380/648831
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 2
  • ???jsp.display-item.citation.isi??? ND
social impact