Entity Resolution (ER) is the task of finding entity profiles that correspond to the same real-world entity. Progressive ER aims to efficiently resolve large datasets when limited time and/or computational resources are available. In practice, its goal is to provide the best possible partial solution by approximating the optimal comparison order of the entity profiles. So far, Progressive ER has only been examined in the context of structured (relational) data sources, as the existing methods rely on schema knowledge to save unnecessary comparisons: they restrict their search space to similar entities with the help of schema-based blocking keys (i.e., signatures that represent the entity profiles). As a result, these solutions are not applicable in Big Data integration applications, which involve large and heterogeneous datasets, such as relational and RDF databases, JSON files, Web corpus etc. To cover this gap, we propose a family of schema-agnostic Progressive ER methods, which do not require schema infor- mation, thus applying to heterogeneous data sources of any schema variety. First, we introduce a na ̈ıve schema-agnostic method, showing that the straightforward solution exhibits a poor performance that does not scale well to large volumes of data. Then, we propose three different advanced methods. Through an extensive experimental evaluation over 7 real-world, established datasets, we show that all the advanced methods outperform to a significant extent both the na ̈ıve and the state-of-the-art schema- based ones. We also investigate the relative performance of the advanced methods, providing guidelines on the method selection.

Schema-agnostic Progressive Entity Resolution / SIMONINI, GIOVANNI; Papadakis, George; Palpanas, Themis; BERGAMASCHI, Sonia. - (2018), pp. 53-64. ((Intervento presentato al convegno 34th IEEE International Conference on Data Engineering, ICDE 2018 tenutosi a Paris nel 16-20/04/2018 [10.1109/ICDE.2018.00015].

Schema-agnostic Progressive Entity Resolution

Giovanni Simonini;Sonia Bergamaschi
2018

Abstract

Entity Resolution (ER) is the task of finding entity profiles that correspond to the same real-world entity. Progressive ER aims to efficiently resolve large datasets when limited time and/or computational resources are available. In practice, its goal is to provide the best possible partial solution by approximating the optimal comparison order of the entity profiles. So far, Progressive ER has only been examined in the context of structured (relational) data sources, as the existing methods rely on schema knowledge to save unnecessary comparisons: they restrict their search space to similar entities with the help of schema-based blocking keys (i.e., signatures that represent the entity profiles). As a result, these solutions are not applicable in Big Data integration applications, which involve large and heterogeneous datasets, such as relational and RDF databases, JSON files, Web corpus etc. To cover this gap, we propose a family of schema-agnostic Progressive ER methods, which do not require schema infor- mation, thus applying to heterogeneous data sources of any schema variety. First, we introduce a na ̈ıve schema-agnostic method, showing that the straightforward solution exhibits a poor performance that does not scale well to large volumes of data. Then, we propose three different advanced methods. Through an extensive experimental evaluation over 7 real-world, established datasets, we show that all the advanced methods outperform to a significant extent both the na ̈ıve and the state-of-the-art schema- based ones. We also investigate the relative performance of the advanced methods, providing guidelines on the method selection.
apr-2018
34th IEEE International Conference on Data Engineering, ICDE 2018
Paris
16-20/04/2018
53
64
Simonini, Giovanni; Papadakis, George; Palpanas, Themis; Bergamaschi, Sonia
Schema-agnostic Progressive Entity Resolution / SIMONINI, GIOVANNI; Papadakis, George; Palpanas, Themis; BERGAMASCHI, Sonia. - (2018), pp. 53-64. ((Intervento presentato al convegno 34th IEEE International Conference on Data Engineering, ICDE 2018 tenutosi a Paris nel 16-20/04/2018 [10.1109/ICDE.2018.00015].
File in questo prodotto:
File Dimensione Formato  
Schema-agnostic Progressive Entity Resolution.pdf

embargo fino al 01/05/2018

Tipologia: Versione dell'editore (versione pubblicata)
Dimensione 540.98 kB
Formato Adobe PDF
540.98 kB Adobe PDF Visualizza/Apri
Pubblicazioni consigliate

Caricamento pubblicazioni consigliate

Licenza Creative Commons
I metadati presenti in IRIS UNIMORE sono rilasciati con licenza Creative Commons CC0 1.0 Universal, mentre i file delle pubblicazioni sono rilasciati con licenza Attribuzione 4.0 Internazionale (CC BY 4.0), salvo diversa indicazione.
In caso di violazione di copyright, contattare Supporto Iris

Utilizza questo identificativo per citare o creare un link a questo documento: http://hdl.handle.net/11380/1150575
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 17
  • ???jsp.display-item.citation.isi??? 8
social impact