Provenance-aware entity resolution: Leveraging provenance to improve quality

Authors Klaus-Dieter Schewe
Qing Wang
Woods Wang
Editors M. Renz
C. Shahabi
X. Zhou
M.A. Cheema
Title Provenance-aware entity resolution: Leveraging provenance to improve quality
Booktitle Database Systems for Advanced Applications - Proc. DASFA 2015, Part I
Type in proceedings
Publisher Springer
Series Lecture Notes in Computer Science
Volume 9049
ISBN 978-3-319-18119-6
Month April
Year 2015
Pages 474-490
SCCH ID# 1505

Entity Resolution (ER) – the process of identifying records that refer to the same real-world entity – pervasively exists in many application areas. Nevertheless, resolving entities is hardly ever completely accurate. In this paper, we investigate a
provenance-aware framework for ER. We first propose an indexing structure that can be efficiently built for provenance storage in support of an ER process. Then a generic repairing strategy, called coordinate-split-merge (CSM), is developed to control the interaction between repairs driven by must-link and cannot-link constraints. Our experimental results show that the proposed indexing structure is efficient for capturing the provenance of ER both in time and space, which is also linearly scalable over the number of matches. Our repairing algorithms can significantly reduce human efforts in leveraging the provenance of ER for identifying erroneous matches.