TY - BOOK
T1 - Record linkage: a machine learning approach, a toolbox, and a digital government web service
AU - Elfeky, Mohamed G.
AU - Verykios, Vassilios S.
AU - Elmagarmid, Ahmed Khalifa
AU - Ghanem, Thanaa M.
AU - Huwait, Ahmed R.
PY - 2003
Y1 - 2003
N2 - Data cleaning is a vital process mat ensures the quality of data stored in real-world databases. Data cleaning problems are frequently encountered in many research areas, such as knowledge discovery in databases, data warehousing, system integration and eservices. The process of identifying the record pairs that represent the same entity (duplicate records), commonly known as record linkage, is one of the essential elements of data cleaning. In this paper, we address the record linkage problem by adopting a machine learning approach. Three models are proposed and are analyzed empirically. Since no existing model, including those proposed in l.h.is paper, has been proved to be superior, we have developed an interactive Record Linkage Toolbox named TAILOR. Users of TAILOR can build their own record linkage models by tuning system parameters and by plugging in in-house developed and public domain tools. The proposed toolbox serves as a framework for the record linkage process, and is designed in an extensible way to interface with existing and future record linkage models. We have conducted an extensive experimental study to evaluate our proposed models using not only synthetic but also real data. Results show that the proposed machine learning record linkage models outperform the existing ones both in accuracy and in performance. As a practical case study, we have incorporated the toolbox as a web service in a digital government web application. Digital government serves as an emerging area for database research, while web services is considered a very suitable approach that meets the needs of the governmental services.
AB - Data cleaning is a vital process mat ensures the quality of data stored in real-world databases. Data cleaning problems are frequently encountered in many research areas, such as knowledge discovery in databases, data warehousing, system integration and eservices. The process of identifying the record pairs that represent the same entity (duplicate records), commonly known as record linkage, is one of the essential elements of data cleaning. In this paper, we address the record linkage problem by adopting a machine learning approach. Three models are proposed and are analyzed empirically. Since no existing model, including those proposed in l.h.is paper, has been proved to be superior, we have developed an interactive Record Linkage Toolbox named TAILOR. Users of TAILOR can build their own record linkage models by tuning system parameters and by plugging in in-house developed and public domain tools. The proposed toolbox serves as a framework for the record linkage process, and is designed in an extensible way to interface with existing and future record linkage models. We have conducted an extensive experimental study to evaluate our proposed models using not only synthetic but also real data. Results show that the proposed machine learning record linkage models outperform the existing ones both in accuracy and in performance. As a practical case study, we have incorporated the toolbox as a web service in a digital government web application. Digital government serves as an emerging area for database research, while web services is considered a very suitable approach that meets the needs of the governmental services.
M3 - Commissioned report
BT - Record linkage: a machine learning approach, a toolbox, and a digital government web service
ER -