On active learning of record matching packages
On active learning of record matching packages
复制标题
DOI:
10.1145/1807167.1807252
复制
发表时间:
2010-06
期刊:
影响因子:
--
通讯作者:
A. Arasu;M. Götz;R. Kaushik
中科院分区:
文献类型:
--
作者:
A. Arasu;M. Götz;R. Kaushik
We consider the problem of learning a record matching package (classifier) in an active learning setting. In active learning, the learning algorithm picks the set of examples to be labeled, unlike more traditional passive learning setting where a user selects the labeled examples. Active learning is important for record matching since manually identifying a suitable set of labeled examples is difficult. Previous algorithms that use active learning for record matching have serious limitations: The packages that they learn lack quality guarantees and the algorithms do not scale to large input sizes. We present new algorithms for this problem that overcome these limitations. Our algorithms are fundamentally different from traditional active learning approaches, and are designed ground up to exploit problem characteristics specific to record matching. We include a detailed experimental evaluation on realworld data demonstrating the effectiveness of our algorithms.