Flexible Models for Microclustering with Application to Entity Resolution
Flexible Models for Microclustering with Application to Entity Resolution
复制标题
应用于实体解析的灵活微集群模型
DOI：
--
复制
发表时间：
2016
期刊：
影响因子：
--
通讯作者：
Beka Steorts
中科院分区：
文献类型：
--
作者：
Brenda Betancourt;Giacomo Zanella;Jeffrey W. Miller;Hanna M. Wallach;Abbas Zaidi;Beka Steorts
大多数用于集群的生成性模型隐含地假设每个集群中的数据点的数量随着数据点的总数线性增长。有限混合模型、Dirichlet过程混合模型和Pitman-Yor过程混合模型以及所有其他无限可交换的集群模型都提出了这一假设。然而，对于某些应用来说，这种假设是不合适的。例如，在执行实体解析时，每个簇的大小应该与数据集的大小无关，并且每个簇应该包含数据点总数的微不足道的一部分。这些应用程序需要生成集群的模型，集群的大小随着数据集的大小近线性增长。我们通过定义微聚类属性并引入一类可以展示该属性的新模型来满足这一需求。我们使用四个实体分辨率数据集将此类模型与两个常用的集群模型进行比较。
Most generative models for clustering implicitly assume that the number of data points in each cluster grows linearly with the total number of data points. Finite mixture models, Dirichlet process mixture models, and Pitman--Yor process mixture models make this assumption, as do all other infinitely exchangeable clustering models. However, for some applications, this assumption is inappropriate. For example, when performing entity resolution, the size of each cluster should be unrelated to the size of the data set, and each cluster should contain a negligible fraction of the total number of data points. These applications require models that yield clusters whose sizes grow sublinearly with the size of the data set. We address this requirement by defining the microclustering property and introducing a new class of models that can exhibit this property. We compare models within this class to two commonly used clustering models using four entity-resolution data sets.
DOI：
--
发表时间：
1997
期刊：
Journal of the royal statistical society series b-methodological
影响因子：
--
作者：
S. Richardson;P. Green;Christian P. Robert;M. Aitkin;David R. Cox;Matthew Stephens;A. Polymenis;W. Gilks;A. Nobile;M. Hodgson;Anthony O'Hagan;N. Longford;A. Dawid;Anthony C. Atkinson;J. Bernardo;J. Besag;Stephen Brooks;S. Byers;A. Raftery;G. Celeux;R. Cheng;W. B. Liu;Yung-Hsin Chien;Edward I. George;N. Cressie;H.-C. Huang;M. Gruet;S. C. Heath;C. Jennison;Andrew B. Lawson;Allan Clark;Geoffrey J. McLachlan;D. Peel;K. Mengersen;A. George;Anne Philippe;Kathryn Roeder;Larry Wasserman;Peter Schlattmann;D. Böhning;D. M. Titterington;H. Tong;M. West
通讯作者：
S. Richardson;P. Green;Christian P. Robert;M. Aitkin;David R. Cox;Matthew Stephens;A. Polymenis;W. Gilks;A. Nobile;M. Hodgson;Anthony O'Hagan;N. Longford;A. Dawid;Anthony C. Atkinson;J. Bernardo;J. Besag;Stephen Brooks;S. Byers;A. Raftery;G. Celeux;R. Cheng;W. B. Liu;Yung-Hsin Chien;Edward I. George;N. Cressie;H.-C. Huang;M. Gruet;S. C. Heath;C. Jennison;Andrew B. Lawson;Allan Clark;Geoffrey J. McLachlan;D. Peel;K. Mengersen;A. George;Anne Philippe;Kathryn Roeder;Larry Wasserman;Peter Schlattmann;D. Böhning;D. M. Titterington;H. Tong;M. West