Modeling Missing Data in Distant Supervision for Information Extraction
Modeling Missing Data in Distant Supervision for Information Extraction
复制标题
DOI：
10.1162/tacl_a_00234
复制
发表时间：
2013-10
影响因子：
10.9
通讯作者：
Alan Ritter;Luke Zettlemoyer;Mausam;Oren Etzioni
中科院分区：
文献类型：
--
作者：
Alan Ritter;Luke Zettlemoyer;Mausam;Oren Etzioni
Distant supervision algorithms learn information extraction models given only large readily available databases and text collections. Most previous work has used heuristics for generating labeled data, for example assuming that facts not contained in the database are not mentioned in the text, and facts in the database must be mentioned at least once. In this paper, we propose a new latent-variable approach that models missing data. This provides a natural way to incorporate side information, for instance modeling the intuition that text will often mention rare entities which are likely to be missing in the database. Despite the added complexity introduced by reasoning about missing data, we demonstrate that a carefully designed local search approach to inference is very accurate and scales to large datasets. Experiments demonstrate improved performance for binary and unary relation extraction when compared to learning with heuristic labels, including on average a 27% increase in area under the precision recall curve in the binary case.
