RI: Small: Fast, Scalable Joint Inference for NLP using Markov Logic

RI：小型：使用马尔可夫逻辑进行快速、可扩展的 NLP 联合推理

• 批准号: 1528037
• 负责人: Vincent Ng
• 金额: $ 36.03万
• 依托单位: University of Texas at Dallas
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2015
• 资助国家: 美国
• 起止时间: 2015-09-01 至 2021-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1528037&HistoricalAwards=false
• 关键词: RI; Small; Fast; Scalable; Joint

Many fundamental tasks in natural language processing (NLP) such as coreference resolution and event extraction involve complex output constraints. Markov Logic Networks (MLNs), a joint inference framework that combines logical and probabilistic representations, enable manual specification of such constraints in a compact manner, effectively allowing easy incorporation of background knowledge into NLP systems to improve their performance. While theoretically appealing, MLNs have been relatively underused in NLP applications. Owing to issues of scalability, researchers have largely restricted themselves to simple MLNs that either make simplifying, sometimes unreasonable assumptions or ignore complex output constraints. This project seeks to bring transformative changes to the way joint inference is applied in NLP. The idea is to develop fast, scalable learning and inference techniques for MLNs so that rich models (i.e., models with high-dimensional features and/or complex output constraints) can be efficiently trained and applied to large data sets. A key component of the project is the formulation and evaluation of rich MLN-based models for important and complex NLP tasks such as coreference resolution. These rich models, especially when trained on large data sets, can potentially yield breakthrough results in NLP, which in turn can have profound societal impact. For example, improvements in coreference technologies stand to benefit essentially all NLP applications the general public relies on every day, such as search, information extraction, and question answering.Successful application of rich MLN-based models to complex NLP tasks requires the development of fast, scalable learning and inference techniques. To scale up weight learning in MLNs, this project develops approaches that leverage advanced algorithms from the constraint satisfaction literature for fast, approximate solution counting. To scale up probabilistic inference, it employs lifted inference algorithms to reduce the domain size of variables in MLNs by exploiting exact as well as approximate symmetries (e.g., paraphrases). The core NLP tasks it focuses on, such as coreference resolution and temporal relation extraction, are sufficiently complex that they provide convincing testbeds for evaluating the scalability of these learning and inference techniques. Equally importantly, as approximate language is a phenomenon that occurs across NLP tasks, these advances are likely to impact a wide swath of tasks in NLP.

自然语言处理（NLP）中的许多基本任务，如共指消解和事件提取，都涉及复杂的输出约束。马尔可夫逻辑网络（MLN）是一种结合了逻辑和概率表示的联合推理框架，能够以紧凑的方式手动指定此类约束，有效地将背景知识轻松纳入NLP系统以提高其性能。虽然理论上很有吸引力，但MLN在NLP应用中的使用相对不足。 由于可扩展性的问题，研究人员在很大程度上限制自己简单的MLN，要么简化，有时不合理的假设或忽略复杂的输出约束。该项目旨在为联合推理在NLP中的应用方式带来变革性的变化。这个想法是为MLN开发快速，可扩展的学习和推理技术，以便丰富的模型（即，具有高维特征和/或复杂输出约束的模型）可以被有效地训练并应用于大数据集。该项目的一个关键组成部分是制定和评估丰富的基于MLN的模型，用于重要而复杂的NLP任务，例如共指消解。这些丰富的模型，特别是在大型数据集上训练时，可能会在NLP中产生突破性的结果，从而产生深远的社会影响。例如，互指技术的改进将使公众每天依赖的所有NLP应用（如搜索、信息提取和问答）受益。要将基于丰富MLN的模型成功应用于复杂的NLP任务，需要开发快速、可扩展的学习和推理技术。为了扩大MLN中的权重学习，该项目开发了利用约束满足文献中的高级算法进行快速近似解计数的方法。为了扩大概率推理，它采用提升的推理算法，通过利用精确和近似对称来减少MLN中变量的域大小（例如，释义）。它关注的核心NLP任务，如共指消解和时态关系提取，足够复杂，它们为评估这些学习和推理技术的可扩展性提供了令人信服的测试平台。同样重要的是，由于近似语言是一种在NLP任务中发生的现象，这些进步可能会影响NLP中的广泛任务。