EAGER: Building Language Technologies by Machine Reading Grammars

EAGER：通过机器阅读语法构建语言技术

• 批准号: 2327143
• 负责人: Antonios Anastasopoulos
• 金额: $ 9.93万
• 依托单位: George Mason University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2023
• 资助国家: 美国
• 起止时间: 2023-06-15 至 2024-05-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2327143&HistoricalAwards=false
• 关键词: EAGER; Building; Language; Technologies; Machine

Recent years have seen incredible advances in natural language processing (NLP) technologies, which now make it possible to perform numerous tasks through, with, or on language data. However, this progress has been limited to the handful of languages for which abundant data are available, because the neural models that facilitate the recent improvements are particularly data hungry. This work suggests that we should move away from the current data-inefficient learning paradigm, and instead attempt to also model languages by relying on the human mode of describing them: the grammar of each language. Put simply, we will aim to incorporate the grammars of languages, as written by linguists and treated as symbolic knowledge bases, in the process of training neural language models. Specifically, this work will focus on the first step towards this goal, namely extracting the necessary information from grammar descriptions and other linguistic documents. We will explore several alternative modeling approaches, first by relying on retrieval-based models. We will additionally attack the problem through a machine-reading and question-answering framework. Ultimately, the success of these methods will enable the creation of linguistically-informed models, which will in turn facilitate the creation of technologies especially for under-served language communities.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

近年来，自然语言处理 (NLP) 技术取得了令人难以置信的进步，现在可以通过语言数据、使用语言数据或在语言数据上执行大量任务。然而，这一进展仅限于少数有大量数据可用的语言，因为促进最近改进的神经模型特别需要数据。这项工作表明，我们应该摆脱当前数据效率低下的学习范式，转而尝试通过依赖人类描述语言的模式（每种语言的语法）来对语言进行建模。简而言之，我们的目标是将语言学家编写的语言语法作为符号知识库纳入训练神经语言模型的过程中。具体来说，这项工作将重点关注实现这一目标的第一步，即从语法描述和其他语言文档中提取必要的信息。我们将探索几种替代建模方法，首先依靠基于检索的模型。我们还将通过机器阅读和问答框架来解决这个问题。最终，这些方法的成功将有助于创建语言信息模型，从而促进技术的创建，特别是针对服务不足的语言社区的技术。该奖项反映了 NSF 的法定使命，并通过使用基金会的智力价值和更广泛的影响审查标准进行评估，被认为值得支持。