Testing and improving methods for efficient annotation through the construction of a large parsed corpus

通过构建大型解析语料库来测试和改进有效注释的方法

• 批准号: 1147499
• 负责人: Anthony Kroch
• 金额: $ 28.74万
• 依托单位: University of Pennsylvania
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2012
• 资助国家: 美国
• 起止时间: 2012-07-15 至 2016-06-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1147499&HistoricalAwards=false
• 关键词: Testing; improving; methods; efficient; annotation

Electronic corpora annotated with linguistic information play a crucial role in natural language processing (NLP) and in linguistic research. Treebanks (corpora annotated with syntactic information) are especially important since they mark the grammatical structure necessary for understanding sentence and discourse meaning. For NLP, treebanks provide testbeds for developing language understanding systems. For linguistic research, they provide the basis for precise and replicable studies of the patterns of use of syntactic forms. Unfortunately, accurate annotation is difficult. Automatic parsers have relatively high error rates and the correction of these errors by human annotators is both slow and itself error-prone. Based on recent advances that Dr. Kroch and his collaborators have made in the creation and quality control of three large treebanks for different languages, Dr. Kroch proposes a major effort to improve corpus construction through the creation of a two-million-word English treebank. Along with this useful and substantial result, the project will develop and test hypotheses on speeding up treebank construction. The work will be guided by two complementary strategies. The first aims to reduce the parser's error rate by enhancing the part-of-speech (POS) tagged input to the parser while the second aims to make the correction of residual errors more efficient by shifting some of the burden from human to automatic error detection and correction. Speeding up the construction of accurate, consistent treebanks will improve the size and quality of training data for parsers, leading to improved performance in real-world NLP applications that rely on parsing. The availability of larger treebanks and of better methods for constructing them will also improve linguistic research. Moreover, as treebanks grow in size, they will become more useful in literary and historical studies, where the rhetorical structure of texts will become investigable in a more precise way than is currently possible.In addition to the intellectual merit of the proposed research and the impact it can be expected to have on text-based research that relies on automated processing techniques, the project will provide valuable training opportunities for graduate and undergraduate students. In contributing to improvements in automated techniques for language processing, this project may also benefit the analytic needs in industry and government security.

标注语言信息的电子语料库在自然语言处理和语言学研究中起着至关重要的作用。树库（标注了句法信息的语料库）尤其重要，因为它们标记了理解句子和话语意义所必需的语法结构。对于NLP，树库为开发语言理解系统提供了测试平台。对于语言学研究来说，它们为精确和可复制地研究句法形式的使用模式提供了基础。不幸的是，准确的注释是困难的。自动解析器的错误率相对较高，人工注释器对这些错误的纠正既缓慢又容易出错。基于Kroch博士和他的合作者在三个不同语言的大型树库的创建和质量控制方面取得的最新进展，Kroch博士建议通过创建一个200万单词的英语树库来改进语料库的构建。随着这一有用和实质性的结果，该项目将开发和测试加速树库建设的假设。这项工作将以两项相互补充的战略为指导。第一个目标是通过增强给解析器的词性标记输入来降低解析器的错误率，而第二个目标是通过将一些负担从人工转移到自动错误检测和纠正来提高残余错误的纠正效率。加快构建准确、一致的树库将提高解析器训练数据的大小和质量，从而提高依赖解析的现实世界NLP应用程序的性能。更大的树库的可用性和更好的构建树库的方法也将促进语言学研究。此外，随着树库规模的增长，它们将在文学和历史研究中变得更有用，在这些研究中，文本的修辞结构将以比目前可能的更精确的方式进行调查。除了提出的研究的智力价值和它可以对依赖于自动化处理技术的基于文本的研究产生预期的影响外，该项目还将为研究生和本科生提供宝贵的培训机会。在为语言处理的自动化技术的改进做出贡献的同时，这个项目也可能有利于工业和政府安全的分析需求。