RI: Small: Developing Large Scale Distributed Syntactic, Semantic and Lexical Language Models for Machine Translation and Speech Recognition

RI：小型：开发用于机器翻译和语音识别的大规模分布式句法、语义和词汇语言模型

• 批准号: 1218863
• 负责人: Shaojun Wang
• 金额: $ 46万
• 依托单位: Wright State University
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2012
• 资助国家: 美国
• 起止时间: 2012-08-01 至 2016-07-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1218863&HistoricalAwards=false
• 关键词: RI; Small; Developing; Large; Scale

This project aims to build large scale distributed syntactic, semantic, and lexical language models that are trained by corpora with up to Web-scale data on a supercomputer in order to substantially improve the performance of machine translation and speech recognition systems. It is conducted under the directed Markov random field paradigm to integrate both topics and syntax to form complex distributions for natural language, and uses hierarchical Pitman-Yor processes to model long-tail properties of natural language. By exploiting this particular structure, the complex statistical estimation and inference algorithms are decomposed and performed in a distributed environment. The language models are put into one-pass decoders of machine translation systems, and the lattice rescoring decoder into a speech recognition system. In addition, a principled solution to a long-standing open problem, smoothing fractional counts due to latent variables in Kneser-Ney's sense, might be found. This project fits into the NSF's strategic long term vision of a Cyber-infrastructure Framework for 21st Century Science and Engineering (CIF21). The project integrates various kinds of known language models and provides a way to overcome the limitations of existing combination methods for language models and to deploy algorithmically interesting methodologies that are scalable to data sets available on the Web. The project provides an environment for interdisciplinary education in information technology that bridges areas of language and speech processing, machine learning, and data-intensive science and engineering to benefit students at several levels.

该项目旨在建立大规模的分布式句法、语义和词汇语言模型，通过在超级计算机上使用高达Web规模的数据的语料库进行训练，以显著提高机器翻译和语音识别系统的性能。它是在有向马尔可夫随机场范式下进行的，将主题和句法结合起来形成自然语言的复杂分布，并使用分层的Pitman-Yor过程来建模自然语言的长尾属性。通过利用这种特殊的结构，复杂的统计估计和推理算法被分解并在分布式环境中执行。语言模型被放入机器翻译系统的单程译码中，格子重新评分译码被放入语音识别系统中。此外，可能会找到一个长期悬而未决的问题的原则性解决方案，即由于克内塞-奈意义上的潜变量而平滑分数计数。该项目符合美国国家科学基金会21世纪科学与工程网络基础设施框架(CIF21)的长期战略愿景。该项目集成了各种已知的语言模型，并提供了一种方法来克服现有语言模型组合方法的限制，并部署算法上有趣的方法，这些方法可扩展到Web上可用的数据集。该项目为信息技术领域的跨学科教育提供了一个环境，将语言和语音处理、机器学习以及数据密集型科学和工程等领域联系起来，使学生在几个层次上受益。