Collaborative research: Bayesian methods for learning and analyzing natural languages

语言是人类行为中最复杂的方面之一，为许多社会交往提供了基础。人们如何学习和使用语言的问题是包括认知科学、心理学和语言学在内的多个行为科学广泛研究的主题。有一个悠久的传统，使用正式的方法来探索这个问题的答案，最近的工作已经开始强调统计模型的重要性。在美国国家科学基金会的支持下，加州大学伯克利分校的格里菲斯博士和布朗大学的约翰逊博士将开发和研究基于贝叶斯统计的学习和分析自然语言的新方法和模型。在贝叶斯统计中，语言数据提供的关于语言结构的信息与约束所考虑的结构的“先验”分布相结合。这种方法可以更容易地从有限的数据中学习语言的属性，并且与强调限制在学习中的作用的人类语言习得理论有直接联系。本研究项目旨在将用于学习和分析语言的统计模型与现代贝叶斯统计的两种方法相结合：马尔可夫链蒙特卡罗算法和非参数贝叶斯模型。这些方法使得在人们通常在认知科学和语言学中使用的复杂模型中应用贝叶斯推理成为可能。该项目的结果将提供与传统语言模型一起工作的新方法，并导致可能与解释人们如何获得语言相关的新模型。通过探索当代统计方法如何应用于计算语言学中使用的概率模型，该项目将在统计学，语言学和认知科学之间建立更紧密的联系，并为学生提供机会，接受培训的主题在这些学科的交叉。这一奖项是支持的一部分，2006财政年度数学科学优先领域特别竞争的数学社会与行为科学（MSBS）

Language is one of the most complex aspects of human behavior, and provides the foundation for many kinds of social interaction. The question of how people learn and use language is a subject of extensive research in several behavioral sciences, including cognitive science, psychology, and linguistics. There is a long tradition of using formal approaches to explore answers to this question, and recent work has begun to emphasize the importance of statistical models. With support from the National Science Foundation, Dr. Griffiths at UC Berkeley and Dr. Johnson at Brown University will develop and investigate new methods and models for learning and analyzing natural languages based on Bayesian statistics. In Bayesian statistics, the information about the structure of language provided by linguistic data is combined with a "prior" distribution that constrains the structures under consideration. This approach can make it easier to learn the properties of a language from limited amounts of data, and has a direct connection to theories of human language acquisition that emphasize the role of constraints in learning. This research project aims to integrate the statistical models used for learning and analyzing language with two methods from modern Bayesian statistics: Markov chain Monte Carlo algorithms and nonparametric Bayesian models. These methods make it possible to apply Bayesian inference in complex models of the kind that people typically work with in cognitive science and linguistics. The results of this project will provide new ways of working with traditional models of language, and lead to new models that are potentially of relevance to explaining how people acquire language. By exploring how contemporary statistical methods can be applied to the probabilistic models used in computational linguistics, this project will build closer connections between statistics, linguistics, and cognitive science, and provide opportunities for students to receive training in topics at the intersection of these disciplines.This award was supported as part of the fiscal year 2006 Mathematical Sciences priority area special competition on Mathematical Social and Behavioral Sciences (MSBS).