Bayesian Learning of a Hierarchical Representation of Language from Raw Speech

这个项目的目标是从原始语音输入中学习语言的分层表示。在最底层，发现语音的声学构建块，音素或类似的子词单位，并为它们学习统计模型，而下一层涉及发现词汇构建块，单词，并学习它们的概率。最后，将从它们构建语义可解释的词类别。特别关注的事实是，自然语言的词汇原则上是无限的，而声音信号表现出极端的可变性。这两个问题将在贝叶斯范式中处理。为了允许词汇表随着输入数据量的增加而增长，将采用非参数贝叶斯统计，特别是那些基于Dirichlet和Pitman-Yor过程的统计，其中参数的数量不需要事先指定。语音输入的可变性导致声学单位发现阶段的歧义，通过避免对音素身份的过早决定和在联合概率模型中处理声学和词汇变量来解释，因此将开发有效的推理技术。虽然我们设想了语音处理领域的几种应用，但将要开发的联合或迭代分层贝叶斯学习框架也将对其他顺序和高度可变的感官输入数据的学习问题感兴趣。

The goal of this project is to learn a hierarchical representation of a language from raw speech input. At the lowest layer the acoustic building blocks of speech, the phonemes or similar sub-word units, are discovered and statistical models learned for them, while the next layer is concerned with the discovery of the lexical building blocks, the words, and learning their probabilities. Finally, semantically interpretable word categories will be built from them. Particular focus is placed on the facts, that the vocabulary in natural languages is in principle unlimited and that the acoustic signal exhibits extreme variability. Both issues will be approached in a Bayesian paradigm. To allow the vocabulary to grow with the amount of input data nonparametric Bayesian statistics, in particular those based on the Dirichlet and the Pitman-Yor processes, will be employed, where the number of parameters need not be specified in advance. The variability of the spoken input, leading to ambiguities at the acoustic unit discovery stage, is accounted for by avoiding premature decisions on the phoneme identity and treating acoustic and lexical variables in a joint probabilistic model, for which efficient inference techniques will be developed. While we envision several applications in the realm of speech processing, the joint or iterative hierarchical Bayesian learning framework to be developed will also be of interest to learning problems on other sequential and highly variable sensory input data.