The processing and learning of pitch in speech

本研究探讨音调是如何在大脑中被处理的，以及语言处理中的学习和经验如何影响大脑的神经组织。语言中的音高可能传达语言对比，如词汇语调或重音，或语法或副语言信息，如语调。由于感知音高的声学基础本质上是相同的，无论一个事件是语言还是音乐，一个基本的争论由此产生，即语言中的音高处理是取决于其语言功能还是由声学特性决定的。我们的研究使用了四种语言，这四种语言都使用音高作为语调，但声调的语言使用不同，为系统研究音高加工提供了理想的试验场。具体来说，我们研究了非母语听众对普通话声调和语调的加工和学习，他们在母语（英语、挪威语和广东话）和非语言（音乐家和非音乐家）中使用音高的经验不同。参与者包括儿童和成人，研究人类大脑的可塑性与年龄和经验在音高学习方面的关系。在一系列实验中，训练非母语的普通话听者感知普通话声调的语言或非语言方面的音高。通过行为和脑成像（fMRI和EEG）技术评估他们训练前和训练后的表现。本研究的发现将对理解认知神经组织和知觉重组做出重大贡献，并导致对学习和经验的基本认知问题的见解。全球化导致越来越多的语言学习者，特别是在加拿大这样的多元文化社会。这项研究将有助于深入了解语言学习的认知神经挑战。此外，与大脑功能有关的学习问题对我们社会的许多其他方面都有重要的影响，包括未来技术的发展，理解听觉和视觉受损者的需求，以及人类作为学习手段的基本感觉能力。

This research investigates how pitch is processed in the brain, and how its neural organization may be affected by learning and experience in language processing. Pitch in language may convey linguistic contrasts such as lexical tone or stress, or grammatical or paralinguistic information such as intonation.  As the acoustic basis for perceived pitch is essentially the same, regardless if an event is language or music, a fundamental debate thus arises as to whether pitch processing in language is dependent on its linguistic function or determined by acoustic properties. Our research makes use of four languages which all use pitch for intonation but differ in their linguistic use of tone, offering an ideal testing ground for a systematic investigation of pitch processing. Specifically, we examine the processing and learning of Mandarin tone and intonation by nonnative listeners with different experience with linguistic use of pitch in their native languages (English, Norwegian and Cantonese) and nonlinguistic use of pitch (musicians versus nonmusicians). Participants include children as well as adults, examining the plasticity of the human brain with respect to age and experience in pitch learning.  In a series of experiments, nonnative Mandarin listeners are trained to perceive either linguistic or non-linguistic aspects of pitch in Mandarin tone. Their pre- and post-training performance is evaluated through behavioural and brain imaging (fMRI and EEG) techniques. Findings of this research will make a significant contribution to understanding cognitive neural organization and reorganization in perception as well as lead to insights into the fundamental cognitive issues of learning and experience. Globalization leads to more and more language learners, especially in a multicultural society like Canada. This research will give insight into the cognitive neural challenges of language learning.  In addition, issues relating learning with brain functions have important implications for many additional facets of our community, including the development of future technology, understanding the needs of the hearing and visually impaired, and the basic sensory abilities humans have as a means by which to learn.