权益分类	功能权益	普通用户	{{item.name}}会员
{{category.name}}	{{benefitItem.name}}

Mathematical modeling of the temporal acpects of speech based on human perceptual and cognitive mechanisms

基于人类感知和认知机制的语音时间方面的数学建模

基本信息

批准号：
16200016
负责人：
KATO Hiroaki
金额：
$ 31.62万
依托单位：
Advanced Telecommunications Research Institute International
依托单位国家：
日本
项目类别：
Grant-in-Aid for Scientific Research (A)
财政年份：
2004
资助国家：
日本
起止时间：
2004 至 2007
项目状态：
已结题

项目摘要

The purpose of this project was to find clues by which humans retrieve the temporal structure of speech, to understand their usage, and to establish a quantitative method to evaluate the temporal adequateness or naturalness of a given speech sound that can replicate the performance of human judgment. For this purpose, three fundamental investigative tasks were implemented a study at the psychophysical level, a study at the linguistic level, and the construction of an evaluation model. One distinguishing feature of this project is that it emphasized the psychophysical aspects nearly as much as the linguistic, even though its primary object was spoken language.Since a person can easily recognize fast speech, even in the case of a foreign language where the meaning is unknown, it is assumed that the processing of the temporal aspects of speech undoubtedly involve non-linguistic and therefore language-independent activities. By concentrating on such processing that is independent of a give … More n language, we developed the basic technology toward a system with small overhead for language processing as well as simple extensibility to multiple languages. The major results follow.(I) Psychophysical level : An algorithm was developed to predict temporal reference points in a given speech by replicating the function of human auditory processing. This algorithm's most important benefit is its applicability to virtually unlimited language variations since it doesn't require any linguistic knowledge.(II) Linguistic level : An empirical study levealed that factors, which affect the perception of prosodic units, vary depending on the particular language's choice of units. This finding provides practical implications concerning how much weight should be placed on prosodic factors when designing effective foreign-language training methods.(III) Modeling : By integrating auditory functions derived from investigation at the psychophysical level, a mathematical model was implemented to automatically evaluate the naturalness of the speech of the English learners. The model's performance closely approximated the subjective evaluation of a native-speaking English instructor. This result not only suggests the importance of psychophysical factors in the adequateness or naturalness evaluation of speech but it also implies potential extensibility of the proposed model to multiple languages. Less

这个项目的目的是寻找线索，人类通过这些线索来检索语音的时间结构，了解它们的用法，并建立一种量化方法来评估给定语音的时间充分性或自然性，以复制人类判断的表现。为此，实施了三项基本调查任务，一项是心理物理层面的研究，一项是语言层面的研究，以及评估模型的构建。这个项目的一个显著特点是，它几乎和语言一样强调心理物理方面，尽管它的主要对象是口语。由于一个人可以很容易地识别快速语音，即使在意义未知的外语中，我们假设语音的时间方面的处理无疑涉及非语言的、因此与语言无关的活动。通过专注于这种独立于给定…的处理更多的语言，我们将基本技术发展到一个语言处理开销很小的系统，以及对多语言的简单扩展。主要结果如下：(I)心理物理水平：通过复制人类听觉处理的功能，开发了一种算法来预测给定语音中的时间参考点。这个算法最大的好处是它对几乎无限的语言变化的适用性，因为它不需要任何语言知识。(Ii)语言水平：一项实证研究表明，影响韵律单位感知的因素因特定语言对单位的选择而异。这一发现为在设计有效的外语训练方法时应该在多大程度上重视韵律因素提供了实践启示。(Iii)建模：通过在心理物理水平上整合调查得出的听觉功能，实现了一个数学模型来自动评估英语学习者的言语自然度。该模型的表现非常接近母语为英语的教师的主观评价。这一结果不仅表明了心理物理因素在言语充分性或自然性评价中的重要性，而且也暗示了所提出的模型对多种语言的潜在可扩展性。较少