权益分类	功能权益	普通用户	{{item.name}}会员
{{category.name}}	{{benefitItem.name}}

A study on interaction between production and perception in speech communication

言语交际中产生与感知交互作用的研究

基本信息

批准号：
16300053
负责人：
AKAGI Masato
金额：
$ 8.13万
依托单位：
Japan Advanced Institute of Science and Technology
依托单位国家：
日本
项目类别：
Grant-in-Aid for Scientific Research (B)
财政年份：
2004
资助国家：
日本
起止时间：
2004 至 2006
项目状态：
已结题

来源：
https://kaken.nii.ac.jp/grant/KAKENHI-PROJECT-16300053/
关键词：
speech perception speech production transformed auditory feedback (TAF)formant electromyographic (EMG) signal face image articulation tongue movement フォルマント

项目摘要

This study employed an auditory feedback paradigm with perturbed fed-back speech to investigate interaction between speech perception and production by measuring simultaneous fluctuations of speech production organs using the electromyographic (EMG) signals, articulatory movements, as well as spectral analyses, where the articulatory data were obtained by the electromagnetic articulographic (EMA) system. Chinese vowels pair [i]-[y] and Japanese vowels pairs [e]-[a], [e]-[i] and [e]-[u] were chosen as the experimental objects. When the speaker is maintaining the first vowel, the feedback sound is randomly changed from the first vowel to the second one in each pair by manipulating the first three formants. Spectral analysis showed that a clear compensation was seen in the first and second formants of the vowels. Analyses of EMG and EMA signals also showed muscle reactivation and tongue movements to compensate for the perturbations. Latency of the compensating response is about 150 ms to start and about 290 ms for maximum compensation from the onset of the perturbation. According to the measurements, it seems that in most cases the speaker attempts to compensate for the "error" caused by the auditory perturbation by a real-time monitoring, and the auditory feedback takes place simultaneously often during speech production.

本研究采用听觉反馈范式与扰动反馈语音，探讨言语感知和生产之间的相互作用，通过测量同时波动的言语生产器官使用肌电图（EMG）信号，发音运动，以及频谱分析，其中发音数据获得的电磁关节图（EMA）系统。本研究以汉语元音[i]-[y]和日语元音[e]-[a]、[e]-[i]和[e]-[u]为实验对象。当说话者保持第一个元音时，通过操纵前三个共振峰，反馈声音从每对中的第一个元音随机地改变到第二个元音。频谱分析表明，在元音的第一和第二共振峰中可以看到明显的补偿。对EMG和EMA信号的分析也显示了肌肉的重新激活和舌头的运动，以补偿扰动。补偿响应的等待时间从扰动开始约为150 ms，最大补偿约为290 ms。根据测量，似乎在大多数情况下，扬声器试图通过实时监测来补偿由听觉扰动引起的“误差”，并且听觉反馈通常在语音产生期间同时发生。