A study on fluctuation of auditory information based on acoustic information deviations and its perception

基于声信息偏差的听觉信息波动及其感知研究

• 批准号: 13610079
• 负责人: AKAGI Masato
• 金额: $ 2.11万
• 依托单位: Japan Advanced Institute of Science and Technology
• 依托单位国家: 日本
• 项目类别: Grant-in-Aid for Scientific Research (C)
• 财政年份: 2001
• 资助国家: 日本
• 起止时间: 2001 至 2003
• 项目状态: 已结题
• 来源: https://kaken.nii.ac.jp/grant/KAKENHI-PROJECT-13610079/
• 关键词: singing voice; fundamental frequency; spectral deviation; singing-ness; inter-aural time difference; nerve firing; synchronization index; entrainment; F0動的変動成分; 聴神経発火パターン; 蝸牛神経核; 球状叢状細胞; FO動的変動成分

This research discusses how acoustic feature deviations in time influence on perception of voice quality (1), especially in singing-voice, and of sound source direction (2).For (1), this study first investigate how much these F0 fluctuations influence singing-voice perception, by removing each F0 fluctuation from the F0 contours, by re-synthesizing the singing-voices using the modified F0s, and by presenting these sounds to subjects. The results show that the effects of all F0 fluctuations on singing-voice perception are large, and effect of overshoot is the largest. This study also investigates what features are related to "singingness." The results indicate "singingness" is strongly associated with "vibration," "ringing" and "clearness" as psychoacoustic features and "vibration" is affected by the following characteristics ; (a) 4 -6 Hz modulation in the F0 and amplitude envelope, (b) formants are fluctuated in frequency and amplitude with the same modulation frequency, and (c) intervals and phases of formant deviation are corresponding to those of F0 deviation.For (2), this study demonstrates the mechanism through which a single neuron enhanced temporal information from the viewpoint of entrainment as well as synchronization using a computational model.As a result of simulation, a model with multiple-input configurations yields enhanced synchronization and nearly perfect entrainment at low CFs.The relation between the number of input terminals and the number of input events to output a spike is derived quantitatively to maintain enhanced temporal information against the primary-like behavior of inputs from ANFs.The results suggest the possibility of a firing mechanism that had multiple inputs on a single neuron in the AVCN.

本研究讨论了声学特征随时间的偏差如何影响语音质量的感知 (1)，特别是在歌声中，以及声源方向 (2)。对于 (1)，本研究首先研究这些 F0 波动对歌声感知的影响程度，方法是从 F0 轮廓中删除每个 F0 波动，使用修改后的 F0 重新合成歌声，并通过提出 这些声音对受试者来说。结果表明，所有F0波动对歌声感知的影响都很大，其中超调的影响最大。这项研究还调查了哪些特征与“歌唱性”相关。结果表明，“歌唱性”与作为心理声学特征的“振动”、“鸣响”和“清晰度”密切相关，并且“振动”受到以下特征的影响； (a) F0 和幅度包络中的 4 -6 Hz 调制，(b) 共振峰在相同调制频率下的频率和幅度波动，(c) 共振峰偏差的间隔和相位与 F0 偏差相对应。对于 (2)，本研究使用计算模型从夹带和同步的角度演示了单个神经元增强时间信息的机制。 模拟中，具有多输入配置的模型在低 CF 下产生增强的同步和近乎完美的夹带。输入端子的数量和输出尖峰的输入事件的数量之间的关系是定量导出的，以针对来自 ANF 的输入的类似主要行为保持增强的时间信息。结果表明在 AVCN 中的单个神经元上有多个输入的激发机制的可能性。

项目成果

Saitou, T., Unoki, M., Akagi, M.: "Extraction of F0 dynamic characteristics and development of F0 control model in singing voice"Proceedings of ICAD2002. 275-278 (2002)

Saitou, T.，Unoki, M.，Akagi, M.：“歌声中F0动态特性的提取和F0控制模型的开发”ICAD2002论文集。

Akagi, M.: "Perception of fundamental frequency fluctuation"Forum Acousticum Sevilla. HEA-02-003-IP. (2002)

Akagi, M.：“基频波动的感知”Forum Acousticum Sevilla。

伊藤一仁, 赤木正人: "Entrainment特性に基づくSBC細胞の位相情報伝達について"日本音響学会平成14年春季音響学会講演論文. 2-9-11 (2002)

Kazuhito Ito、Masato Akagi：“基于夹带特性的 SBC 单元中的相位信息传输”日本声学学会 2002 年春季声学会议演讲论文 2-9-11 (2002)。

Saitou, T., Unoki, M., Akagi, M.: "Development of the F0 control method for singing-voices synthesis"Proceedings of SP2004. 491-494 (2004)

Saitou, T.、Unoki, M.、Akagi, M.：“歌声合成的 F0 控制方法的开发”SP2004 论文集。

齋藤毅, 鵜木祐史, 赤木正人: "歌声のF0制御モデルにおけるパラメータ決定に関する考察"音響学会聴覚研究会資料. H-2003-111. (2003)

Takeshi Saito、Yuji Uoki、Masato Akagi：“歌声 F0 控制模型中参数确定的考虑”日本声学学会听力研究组资料 H-2003-111（2003 年）。