Development of the three dimensional auditory space reproduction system suited to the multi-modal environment

适合多模态环境的三维听觉空间再现系统的开发

• 批准号: 14350193
• 负责人: SUZUKI Yoiti
• 金额: $ 8.9万
• 依托单位: Tohoku University
• 依托单位国家: 日本
• 项目类别: Grant-in-Aid for Scientific Research (B)
• 财政年份: 2002
• 资助国家: 日本
• 起止时间: 2002 至 2004
• 项目状态: 已结题
• 来源: https://kaken.nii.ac.jp/en/grant/KAKENHI-PROJECT-14350193/
• 关键词: spatial hearing; virtual auditory display; Pressure Division Ratio; head movement; moving sound image; multi-modality; 正準相関分析; 両耳間時間差; 加速度知覚; 聴覚誘導性自己運動感覚; 単語認知の難易度; SN比; 聴覚誘導製自己運動感覚; 難聴者; 視聴覚融合

When we recognize outside, we use various sensory information. This mechanism is well-known as a multi-modal information process and very crucial for developing new man-machine interfaces. We have focused on the multi-modal information process concerned with three dimensional auditory space perception. In this study, we investigated the relationship between auditory space perception and somatic information. Moreover, we developed the three dimensional auditory space reproduction system suited to the multi-modal environment.In the first experiment, we experimentally examined the effect of the head movement concerning sound localization by using virtual sound. In this experiment, some HRTFs (Head-Related Transfer Functions) were used to generate virtual sound. These HRTFs were systematically changed from the listener's original one. The results showed that the accuracy of sound localization improved by listener's head movement on all HRTFs. This suggests that somatic information is quite important for sound localization.In the next experiment, the influence of the PDR (Pressure Division Field) on binaural sound synthesis was investigated. we measured PDR by using seven headphones. The results showed that the PDR depended on both the headphone and listener's acoustical characteristics. Moreover the effects of equalizing PDR on sound localization was verified by listening experiment.Using this knowledge obtained in this study, we created a precise three dimensional spatial hearing system. As the results of listening test by using this system, we showed that this system was useful for reproduction 3 dimensional auditory space accurately.

当我们在外面识别时，我们会使用各种感官信息。该机制众所周知是一种多模式信息过程，对于开发新的人机界面非常重要。我们专注于与三维听觉空间感知有关的多模式信息过程。在这项研究中，我们研究了听觉空间感知与躯体信息之间的关系。此外，我们开发了适合多模式环境的三维听觉空间繁殖系统。在第一个实验中，我们通过使用虚拟声音来研究头部运动对声音本地化的影响。在此实验中，使用了一些HRTF（与头部相关的传递功能）来生成虚拟声音。这些HRTF与听众的原始hrtf有系统地更改。结果表明，听众的头部移动在所有HRTF上都提高了声音定位的准确性。这表明体细胞信息对于声音定位非常重要。在下一个实验中，研究了PDR（压力分裂场）对双耳声音合成的影响。我们通过使用七个耳机测量了PDR。结果表明，PDR取决于耳机和听众的声学特征。此外，通过聆听实验验证了均衡PDR对声音定位的影响。使用本研究中获得的这一知识，我们创建了一个精确的三维空间听力系统。作为通过使用此系统的听力测试的结果，我们表明该系统对于繁殖3维听觉空间很有用。

项目成果

ヘッドホンにおける個人性を加味したFEC特性の検証

考虑个性化的耳机 FEC 特性验证

• 发表时间: 2003
• 期刊: 電子情報通信学会技術研究報告 応用音響研究会 EA2003-60
• 作者: K.T.Liu;Y.K.Su;S.J.Chang;K.Onomitsu;Y.Horikoshi;渋谷亮輔
• 通讯作者: 渋谷亮輔

Prediction of directional dependence of ITDs based on anthropometry and its effect on sound localization

基于人体测量学的ITD方向依赖性预测及其对声音定位的影响

• 发表时间: 2005
• 期刊: Proc.of ASJ biannual meetings 3-Q-28
• 作者: WATANABE Kanji

The effects of moving sound images on self-motion perseption

移动声像对自运动知觉的影响

• 发表时间: 2002
• 期刊: Technical Report of IEICE HIP2002-39
• 作者: K.Kamio;K.Nishimura;T.Sato;SUZUKI Fumihiko
• 通讯作者: SUZUKI Fumihiko

A psychophysical investigation of self-motion perception produced by acoustic information

声学信息产生的自运动感知的心理物理学研究

• 发表时间: 2002
• 期刊: 2002 China-Japan Joint Conference on Acoustics
• 作者: N.Hoaison;A.Shindo;K.Kaneko;H.Morikawa;T.Aoyama;Safwat Hassaballa;Shuichi Sakamoto
• 通讯作者: Shuichi Sakamoto

鈴木史彦: "移動仮想音源の動きが自己運動感覚に及ぼす影響について"電子情報通信学会技術研究報告ヒューマン情報処理研究会. HIP2002-39. 19-24 (2002)

Fumihiko Suzuki：“关于移动虚拟声源的运动对自我运动感的影响”IEICE 人类信息处理研究小组技术报告 HIP2002-39 (2002)。