Development of the three dimensional auditory space reproduction system suited to the multi-modal environment

点击翻译按钮获取中文摘要

When we recognize outside, we use various sensory information. This mechanism is well-known as a multi-modal information process and very crucial for developing new man-machine interfaces. We have focused on the multi-modal information process concerned with three dimensional auditory space perception. In this study, we investigated the relationship between auditory space perception and somatic information. Moreover, we developed the three dimensional auditory space reproduction system suited to the multi-modal environment.In the first experiment, we experimentally examined the effect of the head movement concerning sound localization by using virtual sound. In this experiment, some HRTFs (Head-Related Transfer Functions) were used to generate virtual sound. These HRTFs were systematically changed from the listener's original one. The results showed that the accuracy of sound localization improved by listener's head movement on all HRTFs. This suggests that somatic information is quite important for sound localization.In the next experiment, the influence of the PDR (Pressure Division Field) on binaural sound synthesis was investigated. we measured PDR by using seven headphones. The results showed that the PDR depended on both the headphone and listener's acoustical characteristics. Moreover the effects of equalizing PDR on sound localization was verified by listening experiment.Using this knowledge obtained in this study, we created a precise three dimensional spatial hearing system. As the results of listening test by using this system, we showed that this system was useful for reproduction 3 dimensional auditory space accurately.