Effects of visual information on the impression of environmental sounds

本研究的主要目的是探讨视听互动，重点是声音和视觉图像之间的和谐感。以日常生活中遇到的八种环境声音及其动态画面作为刺激。双极性形容词对“和谐-不和谐”被用来衡量和谐的感觉，“满意-不满意”被用来衡量对由声音和视觉图像组成的环境的满意程度。在实验中，声音和运动图像同时呈现给10名被试。采用7分语义差异量表对13种声音或视觉形象的印象、和谐感和满意度进行评判。因子分析提取出两个因素，即审美因素和强力因素。采用协方差结构分析检验视听印象之间的相互依存关系。构建了和谐感因子得分与量表值双向路径的…More结构方程模型。分析后的模型显示出较高的拟合优度。和声感受与声音印象之间存在显著的因果关系（直接影响）。这表明，当声音被认为更美时，和谐的感觉就会变得更高，然后声音就会被认为不那么有力。可以说，对生活环境声音的印象对于判断声音与视觉形象是否是一个很好的组合有很大的影响。在此基础上，建立了包含前一模型的满意度的结构方程模型。该模型揭示了满意度和声音印象之间的重要因果关系，以及上述的直接影响。这表明，当声音被认为更美或更弱时，满意度就会变得更高。少

The major objective of this study is to investigate the audio-visual interaction with the focus on the feeling of harmony between sound and visual image. Eight kinds of environmental sound and its moving picture encountered in daily life were used as stimuli. The bipolar adjective pair "harmonious-disharmonious" was used as a measure of the feeling of harmony, and "satisfactory-unsatisfactory" was used as a measure of the degree of satisfaction with the environment consisting of sound and visual image. In experiment, the sounds and the moving pictures were presented simultaneously to 10 subjects. Thirteen kinds of impression of sound or visual image, the feeling of harmony and the degree of satisfaction were judged by using a 7-point semantic differential scale. The factor analysis extracted two factors, aesthetic factor and powerful factor. The covariance structure analysis was conducted to examine the relationships of interdependence among audio-visual impressions. We formulated the … More structural equation model with dual-directional paths between factor score and scale value of the feeling of harmony. The analyzed model revealed high degree of goodness-of-fit. There were significant causal paths (direct effects) between the feeling of harmony and the impressions of sound. It suggests that as the sound is perceived as being more beautiful, the feeling of harmony becomes higher, and then the sound is perceived as being less powerful. It may be said that the impression of life-environment sound has a large effect on making a judgment on whether sound and visual image is a good combination. Furthermore another structural equation model was formulated including the degree of satisfaction in the previous model. This model revealed significant causal paths between the degree of satisfaction and the impressions of sound as well as the direct effects described above. It suggests that as the sound is perceived as being more beautiful or less powerful, the degree of satisfaction becomes higher. Less