The effective way to use sound and motion picture in multimedia

为了阐明在多媒体中将声音和音乐结合的有效方式，我们进行了一系列实验。首先，考察了视听环境下音乐节奏与运动画面速度的匹配实验。本实验揭示了影响视听内容主观一致性的两个因素。一个是视觉和听觉口音的同步，另一个是音乐节奏和视觉运动速度的匹配。其次，通过主观评分实验考察了视听口音的同步性、音乐节奏与视速的匹配对视听内容的影响。这两个因素对视听内容主观一致性的影响是独立的。同步因素比视听内容更具主导性。最后，探讨了颜色与音乐之间的匹配程度作为颜色和音乐类型的函数。蓝色、紫色、紫色和红色的图像与强劲而黑暗的音乐相匹配，音乐以矿工键和快节奏演奏。明亮的音乐节奏与蓝色、紫色和紫色相匹配。一般说来，音乐与能给人留下深刻印象的颜色相匹配。在多媒体传播中，如果我们知道如何有效地使用声音和动画，我们就可以在没有专业人员帮助的情况下制作出优秀的视听内容。本研究提出了实现这一目标的基本知识。

To clarify the effective way to combine sound and music in multimedia, a series of experiments were examined. Firstly, the matching experiment of the musical tempo and the speed of motion picture in the audio-visual context was examined. This experiment showed two factors which affect the subjective congruency of audio-visual contents. One is the synchronization of visual and auditory accents and the other is the matching of musical tempo and speed of visual movement. Secondly, the effects of the synchronization of visual and auditory accents and the matching of musical tempo and visual speed on the audio-visual contents was examined by the subjective rating experiment. The independency of these two factors on the subjective congruency of audio-visual contents was shown. The synchronization factors was more dominant than the audio-visual contents were discussed. Finally, the degree of matching between color and music was explored as a function of colors and types of music. Blue, violet, purple, and red images are matched with powerful and dark music played with miner key and fast tempo. Bright music with tempo match with blue, purple, and violet. In general, music match with the colors which encourage the impression of music. In multimedia communication, if we know the effective way to use sound and motion picture, we can make excellent audio-visual contents without professionals' help. The present study proposes the basic knowledge to do so.