The effective way to use sound and motion picture in multimedia

点击翻译按钮获取中文摘要

To clarify the effective way to combine sound and music in multimedia, a series of experiments were examined. Firstly, the matching experiment of the musical tempo and the speed of motion picture in the audio-visual context was examined. This experiment showed two factors which affect the subjective congruency of audio-visual contents. One is the synchronization of visual and auditory accents and the other is the matching of musical tempo and speed of visual movement. Secondly, the effects of the synchronization of visual and auditory accents and the matching of musical tempo and visual speed on the audio-visual contents was examined by the subjective rating experiment. The independency of these two factors on the subjective congruency of audio-visual contents was shown. The synchronization factors was more dominant than the audio-visual contents were discussed. Finally, the degree of matching between color and music was explored as a function of colors and types of music. Blue, violet, purple, and red images are matched with powerful and dark music played with miner key and fast tempo. Bright music with tempo match with blue, purple, and violet. In general, music match with the colors which encourage the impression of music. In multimedia communication, if we know the effective way to use sound and motion picture, we can make excellent audio-visual contents without professionals' help. The present study proposes the basic knowledge to do so.