Experimental analysis of auditory and gestural interface

点击翻译按钮获取中文摘要

The purpose of this research is to examine the usability of multimodal interface using systematic musical tones and gesture. In experiment 1, three participantsmatched the sound stimulus on three elements of musical tones ; pitch, rhythm, and the direction of the sound. The result showed that the accuracy of matching was the highest in the pitch, the second in rhythm, and the last in the direction. The order of matching is (1) rhythm, (2) pitch and (3) direction. The combinations of the elements are also discussed. With this result, we can make auditory interfaces that lead users' attention to the most urgent information, and enable it to be received with the necessary accuracy. In experiment 2 and 3, an auditory condition that uses syncbronic constant tones keep presented multi-dimensional information was also examined. Two experiments were conducted with this condition, in maze-navigation task (experiment 2) and a mobile PC simulator (experiment 3). Under this condition, the performing time was shorter than no-sound condition (experiment 2). The frequency of operating errors was less when participants used the system the second time (experiment 3).The result indicates that subjects' learning about the systems are promoted by this auditory condition. In experiment 4 and 5, 24 participants operated a simulator of data base. Under gestural command condition, the performing time was shorter than pointing and short-cut key conditions. Finally, the implications of these results for auditory and gestural interfaces were discussed.