Experimental analysis of auditory and gestural interface

听觉和手势界面的实验分析

• 批准号: 09610071
• 负责人: HAMANO Takashi
• 金额: $ 1.09万
• 依托单位: Musashino Womens' University (1998)Tokyo Institute of Technology (1997)
• 依托单位国家: 日本
• 项目类别: Grant-in-Aid for Scientific Research (C)
• 财政年份: 1996
• 资助国家: 日本
• 起止时间: 1996 至 1998
• 项目状态: 已结题
• 来源: https://kaken.nii.ac.jp/grant/KAKENHI-PROJECT-09610071/
• 关键词: interface; gesuture; auditory; ユーザインタフェース; インターフェース; メタファ

The purpose of this research is to examine the usability of multimodal interface using systematic musical tones and gesture. In experiment 1, three participantsmatched the sound stimulus on three elements of musical tones ; pitch, rhythm, and the direction of the sound. The result showed that the accuracy of matching was the highest in the pitch, the second in rhythm, and the last in the direction. The order of matching is (1) rhythm, (2) pitch and (3) direction. The combinations of the elements are also discussed. With this result, we can make auditory interfaces that lead users' attention to the most urgent information, and enable it to be received with the necessary accuracy. In experiment 2 and 3, an auditory condition that uses syncbronic constant tones keep presented multi-dimensional information was also examined. Two experiments were conducted with this condition, in maze-navigation task (experiment 2) and a mobile PC simulator (experiment 3). Under this condition, the performing time was shorter than no-sound condition (experiment 2). The frequency of operating errors was less when participants used the system the second time (experiment 3).The result indicates that subjects' learning about the systems are promoted by this auditory condition. In experiment 4 and 5, 24 participants operated a simulator of data base. Under gestural command condition, the performing time was shorter than pointing and short-cut key conditions. Finally, the implications of these results for auditory and gestural interfaces were discussed.

这项研究的目的是使用系统的音乐色调和手势检查多模式界面的可用性。在实验1中，三名参与者在三个音乐色调的元素上匹配了声音刺激。音高，节奏和声音的方向。结果表明，匹配的准确性是音高最高的，第二个是节奏的，最后一个是方向上的。匹配的顺序为（1）节奏，（2）音高和（3）方向。还讨论了元素的组合。通过此结果，我们可以制作听觉界面，引导用户注意最紧急信息，并使其能够以必要的准确性接收。在实验2和3中，还检查了使用同步恒定音调的听觉条件，还检查了呈现的多维信息。在迷宫式活动任务（实验2）和一个移动PC模拟器（实验3）中，进行了两个实验。在这种情况下，性能时间比无疾病的条件短（实验2）。当参与者第二次使用系统时，操作错误的频率较小（实验3）。结果表明受试者对系统的学习是通过此听觉条件促进的。在实验4和5中，24名参与者操作了数据库的模拟器。在手势指挥条件下，表现时间比指向和短切的关键条件短。最后，讨论了这些结果对听觉和手势界面的含义。