Exploring the Use of Gesture in Collaborative Tasks
Exploring the Use of Gesture in Collaborative Tasks
复制标题
探索手势在协作任务中的使用
DOI：
10.1145/3027063.3053239
复制
发表时间：
2017
期刊：
影响因子：
--
通讯作者：
J. Ruiz
中科院分区：
文献类型：
--
作者：
Isaac Wang;P. Narayana;Dhruva Patil;Gururaj Mulay;R. Bangar;B. Draper;J. Beveridge;J. Ruiz
Siri 等个人助理引入了通过基于自然语音的界面与人类协作的虚拟助理，改变了人们与计算机交互的方式。然而，仅依靠语音作为沟通媒介可能存在局限性。交流的非语言方面在人类自然话语中也发挥着至关重要的作用。因此，有必要识别手势和其他非语言方面的使用，以便将它们应用于计算机系统的开发。我们进行了一项探索性研究，以确定人类在解决协作任务时如何使用手势和语音进行交流。我们强调了存在/不存在语音时手势策略的差异，并且还表明，将手势与语音结合可以比单独使用语音更快地完成任务。基于这些结果，我们提出了手势和多模式交互设计的启示。
Personal assistants such as Siri have changed the way people interact with computers by introducing virtual assistants that collaborate with humans through natural speech-based interfaces. However, relying on speech alone as the medium of communication can be a limitation; non-verbal aspects of communication also play a vital role in natural human discourse. Thus, it is necessary to identify the use of gesture and other non-verbal aspects in order to apply them towards the development of computer systems. We conducted an exploratory study to identify how humans use gesture and speech to communicate when solving collaborative tasks. We highlight differences in gesturing strategies in the presence/absence of speech and also show that the inclusion of gesture with speech resulted in faster task completion times than with speech alone. Based on these results, we present implications for the design of gestural and multimodal interactions.