How Important are Detailed Hand Motions for Communication for a Virtual Character Through the Lens of Charades?
How Important are Detailed Hand Motions for Communication for a Virtual Character Through the Lens of Charades?
复制标题
通过字谜镜头，详细的手势对于虚拟角色的交流有多重要？
DOI：
10.1145/3578575
复制
发表时间：
2023
影响因子：
6.2
通讯作者：
Jörg, Sophie
中科院分区：
文献类型：
--
作者：
Adkins, Alex;Normoyle, Aline;Lin, Lorraine;Sun, Yu;Ye, Yuting;Di Luca, Massimiliano;Jörg, Sophie
在面对面的交流中，详细的手势在强调要点、描述物体、澄清概念或完全取代词语方面发挥着重要作用。虽然共享虚拟现实（VR）空间正变得越来越流行，但在大多数情况下，这些空间并不能捕捉和显示准确的手部动作。在这篇文章中，我们研究了手和手指动作中的这些错误对理解、角色感知、社会存在和用户舒适度的影响。我们进行了三个感知实验，参与者根据动作捕捉的动作猜测单词和电影名称。我们介绍错误和改变手的运动和应用技术来合成或纠正手的运动。我们在两个大型实验中收集了1000多名亚马逊土耳其机器人参与者的数据，并在VR中进行了第三个实验。由于使用的虚拟角色不同，结果可能会有所不同，我们研究了两个不同现实主义水平的虚拟角色的所有效果。我们在实验中进一步研究了剪辑长度的影响。在其他结果中，我们表明手指运动的缺失会显著降低理解能力，并对人们对虚拟角色及其社交存在的感知产生负面影响。添加一些手部动作，甚至是随机的动作，确实会减弱对虚拟角色或社交存在的感知，但这并不一定能提高理解能力。稍微不准确或错误的手部动作足以达到与准确的手部动作相同的理解水平。然而，他们可能仍然会影响观众对角色的印象。最后，抖动的手部动作应该避免，因为它们会大大降低用户的舒适度。
Detailed hand motions play an important role in face-to-face communication to emphasize points, describe objects, clarify concepts, or replace words altogether. While shared virtual reality (VR) spaces are becoming more popular, these spaces do not, in most cases, capture and display accurate hand motions. In this article, we investigate the consequences of such errors in hand and finger motions on comprehension, character perception, social presence, and user comfort. We conduct three perceptual experiments where participants guess words and movie titles based on motion captured movements. We introduce errors and alterations to the hand movements and apply techniques to synthesize or correct hand motions. We collect data from more than 1000 Amazon Mechanical Turk participants in two large experiments, and conduct a third experiment in VR. As results might differ depending on the virtual character used, we investigate all effects on two virtual characters of different levels of realism. We furthermore investigate the effects of clip length in our experiments.Amongst other results, we show that the absence of finger motion significantly reduces comprehension and negatively affects people’s perception of a virtual character and their social presence. Adding some hand motions, even random ones, does attenuate some of these effects when it comes to the perception of the virtual character or social presence, but it does not necessarily improve comprehension. Slightly inaccurate or erroneous hand motions are sufficient to achieve the same level of comprehension as with accurate hand motions. They might however still affect the viewers’ impression of a character. Finally, jittering hand motions should be avoided as they significantly decrease user comfort.
登录
查看更多内容
影响因子：
6.2
作者：
Glauser, Oliver;Wu, Shihao;Sorkine-Hornung, Olga
通讯作者：
Sorkine-Hornung, Olga
影响因子：
3.7
作者：
Bartneck C;Duenser A;Moltchanova E;Zawieska K
通讯作者：
Zawieska K
影响因子：
6.2
作者：
Han, Shangchen;Liu, Beibei;Wang, Robert
通讯作者：
Wang, Robert
用于手势字符的数据驱动手指运动合成
影响因子：
6.2
作者：
S. Jörg;J. Hodgins;A. Safonova
通讯作者：
A. Safonova
语言进化研究中哑剧的定义
DOI：
10.1007/s11245-016-9425-9
发表时间：
2018
期刊：
Topoi
影响因子：
--
作者：
Przemysław Żywiczyński;Sławomir Wacewicz;Marta Sibierska
通讯作者：
Marta Sibierska