Head gesture sonification for supporting social interaction
Head gesture sonification for supporting social interaction
复制标题
用于支持社交互动的头部手势声音化
DOI：
--
复制
发表时间：
2012
期刊：
影响因子：
--
通讯作者：
Sebastian Zehe
中科院分区：
文献类型：
--
作者：
T. Hermann;Alexander Neumann;Sebastian Zehe
在本文中，我们介绍了两种新的方法，用于头部运动和头部姿态的实时发音。点头或摇头等头部姿势是重要的非语言反向传导信号，有助于沟通互动伙伴的协调和对齐。视力受损的人不能解释这种非语言信号，就像人们在中介沟通（例如在电话上），或合作用户的视觉注意力集中在其他地方一样。我们介绍我们的方法来解决这些问题，我们的传感设置和两种不同的声化方法。对信号识别的第一个初步研究表明，即使没有事先解释，受试者也能理解手势类型，并且可以在没有或很少训练的情况下估计手势强度和频率。
In this paper we introduce two new methods for real-time sonification of head movements and head gestures. Head gestures such as nodding or shaking the head are important non-verbal back-channelling signals which facilitate coordination and alignment of communicating interaction partners. Visually impaired persons cannot interpret such non-verbal signals, same as people in mediated communication (e.g. on the phone), or cooperating users whose visual attention is focused elsewhere. We introduce our approach to tackle these issues, our sensing setup and two different sonification methods. A first preliminary study on the recognition of signals shows that subjects understand the gesture type even without prior explanation and can estimate gesture intensity and frequency with no or little training.