Towards a Gesture-Based Story Authoring System: Design Implications from Feature Analysis of Iconic Gestures During Storytelling

Towards a Gesture-Based Story Authoring System: Design Implications from Feature Analysis of Iconic Gestures During Storytelling
复制标题

走向基于手势的故事创作系统:讲故事过程中标志性手势特征分析的设计启示

DOI:
10.1007/978-3-030-33894-7_38
复制
发表时间:
2019
期刊:
Lecture notes in computer science
影响因子:
--
通讯作者:
Zhang, L.
Zhang, L.
中科院分区:
--
文献类型:
--
作者:
Brown, S. A.;Chu, S. L.;Quek, F.;Canaday, P.;Li, Q.;Loustau, T.;Wu, S.;Zhang, L.

文献摘要

参考文献

被引文献

相似文献

当前使用手势来讲述故事的系统往往主要依赖于预先编写的一组手势或对有形物体使用操纵性手势。我们的研究旨在通过对自然口头讲故事过程中出现的标志性手势的基于特征的分析,为讲故事的手势识别系统的设计提供信息。我们从20名研究参与者那里收集了一组卡通刺激的故事复述,并对故事复述的视频进行了手势分析,重点是标志性手势。标志性手势是一种具有代表性的手势,它提供了物体的形状、位置或运动等信息。根据它们所描绘的概念,分析了这些标志性手势的形式特征。两者之间的模式被识别出来,并用于创建系统可以识别的手势形式模式的建议。
Current systems that use gestures to enable storytelling tend to mostly rely on a pre-scripted set of gestures or the use of manipulative gestures with respect to tangibles. Our research aims to inform the design of gesture recognition systems for storytelling with implications derived from a feature-based analysis of iconic gestures that occur during naturalistic oral storytelling. We collected story retellings of a collection of cartoon stimuli from 20 study participants, and a gesture analysis was performed on videos of the story retellings focusing on iconic gestures. Iconic gestures are a type of representational gesture that provides information about objects such as their shape, location, or movement. The form features of the iconic gestures were analyzed with respect to the concepts that they portrayed. Patterns between the two were identified and used to create recommendations for patterns in gesture form a system could be primed to recognize.
全身手势增强游戏书的互动故事讲述能力
DOI: --
发表时间: 2011
期刊: International Conference on Interactive Digital Storytelling
影响因子: --
作者:
Felix Kistler;Dominik Sollfrank;Nikolaus Bee;E. André
通讯作者: E. André
DOI: --
发表时间: 2012
期刊: Iberian Conference on Information Systems and Technologies
影响因子: --
作者:
P. Trigueiros;F. Ribeiro;Luis Paulo Reis
通讯作者: Luis Paulo Reis