Model Transfer for Event tracking as Transcript Understanding for Videos of Small Group Interaction
Model Transfer for Event tracking as Transcript Understanding for Videos of Small Group Interaction
复制标题
DOI：
--
复制
发表时间：
2022
期刊：
影响因子：
--
通讯作者：
Sumit Agarwal;Rosa Vitiello;C. Rosé
中科院分区：
文献类型：
--
作者：
Sumit Agarwal;Rosa Vitiello;C. Rosé
小组互动的视频包含了大量的信息，远远超出了讨论记录中直接传达的信息。跟踪谁参与了一个扩展的互动，以及他们每个人的轨迹彼此之间的关系是理解联合活动的基础，尽管它在紧密耦合的小组工作的视频中带来了一些独特的挑战。在深入了解这些场景的属性的激励下，包括小组组成和任务导向、目标导向任务的属性，我们提出了一个成功的概念证明。特别是，我们提出了一个转移实验到一个二元机器人建设任务，烧蚀研究和定性分析。
Videos of group interactions contain a wealth of information beyond the information directly communicated in a transcript of the discussion. Tracking who has participated throughout an extended interaction and what each of their trajectories has been in relation to one another is the foundation for joint activity understanding, though it comes with some unique challenges in videos of tightly coupled group work. Motivated by insights into the properties of such scenarios, including group composition and the properties of task-oriented, goal directed tasks, we present a successful proof-of-concept. In particular, we present a transfer experiment to a dyadic robot construction task, an ablation study, and a qualitative analysis.