A Speech-Based Model for Tracking the Progression of Activities in Extreme Action Teamwork
A Speech-Based Model for Tracking the Progression of Activities in Extreme Action Teamwork
复制标题
DOI：
10.1145/3512920
复制
发表时间：
2022-03
影响因子：
--
通讯作者：
Swathi Jagannath;Neha Kamireddi;K. A. Zellner;R. Burd;I. Marsic;Aleksandra Sarcevic
中科院分区：
文献类型：
--
作者：
Swathi Jagannath;Neha Kamireddi;K. A. Zellner;R. Burd;I. Marsic;Aleksandra Sarcevic
设计计算机化的方法来支持复杂的团队合作需要理解与活动相关的信息是如何在团队成员之间传递的。在本文中，我们将重点放在口头交流上，并描述了一个基于语音的模型，该模型是我们在时间关键的团队合作中开发的，用于跟踪活动进展。我们将我们的研究置于创伤复苏的紧急医学领域，并从104个实际复苏的录音中转录语音。利用转录本，我们首先研究了34个临床相关活动中的言语性质。从这一分析中，我们确定了11个交际事件，涉及活动表现的三个不同阶段——之前、期间和之后。对于每个活动，我们使用叙事模式的概念创建了交流事件的顺序。通过对34个图式的概括方面进行提取和汇总，最终形成基于语音的模型。我们通过使用17个新的转录本来评估模型的性能，并发现该模型在98%的与活动相关的会话实例中可靠地识别了活动阶段。最后，我们讨论了这些结果，它们对设计支持复杂团队合作的计算机化方法的影响，以及它们在其他安全关键领域的推广意义。
Designing computerized approaches to support complex teamwork requires an understanding of how activity-related information is relayed among team members. In this paper, we focus on verbal communication and describe a speech-based model that we developed for tracking activity progression during time-critical teamwork. We situated our study in the emergency medical domain of trauma resuscitation and transcribed speech from 104 audio recordings of actual resuscitations. Using the transcripts, we first studied the nature of speech during 34 clinically relevant activities. From this analysis, we identified 11 communicative events across three different stages of activity performance-before, during, and after. For each activity, we created sequential ordering of the communicative events using the concept of narrative schemas. The final speech-based model emerged by extracting and aggregating generalized aspects of the 34 schemas. We evaluated the model performance by using 17 new transcripts and found that the model reliably recognized an activity stage in 98% of activity-related conversation instances. We conclude by discussing these results, their implications for designing computerized approaches that support complex teamwork, and their generalizability to other safety-critical domains.