CRII: CHS: Collaboratively Perceiving, Comprehending, and Projecting into the Future: Supporting Team Situational Awareness with Adaptive Collaborative Tactons

在数据丰富的环境中，数据过载（尤其是在可视通道中）和相关的监控故障已经成为一个主要挑战。克服数据过载的一个有希望的方法是通过引入多模态显示，它通过各种感觉通道（包括视觉、听觉和触觉）分发信息。近年来，触觉作为一种减轻视觉和听觉通道负担的手段受到了越来越多的关注，但这种方式仍有很多有待发现。触觉，或触觉图标/显示，是结构化的、抽象的信息，可以用来在没有视觉的情况下传达信息。然而，如果策略的设计没有考虑到复杂系统依赖于团队的协调活动，那么策略的有效性可能会受到损害。PI在该项目的目标是建立一个研究计划，探索自适应协作战术作为支持态势感知的手段，即团队感知和理解来自环境的信息并实时预测未来事件的能力。项目成果将有助于更深入地了解个人和团队之间和跨感官通道之间的感知和注意力，以及多模式界面如何支持数据丰富领域的团队合作。该工作将在人为因素中整合三个不同的主题：多模式界面、态势感知和自适应系统。PI将通过利用多模态方面来开发定量和定性模型以及使用生理测量（特别是眼动追踪数据）的算法，创建方法来设计考虑到团队所需的环境和信息类型的策略。反过来，这些将通知自适应策略的功能，通过调整响应各种感知参数和条件的信息表示来支持协作。

Data overload, especially in the visual channel, and associated breakdowns in monitoring already represent a major challenge in data-rich environments. One promising means of overcoming data overload is through the introduction of multimodal displays which distribute information across various sensory channels (including vision, audition, and touch). In recent years, touch has received more attention as a means to offload the overburdened visual and auditory channels, but much remains to be discovered in this modality. Tactons, or tactile icons/displays, are structured, abstract messages that can be used to communicate information in the absence of vision. However, the effectiveness of tactons may be compromised if their design does not take into account that complex systems depend on the coordinated activities of a team. The PI's goal in this project is to establish a research program that will explore adaptive collaborative tactons as a means to support situational awareness, that is the ability of a team to perceive and comprehend information from the environment and predict future events in real time. Project outcomes will contribute to a deeper understanding of perception and attention between and across sensory channels for individuals and teams, and to how multimodal interfaces can support teamwork in data-rich domains.The work will integrate three disparate topics within human factors: multimodal interfaces, situational awareness, and adaptive systems. The PI will create methods to design tactons that take into account both context and the types of information needed by a team, by leveraging the multimodal aspects to develop quantitative and qualitative models and algorithms using physiological measures (in particular, eye tracking data). These in turn will inform the functionality of adaptive tactons that support collaboration by adjusting the presentation of information in response to various sensed parameters and conditions.