CRII: CHS: Collaboratively Perceiving, Comprehending, and Projecting into the Future: Supporting Team Situational Awareness with Adaptive Collaborative Tactons

数据过载，特别是视觉通道中的数据过载，以及相关的监控故障，已经成为数据丰富环境中的一项重大挑战。克服数据过载的一个有希望的方法是引入多模式显示器，这种显示器通过各种感官渠道(包括视觉、听觉和触觉)分发信息。近年来，触摸作为一种减轻过载的视觉和听觉通道的手段受到了更多的关注，但这种方式仍有许多有待发现的地方。Tacton，或触觉图标/显示，是结构化的抽象消息，可用于在没有视觉的情况下交流信息。然而，如果它们的设计没有考虑到复杂的系统依赖于团队的协调活动，那么它们的有效性可能会受到影响。PI在这个项目中的目标是建立一个研究计划，探索适应性协作松饼作为支持态势感知的一种手段，即团队感知和理解来自环境的信息并实时预测未来事件的能力。项目成果将有助于更深入地理解个人和团队感觉通道之间和跨感觉通道的感知和注意力，以及多通道界面如何支持数据丰富的领域中的团队合作。这项工作将在人为因素中整合三个不同的主题：多通道界面、情景感知和自适应系统。PI将创建设计既考虑环境又考虑团队所需信息类型的方法，方法是利用多模式方面来开发使用生理测量(特别是眼球跟踪数据)的定量和定性模型和算法。这些反过来将通过响应于各种感测的参数和条件来调整信息的呈现来通知支持协作的自适应标签的功能。

Data overload, especially in the visual channel, and associated breakdowns in monitoring already represent a major challenge in data-rich environments. One promising means of overcoming data overload is through the introduction of multimodal displays which distribute information across various sensory channels (including vision, audition, and touch). In recent years, touch has received more attention as a means to offload the overburdened visual and auditory channels, but much remains to be discovered in this modality. Tactons, or tactile icons/displays, are structured, abstract messages that can be used to communicate information in the absence of vision. However, the effectiveness of tactons may be compromised if their design does not take into account that complex systems depend on the coordinated activities of a team. The PI's goal in this project is to establish a research program that will explore adaptive collaborative tactons as a means to support situational awareness, that is the ability of a team to perceive and comprehend information from the environment and predict future events in real time. Project outcomes will contribute to a deeper understanding of perception and attention between and across sensory channels for individuals and teams, and to how multimodal interfaces can support teamwork in data-rich domains.The work will integrate three disparate topics within human factors: multimodal interfaces, situational awareness, and adaptive systems. The PI will create methods to design tactons that take into account both context and the types of information needed by a team, by leveraging the multimodal aspects to develop quantitative and qualitative models and algorithms using physiological measures (in particular, eye tracking data). These in turn will inform the functionality of adaptive tactons that support collaboration by adjusting the presentation of information in response to various sensed parameters and conditions.