CAREER: A Multi-Disciplinary Approach to the Next Generation of Collaborative Technologies

本研究旨在促进下一代协作技术的发展，并研究其对人类协作的影响。它通过提高我们对共享视觉环境的各种特征如何影响沟通、协调和协作的理论理解来做到这一点。该研究开发并提供了一种新的双眼动追踪方法的代码，该方法可用于研究协调和协作。它还开发了一套新的指标，可以更广泛地用于理解与对话和对话有关的协调眼球运动。这项工作的结果将增加许多学科的知识，包括人机交互、语言技术、计算机科学、计算语言学、传播学、认知科学以及社会和认知心理学。正如最近在远程医疗、远程教育和远程培训与维修方面所做的努力所证明的那样，远程支持这些活动的技术存在巨大潜力，最终带来广泛的好处，例如平等获得优质教育和医疗服务。本研究的教育活动包括：(1)开设新的博士课程，教授理论驱动的设计方法；(2)开发一系列使用双眼动追踪方法教授行为编码、统计学和机器学习的课程模块；(3)开发一个公开可用的多模态语料库，并提供一套教程；(4)开发一系列关于双眼动追踪的国际研讨会。最后，这项研究将在培养研究生和本科生跨学科研究方法的同时，促进发现和理解，并将有助于计算机和信息科学领域传统上代表性不足的个人的发展。

This research aims to enable the development of the next generation of collaborative technologies and to study their effects on human collaboration. It does so by improving our theoretical understanding of how various features of shared visual context affect communication, coordination and collaboration. The research develops and makes available the code for a new dual eye tracking methodology that can be used to study coordination and collaboration. It also develops a new set of metrics that can be more generally used to understand coordinated eye movements as they relate to dialogue and conversation. The results of this work will add to knowledge in a number of disciplines, including human-computer interaction, language technologies, computer science, computational linguistics, communication studies, cognitive science, and social and cognitive psychology.As recent efforts in telemedicine, distance education, and remote training and repair attest, there exists enormous potential for technologies to support these activities at a distance, ultimately resulting in widespread benefits such as equal access to quality education and medical care. The education activities in this research include: (1) developing a new Ph.D. course that teaches a theory-driven design approach; (2) developing a series of course modules that use the dual eye tracking methodology to teach behavioral coding, statistics and machine learning; (3) developing a publicly available multimodal corpus with a set of tutorials, and (4) developing a series of international workshops on dual eye tracking. Finally, the research will simultaneously advance discovery and understanding while training both graduate and undergraduate students in interdisciplinary research methods and will contribute to the development of traditionally underrepresented individuals in the fields of computer and information sciences.