CAREER: A Multi-Disciplinary Approach to the Next Generation of Collaborative Technologies

这项研究旨在开发下一代协作技术，并研究它们对人类协作的影响。它通过提高我们对共享视觉环境的各种特征如何影响沟通，协调和协作的理论理解来实现。该研究开发并提供了一种新的双眼跟踪方法的代码，可用于研究协调和协作。它还开发了一套新的指标，可以更普遍地用于理解与对话和谈话有关的协调眼动。这项工作的结果将增加许多学科的知识，包括人机交互、语言技术、计算机科学、计算语言学、传播学、认知科学以及社会和认知心理学。正如最近在远程医疗、远程教育、远程培训和维修方面的努力所证明的那样，远程支持这些活动的技术存在着巨大的潜力，最终带来广泛的利益，如平等获得优质教育和医疗保健。本研究的教育活动包括：（1）培养新的博士生;该项目包括：（1）开发一个教授理论驱动设计方法的课程;（2）开发一系列使用双眼动追踪方法教授行为编码、统计学和机器学习的课程模块;（3）开发一个公开的多模式语料库和一套教程;（4）开发一系列关于双眼动追踪的国际研讨会。最后，该研究将同时推进发现和理解，同时培养研究生和本科生的跨学科研究方法，并将有助于传统上代表性不足的个人在计算机和信息科学领域的发展。

This research aims to enable the development of the next generation of collaborative technologies and to study their effects on human collaboration. It does so by improving our theoretical understanding of how various features of shared visual context affect communication, coordination and collaboration. The research develops and makes available the code for a new dual eye tracking methodology that can be used to study coordination and collaboration. It also develops a new set of metrics that can be more generally used to understand coordinated eye movements as they relate to dialogue and conversation. The results of this work will add to knowledge in a number of disciplines, including human-computer interaction, language technologies, computer science, computational linguistics, communication studies, cognitive science, and social and cognitive psychology.As recent efforts in telemedicine, distance education, and remote training and repair attest, there exists enormous potential for technologies to support these activities at a distance, ultimately resulting in widespread benefits such as equal access to quality education and medical care. The education activities in this research include: (1) developing a new Ph.D. course that teaches a theory-driven design approach; (2) developing a series of course modules that use the dual eye tracking methodology to teach behavioral coding, statistics and machine learning; (3) developing a publicly available multimodal corpus with a set of tutorials, and (4) developing a series of international workshops on dual eye tracking. Finally, the research will simultaneously advance discovery and understanding while training both graduate and undergraduate students in interdisciplinary research methods and will contribute to the development of traditionally underrepresented individuals in the fields of computer and information sciences.