Supporting deixis in remote augmented reality collaboration

支持远程增强现实协作中的指示指示

• 批准号: 530742-2018
• 负责人: Bateman, Scott
• 金额: $ 1.82万
• 依托单位: University of New Brunswick
• 依托单位国家: 加拿大
• 项目类别: Engage Grants Program
• 财政年份: 2018
• 资助国家: 加拿大
• 起止时间: 2018-01-01 至 2019-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=644786
• 关键词: Supporting; deixis; remote; augmented; reality

In face-to-face collaboration, we often take for granted the ease with which we can communicate with others,**and how the ease of communication plays a key role in the success of a collaboration. Recent technological**innovations have opened the possibility of working with others at a distance in new ways. However, remote**collaboration is still often slow, clumsy and awkward. One key, and often overlooked, aspect that makes**colocated collaborations fast and fluid are deictic gestures - the use of gestures, like pointing, to provide**context and information in verbal communication. Deictic gestures allow people to simply make statements**such as "that thing there", which is perfectly clear when combined with pointing at the object. However,**without adequate support for deixis the statement loses meaning, and collaboration can become cumbersome**and less effective.**Kognitiv Spark is a New Brunswick based business that is interested in how to better support the use of deictic**gestures in their flagship product, Remote Spark. Remote Spark is an augmented reality-based**tele-conferencing system that allows a worker to receive the guidance of a remote expert who could be located**anywhere in the world. Remote Spark uses see-through augmented reality glasses that allow a worker to view**and interact with computer graphics while still seeing the world around. This provides the technological basis**to allow workers to receive guidance in a way that is more tightly aligned with their work. However, how**deixis can be best integrated into Remote Spark is an open challenge.**In this project, we will build an understanding of the use of deixis in augmented reality collaborations. We will**create prototypes that provide alternative designs and approaches for the display and placement of pointing**gestures from a remote collaborator. We will also test new hand tracking algorithms to better allow the**production of pointing gestures by system users. Finally, we will perform an empirical study on the efficacy of**the created prototypes.

在面对面的协作中，我们经常认为与他人沟通的轻松性是理所当然的，** 以及沟通的轻松性如何在协作的成功中发挥关键作用。最近的技术革新为以新的方式与他人进行远距离合作提供了可能性。然而，远程协作仍然常常是缓慢、笨拙和笨拙的。一个关键的，也是经常被忽视的，使协同工作快速流畅的方面是指示手势-使用手势，比如指向，在口头交流中提供上下文和信息。指示性手势允许人们简单地做出陈述 **，比如“那边的那个东西”，当与指向对象相结合时，这是非常清楚的。然而，** 如果没有足够的指示语支持，声明就失去了意义，协作就会变得繁琐 **，效率也会降低。Kognitiv Spark是一家总部位于新玩法的公司，该公司对如何在其旗舰产品Remote Spark中更好地支持指示 ** 手势的使用感兴趣。Remote Spark是一种基于增强现实的远程会议系统，它允许工作人员接收远程专家的指导，该专家可以位于世界任何地方。Remote Spark使用透视增强现实眼镜，允许工作人员查看 ** 并与计算机图形交互，同时仍然看到周围的世界。这提供了技术基础 **，使工人能够以与其工作更密切相关的方式接受指导。然而，如何将指示语最好地集成到Remote Spark中是一个开放的挑战。在这个项目中，我们将建立在增强现实协作中使用指示的理解。我们将创建原型，为远程协作者的指向手势的显示和放置提供替代设计和方法。我们还将测试新的手部跟踪算法，以更好地允许系统用户生成指向手势。最后，我们将对所创建的原型的有效性进行实证研究。