Eye Movements in Perception, Interaction and Visual Guidance of Actions

感知、交互和视觉动作引导中的眼动

• 批准号: RGPIN-2015-05560
• 负责人: Bischof, Walter
• 金额: $ 1.75万
• 依托单位: University of British Columbia
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2018
• 资助国家: 加拿大
• 起止时间: 2018-01-01 至 2019-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=645528
• 关键词: Eye; Movements; Perception; Interaction; Visual

We perceive the world around us by continuously moving our eyes to see different locations in fine detail. Over the past few decades, researchers have obtained a good understanding of where we are most likely to look, for example, when we read a book or a computer screen, or when we look at photos or movies. This is, however, only one part of the story. When with work on something with our hands, for example, building something or cooking a dinner, we use our eyes to guide our hands. In other words, we also use our vision to control our actions. This eye-hand coordination is much less understood, mostly because only recently have good quality eye trackers become available that are able to track our eyes while we move our head and body. ******The goal of this project is a systematic investigation of eye movements in eye-hand coordination, which will lead to answers to the following questions. How do the properties of objects we interact with affect the eye movements? For example, how do eye movements change depending on the number of objects we are interacting with, whether the objects are static or moving, or whether there are obstacles to our intended manipulations? How does the intended interaction with the objects affect eye movements? For example, does it matter whether we simply want to touch an object, or grab it, or manipulate it? Does it matter whether we interact with an object with the hands or a tool? Finding answers to these questions will lead to a much better understanding of eye-hand coordination.******A few examples illustrate the importance of this research. 1) We have developed an interactive table for patients in physical rehabilitation, and a prototype system is currently in daily use at a local rehabilitation hospital. We need, however, a much better understanding of how the patients use the table in order to make it more adaptive to their needs and abilities. A good understanding of eye-hand coordination will allow this. 2) We are developing a new method for tracking how much amputees rely on vision to operate a prosthetic arm, which we do by combining movement tracking with eye tracking. This will allow us to assess to what extent an amputee must physically watch the artificial arm in order to operate it and will allow us to evaluate the effectiveness of different prosthesis devices. 3) Soon there will be smartphones and tablets on the market that can respond not only to touch, but also to hand movements and eye movements. In order to design and use these devices effectively, we must have a better understanding of the interaction between eye movements and hand movements. My research will make this possible.**

我们通过不断移动眼睛来观察不同位置的细节来感知周围的世界。在过去的几十年里，研究人员已经很好地了解了我们最有可能看的地方，例如，当我们阅读书籍或电脑屏幕时，或者当我们看照片或电影时。 然而，这只是故事的一部分。当我们用手做一些事情时，例如，建造一些东西或做饭，我们用眼睛来指导我们的手。换句话说，我们也用我们的愿景来控制我们的行动。这种眼手协调的理解要少得多，主要是因为直到最近才有高质量的眼动仪，能够在我们移动头部和身体时跟踪我们的眼睛。** 本项目的目标是系统地研究眼手协调中的眼球运动，这将导致以下问题的答案。我们与之互动的物体的属性如何影响眼球运动？例如，眼球运动是如何变化的，取决于我们与之交互的物体的数量，物体是静止的还是移动的，或者我们预期的操作是否有障碍物？与物体的预期互动如何影响眼球运动？例如，我们是否只是想触摸一个物体，抓住它，或者操纵它？我们是用手还是用工具与物体互动，这有关系吗？找到这些问题的答案将有助于更好地理解手眼协调。一些例子说明了这项研究的重要性。1)我们已经开发了一个交互式表的患者在物理康复，原型系统目前在日常使用中，在当地的康复医院。然而，我们需要更好地了解患者如何使用桌子，以便使其更适合他们的需求和能力。对手眼协调的良好理解将允许这一点。2)我们正在开发一种新的方法来跟踪截肢者在多大程度上依赖视觉来操作假肢，我们通过结合运动跟踪和眼睛跟踪来实现这一点。这将使我们能够评估截肢者必须在多大程度上观察假肢才能操作它，并使我们能够评估不同假肢设备的有效性。3)很快，市场上就会出现智能手机和平板电脑，它们不仅能对触摸做出反应，还能对手部运动和眼部运动做出反应。为了有效地设计和使用这些设备，我们必须更好地了解眼球运动和手部运动之间的相互作用。我的研究将使这成为可能。**