How to harness the benefits of multisensory-motor integration: Attention and Preparation

听到蚊子，看到蚊子，打蚊子。从保护自己免受昆虫的侵害，到拿起电话，再到从水瓶里喝水，自愿的目标导向行动构成了我们日常互动的基础。拟议的多感觉-运动整合原则的系统探索将改善人类如何执行这些对日常生活、教育、就业和娱乐活动至关重要的自愿行动。能够支持日常任务的智能技术正变得越来越强大，使生活变得更加高效。 然而，这些技术仍然需要人类的监督;我们如何整合，解释和响应多感官刺激直接影响我们完成日常任务的相对成功。我的研究项目旨在更好地理解和解释人类如何整合我们所看到的，感觉和听到的，当执行志愿行动。虽然新技术的设计者有最好的意图来帮助人类更有效地执行，但有许多方式可以增加感官输入也可能导致更长和更不准确的反应。直到最近，我们对多感觉整合的了解都是基于简单的反应，比如按下按钮。我们知道，个人和任务特征影响我们如何互动和执行自愿行动。我们不断更新和调整我们的行动，根据我们打算做什么，认为我们做了什么，以及可用的感官反馈。本研究将有助于我们理解听觉刺激如何、何时以及为什么会影响运动成绩。我将进行一系列实验，共同评估任务指令如何与听觉刺激相互作用，以及节奏如何影响或稳定运动规划过程。通过使用视线跟踪测量人们看向何处以及使用三维运动分析测量他们如何在空间中移动四肢，将对如何进行运动进行详细分析。这一基本研究路线的结果将为一系列可能的应用提供信息，包括设计新的人机界面，治疗和教育方法。例如，通过了解节奏如何影响运动，从业者将更好地预测何时以及对谁来说，节奏将改善肢体控制。了解多感官刺激如何以及为什么可以促进自愿行动也将告知培训技术和设计原则，这将提高任务学习;对于驾驶等活动至关重要，其中高效和有效的运动对安全至关重要。

Hear mosquito, see mosquito, hit mosquito. From protecting ourselves from insects, to picking up our phone, to drinking from our water bottle, voluntary goal-directed actions form the basis for our everyday interactions. The proposed systematic exploration of the principles for multisensory-motor integration will improve how humans perform these voluntary actions that are essential for activities of daily living, education, employment and recreation. Smart technologies able to support everyday tasks are becoming increasingly enhanced to make life more efficient. However, such technologies still require human oversight; how we integrate, interpret and respond to multisensory stimuli directly impacts our relative success in accomplishing daily tasks. My research program seeks to better understand and explain how humans integrate what we see, feel and hear when performing voluntary actions. While designers of new technology have the best intentions to help humans perform more efficiently, there are numerous ways in which the increasing sensory input may also lead to longer and less accurate responses. Until recently, much of what we knew about multisensory integration was based on simple responses, such as pressing a button. We know that individual and task characteristics influence how we interact and perform voluntary actions. We continuously update and adapt our actions based on what we intended to do, thought we did, and the available sensory feedback. The present research will help us understand how, when and why auditory stimuli impacts movement performance. I will conduct a series of experiments that together assess how task instructions interact with auditory stimuli and how rhythm may influence or stabilize movement planning processes. Detailed analyses of how movements are performed will be done by measuring where people look using gaze tracking and how they move their limbs through space using three-dimensional motion analysis. The results of this fundamental line of research will inform a range of possible applications, including the design of new human computer interfaces, therapies and educational approaches. For example, by understanding how rhythm influences movement, practitioners will be better informed to predict when and for whom rhythm will lead to improved limb control. Understanding how and why multisensory stimuli can facilitate voluntary actions will also inform training techniques and design principles that will enhance task learning; crucial for activities, such as driving, where efficient and effective movement is essential for safety.