SBE-UKRI: Integrating vision and action through selection history

大多数真实世界的视觉场景是复杂和拥挤的，其中多个对象竞争注意力和目标导向的动作。例如，在日常生活中，一个人很容易从一个包含许多种水果的杂货店陈列中拿起一个红苹果。与这种复杂环境的成功互动需要多种机制之间的无缝协调。特别是，帮助我们理解世界的注意力选择机制与行为选择机制是统一的，使我们能够产生适应性运动。这种注意力-行动的协同作用是所有复杂行为的根源。 然而，研究人员通常单独研究这两种机制，而不研究它们之间的相互作用。这种做法使得直接比较注意选择和动作选择的结果是不可能的。为了克服这一差距，本提案的目标是确定控制注意力选择和动作选择的机制之间的相互作用，特别是当最近的选择历史偏见随后的行为。它将为在全球框架内选择注意力和行动所涉及的行为机制的统一理论提供基础。具体而言，拟议的项目将集中在三个欠研究的方面的动作选择：动作执行，效应器和生物力学成本的变化，以确定其新颖的关系与丰富的研究选择历史的感知功能。为了确保成功的结果，两个研究团队之间的国际合作，谁将发挥互补和协同作用，将在注意力和运动控制和计算建模的专家之间形成。这一共同奋进将促进我们对注意力和行动驱动机制之间相互依存关系的理解，最终解释适应性的现实世界选择行为。通过包括有才华的本科生，包括国家选择的代表性不足的少数民族，该提案还旨在促进研究，STEM和广泛教育的整合。此外，研究成果还有助于重大技术创新，包括为机器人手臂和遥控操作员的新型控制架构奠定基础，改善人机界面，如认知神经修复和广泛使用的触摸用户界面（例如智能电话）。该项目由英国经济及社会研究理事会（ESRC）在SBE下联合资助-UKRI牵头机构合作研究机会。该奖项反映了NSF的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

Most real-world visual scenes are complex and crowded, where multiple objects compete for attention and goal-directed action. In daily life, for example, a person easily picks up a red apple from a grocery display containing many kinds of fruit. Successful interactions with such complex environments require seamless coordination among multiple mechanisms. In particular, mechanisms of attentional selection that help us make sense of the world work in unity with those that underlie action selection, allowing us to generate adaptive movements. This attention-action synergy is at the root of all complex behavior. However, researchers typically study these two mechanisms separately, without investigating interactions between them. This practice makes direct comparisons between the findings in attentional selection and action selection impossible. To overcome this gap, the goal of this proposal is to determine the interplay between mechanisms controlling attentional selection and action selection, particularly when recent selection history biases subsequent behavior. It will provide a basis for unifying theories of behavioral mechanisms involved in the selection of attention and action in a global frame. Specifically, the proposed project will focus on three understudied aspects of action selection: variation in action execution, effectors, and biomechanical costs, to determine their novel relations with the wealth of research on selection history of perceptual features. To ensure successful outcomes, an international collaboration between the two research teams, who will play complementary and synergistic roles, will be formed between experts in attention and motor control and computational modeling. This joint endeavor will advance our understanding of the interdependence between attention and action-driven mechanisms to eventually explain adaptive, real-world selection behavior. By including talented undergraduates including nationally selected underrepresented minorities, this proposal also intends to foster the integration of research, STEM and a broad education. Furthermore, outcomes can also contribute to significant technological innovations, including foundation for novel control architecture for robot arms and teleoperators, improving human-computer-interface such as cognitive neural prosthetics and the widely used touch-user-interfaces (e.g. smart phones).This project is jointly funded with the UK's Economic and Social Research Council (ESRC) under the SBE-UKRI Lead Agency collaborative research opportunity.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.