INSPIRE Track 1: Action, Vision and Language, and their Brain Mechanisms in Evolutionary Relationship

这项INSPIRE奖的部分资金来自社会、行为和经济科学局行为和认知科学部的感知、行动和认知计划以及计算机和信息科学与工程局信息和智能系统司的稳健智能计划。这项研究将应对并弥合两个重大挑战：(1)了解猕猴和人类最后一个共同祖先的大脑如何支持行动、感知和社交互动，补充其他地方的类人猿建模；以及(2)建立在进化洞察力的基础上，更好地理解当我们使用语言时，人脑的不同部分如何协同工作。关键的切入点将是手语和口语，以及使用手势(例如，猿的新奇手势)来传达意思。更进一步，特别关注的是将大脑产生和识别动作的能力以及它们与其他大脑系统的相互作用联系起来的系统。一个由语言学、灵长类动物学、神经解剖学、神经生理学和运动、认知和语言过程的神经计算建模领域的国际科学家组成的小组将汇集各种灵长类物种的解剖学、生理学、行为和交流的数据。为了支持这种扩展的协作，研究人员将建立一个新的在线协作环境(“协作实验室工作空间”)来测试、预测和挑战建模和实验。这一基础设施可能会促进建模者、实验者和临床医生之间的一种新的协作风格。这项研究还有可能支持对导致失用症和失语症临床障碍的损害进行建模。视觉、动作和语言模型的整合对于创造能够灵活而有用地与人互动的机器人以及“神经形态建筑”也很重要，在“神经形态建筑”中，建筑的传感器和动作系统根据人类居民进行自适应调整。

This INSPIRE award is partially funded by the Perception, Action, and Cognition Program in the Division of Behavioral and Cognitive Sciences in the Directorate for Social, Behavioral, and Economic Sciences and the Robust Intelligence Program in the Division of Information and Intelligent Systems in the Directorate of Computer and Information Science and Engineering.This research will address and bridge two grand challenges: (1) To understand how action, perception, and social interaction were supported by the brain of the last common ancestor of macaque and human, complementing modeling elsewhere on great apes, and (2) To build on evolutionary insights to better understand how different parts of the human brain work together when we use language. Key entry points will be signed and spoken languages and the use of hand gestures (e.g., novel hand gestures by apes) to convey meaning. Going further, a particular focus will be on systems that link the brain's capacities to generate as well as recognize actions, and their interactions with other brain systems. An international group of scientists in linguistics, primatology, neuroanatomy, neurophysiology, and neurocomputational modeling of motor, cognitive and language processes will pool data on the anatomy, physiology, behavior and communication of the various primate species. To support this extended collaboration, the researchers will build a novel online collaborative environment ("Collaboratory Workspaces") to test, make predictions, and challenge both the modeling and experimentation. This infrastructure may catalyze a new style of collaboration between modelers, experimentalists, and clinicians. The research also has the potential to support modeling of the damage that results in the clinical disorders of apraxia and aphasia. Integration of models of vision, action and language is also important for creating robots that can flexibly and usefully interact with individual people and for "neuromorphic architecture," in which a building's sensors and action systems adaptively adjust to the human inhabitants.