Sensing and perception for autonomous agents

自主代理的感知和感知

• 批准号: RGPIN-2016-05311
• 负责人: Jenkin, Michael
• 金额: $ 2.26万
• 依托单位: York University
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2020
• 资助国家: 加拿大
• 起止时间: 2020-01-01 至 2021-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=709642
• 关键词: Sensing; perception; autonomous; agents

Mobility is a key aspect of intelligence. Mobility enables an agent to explore its environment, to interact with its environment, and provides a realistic definition of here versus there. But mobility also introduces complex problems associated with sensing and perception. For example, mobility introduces fundamental questions such as; where is an agent in the environment? what is its pose? and questions related to change in pose: has an agent moved? and if so, how far and in what direction? What makes answering these problems difficult for an agent is that it rarely has access to some external process that can answer these questions directly. Rather the system (typically) must rely on sensors and sensing algorithms associated with the agent itself, and must integrate this information along with intent in order to obtain a best estimate for answers to these problems. Furthermore, getting answers to these questions wrong can have catastrophic consequences for the agent itself. For example, disorientation in divers, astronauts or pilots is a common problem leading to life-threatening consequences and mission failure. These fundamental problems are found across a range of disciplines, and not surprisingly have different names in different research cultures and when different sensors and sensor collections are used. For example, the task of estimating pose changes is found in egomotion estimation, motion from vection, structure from motion, and visual odometry. Similarly, robust solutions to the estimation of self-orientation and self-motion informs a wide variety of applications, from human performance in challenging environments, to virtual reality, to the design and development of autonomous vehicles. The primary research objective of this proposal is the development of robust and effective algorithms for motion and pose estimation for autonomous agents. Although biological and machine systems have access to a wide range of potential sensors and sensing modalities to address these questions, of particular interest here is in understanding how vision, and in particular binocular vision can be coupled with inertial sensing to estimate pose and motion. The basic approach to be followed in my research program is based upon a strategy that has proven particularly effective in other aspects of intelligent machines. Models of how biological systems solve similar tasks will be used to motivate solutions for machines. These solutions will then be evaluated in the lab and then in complex unstructured environments to test both the performance of the resulting system as well as to explore the efficacy of the underlying biological model.

机动性是智能的一个关键方面。移动性使代理能够探索其环境，与其环境交互，并提供了这里与那里的现实定义。但移动性也带来了与感知和感知相关的复杂问题。例如，移动性引入了一些基本问题，例如：代理在环境中的什么位置？它的姿势是什么？以及与姿势改变相关的问题：特工搬家了吗？如果是这样的话，距离有多远，方向是什么？ 使代理很难回答这些问题的原因是，它很少能够访问可以直接回答这些问题的一些外部进程。相反，系统(通常)必须依赖于与代理本身相关的传感器和传感算法，并且必须将这些信息与意图结合在一起，以便获得对这些问题的答案的最佳估计。此外，对这些问题的回答错误可能会给代理人本身带来灾难性的后果。例如，潜水员、宇航员或飞行员的定向障碍是一个常见的问题，会导致危及生命的后果和任务失败。这些基本问题在一系列学科中都有发现，并且在不同的研究文化中以及在使用不同的传感器和传感器集合时具有不同的名称，这并不令人惊讶。例如，估计姿势变化的任务可以在姿势估计、运动向量估计、运动结构估计和视觉里程计中找到。同样，对自定位和自运动的估计的稳健解决方案提供了广泛的应用，从人类在具有挑战性的环境中的表现，到虚拟现实，再到自动驾驶车辆的设计和开发。该方案的主要研究目标是为自主智能体开发健壮而有效的运动和姿态估计算法。虽然生物和机器系统可以利用各种潜在的传感器和传感模式来解决这些问题，但这里特别感兴趣的是了解视觉，特别是双目视觉如何与惯性传感相结合来估计姿势和运动。 在我的研究计划中遵循的基本方法是基于一种已被证明在智能机器的其他方面特别有效的策略。生物系统如何解决类似任务的模型将被用来激励机器的解决方案。然后，这些解决方案将在实验室中进行评估，然后在复杂的非结构化环境中进行评估，以测试结果系统的性能以及探索基础生物模型的有效性。