From Perception and Learning to Understanding and Action

从感知和学习到理解和行动

• 批准号: RGPIN-2020-06837
• 负责人: Pal, Christopher
• 金额: $ 3.5万
• 依托单位: École Polytechnique de Montréal
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2022
• 资助国家: 加拿大
• 起止时间: 2022-01-01 至 2023-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=754210
• 关键词: Perception; Learning; Understanding; Action

Artificial Intelligence (AI) has long concerned itself with the notion of creating intelligent agents capable of observing the world and selecting actions to take based on those observations. The proposed research program will be pursued through exploring fundamental research problems linked to the combination of computer vision, embodied intelligence, natural language understanding, deep learning, reinforcement learning and robotics. The research program will make extensive use of simulation environments and human--agent interaction to explore deep learning, deep reinforcement learning, and question answering with embodied agents. Research will explore fundamental questions as well as realistic settings including: autonomous vehicles, robots that physically interact with the world and purely software based information agents. This research will examine three representative settings. (1) Autonomous vehicles: in this setting, many of the abstract concepts discussed above become more firmly grounded in a concrete task. Furthermore, key problems associated with many sub-disciplines of AI such as computer vision, automated reasoning, planning and the paradigm of reinforcement learning (RL) can become clearer when grounded in such an application. (2) Other settings such as those associated with the creation of more general-purpose robotics for industrial and home settings can also serve as grounding applications. In these settings an agent's understanding of how the world and objects within the world physically interact with the agent also becomes an important element of the problem. As one begins to envision the way in which people might interact with more general purpose and "embodied" intelligent agents, natural language emerges as a powerful way to facilitate human--robot interactions. Language can also serve as a mechanism for teaching agents new capabilities. Language can also be coupled with visual demonstrations to further enhance the learning of an embodied agent. (3) Intelligent assistants - such as those that interact with the user through a smartphone or smart speaker, could be thought of as software agents that exist in a world of information. The combination of physically embodied agents with information agents could propel the benefits of AI into the everyday world of Canadians. The large scale testing of autonomous cars is underway in North America and cars without safety drivers are now operating in the United States. The autonomous car oriented research proposed here explores subjects of critical importance to Canada and Canadians in terms of both public safety and economic prosperity. Further, more general-purpose robotics has the potential to transform manufacturing, distribution and delivery services and well as provide powerful assistance tools for the disabled.

人工智能（AI）长期以来一直关注的是创建能够观察世界并根据这些观察结果选择采取行动的智能代理的概念。拟议的研究计划将通过探索与计算机视觉，体现智能，自然语言理解，深度学习，强化学习和机器人技术相关的基本研究问题来实现。该研究计划将广泛使用模拟环境和人类的互动，以探索深度学习，深入的强化学习以及与体现的代理的答案。研究将探讨基本问题以及现实设置，包括：自动驾驶汽车，与世界物理互动的机器人以及纯粹基于软件的信息代理。 这项研究将检查三个代表性设置。 （1）自动驾驶汽车：在这种情况下，上面讨论的许多抽象概念在具体任务中更加牢固。此外，与AI的许多子学科相关的关键问题，例如计算机视觉，自动推理，计划和增强学习范式（RL）时，在这种应用中的基础上可能会变得更加清晰。 （2）其他环境，例如与创建更通用的工业和家庭环境相关的设置也可以作为基础应用。在这些环境中，代理人对世界内世界和对象如何与代理人进行物理互动的理解也成为问题的重要因素。随着人们开始设想人们可能与更通用的智能代理人互动的方式，自然语言是一种促进人类互动的有力方式。语言还可以作为教师新功能的一种机制。语言也可以与视觉演示相结合，以进一步增强体现代理的学习。 （3）智能助理 - 例如通过智能手机或智能扬声器与用户互动的助手，可以将其视为信息世界中存在的软件代理。物理体现的代理与信息代理的结合可以推动AI的好处进入加拿大人的日常世界。 自动驾驶汽车的大规模测试正在北美进行，现在没有安全驾驶员的汽车在美国正在运行。以自动驾驶汽车为导向的研究在这里提出的研究探讨了对加拿大和加拿大人至关重要的主题，从公共安全和经济繁荣方面。此外，更通用的机器人技术有可能改变制造，分销和交付服务，并为残疾人提供强大的援助工具。