Intelligent and Integrated Control of V2X-Enabled Autonomous Vehicles using Deep Reinforcement Learning

使用深度强化学习对支持 V2X 的自动驾驶车辆进行智能集成控制

• 批准号: RGPIN-2021-02839
• 负责人: Lei, Lei
• 金额: $ 2.4万
• 依托单位: University of Guelph
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2022
• 资助国家: 加拿大
• 起止时间: 2022-01-01 至 2023-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=752881
• 关键词: Intelligent; Integrated; Control; V2X; Enabled

High-profile autonomous vehicle failures caused by unreliable decision making systems have impeded their uptake. These failures are often due to the limited and unreliable information obtained by the vehicle's on-board sensors about its surrounding environment. This "sensory" challenge can be overcome by leveraging vehicle-to-everything (V2X) communications, which would enable autonomous vehicles to communicate wirelessly with each other, nearby infrastructure and the environment. Autonomous vehicles can achieve a more accurate and comprehensive picture of its surrounding when the critical information received through V2X communications is combined with the typical sensory data. An intelligent and integrated control decision making system is required to realize the perfect combination of autonomous driving and V2X communications. However, how to jointly optimize vehicle control and communication control in an integrated framework toward safe and efficient autonomous driving is an unsolved challenge. The system would need to include two types of controls: (1) autonomous driving control of the vehicles and; (2) communication control of the vehicular networks. Compared with the traditional control approaches, Deep Reinforcement Learning (DRL) can introduce ambient intelligence into connected and autonomous vehicles. My proposed research program will provide a framework to optimize an intelligent and integrated control decision making system based on DRL. It will span three activities: DRL-based Vehicle Control with Enhanced Perception and Cooperation through V2X. I will develop DRL algorithms that can learn "what and when to communicate", jointly with how to leverage the communicated information to make intelligent vehicle control decisions under the assumption of ideal communications with no cost. Robust DRL-based Vehicle Control with Non-Ideal V2X Communications. I will investigate the trade-off between the benefit of communications to improve control performance and the cost of communications, with the objective of making optimal decisions on the "what and when to communicate" problem. Moreover, I will develop robust and safe DRL algorithms for autonomous driving that can handle the uncertainty due to non-ideal V2X communications. Joint DRL-based Vehicle and Radio Resource Control toward Perfect Combination of Autonomous Driving and V2X Communications. "How to communicate", i.e., how to control the scarce radio resources, is closely interrelated with vehicle control, as the communication performance will impact the driving perception. My goal is to consider tighter integration of the two types of control to achieve a global optimal solution for V2X-enabled autonomous driving. Through the above activities, my research program promises to improve the reliability of autonomous vehicles thereby accelerating their adoption, easing road congestion, reducing fuel consumption, and providing a more comfortable and safer experience for passengers.

由不可靠的决策系统引起的备受瞩目的自动驾驶汽车故障阻碍了它们的应用。这些故障通常是由于车辆的车载传感器获得的关于其周围环境的信息有限且不可靠。这种“感官”挑战可以通过利用车辆到一切（V2X）通信来克服，这将使自动驾驶车辆能够相互无线通信，附近的基础设施和环境。当通过V2X通信接收的关键信息与典型的传感数据相结合时，自动驾驶汽车可以实现对其周围环境的更准确和全面的了解。实现自动驾驶与V2X通信的完美结合，需要一个智能化、集成化的控制决策系统。然而，如何在集成框架中联合优化车辆控制和通信控制，以实现安全高效的自动驾驶是一个尚未解决的挑战。该系统需要包括两种类型的控制：（1）车辆的自动驾驶控制;（2）车辆网络的通信控制。与传统的控制方法相比，深度强化学习（DRL）可以将环境智能引入互联和自动驾驶汽车。 我的研究计划将提供一个框架，以优化智能和集成控制决策系统的基础上DRL。它将涵盖三个活动：基于DRL的车辆控制，通过V2X增强感知和协作。我将开发DRL算法，该算法可以学习“什么时候通信”，以及如何利用通信信息在理想通信的假设下做出智能车辆控制决策。 具有非理想V2X通信的鲁棒的基于DRL的车辆控制。我将研究通信的好处，以提高控制性能和通信的成本之间的权衡，与“什么和什么时候沟通”的问题上做出最佳决策的目标。此外，我还将开发强大而安全的自动驾驶日间行车线算法，以应对非理想V2X通信带来的不确定性。 基于DRL的车辆和无线电资源联合控制，实现自动驾驶和V2X通信的完美结合。“如何沟通”，即，如何控制稀缺的无线电资源与车辆控制密切相关，因为通信性能将影响驾驶感知。我的目标是考虑更紧密地集成这两种类型的控制，以实现V2X自动驾驶的全局最佳解决方案。 通过上述活动，我的研究计划有望提高自动驾驶汽车的可靠性，从而加速其采用，缓解道路拥堵，降低燃油消耗，并为乘客提供更舒适，更安全的体验。