CRII: CNS: Bringing Predictable Real-time Computing to Connected Autonomous Driving Systems

CRII：CNS：为互联自动驾驶系统带来可预测的实时计算

• 批准号: 2103604
• 负责人: Zheng Dong
• 金额: $ 17.49万
• 依托单位: Wayne State University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2021
• 资助国家: 美国
• 起止时间: 2021-09-01 至 2024-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2103604&HistoricalAwards=false
• 关键词: CRII; CNS; Bringing; Predictable; Real

Connected vehicle technology is a promising solution to provide reliable autonomous driving that will change the traditional transportation system by building stable, interactive wireless communications between vehicles, the smart infrastructures (e.g., the roadside unit), and personal communications devices. However, achieving reliable and safe connected autonomous driving (CAD) is still very challenging. On one hand, the safety of the CAD system hinges critically on its timing correctness, as crucial driving decisions fully depend on the output of the real-time perception system. On the other hand, requesting information from other devices mayl create additional delays for the on-vehicle real-time perception tasks, and thus the timing correctness of the CAD system can be easily violated by unpredictable communications. This project seeks to bring predictable real-time computing to CAD systems, and the goal of the proposed research is to enable the connected autonomous vehicle and exterior devices to perform real-time perception tasks as a whole by (i) establishing a practical real-time task model to integrate exterior devices into the on-vehicle perception system, which can be implemented on the GPU-enabled computing platforms; (ii) proposing real-time task scheduling algorithms and associated timing validation analysis to guarantee that all the real-time perception tasks can complete at the right time; (iii) developing a prototype CAD system on the autonomous vehicle testbed, HydraOne, and the roadside unit, Equinox, to evaluate the real-time performance of the proposed solutions.Building a CAD system will constitute a major technological breakthrough towards realizing fully autonomous vehicles. In particular, this project emphasizes both scheduling algorithm design and system implementation. The establishment of a real-time suspending-gang task model will enable the first-of-its-kind formalization for depicting the executing flow of real-time workloads executed between the autonomous vehicle and the exterior devices. The real-time task scheduler oversees the entire system and ensures its timing correctness. The creation of new real-time resource allocation methods together with the associated analysis for validating timing constraints will drive the scheduling theory towards real applications in future cyber-physical systems. The proposed research aims to realize the CAD system on the physical platforms (HydraOne/Equinox), with indoor and outdoor studies beyond simulation. Especially, HydraOne/Equinox are ready-to-use platforms that will allow experts/researchers to easily examine their research designs regarding autonomous driving. Educational efforts will be devoted to (i) develop the HydraOne Educational Toolkit for undergraduate education and research, (ii) curriculum design for hands-on learning in the BS/MS program, (iii) summer camp development for K-12 students and teachers, (iv) broadening participation in computing and engineering to enhance diversity.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

互联汽车技术是一种很有前途的解决方案，可以提供可靠的自动驾驶，通过在车辆、智能基础设施(例如路边单元)和个人通信设备之间建立稳定、交互的无线通信来改变传统交通系统。然而，实现可靠、安全的联网自动驾驶(CAD)仍然是非常具有挑战性的。一方面，CAD系统的安全性关键取决于它的时序正确性，因为关键的驾驶决策完全取决于实时感知系统的输出。另一方面，从其他设备请求信息可能会给车载实时感知任务带来额外的延迟，因此CAD系统的定时正确性很容易被不可预测的通信所破坏。该项目旨在将可预测的实时计算引入到CAD系统中，研究的目标是通过(I)建立一个实用的实时任务模型，将外部设备集成到车载感知系统中，并在支持GPU的计算平台上实现；(Ii)提出实时任务调度算法和相关的时序验证分析，以确保所有实时感知任务都能在正确的时间完成；(Iii)在自动驾驶车辆试验台HydraOne和路边单元Equinox上开发原型CAD系统，以评估所提出的解决方案的实时性能。建立CAD系统将是实现全自动车辆的重大技术突破。特别强调了调度算法的设计和系统的实现。实时挂起任务模型的建立将使描述自动车辆和外部设备之间执行的实时工作负载的执行流程的此类任务模型成为可能。实时任务调度器监督整个系统，确保其时序的正确性。新的实时资源分配方法的创建以及用于验证时间约束的相关分析将推动调度理论在未来的网络物理系统中走向真正的应用。本研究的目的是在物理平台(HydraOne/Equinox)上实现CAD系统，进行室内和室外研究，而不是模拟。特别是，HydraOne/Equinox是现成的平台，将允许专家/研究人员轻松检查他们关于自动驾驶的研究设计。教育工作将致力于(I)为本科教育和研究开发HydraOne教育工具包，(Ii)为BS/MS计划的实践学习设计课程，(Iii)为K-12学生和教师开发夏令营，(Iv)扩大对计算和工程的参与，以增强多样性。该奖项反映了NSF的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

BlueScale: a scalable memory architecture for predictable real-time computing on highly integrated SoCs

BlueScale：可扩展内存架构，用于在高度集成的 SoC 上进行可预测的实时计算

• DOI: 10.1145/3489517.3530612
• 发表时间: 2022
• 期刊: The 59th ACM/IEEE Design Automation Conference
• 作者: Jiang, Zhe;Yang, Kecheng;Audsley, Neil;Fisher, Nathan;Shi, Weisong;Dong, Zheng
• 通讯作者: Dong, Zheng

WatchDog: Real-time Vehicle Tracking on Geo-distributed Edge Nodes

• DOI: 10.1145/3549551
• 发表时间: 2020-02
• 期刊: ACM Transactions on Internet of Things
• 作者: Zheng Dong;Yan Lu;G. Tong;Yuanchao Shu;Shuai Wang;Weisong Shi

AXI-IC^{RT}: Towards a Real-Time AXI-Interconnect for Highly Integrated SoCs

AXI-IC^{RT}：面向高度集成 SoC 的实时 AXI 互连

• DOI: 10.1109/tc.2022.3179227
• 发表时间: 2023
• 期刊: IEEE Transactions on Computers
• 影响因子: 3.7
• 作者: Jiang, Zhe;Yang, Kecheng;Fisher, Nathan;Gray, Ian;Audsley, Neil;Dong, Zheng
• 通讯作者: Dong, Zheng

Prophet: Realizing a Predictable Real-time Perception Pipeline for Autonomous Vehicles

• DOI: 10.1109/rtss55097.2022.00034
• 发表时间: 2022-12
• 期刊: 2022 IEEE Real-Time Systems Symposium (RTSS)
• 作者: Liangkai Liu;Zheng-hong Dong;Yanzhi Wang;Weisong Shi

Towards Hard Real-Time and Energy-Efficient Virtualization for Many-Core Embedded Systems

• DOI: 10.1109/tc.2022.3207115
• 发表时间: 2023-01
• 期刊: IEEE Transactions on Computers
• 影响因子: 3.7
• 作者: Zhe Jiang;Kecheng Yang;Yunfeng Ma;N. Fisher;N. Audsley;Zheng Dong