CPS: Medium: Collaborative Research: Robust Sensing and Learning for Autonomous Driving Against Perceptual Illusion

自动驾驶即将给交通系统带来革命性的变化，并显著改善人们的福祉。自动驾驶汽车依靠多个传感器和人工智能算法来促进感知和感知，以便在世界上导航。由于汽车行业主要关注于提高自主水平和增强感知性能，主要是在良性环境中，感知技术针对物理攻击的安全性和安全性尚未得到彻底调查。具体地说，创造物理世界感知错觉的对手可能会对自动驾驶车辆的感知和学习系统构成重大威胁，潜在地破坏对这些系统的信任。这项研究项目旨在加深我们对物理攻击下的安全和安全风险的认识。该项目致力于增强自动驾驶的感知和学习弹性，以抵御恶意的知觉错觉攻击。该项目的成功将显著提高自动驾驶在面对新出现的物理世界威胁时的安全性和安全性，为自动驾驶在下一代交通系统中的安全部署铺平道路。该项目的目标是研究先进的传感和学习技术，以提高自动驾驶在复杂和恶劣环境中的精确度和稳健性。该团队的方法包括：(I)一个全面的框架，用于评估自动驾驶系统的软件/硬件组件中的关键漏洞，并设计有效的攻击向量来产生虚假和欺骗性的感知；(Ii)实时超分辨率雷达传感技术和数据融合方法，在中后期阶段整合各种传感器类型的特征，以有效增强每种传感模式对错觉的稳健性；以及(Iii)一个系统框架，以增强算法的通用性，并使用多视图表示学习实现对多模式攻击的稳健感知。提出的解决方案将经过严格的测试，使用仿真和实验来验证其有效性和稳健性。这些解决方案有助于开发更安全、更强大的自动驾驶系统，能够在现实世界中抵御感知错觉攻击。该项目还将为不同级别和年龄段的代表性不足的学生提供研究培训机会。由此产生的新技术将作为开源共享，用于通过该项目开发的知识的更广泛传播和发展。该奖项反映了NSF的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。

Autonomous driving is on the verge of revolutionizing the transportation system and significantly improving the well-being of people. An autonomous vehicle relies on multiple sensors and AI algorithms to facilitate sensing and perception for navigating the world. As the automotive industry primarily focuses on increasing autonomy levels and enhancing perception performance in mainly benign environments, the security and safety of perception technologies against physical attacks have yet to be thoroughly investigated. Specifically, adversaries creating physical-world perceptual illusions may pose a significant threat to the sensing and learning systems of autonomous vehicles, potentially undermining trust in these systems. This research project aims to deepen our understanding of the security and safety risks under physical attacks. The project endeavors to bolster sensing and learning resilience in autonomous driving against malicious perceptual illusion attacks. The success of the project will significantly advance the security and safety of autonomous driving in the face of emerging physical-world threats, paving the way for the safe deployment of autonomous vehicles in next-generation transportation systems.The goal of this project is to investigate advanced sensing and learning technologies to enhance the precision and robustness of autonomous driving in intricate and hostile environments. The team’s approach includes: (i) a comprehensive framework to evaluate key vulnerabilities in software/hardware components of autonomous driving systems and devise effective attack vectors for generating false and deceptive perceptions; (ii) a real-time super-resolution radar sensing technology and a data fusion approach that integrates features from various sensor types at both the middle and late stages to effectively bolster the robustness of each sensing modality against illusions; and (iii) a systematic framework to enhance the algorithmic generality and achieve robust perception against multi-modal attacks using multi-view representation learning. The presented solutions will undergo rigorous testing using simulations and experiments to validate their effectiveness and robustness. These solutions contribute to the development of more secure and robust autonomous driving systems, capable of withstanding perceptual illusion attacks in real-world scenarios. The project will also offer research training opportunities for underrepresented students across diverse levels and age groups. The resulting novel technology will be shared as open-source for broader dissemination and advancement of the knowledge developed through this project.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.