CRII: SaTC: Towards Secure and Privacy-preserving Input on Augmented Reality Systems

该奖项全部或部分由《2021年美国救援计划法案》（公法117-2）资助。增强现实是一种互动和沉浸式体验，它将现实世界的场景与虚拟物体叠加在一起。为了提供这样的体验，增强现实设备依靠各种传感器来准确同步地感知用户和周围环境。然而，传感器遭受各种攻击，这进一步影响了增强现实体验。该项目的目标是全面了解增强现实设备中所有传感器的可行攻击，并针对发现的攻击提出新的防御算法。研究结果将提高增强现实设备的安全性和隐私性。为了实现这一目标，该项目侧重于(i)识别可行的传感器注入攻击，并提出基于行为知识和传感器融合的防御算法；（ii）研究利用增强现实设备上现有的传感器数据可以推断出哪些敏感信息；（iii）在操作系统中提出推理预防模型，在传感器数据发送到增强现实应用之前过滤掉敏感信息。这项工作的结果可以为构建安全和保护隐私的增强现实应用程序和设备提供见解。该项目还将吸引研究生、本科生和K-12学生发展他们对计算机安全和隐私的兴趣。该奖项反映了美国国家科学基金会的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

This award is funded in whole or in part under the American Rescue Plan Act of 2021 (Public Law 117-2).Augmented reality is a type of interaction and immersive experience that overlays the real-world scene with virtual objects. To deliver such an experience, augmented reality devices rely on various sensors to sense the user and surrounding environment accurately and synchronously. However, the sensors suffer from various attacks, which further negatively affect the augmented reality experience. The goal of this project is to have a complete understanding of feasible attacks on all sensors in augmented reality devices and propose new defense algorithms against found attacks. The outcome of the research will improve the security and privacy of augmented reality devices.To accomplish this goal, the project focuses on (i) identifying feasible sensor injection attacks and proposing defense algorithms with behavior knowledge and sensor fusion, (ii) studying what sensitive information can be inferred using the existing sensor data on augmented reality devices, and (iii) proposing an inference prevention model in the operating system to filter out sensitive information in sensor data before sending them to augmented reality applications. The outcome of this work can provide insights for building secure and privacy-preserving augmented reality applications and devices. This project will also engage graduate, undergraduate, and K-12 students to develop their interests in computer security and privacy.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.