CRII: SaTC: Towards Secure and Privacy-preserving Input on Augmented Reality Systems

该奖项的全部或部分资金来自《2021年美国救援计划法案》(公法117-2)。增强现实是一种用虚拟物体覆盖现实世界场景的互动和身临其境的体验。为了提供这样的体验，增强现实设备依赖于各种传感器来准确和同步地感知用户和周围环境。然而，传感器遭受了各种攻击，这进一步对增强现实体验产生了负面影响。该项目的目标是全面了解针对增强现实设备中所有传感器的可行攻击，并针对发现的攻击提出新的防御算法。研究成果将提高增强现实设备的安全性和隐私性。为了实现这一目标，该项目专注于(I)识别可行的传感器注入攻击，并提出具有行为知识和传感器融合的防御算法；(Ii)研究利用增强现实设备上现有的传感器数据可以推断出哪些敏感信息；以及(Iii)在操作系统中提出一个推理预防模型，在将传感器数据发送到增强现实应用程序之前过滤掉传感器数据中的敏感信息。这项工作的结果可以为构建安全和隐私保护的增强现实应用程序和设备提供见解。该项目还将鼓励研究生、本科生和K-12年级的学生培养他们对计算机安全和隐私的兴趣。该奖项反映了NSF的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。

This award is funded in whole or in part under the American Rescue Plan Act of 2021 (Public Law 117-2).Augmented reality is a type of interaction and immersive experience that overlays the real-world scene with virtual objects. To deliver such an experience, augmented reality devices rely on various sensors to sense the user and surrounding environment accurately and synchronously. However, the sensors suffer from various attacks, which further negatively affect the augmented reality experience. The goal of this project is to have a complete understanding of feasible attacks on all sensors in augmented reality devices and propose new defense algorithms against found attacks. The outcome of the research will improve the security and privacy of augmented reality devices.To accomplish this goal, the project focuses on (i) identifying feasible sensor injection attacks and proposing defense algorithms with behavior knowledge and sensor fusion, (ii) studying what sensitive information can be inferred using the existing sensor data on augmented reality devices, and (iii) proposing an inference prevention model in the operating system to filter out sensitive information in sensor data before sending them to augmented reality applications. The outcome of this work can provide insights for building secure and privacy-preserving augmented reality applications and devices. This project will also engage graduate, undergraduate, and K-12 students to develop their interests in computer security and privacy.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.