BystandAR: Protecting Bystander Visual Data in Augmented Reality Systems
BystandAR: Protecting Bystander Visual Data in Augmented Reality Systems
复制标题
DOI：
10.1145/3581791.3596830
复制
发表时间：
2023-06
期刊：
影响因子：
--
通讯作者：
Brendan David-John;Jiacheng Shang;Bo Ji;Matthew Corbett;Y. C. Hu;Bo Ji. 2023. BystandAR
中科院分区：
文献类型：
--
作者：
Brendan David-John;Jiacheng Shang;Bo Ji;Matthew Corbett;Y. C. Hu;Bo Ji. 2023. BystandAR
通过他们提供的沉浸式体验，增强现实（AR）设备与其他移动设备区分开。尽管潜在的旁观者数据泄漏，因此在实现这种沉浸式体验的现代AR设备上的强大传感器套件对于实现这种身临其境的体验是必需的，但它们可能会使旁观者（即设备在使用期间周围的设备周围的那些围绕设备围绕设备围绕该设备的人）的不安，这称为旁观者隐私问题。在本文中，我们提出了旁观，这是第一个可以实时保护旁观者视觉（摄像机和深度）数据的实用系统，仅在设备处理中。旁观者建立在一个关键见解的基础上，即设备用户的眼睛和声音是人际交互中受试者/旁观者检测的高效指标，并利用了新颖的AR功能，例如眼睛凝视跟踪，以佩戴者为中心的麦克风以及空间意识，以实现无需偏离敏感信息的可用帧速率。通过16个参与者的用户研究，我们表明旁观者可以正确识别并保护98.14％的旁观者，同时允许访问96.27％的受试者。我们以每秒52.6帧的平均帧速率完成此操作，而无需将未受保护的旁观者数据卸载到另一个设备。
Augmented Reality (AR) devices are set apart from other mobile devices by the immersive experience they offer. While the powerful suite of sensors on modern AR devices is necessary for enabling such an immersive experience, they can create unease in bystanders (i.e., those surrounding the device during its use) due to potential bystander data leaks, which is called the bystander privacy problem. In this paper, we propose BystandAR, the first practical system that can effectively protect bystander visual (camera and depth) data in real-time with only on-device processing. BystandAR builds on a key insight that the device user's eye gaze and voice are highly effective indicators for subject/bystander detection in interpersonal interaction, and leverages novel AR capabilities such as eye gaze tracking, wearer-focused microphone, and spatial awareness to achieve a usable frame rate without offloading sensitive information. Through a 16-participant user study,we show that BystandAR correctly identifies and protects 98.14% of bystanders while allowing access to 96.27% of subjects. We accomplish this with average frame rates of 52.6 frames per second without the need to offload unprotected bystander data to another device.