Poster: BystandAR: Protecting Bystander Visual Data in Augmented Reality Systems
Poster: BystandAR: Protecting Bystander Visual Data in Augmented Reality Systems
复制标题
DOI：
10.1145/3581791.3597377
复制
发表时间：
2023-06
期刊：
影响因子：
--
通讯作者：
Matthew Corbett;Brendan David-John;Jiacheng Shang;Y. C. Hu;Bo Ji
中科院分区：
文献类型：
--
作者：
Matthew Corbett;Brendan David-John;Jiacheng Shang;Y. C. Hu;Bo Ji
增强现实（AR）设备通过其提供的沉浸式体验而与其他移动的设备区分开。虽然现代AR设备上强大的传感器套件对于实现这种沉浸式体验是必要的，但它们可能会引起旁观者的不安（即，在设备使用期间围绕设备的那些人），这是由于潜在的旁观者数据泄露，这被称为旁观者隐私问题。在这张海报中，我们提出了BystandAR，这是第一个可以实时有效保护旁观者视觉（相机和深度）数据的实用系统，只需在设备上进行处理。BystandAR建立在一个关键的见解，即设备用户的眼睛注视和语音是人际互动中主体/旁观者检测的高效指标，并利用新颖的AR功能，如眼睛注视跟踪，佩戴者聚焦麦克风和空间感知，以实现可用的帧速率，而无需卸载敏感信息。通过一项16名参与者的用户研究，我们发现BystandAR正确识别并保护了98.14%的旁观者，同时允许访问96.27%的受试者。我们以每秒52.6帧的平均帧速率实现了这一目标，而无需将未受保护的旁观者数据卸载到另一台设备。
Augmented Reality (AR) devices are set apart from other mobile devices by the immersive experience they offer. While the powerful suite of sensors on modern AR devices is necessary for enabling such an immersive experience, they can create unease in bystanders (i.e., those surrounding the device during its use) due to potential bystander data leaks, which is called the bystander privacy problem. In this poster, we propose BystandAR, the first practical system that can effectively protect bystander visual (camera and depth) data in real-time with only on-device processing. BystandAR builds on a key insight that the device user's eye gaze and voice are highly effective indicators for subject/bystander detection in interpersonal interaction, and leverages novel AR capabilities such as eye gaze tracking, wearer-focused microphone, and spatial awareness to achieve a usable frame rate without offloading sensitive information. Through a 16-participant user study, we show that BystandAR correctly identifies and protects 98.14% of bystanders while allowing access to 96.27% of subjects. We accomplish this with average frame rates of 52.6 frames per second without the need to offload unprotected bystander data to another device.