A Dynamic AI System for Extending the Capabilities of Blind People
A Dynamic AI System for Extending the Capabilities of Blind People
复制标题
用于扩展盲人能力的动态人工智能系统
DOI：
10.1145/3334480.3383142
复制
发表时间：
2020
期刊：
影响因子：
--
通讯作者：
C. Morrison
中科院分区：
文献类型：
--
作者：
Martin Grayson;Anja Thieme;R. Marques;Daniela Massiceti;Edward Cutrell;C. Morrison
我们介绍了一种先进的基于计算机视觉的人工智能系统，为视力障碍(VI)患者提供动态、原位的信息，了解附近其他人的位置、身份和凝视方向。我们的人工智能系统采用了头戴式全息镜头设备的摄像技术，可以捕捉到佩戴者周围近180°的视野。捕获的图像然后由多种最先进的感知算法处理，这些算法的输出被集成到系统检测到的所有人的实时跟踪模型中。用户可以使用戴在手腕上的输入控制器以声音的方式(通过空间化的音频)接收关于这些人的信息。通过人工智能系统交互，拥有这种动态获取信息的能力，使VI患者能够：发展他们的沟通技能；更容易地专注于他人；并在他们的社交互动中更有信心。因此，我们的工作探索了人工智能系统如何成为人类的有用资源，帮助扩大他们的机构，以开发新的或扩展现有的技能。
We introduce an advanced computer vision-based AI system that offers people with vision impairments (VI) dynamic, in-situ access to information about the location, identity and gaze-direction of other people nearby. Our AI system utilizes the camera technology of a head-worn HoloLens device, which captures a near 180° field-of-view surrounding the person who is wearing it. Captured images are then processed by multiple state-of-the-art perception algorithms whose outputs are integrated into a real-time tracking model of all people that the system detected. Users can receive information about those people acoustically (via spatialized audio) using a wrist-worn input controller. Having such dynamic access to information, through AI system interactions, enables people with VI to: develop their communication skills; more easily focus on others; and be more confident in their social interactions. Thus, our work explores how AI systems can serve as a useful resource for humans, helping expand their agency to develop new or extend existing skills.