GO-Finder: A Registration-free Wearable System for Assisting Users in Finding Lost Hand-held Objects
GO-Finder: A Registration-free Wearable System for Assisting Users in Finding Lost Hand-held Objects
复制标题
DOI：
10.1145/3519268
复制
发表时间：
2022-11
影响因子：
3.4
通讯作者：
Takuma Yagi;Takumi Nishiyasu;Kunimasa Kawasaki;Moe Matsuki;Yoichi Sato
中科院分区：
文献类型：
--
作者：
Takuma Yagi;Takumi Nishiyasu;Kunimasa Kawasaki;Moe Matsuki;Yoichi Sato
人们花费大量的时间和精力寻找丢失的物品。为了帮助提醒人们遗失物品的位置，各种提供遗失物品位置信息的计算系统已经开发出来。然而，用于帮助人们寻找对象的现有系统需要用户预先注册目标对象。这一要求给用户带来了繁琐的负担，系统不禁会提醒他们意外丢失的物品。我们提出了Go-Finder(“通用对象查找器”)，这是一个基于相机的免注册可穿戴式系统，它基于两个关键特性：手持对象的自动发现和基于图像的候选选择，帮助人们找到任意数量的对象。给定一段从可穿戴式摄像头拍摄的视频，Go-Finder会自动检测并分组手持对象，以形成对象的可视时间线。用户可以通过智能手机应用程序浏览时间线来检索对象的最后外观。我们进行了用户研究，以调查用户如何从使用Go-Finder中受益。在第一项研究中，我们要求参与者执行一项物体提取任务，并证实通过提供关于物体位置的清晰视觉线索，在物体搜索任务中提高了准确率，减少了精神负担。在第二项研究中，系统在更长和更现实的情景下的可用性得到了验证，并伴随着基于上下文的候选筛选的额外功能。参与者的反馈表明，Go-Finder在出现100多个对象的现实场景中也很有用。
People spend an enormous amount of time and effort looking for lost objects. To help remind people of the location of lost objects, various computational systems that provide information on their locations have been developed. However, prior systems for assisting people in finding objects require users to register the target objects in advance. This requirement imposes a cumbersome burden on the users, and the system cannot help remind them of unexpectedly lost objects. We propose GO-Finder (“Generic Object Finder”), a registration-free wearable camera-based system for assisting people in finding an arbitrary number of objects based on two key features: automatic discovery of hand-held objects and image-based candidate selection. Given a video taken from a wearable camera, GO-Finder automatically detects and groups hand-held objects to form a visual timeline of the objects. Users can retrieve the last appearance of the object by browsing the timeline through a smartphone app. We conducted user studies to investigate how users benefit from using GO-Finder. In the first study, we asked participants to perform an object retrieval task and confirmed improved accuracy and reduced mental load in the object search task by providing clear visual cues on object locations. In the second study, the system’s usability on a longer and more realistic scenario was verified, accompanied by an additional feature of context-based candidate filtering. Participant feedback suggested the usefulness of GO-Finder also in realistic scenarios where more than one hundred objects appear.