Real time object scanning using a mobile phone and cloud-based visual search engine
Real time object scanning using a mobile phone and cloud-based visual search engine
复制标题
使用手机和基于云的视觉搜索引擎进行实时物体扫描
DOI：
10.1145/2513383.2513443
复制
发表时间：
2013
期刊：
影响因子：
--
通讯作者：
Jeffrey P. Bigham
中科院分区：
文献类型：
--
作者：
Yu Zhong;Pierre Garrigues;Jeffrey P. Bigham
计算机视觉和人力服务可以为盲人提供周围世界的视觉信息，但它们的功效取决于高质量的照片输入。盲人通常很难捕捉到这些应用程序所需的信息，因为他们看不见自己在拍什么。在本文中，我们提出了扫描搜索，一个移动应用程序，为盲人提供了一种新的方式来拍摄高质量的照片，以支持识别任务。为了支持物体的实时扫描，我们开发了一种关键帧提取算法，该算法可以从手机连续相机视频流中自动提取高质量的帧。这些关键帧被传输到一个基于云的识别引擎，该引擎识别出图像中最重要的物体。通过这种方式，盲人用户可以扫描感兴趣的对象，并实时听到潜在的结果。我们还提出了一项研究，探讨了发送多少照片的权衡，并与8名盲人参与者进行了一项用户研究，比较了扫描搜索与标准拍照界面。我们的结果表明，扫描搜索允许用户更有效地捕获感兴趣的对象，并且比标准界面更受用户的青睐。
Computer vision and human-powered services can provide blind people access to visual information in the world around them, but their efficacy is dependent on high-quality photo inputs. Blind people often have difficulty capturing the information necessary for these applications to work because they cannot see what they are taking a picture of. In this paper, we present Scan Search, a mobile application that offers a new way for blind people to take high-quality photos to support recognition tasks. To support realtime scanning of objects, we developed a key frame extraction algorithm that automatically retrieves high-quality frames from continuous camera video stream of mobile phones. Those key frames are streamed to a cloud-based recognition engine that identifies the most significant object inside the picture. This way, blind users can scan for objects of interest and hear potential results in real time. We also present a study exploring the tradeoffs in how many photos are sent, and conduct a user study with 8 blind participants that compares Scan Search with a standard photo-snapping interface. Our results show that Scan Search allows users to capture objects of interest more efficiently and is preferred by users to the standard interface.
登记。
DOI：
10.1007/978-1-4939-7647-8_1
发表时间：
2018
期刊：
Neuromethods
影响因子：
--
作者：
Joshi,AnandA
通讯作者：
Joshi,AnandA