Gaze-contingent computer screen magnification control for people with low vision

针对低视力人士的注视相关计算机屏幕放大倍数控制

• 批准号: 10471849
• 负责人: Roberto Manduchi
• 金额: $ 35.87万
• 依托单位: UNIVERSITY OF CALIFORNIA SANTA CRUZ
• 依托单位国家: 美国
• 财政年份: 2020
• 资助国家: 美国
• 起止时间: 2020-09-01 至 2024-08-31
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/10471849
• 关键词: Affect; Age; Algorithms; Appearance; Apple; Behavior Control; Benchmarking; Blindness; Categories; Collaborations; Communication; Complex; Computer Vision Systems; Computer software; Computers; Consumption; Correlation Studies; Data; Data Set; Desktop Video; Engineering; Ensure; Eye; Face; Failure; Funding; Glass; Goals; Hand; Image; Individual; Learning; Location; Magic; Manuals; Measures; Minnesota; Modality; Mus; Operating System; Optometry; Performance; Peripheral; Persons; Process; Psychological reinforcement; Psychology; Reader; Reading; Research; Resort; Role; Schools; Science; Speech; Speed; Structure; Study Subject; System; Tablet Computer; Technology; Testing; Text; Time; Training; Translating; Update; Vision; Visual; Visual impairment; Work; algorithm development; algorithm training; base; computer science; control trial; cost; data acquisition; design; experience; experimental study; falls; gaze; human subject; interest; motor control; news; recurrent neural network; sample fixation; software systems; tool; web page; web site

! Project Summary This application describes proposed research with the goal of facilitating use of a computer screen magnifier by people with low vision. Screen magnification is a well-established, popular technology for access of onscreen content. Its main shortcoming is that it requires the user to continuously control, with the mouse or trackpad, the location of the focus of magnification, in order to ensure that the magnified content of interest is within the screen viewport. This tedious process may be time-consuming and ineffective. For example, the simple task of reading the news on a web site requires continuous horizontal scrolling, which affects the experience of using this otherwise very beneficial technology, and may discourage its use, especially by those with poor manual coordination. We propose to develop a software system that enables hands-free control of a screen magnifier. This system will rely on the user’s eye gaze (measured by a regular IR-based tracker, or from analysis of the images in a camera embedded in the screen) to update the location of the focus of magnification as desired. This research is inspired by preliminary work, which showed promising results with two simple gaze-based control algorithms, tested on three individuals with low vision. This project will be a collaboration between the Department of Computer Science and Engineering at UC Santa Cruz (PI: Manduchi, Co-I: Prado) and the School of Optometry at UC Berkeley (PI: Chung). Dr. Legge from the Department of Psychology at U. Minnesota will participate as a consultant. Two human subjects studies are planned. In Study 1 with 80 low vision subjects from four different categories of visual impairment, we will investigate the failure rate of a commercial gaze tracker (Aim 1), and will record mouse tracks, gaze tracks, and images from the subjects while performing a number of tasks using two modalities of screen magnification (Aim 2). In Study 2, with the same number of subjects, we will repeat the Study 1 experiment, but using a gaze-based controller trained from the data collected in Study 1, and individually tunable for best performance (Aim 3). In addition, we will experiment with an appearance-based gaze tracker that uses images from the screen camera, thereby removing the need for specialized gaze tracking hardware, as well as with a computer tablet form factor (Aim 4). We expect that reading speed and error rate using our gaze-based controller will be no worse than using mouse-based control. If successful, this study will show that the convenience of hands-free control offered by the proposed system comes at no additional cost in terms of individual performance at the considered tasks. !

! 项目摘要 本申请描述了以便于人们使用计算机屏幕放大镜为目标的拟议研究 视力低下。屏幕放大是一种成熟的流行技术，用于访问视频内容。其 主要缺点是它需要用户用鼠标或触控板连续地控制 放大的焦点，以确保感兴趣的放大内容在屏幕视口内。这 繁琐过程可能是耗时且无效的。例如，在网络上阅读新闻的简单任务 一个网站需要连续的水平滚动，这影响了使用体验，否则非常有益 技术，并可能阻碍其使用，特别是那些与穷人的手动协调。 我们建议开发一个软件系统，使免提控制屏幕放大镜。该系统将 依赖于用户的眼睛注视（通过常规的基于IR的跟踪器测量，或者通过对相机中的图像的分析 嵌入在屏幕中）以根据需要更新放大焦点的位置。这项研究的灵感来自于 初步工作，这表明有希望的结果与两个简单的凝视为基础的控制算法，测试三个 低视力的人。 该项目将是加州大学圣塔分校计算机科学与工程系之间的合作， 克鲁兹（PI：Manduchi，Co-I：普拉多）和加州大学伯克利分校视光学院（PI：Chung）。Legge博士， 美国大学心理学系。明尼苏达州将作为顾问参加。计划进行两项人类受试者研究。 在研究1中，80名低视力受试者来自四种不同类别的视觉障碍，我们将调查失败 商业凝视跟踪器（目标1）的速率，并将记录鼠标轨迹、凝视轨迹和来自受试者的图像 同时使用两种屏幕放大模式执行多项任务（目标2）。在研究2中，相同的 我们将重复研究1的实验，但使用从数据中训练的基于凝视的控制器 在研究1中收集，并单独可调以获得最佳性能（目标3）。此外，我们还将尝试 基于外观的凝视跟踪器，其使用来自屏幕摄像机的图像，从而消除了对专门的 凝视跟踪硬件，以及与平板电脑的形式因素（目标4）。我们希望阅读速度和 使用我们的基于凝视的控制器的错误率不会比使用基于鼠标的控制更差。如果成功，这项研究 将表明，所提出的系统提供的免提控制的便利性是在没有额外成本的情况下， 在所考虑的任务中的个人表现。 !