Gaze-contingent computer screen magnification control for people with low vision

针对低视力人士的注视相关计算机屏幕放大倍数控制

• 批准号: 10053172
• 负责人: Roberto Manduchi
• 金额: $ 35.08万
• 依托单位: UNIVERSITY OF CALIFORNIA SANTA CRUZ
• 依托单位国家: 美国
• 财政年份: 2020
• 资助国家: 美国
• 起止时间: 2020-09-01 至 2024-08-31
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/10053172
• 关键词: Affect; Age; Algorithms; Appearance; Apple; Behavior Control; Benchmarking; Blindness; Categories; Collaborations; Communication; Complex; Computer Vision Systems; Computer software; Computers; Consumption; Correlation Studies; Data; Data Set; Desktop Video; Engineering; Ensure; Eye; Face; Failure; Funding; Glass; Goals; Hand; Image; Individual; Learning; Location; Magic; Manuals; Measures; Minnesota; Modality; Mus; Operating System; Optometry; Performance; Peripheral; Process; Psychological reinforcement; Psychology; Reader; Reading; Research; Resort; Role; Schools; Science; Speech; Speed; Structure; Study Subject; System; Tablet Computer; Technology; Testing; Text; Time; Training; Translating; Update; Vision; Visual; Visual impairment; Work; algorithm development; algorithm training; base; computer science; control trial; cost; data acquisition; design; experience; experimental study; falls; gaze; human subject; interest; motor control; news; recurrent neural network; sample fixation; software systems; tool; web page; web site

! Project Summary This application describes proposed research with the goal of facilitating use of a computer screen magnifier by people with low vision. Screen magnification is a well-established, popular technology for access of onscreen content. Its main shortcoming is that it requires the user to continuously control, with the mouse or trackpad, the location of the focus of magnification, in order to ensure that the magnified content of interest is within the screen viewport. This tedious process may be time-consuming and ineffective. For example, the simple task of reading the news on a web site requires continuous horizontal scrolling, which affects the experience of using this otherwise very beneficial technology, and may discourage its use, especially by those with poor manual coordination. We propose to develop a software system that enables hands-free control of a screen magnifier. This system will rely on the user’s eye gaze (measured by a regular IR-based tracker, or from analysis of the images in a camera embedded in the screen) to update the location of the focus of magnification as desired. This research is inspired by preliminary work, which showed promising results with two simple gaze-based control algorithms, tested on three individuals with low vision. This project will be a collaboration between the Department of Computer Science and Engineering at UC Santa Cruz (PI: Manduchi, Co-I: Prado) and the School of Optometry at UC Berkeley (PI: Chung). Dr. Legge from the Department of Psychology at U. Minnesota will participate as a consultant. Two human subjects studies are planned. In Study 1 with 80 low vision subjects from four different categories of visual impairment, we will investigate the failure rate of a commercial gaze tracker (Aim 1), and will record mouse tracks, gaze tracks, and images from the subjects while performing a number of tasks using two modalities of screen magnification (Aim 2). In Study 2, with the same number of subjects, we will repeat the Study 1 experiment, but using a gaze-based controller trained from the data collected in Study 1, and individually tunable for best performance (Aim 3). In addition, we will experiment with an appearance-based gaze tracker that uses images from the screen camera, thereby removing the need for specialized gaze tracking hardware, as well as with a computer tablet form factor (Aim 4). We expect that reading speed and error rate using our gaze-based controller will be no worse than using mouse-based control. If successful, this study will show that the convenience of hands-free control offered by the proposed system comes at no additional cost in terms of individual performance at the considered tasks. !

好了！ 项目摘要 本申请描述了旨在促进人们使用计算机屏幕放大镜的拟议研究 视力低下。屏幕放大是一种成熟的、流行的访问屏幕内容的技术。它的 它的主要缺点是需要用户用鼠标或触摸板连续控制 放大焦点，以确保感兴趣的放大内容位于屏幕视区内。这 单调乏味的过程可能既耗时又低效。例如，在网络上阅读新闻的简单任务 网站需要连续的水平滚动，这会影响使用这一功能的体验，否则非常有益 技术，并可能不鼓励其使用，特别是那些人工协调能力差的人。 我们建议开发一种软件系统，可以免提控制屏幕放大镜。这个系统将会 依靠用户的眼睛凝视(通过常规的基于红外的跟踪器测量，或通过对相机中图像的分析来测量 嵌入在屏幕中)以根据需要更新放大焦点的位置。这项研究的灵感来自于 初步工作，显示了两个简单的基于凝视的控制算法，在三个 视力低下的人。 这个项目将是加州大学圣诞老人分校计算机科学系和工程系之间的合作 科鲁兹(Pi：Manduchi，Co-I：Prado)和加州大学伯克利分校验光学院(Pi：Chung)。理雅各医生来自 明尼苏达大学心理学系将作为顾问参加。计划进行两项人体受试者研究。 在研究1中，我们将对来自四种不同类别的视力障碍的80名低视力受试者进行调查 商业视线追踪器的速度(目标1)，并将记录鼠标轨迹，凝视轨迹，和来自受试者的图像 同时使用两种模式的屏幕放大来执行多个任务(目标2)。在研究2中，使用相同的 受试者的数量，我们将重复研究1的实验，但使用基于凝视的控制器训练而来的数据 在研究1中收集，并可单独调整以获得最佳性能(目标3)。此外，我们还将尝试使用 基于外观的凝视跟踪器，使用屏幕摄像头的图像，因此不需要专门的 视线跟踪硬件，以及一个电脑平板电脑外形因素(目标4)。我们期望阅读速度和 使用我们基于凝视的控制器的错误率不会比使用基于鼠标的控制更差。如果成功，这项研究 将表明，建议的系统提供的免提控制便利不会带来额外的成本 个人在所考虑的任务中的表现。 好了！