Gaze-contingent computer screen magnification control for people with low vision

！ 项目概要 该申请描述了拟议的研究，其目的是促进人们使用计算机屏幕放大镜 视力低下。屏幕放大是一种成熟且流行的访问屏幕内容的技术。其 主要缺点是它需要用户使用鼠标或触控板连续控制物体的位置 放大焦点，以确保放大后的感兴趣内容位于屏幕视口内。这个 繁琐的过程可能既耗时又无效。例如，在网络上阅读新闻的简单任务 网站需要连续水平滚动，这影响了使用体验，否则非常有利 技术，并可能阻碍其使用，尤其是那些手动协调能力差的人。 我们建议开发一种软​​件系统，可以实现屏幕放大器的免提控制。该系统将 依赖于用户的眼睛注视（通过常规的基于红外的跟踪器测量，或通过对相机中的图像的分析来测量） 嵌入屏幕中）以根据需要更新放大焦点的位置。这项研究的灵感来自 初步工作，通过两种简单的基于凝视的控制算法显示出有希望的结果，并在三个设备上进行了测试 视力低下的人。 该项目将是加州大学圣塔分校计算机科学与工程系之间的合作 Cruz（PI：Manduchi，Co-I：Prado）和加州大学伯克利分校验光学院（PI：Chung）。莱格博士来自 明尼苏达大学心理学系将作为顾问参与。计划进行两项人类受试者研究。 在研究 1 中，有 80 名来自四种不同类别的视力障碍的低视力受试者，我们将调查失败情况 商业视线追踪器的速率（目标 1），并将记录鼠标轨迹、视线轨迹和受试者的图像 同时使用两种屏幕放大模式执行多项任务（目标 2）。在研究 2 中，同样 受试者数量，我们将重复研究 1 实验，但使用根据数据训练的基于凝视的控制器 研究 1 中收集的数据，并可单独调整以获得最佳性能（目标 3）。此外，我们将尝试一个 基于外观的视线跟踪器，使用来自屏幕摄像头的图像，从而无需专门的 视线跟踪硬件，以及平板电脑外形（目标 4）。我们期望阅读速度和 使用基于凝视的控制器的错误率不会比使用基于鼠标的控制差。如果这项研究成功的话 将表明所提出的系统提供的免提控制的便利性无需额外成本 就所考虑的任务中的个人表现而言。 ！

! Project Summary This application describes proposed research with the goal of facilitating use of a computer screen magnifier by people with low vision. Screen magnification is a well-established, popular technology for access of onscreen content. Its main shortcoming is that it requires the user to continuously control, with the mouse or trackpad, the location of the focus of magnification, in order to ensure that the magnified content of interest is within the screen viewport. This tedious process may be time-consuming and ineffective. For example, the simple task of reading the news on a web site requires continuous horizontal scrolling, which affects the experience of using this otherwise very beneficial technology, and may discourage its use, especially by those with poor manual coordination. We propose to develop a software system that enables hands-free control of a screen magnifier. This system will rely on the user’s eye gaze (measured by a regular IR-based tracker, or from analysis of the images in a camera embedded in the screen) to update the location of the focus of magnification as desired. This research is inspired by preliminary work, which showed promising results with two simple gaze-based control algorithms, tested on three individuals with low vision. This project will be a collaboration between the Department of Computer Science and Engineering at UC Santa Cruz (PI: Manduchi, Co-I: Prado) and the School of Optometry at UC Berkeley (PI: Chung). Dr. Legge from the Department of Psychology at U. Minnesota will participate as a consultant. Two human subjects studies are planned. In Study 1 with 80 low vision subjects from four different categories of visual impairment, we will investigate the failure rate of a commercial gaze tracker (Aim 1), and will record mouse tracks, gaze tracks, and images from the subjects while performing a number of tasks using two modalities of screen magnification (Aim 2). In Study 2, with the same number of subjects, we will repeat the Study 1 experiment, but using a gaze-based controller trained from the data collected in Study 1, and individually tunable for best performance (Aim 3). In addition, we will experiment with an appearance-based gaze tracker that uses images from the screen camera, thereby removing the need for specialized gaze tracking hardware, as well as with a computer tablet form factor (Aim 4). We expect that reading speed and error rate using our gaze-based controller will be no worse than using mouse-based control. If successful, this study will show that the convenience of hands-free control offered by the proposed system comes at no additional cost in terms of individual performance at the considered tasks. !