Repurposing Visual Input Modalities for Blind Users: A Case Study of Word Processors.
Repurposing Visual Input Modalities for Blind Users: A Case Study of Word Processors.
复制标题
DOI：
10.1109/smc42975.2020.9283015
复制
发表时间：
2020-10
期刊：
影响因子：
--
通讯作者：
Ramakrishnan IV
中科院分区：
文献类型：
--
作者：
Lee HN;Ashok V;Ramakrishnan IV
鼠标和触摸板等视觉“点击”交互工件是有形的输入形式，对于视力正常的用户方便地与计算机应用程序交互是必不可少的。相比之下，盲人用户无法利用这些视觉输入方式，因此在使用耦合到键盘的顺序叙述屏幕阅读器辅助技术与计算机交互时受到限制。因此，盲人用户通常需要显著更多的时间和精力来完成甚至简单的应用任务（例如，在文字处理器中应用一种风格），而他们的视力正常的同龄人可以毫不费力地使用点击鼠标完成同样的任务。本文探讨了重新利用视觉输入方式的非视觉交互的想法，使盲人用户也可以从这些形式的简单和有效的访问的好处。具体来说，以文字处理应用程序为代表的案例研究，我们设计和开发了NVMouse作为这种再利用思想的具体体现，其中空间分布的文字处理器控件被映射到一个虚拟的分层“功能菜单”，使用简单的滚动和点击输入动作可以轻松地非视觉地遍历。此外，NVMouse通过利用数据驱动的预测模型来提高访问常用应用程序命令的效率，该模型可以确定用户接下来最有可能访问的命令，给定文档中当前的“本地”屏幕阅读器上下文。一项有14名盲人参与者的用户研究将基于键盘的屏幕阅读器与NVMouse进行了比较，结果显示，后者显着减少了任务完成时间和用户工作量（即，用户操作的数量）。
Visual ‘point-and-click’ interaction artifacts such as mouse and touchpad are tangible input modalities, which are essential for sighted users to conveniently interact with computer applications. In contrast, blind users are unable to leverage these visual input modalities and are thus limited while interacting with computers using a sequentially narrating screen-reader assistive technology that is coupled to keyboards. As a consequence, blind users generally require significantly more time and effort to do even simple application tasks (e.g., applying a style to text in a word processor) using only keyboard, compared to their sighted peers who can effortlessly accomplish the same tasks using a point-and-click mouse. This paper explores the idea of repurposing visual input modalities for non-visual interaction so that blind users too can draw the benefits of simple and efficient access from these modalities. Specifically, with word processing applications as the representative case study, we designed and developed NVMouse as a concrete manifestation of this repurposing idea, in which the spatially distributed word-processor controls are mapped to a virtual hierarchical ‘Feature Menu’ that is easily traversable non-visually using simple scroll and click input actions. Furthermore, NVMouse enhances the efficiency of accessing frequently-used application commands by leveraging a data-driven prediction model that can determine what commands the user will most likely access next, given the current ‘local’ screen-reader context in the document. A user study with 14 blind participants comparing keyboard-based screen readers with NVMouse, showed that the latter significantly reduced both the task-completion times and user effort (i.e., number of user actions) for different word-processing activities.
登录
查看更多内容
影响因子：
2.7
作者：
Wang, Katie;Barron, Laura G.;Hebl, Michelle R.
通讯作者：
Hebl, Michelle R.
影响因子：
3.7
作者：
BRADLEY, JV
通讯作者：
BRADLEY, JV
影响因子：
2.7
作者：
Wagar, Mirza Muhammad;Aslam, Muhammad;Farhan, Muhammad
通讯作者：
Farhan, Muhammad
DOI：
10.1145/3132525.3132531
发表时间：
2017-10
期刊：
ASSETS. Annual ACM Conference on Assistive Technologies
影响因子：
--
作者：
Billah SM;Ashok V;Porter DE;Ramakrishnan IV
通讯作者：
Ramakrishnan IV