CHS: Medium: Improving the Accessibility of Mobile Applications by Enabling Third-Party Assessment, Repair, and Enhancement

CHS：中：通过启用第三方评估、修复和增强来提高移动应用程序的可访问性

• 批准号: 1702751
• 负责人: James Fogarty
• 金额: $ 119.85万
• 依托单位: University of Washington
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2017
• 资助国家: 美国
• 起止时间: 2017-09-01 至 2023-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1702751&HistoricalAwards=false
• 关键词: CHS; Medium; Improving; Accessibility; Mobile

Many mobile applications (apps) do not properly implement accessibility services that help people with disabilities use computers, effectively denying access to apps and associated services for many vulnerable people. This project will develop new approaches to assess, repair, and enhance accessibility across large numbers of apps without needing access to source code of an app or the phone's operating system. To do this the research team will develop new pixel-level analyses of app interfaces to assess whether they correctly implement application programming interfaces (APIs) that the phone platform provides to support accessibility, then release datasets that give a picture of accessibility across the ecosystem of apps. The team will also develop new approaches that allow third parties to build alternate "proxy" interfaces that run on top of an existing app and implement accessibility APIs, as well as new approaches for those proxies to be personalized to a particular person's abilities and needs. The team will work closely with partners who serve people with disabilities in both design and evaluation of the tools, bringing direct benefits to those partners, as well as broader social benefits through actively disseminating the tools, methods, and datasets to support others in doing accessibility research. The project will also provide research and education opportunities for students from grade to grad school, with the team specifically targeting students from groups that are underrepresented in computing research, including those with disabilities.For assessment, the team will develop methods for executing an application in a mobile phone emulator, navigating its interface using common tasks, capturing both images of the interface and its accessibility API representation, and evaluating whether a recovered pixel-based interface hierarchy from the captured image correctly corresponds to the API representation. Working with people with disabilities to develop effective summaries and presentations of the analyses, the team will develop scalable infrastructure and efficient analyses to look for patterns in types of accessibility failures, how these failures are distributed across apps and developers, and how they are affected by app updates. For repair and enhancement, the team will develop interaction proxies that leverage the platform's accessibility services to create overlay windows that cover the underlying app interface and exchange events with it. They will also develop design patterns that link common accessibility failures with repair strategies, providing libraries to quickly implement these patterns in interaction proxies to support both third-party and eventually automatic repair of these common failures. Finally, the team will explore how novel interaction techniques that respond to individual abilities could be broadly deployed via interaction proxies, using a Model-View/Controller paradigm to manage the combinatorial complexity of applying particular enhancements to particular interfaces.

许多移动应用程序（应用程序）无法正确实施可访问性服务，这些服务可以帮助残疾人使用计算机，从而有效否认许多弱势群体对应用程序和相关服务的访问。该项目将开发新的方法来评估，维修和增强大量应用程序的可访问性，而无需访问应用程序的源代码或手机的操作系统。为此，研究团队将开发对应用程序接口的新像素级分析，以评估他们是否正确地实施了电话平台提供的应用程序编程接口（API），以支持可访问性，然后释放数据集，以提供跨应用程序生态系统的可访问性图片。该团队还将开发新的方法，使第三方能够在现有应用程序之上运行并实现可访问性API，以及为这些代理人个性化特定人的能力和需求的新方法。该团队将与在设计和评估工具方面为残疾人提供服务，为这些合作伙伴带来直接利益，以及通过积极传播工具，方法和数据集的更广泛的社会益处的合作伙伴紧密合作。该项目还将为从成绩到研究生的学生提供研究和教育机会，团队专门针对来自计算研究的团队的学生，包括残疾人。评估，该团队将开发用于在移动电话模拟器中执行应用程序的方法捕获的图像正确对应于API表示。该团队与残疾人一起开发有效的摘要和分析的介绍，将开发可扩展的基础架构和有效的分析，以寻找可访问性失败类型的模式，这些失败是如何在应用程序和开发人员中分配的，以及如何受应用程序更新影响。为了维修和增强，团队将开发互动代理，以利用平台的可访问性服务来创建覆盖基础应用程序接口和交换事件的覆盖窗口。他们还将开发设计模式，将共同可访问性失败与维修策略联系起来，从而在互动代理中快速实施这些模式，以支持第三方并最终自动维修这些常见的失败。最后，该团队将使用模型视图/控制器范式来管理对个人能力的响应的新颖交互技术如何通过交互代理进行广泛部署，以管理将特定增强功能应用于特定接口的组合复杂性。

项目成果

Jod: Examining Design and Implementation of a Videoconferencing Platform for Mixed Hearing Groups

Jod：检查混合听力群体视频会议平台的设计和实现

• DOI: 10.1145/3597638.3608382
• 发表时间: 2023
• 期刊: Proceedings of the ACM Conference on Computers and Accessibility
• 作者: Mittal, Anant;Gupta, Meghna;Poddar, Roshni;Naik, Tarini;Kuppuraj, Seethalakshmi;Fogarty, James;Kumar, Pratyush;Jain, Mohit
• 通讯作者: Jain, Mohit

GestureCalc: An Eyes-Free Calculator for Touch Screens

• DOI: 10.1145/3308561.3353783
• 发表时间: 2019-10
• 期刊: Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility
• 作者: Bindita Chaudhuri;Leah Perlmutter;Justin Petelka;Philip E. Garrison;J. Fogarty;J. Wobbrock;R. Ladner

Crowdsourcing Similarity Judgments for Agreement Analysis in End-User Elicitation Studies

最终用户启发研究中协议分析的众包相似性判断

• DOI: 10.1145/3242587.3242621
• 发表时间: 2018
• 期刊: Proceedings of the ACM Symposium on User Interface Software and Technology
• 作者: Ali, Abdullah X.;Morris, Meredith Ringel;Wobbrock, Jacob O.
• 通讯作者: Wobbrock, Jacob O.

Quantifying Touch: New Metrics for Characterizing What Happens During a Touch

量化触摸：描述触摸过程中发生的情况的新指标

• DOI: 10.1145/3517428.3544804
• 发表时间: 2022
• 期刊: Proceedings of the ACM Conference on Computers and Accessibility
• 作者: Kong, Junhan;Zhong, Mingyuan;Fogarty, James;Wobbrock, Jacob O.
• 通讯作者: Wobbrock, Jacob O.

Distributed interaction design: designing human-centered interactions in a time of social distancing

分布式交互设计：在社交距离时代设计以人为本的交互

• DOI: 10.1145/3447790
• 发表时间: 2021
• 期刊: Interactions
• 作者: Ali, Abdullah X.;Morris, Meredith Ringel;Wobbrock, Jacob O.
• 通讯作者: Wobbrock, Jacob O.