Collaborative Research: Learning by Touch: Preparing Blind Students to Participate in the Data Science Revolution

合作研究：触摸学习：帮助盲人学生参与数据科学革命

• 批准号: 2016363
• 负责人: Sile O'Modhrain
• 金额: $ 32.81万
• 依托单位: Regents of the University of Michigan - Ann Arbor
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2020
• 资助国家: 美国
• 起止时间: 2020-10-01 至 2024-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2016363&HistoricalAwards=false
• 关键词: Collaborative; Research; Learning; Touch; Preparing

Over the past decade the data science revolution has transformed the way scientists, engineers, and businesses work. A key enabler is the rise of interactive data visualization tools, which allow users to filter, analyze, and understand large data sets. Beyond static charts and graphs, interactive data visualization allows users to view data in different ways and from different perspectives, to build deeper understanding of trends, and to test hypotheses. However, Blind and Visually Impaired People have not been able to fully participate in this data revolution. Common tools for data analysis and data exploration are based on interactive spatial graphics, displayed on 2D screens. These spatial diagrams, charts, and other representations are not easily conveyed through speech or text – the typical ways in which Blind and Visually impaired people consume information through computers. This lack of access to common tools has presented a barrier for Blind and Visually Impaired People to enter STEM fields. History teaches us that, with the right tools, Blind and Visually Impaired People can contribute fully to highly technical fields. For example, many blind people are engaged as programmers and network administrators across a range of industries. It is evident that, if Blind and Visually Impaired People are provided with accessible tools that are functionally equivalent to those used by others and are able to interact with and generate their own data, they will take their place in the world of work, alongside their sighted peers. To address these issues, this project will work to: (1) increase understanding of data literacy amongst Blind and Visually Impaired People; (2) develop new tools and techniques, using touch and audio, to help prepare Blind and Visually Impaired People’s to understand and explore data. This is expected to begin to increase access to STEM concepts and materials in the BVI community, where access has previously been limited. Spatial information is ubiquitous in STEM; finding effective ways to make it accessible to everyone is imperative. Increasing access to Interactive Data Visualization tools will help prepare the Blind and Visually Impaired to participate as data scientists, software engineers, and informed citizens. This research will work to make fundamental contributions in the fields of information visualization, assistive technology, and haptic perception, advancing our understanding of techniques for effective encoding and exploration of spatial information in alternate forms to graphical representation. It will also expand on guidelines for multi-modal haptic interaction with spatial information and create new open source software to enable these interactions. Finally, it will contribute to the field of informal STEM learning, providing understanding about data literacy and personal data exploration as a pathway to engage the Blind and Visually Impaired community in data science and STEM activities. The research will use a mixed methods approach, using co-design, qualitative and longitudinal field studies, and quantitative lab studies. Through 4 synergistic research themes, this project will expand knowledge of broadening access to interactive data visualization for Blind and Visually Impaired People by investigating: (1) current practices, gaps and needs in data literacy for Blind and Visually Impaired People; (2) how task goals affect exploration strategies for tactile perception of data for BVI people; (3) data exploration and manipulation strategies through co-design using an interactive tactile display; and (4) the efficacy of interactive tactile data exploration to expand data literacy for BVI people.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

在过去的十年中，数据科学革命已经改变了科学家、工程师和企业的工作方式。一个关键的推动因素是交互式数据可视化工具的兴起，它允许用户过滤、分析和理解大型数据集。除了静态图表和图形之外，交互式数据可视化还允许用户以不同的方式和从不同的角度查看数据，以更深入地了解趋势并测试假设。然而，盲人和视障人士还未能充分参与这场数据革命。用于数据分析和数据探索的常用工具基于在2D屏幕上显示的交互式空间图形。这些空间图、图表和其他表现形式不容易通过语音或文本传达--这是盲人和视障人士通过计算机消费信息的典型方式。这种缺乏通用工具的情况阻碍了盲人和视障人士进入STEM领域。历史告诉我们，有了正确的工具，盲人和视力障碍者可以为高技术领域做出充分的贡献。例如，许多盲人在各行各业担任程序员和网络管理员。 显然，如果盲人和视力障碍者能够获得与其他人使用的工具功能相同的无障碍工具，并能够与他们互动和生成自己的数据，他们将与他们的视力同龄人一起在工作世界中占有一席之地。为了解决这些问题，该项目将致力于：（1）提高盲人和视障人士对数据素养的理解;（2）开发新的工具和技术，利用触摸和音频，帮助盲人和视障人士做好理解和探索数据的准备。预计这将开始增加英属维尔京群岛社区获得STEM概念和材料的机会，以前这些概念和材料的获得是有限的。 空间信息在STEM中无处不在;找到有效的方法使每个人都能访问它是当务之急。增加使用交互式数据可视化工具的机会将有助于盲人和视障人士做好准备，以数据科学家、软件工程师和知情公民的身份参与其中。这项研究将致力于在信息可视化，辅助技术和触觉感知领域做出根本性的贡献，推进我们对有效编码技术的理解，并以图形表示的替代形式探索空间信息。它还将扩展多模态触觉与空间信息交互的指导方针，并创建新的开源软件来实现这些交互。最后，它将有助于非正式STEM学习领域，提供对数据素养和个人数据探索的理解，作为让盲人和视障社区参与数据科学和STEM活动的途径。该研究将采用混合方法，使用共同设计，定性和纵向实地研究以及定量实验室研究。通过4个协同研究主题，该项目将通过调查扩大盲人和视障人士获得交互式数据可视化的知识：（1）盲人和视障人士数据素养的现行做法，差距和需求;（2）任务目标如何影响BVI人对数据触觉感知的探索策略;（3）BVI人的数据感知能力。（3）通过使用交互式触觉显示器的协同设计的数据探索和操纵策略;以及（4）交互式触觉数据探索的有效性，以扩大数据素养的英属维尔京群岛的人。这一奖项反映了NSF的法定使命，并已被认为是值得支持，通过评估使用基金会的学术价值和更广泛的影响审查标准。

项目成果

COVID-19 highlights the issues facing blind and visually impaired people in accessing data on the web

• DOI: 10.1145/3430263.3452432
• 发表时间: 2021-04
• 期刊: Proceedings of the 18th International Web for All Conference
• 作者: A. Siu;Danyang Fan;Gene S.-H. Kim;Hrishikesh V. Rao;Xavier Vazquez;Sile O'Modhrain;Sean Follmer

The Accessibility of Data Visualizations on the Web for Screen Reader Users: Practices and Experiences During COVID-19

• DOI: 10.1145/3557899
• 发表时间: 2022-08
• 期刊: ACM Transactions on Accessible Computing
• 影响因子: 2.4
• 作者: Danyang Fan;Alexa Fay Siu;Hrishikesh V. Rao;Gene S.-H. Kim;Xavier Vazquez;Lucy Greco;Sile O'Modhrain;Sean Follmer