Collaborative Research: Learning by Touch: Preparing Blind Students to Participate in the Data Science Revolution

合作研究：触摸学习：帮助盲人学生参与数据科学革命

• 批准号: 2016789
• 负责人: Sean Follmer
• 金额: $ 42.18万
• 依托单位: Stanford University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2020
• 资助国家: 美国
• 起止时间: 2020-10-01 至 2024-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2016789&HistoricalAwards=false
• 关键词: Collaborative; Research; Learning; Touch; Preparing

Over the past decade the data science revolution has transformed the way scientists, engineers, and businesses work. A key enabler is the rise of interactive data visualization tools, which allow users to filter, analyze, and understand large data sets. Beyond static charts and graphs, interactive data visualization allows users to view data in different ways and from different perspectives, to build deeper understanding of trends, and to test hypotheses. However, Blind and Visually Impaired People have not been able to fully participate in this data revolution. Common tools for data analysis and data exploration are based on interactive spatial graphics, displayed on 2D screens. These spatial diagrams, charts, and other representations are not easily conveyed through speech or text – the typical ways in which Blind and Visually impaired people consume information through computers. This lack of access to common tools has presented a barrier for Blind and Visually Impaired People to enter STEM fields. History teaches us that, with the right tools, Blind and Visually Impaired People can contribute fully to highly technical fields. For example, many blind people are engaged as programmers and network administrators across a range of industries. It is evident that, if Blind and Visually Impaired People are provided with accessible tools that are functionally equivalent to those used by others and are able to interact with and generate their own data, they will take their place in the world of work, alongside their sighted peers. To address these issues, this project will work to: (1) increase understanding of data literacy amongst Blind and Visually Impaired People; (2) develop new tools and techniques, using touch and audio, to help prepare Blind and Visually Impaired People’s to understand and explore data. This is expected to begin to increase access to STEM concepts and materials in the BVI community, where access has previously been limited. Spatial information is ubiquitous in STEM; finding effective ways to make it accessible to everyone is imperative. Increasing access to Interactive Data Visualization tools will help prepare the Blind and Visually Impaired to participate as data scientists, software engineers, and informed citizens. This research will work to make fundamental contributions in the fields of information visualization, assistive technology, and haptic perception, advancing our understanding of techniques for effective encoding and exploration of spatial information in alternate forms to graphical representation. It will also expand on guidelines for multi-modal haptic interaction with spatial information and create new open source software to enable these interactions. Finally, it will contribute to the field of informal STEM learning, providing understanding about data literacy and personal data exploration as a pathway to engage the Blind and Visually Impaired community in data science and STEM activities. The research will use a mixed methods approach, using co-design, qualitative and longitudinal field studies, and quantitative lab studies. Through 4 synergistic research themes, this project will expand knowledge of broadening access to interactive data visualization for Blind and Visually Impaired People by investigating: (1) current practices, gaps and needs in data literacy for Blind and Visually Impaired People; (2) how task goals affect exploration strategies for tactile perception of data for BVI people; (3) data exploration and manipulation strategies through co-design using an interactive tactile display; and (4) the efficacy of interactive tactile data exploration to expand data literacy for BVI people.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

在过去的十年中，数据科学革命改变了科学家，工程师和企业的工作方式。关键推动器是交互式数据可视化工具的兴起，该工具允许用户过滤，分析和理解大型数据集。除了静态图表和图表之外，交互式数据可视化还可以使用户以不同的方式和不同的角度查看数据，从而更深入地了解趋势并检验假设。但是，盲人和视力障碍的人无法完全参与这场数据革命。数据分析和数据探索的常见工具基于2D屏幕上显示的交互式空间图形。这些空间图，图表和其他表示不容易通过语音或文本传达，这是盲人和视力障碍者通过计算机消费信息的典型方式。这种缺乏通用工具的机会为盲人和视力障碍的人进入STEM领域带来了障碍。历史告诉我们，使用正确的工具，盲人和视力障碍的人可以为高科技领域做出充分贡献。例如，许多盲人曾担任各个行业的程序员和网络管理员。有证据表明，如果为盲人和视力障碍的人提供了与他人使用的功能相同的可访问工具，并且他们是否可以与他们的数据互动并生成自己的数据，他们将在工作世界中与视力同行一起占据一席之地。为了解决这些问题，该项目将致力于：（1）对盲人和视力障碍人士中对数据素养的了解； （2）使用触摸和音频开发新的工具和技术，以帮助准备盲人和视力障碍的人以了解和探索数据。预计这将开始增加BVI社区的STEM概念和材料的访问，而BVI社区以前访问访问权限。空间信息无处不在。必须找到使每个人都可以使用的有效方法。增加获得交互式数据可视化工具的访问将有助于准备盲人和视力障碍，以作为数据科学家，软件工程师和知情公民参与。这项研究将努力在信息可视化，辅助技术和狂热感知领域做出基本贡献，从而促进我们对技术的理解，以有效地编码和探索替代形式的空间信息，以探索图形表示。它还将扩展与空间信息的多模式哈蒂互动的准则，并创建新的开源软件以实现这些交互。最后，它将有助于非正式的STEM学习领域，从而提供有关数据素养和个人数据探索的理解，以此作为参与数据科学和STEM活动中盲人和视力障碍社区的途径。该研究将使用共同设计，定性和纵向现场研究以及定量实验室研究使用混合方法。通过4个协同研究主题，该项目将扩大知识，即通过调查盲目和视力障碍者的交互式数据可视化的知识：（1）目前的实践，差距和需求，用于盲人和视力障碍者的数据素养； （2）任务目标如何影响BVI人对数据的触觉感知的勘探策略； （3）使用交互式触觉显示通过共同设计的数据探索和操纵策略； （4）交互式触觉数据探索对扩大BVI人的数据素养的效率。该奖项反映了NSF的法定任务，并使用基金会的知识分子优点和更广泛的影响审查标准，被认为是通过评估而被视为珍贵的。

项目成果

COVID-19 highlights the issues facing blind and visually impaired people in accessing data on the web

• DOI: 10.1145/3430263.3452432
• 发表时间: 2021-04
• 期刊: Proceedings of the 18th International Web for All Conference
• 作者: A. Siu;Danyang Fan;Gene S.-H. Kim;Hrishikesh V. Rao;Xavier Vazquez;Sile O'Modhrain;Sean Follmer

The Accessibility of Data Visualizations on the Web for Screen Reader Users: Practices and Experiences During COVID-19

• DOI: 10.1145/3557899
• 发表时间: 2022-08
• 期刊: ACM Transactions on Accessible Computing
• 影响因子: 2.4
• 作者: Danyang Fan;Alexa Fay Siu;Hrishikesh V. Rao;Gene S.-H. Kim;Xavier Vazquez;Lucy Greco;Sile O'Modhrain;Sean Follmer

Slide-Tone and Tilt-Tone: 1-DOF Haptic Techniques for Conveying Shape Characteristics of Graphs to Blind Users

Slide-Tone 和 Tilt-Tone：向盲人用户传达图形形状特征的 1-DOF 触觉技术

• DOI: 10.1145/3491102.3517790
• 发表时间: 2022
• 期刊: CHI '22: CHI Conference on Human Factors in Computing Systems
• 作者: Fan, Danyang;Siu, Alexa Fay;Law, Wing-Sum Adrienne;Zhen, Raymond Ruihong;O'Modhrain, Sile;Follmer, Sean
• 通讯作者: Follmer, Sean

Supporting Accessible Data Visualization Through Audio Data Narratives

通过音频数据叙述支持可访问的数据可视化

• DOI: 10.1145/3491102.3517678
• 发表时间: 2022
• 期刊: CHI '22: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems
• 作者: Siu, Alexa;S-H Kim, Gene;O'Modhrain, Sile;Follmer, Sean
• 通讯作者: Follmer, Sean