Perceptual and Implementation Strategies for Knowledge Acquisition of Digital Tactile Graphics for Blind and Visually Impaired Students

盲人和视障学生数字触觉图形知识获取的感知和实施策略

• 批准号: 1644538
• 负责人: Jenna Gorlewicz
• 金额: $ 35.02万
• 依托单位: Saint Louis University
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2017
• 资助国家: 美国
• 起止时间: 2017-01-15 至 2021-12-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1644538&HistoricalAwards=false
• 关键词: Perceptual; Implementation; Strategies; Knowledge; Acquisition

Students with disabilities often have fewer opportunities for experiential learning, an important component of quality STEM education. With continued shifts toward the use of digital media to supplement instruction in STEM classrooms, much of the content remains inaccessible, particular for students with visual impairments. The promise of technology and use of tactile graphics is an effective, emerging innovation for providing more complete access to important information and materials. Tactile graphics are images that use raised surfaces to convey non-textual information such as maps, paintings, graphs and diagrams. Touchscreen-based smart devices allow visual information to be digitally and dynamically represented via tactile, auditory, visual, and kinesthetic feedback. Tactile graphic technology embedded in touchscreen devices can be leveraged to make STEM content more accessible to blind and visually impaired students. This project will develop a learner-centered, perceptually-motivated framework addressing the requirements for students with blindness and visual impairments to access graphical content in STEM. Using TouchSense technology, the investigators will create instructional materials using tactile graphics and test them in a pilot classroom of both sighted and BVI students. The investigators will work with approximately 150 students with visual impairments to understand the kind of feedback that is most appropriate for specific content in algebra (coordinate plane), cell biology, and geography. Qualitative research methods will be used to analyze the video-based data set. This project is supported by NSF's EHR Core Research (ECR) program and the Discovery Research PreK-12 Program. The ECR program emphasizes fundamental STEM education research that generates foundational knowledge in the field. Investments are made in critical areas that are essential, broad and enduring: STEM learning and STEM learning environments, broadening participation in STEM, and STEM workforce development. The program supports the accumulation of robust evidence to inform efforts to understand, build theory to explain, and suggest intervention and innovations to address persistent challenges in STEM interest, education, learning and participation. The Discovery Research PreK-12 program (DRK-12) seeks to significantly enhance the learning and teaching of science, technology, engineering and mathematics (STEM) by preK-12 students and teachers, through research and development of innovative resources, models and tools (RMTs). Projects in the DRK-12 program build on fundamental research in STEM education and prior research and development efforts that provide theoretical and empirical justification for proposed projects.

残疾学生的体验式学习机会往往较少，而体验式学习是优质 STEM 教育的重要组成部分。随着 STEM 课堂不断转向使用数字媒体来补充教学，许多内容仍然无法访问，特别是对于有视力障碍的学生而言。技术的承诺和触觉图形的使用是一种有效的新兴创新，可以提供对重要信息和材料的更完整的访问。触觉图形是使用凸起表面传达非文本信息的图像，例如地图、绘画、图表和图表。基于触摸屏的智能设备允许通过触觉、听觉、视觉和动觉反馈以数字方式动态地呈现视觉信息。 触摸屏设备中嵌入的触觉图形技术可让盲人和视障学生更容易理解 STEM 内容。该项目将开发一个以学习者为中心、感知驱动的框架，满足失明和视力障碍学生访问 STEM 图形内容的要求。利用 TouchSense 技术，研究人员将使用触觉图形创建教学材料，并在由视力正常的学生和英属维尔京群岛学生组成的试点教室中进行测试。研究人员将与大约 150 名有视力障碍的学生合作，了解最适合代数（坐标平面）、细胞生物学和地理学特定内容的反馈类型。将使用定性研究方法来分析基于视频的数据集。 该项目得到了 NSF 的 EHR 核心研究 (ECR) 计划和发现研究 PreK-12 计划的支持。 ECR 项目强调基础 STEM 教育研究，产生该领域的基础知识。投资针对重要、广泛和持久的关键领域：STEM 学习和 STEM 学习环境、扩大 STEM 参与以及 STEM 劳动力发展。该计划支持积累强有力的证据，为理解、建立理论解释、建议干预和创新的努力提供信息，以应对 STEM 兴趣、教育、学习和参与方面持续存在的挑战。 发现研究 PreK-12 计划 (DRK-12) 旨在通过创新资源、模型和工具 (RMT) 的研究和开发，显着增强 PreK-12 学生和教师对科学、技术、工程和数学 (STEM) 的学习和教学。 DRK-12 计划中的项目建立在 STEM 教育基础研究以及先前的研究和开发工作的基础上，为拟议项目提供理论和实证依据。

项目成果

Non-visual Perception of Lines on a Multimodal Touchscreen Tablet

多模式触摸屏平板电脑上线条的非视觉感知

• 发表时间: 2019
• 期刊: ACM transactions on applied perception
• 影响因子: 1.6
• 作者: Tennison, J. L.;Gorlewicz, J. L.
• 通讯作者: Gorlewicz, J. L.

Establishing Vibration-Based Tactile Line Profiles for Use in Multimodal Graphics

建立用于多模态图形的基于振动的触觉线轮廓

• DOI: 10.1145/3383457
• 发表时间: 2020
• 期刊: ACM Transactions on Applied Perception
• 影响因子: 1.6
• 作者: Tennison, Jennifer L.;Uesbeck, P. Merlin;Giudice, Nicholas A.;Stefik, Andreas;Smith, Derrick W.;Gorlewicz, Jenna L.
• 通讯作者: Gorlewicz, Jenna L.

The Graphical Access Challenge for People with Visual Impairments: Positions and Pathways Forward. In D. Cvetkovic (ed), Interactive Multimedia - Multimedia Production and Digital Storytelling

视觉障碍人士的图形访问挑战：立场和前进的道路。

• DOI: 10.5772/intechopen.82289
• 发表时间: 2019
• 期刊: Intech
• 作者: Gorlewicz, J. L.;Tennison, J. L.;Palani, H. P.;Giudice, N. A.
• 通讯作者: Giudice, N. A.

Investigating Multi-Touch Vibrations on Mobile Touchscreens

研究移动触摸屏上的多点触控振动

• DOI: 10.1109/whc49131.2021.9517131
• 发表时间: 2021
• 期刊: 2021 IEEE World Haptics Conference
• 作者: Pasquesi, John;Gorlewicz, Jenna L.
• 通讯作者: Gorlewicz, Jenna L.

Comparing Haptic Pattern Matching on Tablets and Phones: Large Screens Are Not Necessarily Better

比较平板电脑和手机上的触觉模式匹配：大屏幕不一定更好

• DOI: 10.1097/opx.0000000000001274
• 发表时间: 2018
• 期刊: Optometry and Vision Science
• 影响因子: 1.4
• 作者: Tennison, Jennifer L.;Carril, Zachary S.;Giudice, Nicholas A.;Gorlewicz, Jenna L.
• 通讯作者: Gorlewicz, Jenna L.