Sonified Interactive Simulations for Accessible Middle School STEM

面向无障碍中学 STEM 的 Sonified 交互式模拟

• 批准号: 1621363
• 负责人: Emily Moore
• 金额: $ 199.01万
• 依托单位: University of Colorado at Boulder
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2016
• 资助国家: 美国
• 起止时间: 2016-10-01 至 2021-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1621363&HistoricalAwards=false
• 关键词: Sonified; Interactive; Simulations; Accessible; Middle

Students with disabilities often have fewer opportunities for experiential learning, an important component of quality STEM education. Computer based simulations in science can provide valuable opportunities for these students to experience and manipulate natural phenomena related to critical STEM ideas. However, existing simulations remain largely inaccessible to students with visual impairments in particular. Recent advances in technology related to sonification use with simulations can make it possible for these students to have a more complete and authentic experience. Sonification is the use of non-speech sounds, such as musical tones, to represent visual information including data. Such sounds can be manipulated temporally and spatially and can also vary by amplitude and frequency to convey information that is more traditionally displayed visually. Researchers will iteratively develop five middle school physical science simulations to include sonifications aimed at enhancing accessibility for all learners, but particularly for those with visual impairments. Data collection activities will include focus groups and interviews with students and teachers focused on engagement. The end products of this project will include sonified simulations, professional development resources, design guidelines and exemplars, and publications. The Discovery Research PreK-12 program (DRK-12) seeks to significantly enhance the learning and teaching of science, technology, engineering and mathematics (STEM) by preK-12 students and teachers, through research and development of innovative resources, models and tools (RMTs). Projects in the DRK-12 program build on fundamental research in STEM education and prior research and development efforts that provide theoretical and empirical justification for proposed projects.

残疾学生通常很少有机会体验学习，这是优质STEM教育的重要组成部分。 基于计算机的科学模拟可以为这些学生提供宝贵的机会，体验和操纵与关键STEM想法相关的自然现象。 然而，现有的模拟仍然在很大程度上无法访问的学生，特别是视觉障碍。 最近与模拟声化使用相关的技术进步可以使这些学生获得更完整和真实的体验。发音是使用非语音声音，如音乐音调，来表示包括数据在内的视觉信息。 这种声音可以在时间和空间上被操纵，并且还可以通过幅度和频率来改变，以传达更传统地视觉显示的信息。 研究人员将迭代开发五个中学物理科学模拟，包括旨在提高所有学习者，特别是那些有视觉障碍的学习者的可访问性的声音。 数据收集活动将包括焦点小组和与学生和教师的访谈，重点是参与。该项目的最终产品将包括声化模拟、专业开发资源、设计指南和范例以及出版物。 探索研究PreK-12计划（DRK-12）旨在通过研究和开发创新资源，模型和工具（RMT），显着提高preK-12学生和教师的科学，技术，工程和数学（STEM）的学习和教学。DRK-12计划中的项目建立在STEM教育的基础研究和先前的研究和开发工作的基础上，这些研究和开发工作为拟议项目提供了理论和经验依据。

项目成果

Storytelling to Sensemaking: A Systematic Framework for Designing Auditory Description Display for Interactives

从讲故事到意义建构：设计交互式听觉描述显示的系统框架

• DOI: 10.1145/3313831.3376460
• 发表时间: 2020
• 期刊: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems
• 作者: Smith, Taliesin L.;Moore, Emily B.
• 通讯作者: Moore, Emily B.

Haptic paradigms for multimodal interactive simulations

多模态交互模拟的触觉范式

• 发表时间: 2021
• 期刊: Journal on technology and persons with disabilities
• 作者: Tennison, J. L.;Greenberg, J.;Moore, E. B.;& Gorlewicz, J. L.
• 通讯作者: & Gorlewicz, J. L.

Design and evaluation of a multimodal physics simulation

多模态物理模拟的设计和评估

• 发表时间: 2019
• 期刊: Journal on technology and persons with disabilities
• 作者: Tomlinson, Brianna;Kaini, Prakrit;Harden, E. Lynn;Walker, Bruce;Moore, Emily B.
• 通讯作者: Moore, Emily B.

Auditory Display in Interactive Science Simulations: Description and Sonification Support Interaction and Enhance Opportunities for Learning

交互式科学模拟中的听觉显示：描述和声音化支持交互并增加学习机会

• DOI: 10.1145/3313831.3376886
• 发表时间: 2020
• 期刊: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems
• 作者: Tomlinson, Brianna J.;Walker, Bruce N.;Moore, Emily B.
• 通讯作者: Moore, Emily B.