REU Site: Collaborative: Making Augmented and Virtual Reality Accessible

REU 网站：协作：让增强现实和虚拟现实变得触手可及

• 批准号: 2051053
• 负责人: Steven Feiner
• 金额: $ 17.24万
• 依托单位: Columbia University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2021
• 资助国家: 美国
• 起止时间: 2021-05-15 至 2024-04-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2051053&HistoricalAwards=false
• 关键词: REU; Site; Collaborative; Making; Augmented

Augmented and virtual reality (XR) technologies are becoming popular consumer products. However, at present XR devices, development tools, and content pose major accessibility challenges for people with disabilities. How can you describe a 3D virtual environment to a person with a visual impairment? How should you present captions in 3D to a person who is hard-of-hearing? How can a person with a motor control disability navigate a 3D world? This REU Site brings together Profs. Shiri Azenkot and Brian Smith, experts in accessibility, along with Prof. Steven Feiner, an augmented reality and 3D interaction pioneer. The site will train students to be future leaders in XR accessibility. Students will receive training in accessibility and XR, engage in the research process from ideation to presentations, and join a community of scholars and practitioners who will provide career advice and mentorship. In addition, the projects undertaken by REU students will form the basis for new collaborations among the investigators and other collaborators at Columbia and Cornell. The site will recruit students from underrepresented backgrounds, especially students with disabilities. The target is to have a mixed-ability cohort where half the students have a disability and half do not. Students will participate in a range of formal and informal learning, including an XR development "bootcamp," conversations with XR experts across academia and industry, and presentations on their work progress. Students will work on projects at the intersection of accessibility and XR. Examples of possible projects include designing descriptions that provide overviews of virtual environments for people who are blind and designing effective navigation techniques in a virtual environment, also for people who are blind. The broader impacts of this proposal are two-fold. First, it supports the NSF’s mission of broadening participation by focusing recruitment efforts on students from underrepresented groups, especially students with disabilities. Second, the focus of the research will benefit people with disabilities around the world. As XR becomes an increasingly popular consumer platform, the REU research will help ensure that it provides an equal user experience to people regardless of their disability status.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

增强和虚拟现实（XR）技术正在成为流行的消费产品。然而，目前XR设备、开发工具和内容对残疾人构成了重大的可访问性挑战。如何向有视觉障碍的人描述3D虚拟环境？您应该如何向重听人呈现3D字幕？运动控制障碍的人如何在3D世界中导航？ 本网站汇集了教授。Shiri Azenkot和Brian Smith，无障碍专家，沿着Steven Feiner教授，增强现实和3D交互先驱。该网站将培养学生成为XR可访问性的未来领导者。学生将接受无障碍和XR的培训，参与从构思到演示的研究过程，并加入学者和从业者的社区，他们将提供职业建议和指导。此外，REU学生开展的项目将成为哥伦比亚和康奈尔大学研究人员和其他合作者之间新合作的基础。该网站将招收来自代表性不足背景的学生，特别是残疾学生。目标是建立一个能力混合的群体，其中一半学生有残疾，一半没有残疾。学生将参加一系列正式和非正式的学习，包括XR开发“训练营”，与学术界和工业界的XR专家进行对话，以及介绍他们的工作进展。学生将在可访问性和XR的交叉点的项目工作。可能的项目包括为盲人设计提供虚拟环境概述的描述，以及在虚拟环境中为盲人设计有效的导航技术。这一提议的广泛影响是双重的。首先，它支持国家科学基金会扩大参与的使命，将招生工作的重点放在代表性不足的群体的学生，特别是残疾学生。第二，研究的重点将使世界各地的残疾人受益。随着XR成为越来越受欢迎的消费者平台，REU的研究将有助于确保它为残疾人提供平等的用户体验，无论他们的残疾状况如何。该奖项反映了NSF的法定使命，并通过使用基金会的智力价值和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

Towards Accessible Sports Broadcasts for Blind and Low-Vision Viewers

为盲人和弱视观众提供无障碍体育广播

• DOI: 10.1145/3544549.3585610
• 发表时间: 2023
• 期刊: Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems
• 作者: Jain, Gaurav;Hindi, Basel;Courtien, Connor;Wyrick, Conrad;Xu, Xin Yi;Malcolm, Michael C;Smith, Brian A.
• 通讯作者: Smith, Brian A.

Uncovering Visually Impaired Gamers’ Preferences for Spatial Awareness Tools Within Video Games

揭示视障游戏玩家对视频游戏中空间感知工具的偏好

• DOI: 10.1145/3517428.3544802
• 发表时间: 2022
• 期刊: Proceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility
• 作者: Nair, Vishnu;Ma, Shao-en;Gonzalez Penuela, Ricardo E.;He, Yicheng;Lin, Karen;Hayes, Mason;Huddleston, Hannah;Donnelly, Matthew;Smith, Brian A.
• 通讯作者: Smith, Brian A.

Towards a Generalized Acoustic Minimap for Visually Impaired Gamers

为视障玩家打造通用声学小地图

• DOI: 10.1145/3474349.3480177
• 发表时间: 2021
• 期刊: UIST '21: The Adjunct Publication of the 34th Annual ACM Symposium on User Interface Software and Technology
• 作者: Nair, Vishnu;Ma, Shao-en;Huddleston, Hannah;Lin, Karen;Hayes, Mason;Donnelly, Matthew;Gonzalez, Ricardo E;He, Yicheng;Smith, Brian A.
• 通讯作者: Smith, Brian A.