CAREER: Making Digital Imagery Accessible to Blind and Low-Vision Users via Audiohaptic Dioramas
职业:通过视听立体模型让盲人和弱视用户可以访问数字图像
基本信息
- 批准号:2339788
- 负责人:
- 金额:$ 79.84万
- 依托单位:
- 依托单位国家:美国
- 项目类别:Continuing Grant
- 财政年份:2024
- 资助国家:美国
- 起止时间:2024-06-01 至 2029-05-31
- 项目状态:未结题
- 来源:
- 关键词:
项目摘要
Blind and low-vision people are largely left out of visual experiences on computers, affecting many aspects of daily life such as navigating, shopping, reading the news, and staying in touch with friends. Computers currently convey images to blind users via simple text descriptions, which does not allow users to form their own interpretations. This project seeks to enhance the quality of life for blind people by introducing the concept of audiohaptic dioramas, which allows users to learn what things look like in a way similar to real life: by exploring objects' three-dimensional structure via touch, gleaning physical details such as depth, shape, and material. Audiohaptic dioramas will work with everyday touchscreens, allowing blind users to touch or point at an image and sense its physical details via intuitive audio and haptic cues. This technology will give blind people greater access to images, films, video games, virtual reality, and the Web. The investigator will partner with leading technology companies to make audiohaptic dioramas available on mainstream consumer apps. The project's educational component will make K-12 textbooks accessible to blind students by supplementing printed images with audiohaptic dioramas. It will also train blind students to become technology designers, a field hard to enter without sight, catalyzing future efforts to make technology more inclusive.This research program advances a decades-long problem in accessibility research: understanding how to make images equivalently accessible to blind users. Through the concept of audiohaptic dioramas, this research will contribute the first techniques for conveying physical details of three-dimensional scenes via sound and haptics in a way that is compatible with everyday touchscreen devices. The research program will follow a user-centered design and evaluation process to ensure that blind users’ needs are met, involving blind community and lab members throughout and partnering with blind-serving organizations. This project will lead to several scientific contributions: (1) a framework for conveying still images’ depth, shape, material, and color intuitively via sound and haptics on a per-pixel basis as users explore them on a touchscreen; (2) techniques for enabling blind people to independently perform everyday visual tasks such as navigation, finding a building entrance, or finding a specific color shirt using their smartphone camera or smartglasses; and (3) techniques for enabling blind people to visualize interactive virtual environments from video games and virtual reality.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
盲人和低视力人群在很大程度上被排除在计算机视觉体验之外,影响日常生活的许多方面,如导航,购物,阅读新闻以及与朋友保持联系。目前,计算机通过简单的文本描述向盲人用户传达图像,这不允许用户形成自己的解释。该项目旨在通过引入视听立体模型的概念来提高盲人的生活质量,使用户能够以类似于真实的生活的方式了解事物的外观:通过触摸探索物体的三维结构,收集深度,形状和材料等物理细节。听觉触觉立体模型将与日常触摸屏一起使用,允许盲人用户触摸或指向图像,并通过直观的音频和触觉提示感知其物理细节。这项技术将使盲人更容易获得图像、电影、视频游戏、虚拟现实和网络。调查人员将与领先的技术公司合作,在主流消费者应用程序上提供音频触觉立体模型。该项目的教育部分将使盲人学生能够使用K-12教科书,用视听立体模型补充印刷图像。它还将培养盲人学生成为技术设计师,这是一个没有视力很难进入的领域,催化未来努力使技术更具包容性。该研究计划推进了无障碍研究中长达数十年的问题:了解如何使图像对盲人用户具有同等的可访问性。通过audiohaptic立体模型的概念,这项研究将有助于通过声音和触觉传达三维场景的物理细节的第一种技术,与日常的触摸屏设备兼容。该研究计划将遵循以用户为中心的设计和评估过程,以确保盲人用户的需求得到满足,涉及盲人社区和实验室成员,并与盲人服务组织合作。该项目将带来几项科学贡献:(1)当用户在触摸屏上探索静态图像时,通过声音和触觉以像素为基础直观地传达静态图像的深度,形状,材料和颜色的框架;(2)使盲人能够独立完成日常视觉任务的技术,例如导航,寻找建筑物入口,或使用智能手机摄像头或智能眼镜找到特定颜色的衬衫;以及(3)使盲人能够从视频游戏和虚拟现实中可视化交互式虚拟环境的技术。该奖项反映了NSF的法定使命,并通过使用基金会的学术价值和更广泛的影响审查标准。
项目成果
期刊论文数量(0)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)
数据更新时间:{{ journalArticles.updateTime }}
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
数据更新时间:{{ journalArticles.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ monograph.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ sciAawards.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ conferencePapers.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ patent.updateTime }}
Brian Smith其他文献
Towards A Data Centric System Architecture: SHARP
迈向以数据为中心的系统架构:SHARP
- DOI:
- 发表时间:
2017 - 期刊:
- 影响因子:0
- 作者:
R. Graham;Gil Bloch;Devendar Bureddy;G. Shainer;Brian Smith - 通讯作者:
Brian Smith
Capture and visualization of live Mycobacterium tuberculosis bacilli from tuberculosis bioaerosols
从结核生物气溶胶中捕获活结核杆菌并进行可视化
- DOI:
- 发表时间:
2019 - 期刊:
- 影响因子:0
- 作者:
R. Dinkele;S. Gessner;A. Koch;C. Morrow;M. Gqada;M. Kamariza;C. Bertozzi;Brian Smith;Courtney McLoud;A. Kamholz;W. Bryden;C. Call;V. Mizrahi;R. Wood;D. Warner - 通讯作者:
D. Warner
Usage and usefulness of technical software documentation: An industrial case study
技术软件文档的用法和有用性:工业案例研究
- DOI:
10.1016/j.infsof.2014.08.003 - 发表时间:
2015 - 期刊:
- 影响因子:0
- 作者:
Golara Garousi;V. Garousi;G. Ruhe;Junji Zhi;M. Moussavi;Brian Smith - 通讯作者:
Brian Smith
Using simulation to teach lean methodologies and the benefits for Millennials
使用模拟来教授精益方法以及对千禧一代的好处
- DOI:
10.1080/14783363.2017.1303330 - 发表时间:
2019 - 期刊:
- 影响因子:3.9
- 作者:
R. Burch V.;Brian Smith - 通讯作者:
Brian Smith
Brian Smith的其他文献
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
{{ truncateString('Brian Smith', 18)}}的其他基金
QuSeC-TAQS: Distributed Entangled Quantum-Enhanced Interferometric Imaging for Telescopy and Metrology
QuSeC-TAQS:用于望远镜和计量的分布式纠缠量子增强干涉成像
- 批准号:
2326803 - 财政年份:2023
- 资助金额:
$ 79.84万 - 项目类别:
Standard Grant
Multimode Continuous-Variable Quantum Optics for Precision Sensing
用于精密传感的多模连续可变量子光学器件
- 批准号:
2207767 - 财政年份:2022
- 资助金额:
$ 79.84万 - 项目类别:
Continuing Grant
Reversible modification of methionine as a mechanism to regualte protein function in the mitochondrion and secretory pathway
蛋氨酸的可逆修饰作为调节线粒体和分泌途径中蛋白质功能的机制
- 批准号:
BB/V001183/1 - 财政年份:2021
- 资助金额:
$ 79.84万 - 项目类别:
Research Grant
Temporal Multimode Transformations for Quantum Information Science
量子信息科学的时态多模变换
- 批准号:
2112900 - 财政年份:2021
- 资助金额:
$ 79.84万 - 项目类别:
Standard Grant
QuIC-TAQS: Implementation of a Neutral-Atom-Photonic-Cluster State
QuIC-TAQS:中性原子光子团簇态的实现
- 批准号:
2138068 - 财政年份:2021
- 资助金额:
$ 79.84万 - 项目类别:
Continuing Grant
CRCNS US-France Research Proposal: Collaborative Research: Encoding reward expectation in Drosophilia
CRCNS 美国-法国研究提案:合作研究:编码果蝇奖励期望
- 批准号:
2113179 - 财政年份:2021
- 资助金额:
$ 79.84万 - 项目类别:
Standard Grant
Collaborative Research: All Birds: A Time-scaled Avian Tree From Integrated Phylogenomic and Fossil Data
合作研究:所有鸟类:来自综合系统基因组和化石数据的时间尺度鸟类树
- 批准号:
1655736 - 财政年份:2017
- 资助金额:
$ 79.84万 - 项目类别:
Standard Grant
Collaborative Research: Mapping and Tracking Conformational Control of Nitric Oxide Synthase Activation
合作研究:绘制和跟踪一氧化氮合酶激活的构象控制
- 批准号:
1708829 - 财政年份:2017
- 资助金额:
$ 79.84万 - 项目类别:
Continuing Grant
Temporal-Spectral Multimode Photonics for Quantum Information Science
用于量子信息科学的时谱多模光子学
- 批准号:
1620822 - 财政年份:2016
- 资助金额:
$ 79.84万 - 项目类别:
Continuing Grant
Ideas Lab Collaborative Research: Using Natural Odor Stimuli to Crack the Olfactory Code
创意实验室合作研究:利用自然气味刺激破解嗅觉密码
- 批准号:
1556337 - 财政年份:2015
- 资助金额:
$ 79.84万 - 项目类别:
Continuing Grant
相似国自然基金
Scalable Learning and Optimization: High-dimensional Models and Online Decision-Making Strategies for Big Data Analysis
- 批准号:
- 批准年份:2024
- 资助金额:万元
- 项目类别:合作创新研究团队
相似海外基金
Cultivating digital music making in regional Australia
培育澳大利亚乡村地区的数字音乐制作
- 批准号:
DP240100680 - 财政年份:2024
- 资助金额:
$ 79.84万 - 项目类别:
Discovery Projects
USING DIGITAL TOOLS TO IMPROVE DECISION MAKING AROUND LIVESTOCK DISEASE IN LOW RESOURCE SETTINGS
使用数字工具改善资源匮乏地区牲畜疾病的决策
- 批准号:
2883476 - 财政年份:2023
- 资助金额:
$ 79.84万 - 项目类别:
Studentship
DECIDE: Decoding cities for informed decision-making: a digital twin approach for minoring territorial disparities and enhancing urban liveability
决策:解码城市以做出明智的决策:缩小地域差距和提高城市宜居性的数字孪生方法
- 批准号:
EP/Y028716/1 - 财政年份:2023
- 资助金额:
$ 79.84万 - 项目类别:
Fellowship
Real-time digital optimisation and decision making for energy and transport systems
能源和运输系统的实时数字优化和决策
- 批准号:
EP/Y004930/1 - 财政年份:2023
- 资助金额:
$ 79.84万 - 项目类别:
Research Grant
Real-time digital optimisation and decision making for energy and transport systems
能源和运输系统的实时数字优化和决策
- 批准号:
EP/Y004841/1 - 财政年份:2023
- 资助金额:
$ 79.84万 - 项目类别:
Research Grant
"i-agree": An innovative platform that provides confirmation of informed consent when making digital contracts preventing costly and lengthy disputes
“i-agree”:一个创新平台,在制定数字合同时提供知情同意确认,防止代价高昂且漫长的纠纷
- 批准号:
10075329 - 财政年份:2023
- 资助金额:
$ 79.84万 - 项目类别:
Collaborative R&D
Making digital health work for excluded populations: a companion app for an AI medical device specifically designed for the most vulnerable heart failure patients
让数字健康服务于被排斥的人群:专为最脆弱的心力衰竭患者设计的人工智能医疗设备配套应用程序
- 批准号:
10055529 - 财政年份:2023
- 资助金额:
$ 79.84万 - 项目类别:
Grant for R&D
Real-time Digital Optimisation And Decision Making For Energy And Transport Systems
能源和运输系统的实时数字优化和决策
- 批准号:
EP/Y004450/1 - 财政年份:2023
- 资助金额:
$ 79.84万 - 项目类别:
Research Grant
A digital ontology for human-centred decision-making in a circular built environment
循环建筑环境中以人为本决策的数字本体
- 批准号:
2868627 - 财政年份:2023
- 资助金额:
$ 79.84万 - 项目类别:
Studentship
Measuring life quality from digital footprints for informed policy decision making
通过数字足迹衡量生活质量,以做出明智的政策决策
- 批准号:
2884749 - 财政年份:2023
- 资助金额:
$ 79.84万 - 项目类别:
Studentship