CHS: Small: Collaborative Research: 3D Audio Augmentation for Limited Field of View Augmented Reality Systems for Medical Training
CHS:小型:协作研究:用于有限视场的 3D 音频增强医疗培训增强现实系统
基本信息
- 批准号:1718085
- 负责人:
- 金额:$ 29.97万
- 依托单位:
- 依托单位国家:美国
- 项目类别:Standard Grant
- 财政年份:2017
- 资助国家:美国
- 起止时间:2017-09-01 至 2024-02-29
- 项目状态:已结题
- 来源:
- 关键词:
项目摘要
Medical task simulators can provide a safe, affordable, and repeatable environment in which practitioners can rehearse procedures without impacting patient safety. Augmented reality (AR) is therefore the ideal display technology in this field, allowing the user to directly interact and practice skills within a natural environment. But current AR displays typically have a narrow field of view (FOV), which makes it difficult for users to immediately attend to an object outside of their periphery. This research will employ 3D audio to overcome that challenge. As a benefit to other AR and medical researchers, the system itself and other materials created for the present work (design, implementation, and tutorials) will be openly available on the project's website for all to use, modify, and contribute, and an open-source community will be created to link users and researchers who have similar interests as the present work. Undergraduate, women, and minority students will be engaged in all project activities through the Distributed Research Experiences for Undergraduates (DREU) program of the NSF-funded iAAMCS (Institute for African-American Mentoring in Computing Sciences), as well as the PI's courses on 3D sound design. Results will also be disseminated at relevant conference venues. The present work will advance research relating to the use of 3D audio for cueing in narrow FOV contexts, thereby improving interaction in large AR environments, and will create generalizable best-practices that lead to successful experiences when using AR devices. 
This research will develop the tools, methods, and infrastructure to evaluate how 3D sound can be used to enhance AR. This area of research is increasingly important, because as virtual reality (VR) and AR systems become more commonplace, it is imperative to design tools to overcome device limitations. The practical application of the proposed work will be realized through the evaluation of an AR-based prostate biopsy training procedure that will capture and reconstruct a full surgical procedure, with at least 3 dynamic participants in very close proximity. The project will pursue three main themes: (1) Infrastructure Development - The PIs and team will develop an extensible open-source software system that allows users to test their desired sound mappings; (2) Sound Mapping Quantification - Although sound has been used to convey spatial information in numerous contexts, the appropriate strategy for mapping periphery information to spatial sound attributes has not yet been determined, so the PIs propose a series of user studies to determine the mappings that most successfully help a user to attend to a target outside of their FOV; (3) Practical Application - To assess how well the proposed solution mitigates the challenge of a narrow FOV, a user study will be conducted to determine how the addition of 3D audio affects participants learning to perform the steps of a prostate biopsy procedure.
医疗任务模拟器可以提供一个安全,负担得起的,可重复的环境,从业者可以排练程序,而不会影响病人的安全。 因此,增强现实(AR)是该领域的理想显示技术,允许用户在自然环境中直接交互和练习技能。 但目前的AR显示器通常具有狭窄的视场(FOV),这使得用户难以立即注意到其外围之外的对象。 这项研究将使用3D音频来克服这一挑战。 作为其他AR和医学研究人员的利益,系统本身和为当前工作创建的其他材料(设计,实现和教程)将在项目网站上公开提供,供所有人使用,修改和贡献,并将创建一个开源社区,以链接与当前工作有相似兴趣的用户和研究人员。 本科生,女性和少数民族学生将通过NSF资助的iAAMCS(非裔美国人计算机科学导师研究所)的本科生分布式研究经验(DREU)计划以及PI的3D声音设计课程参与所有项目活动。 还将在有关会议地点传播结果。 目前的工作将推进与在窄FOV环境中使用3D音频进行提示相关的研究,从而改善大型AR环境中的交互,并将创建可推广的最佳实践,从而在使用AR设备时获得成功体验。 
这项研究将开发工具,方法和基础设施,以评估如何使用3D声音来增强AR。 这一研究领域越来越重要,因为随着虚拟现实(VR)和AR系统变得越来越普遍,设计工具来克服设备限制势在必行。 拟议工作的实际应用将通过评估基于AR的前列腺活检培训程序来实现,该程序将捕获和重建完整的外科手术,至少有3名动态参与者非常接近。 该项目将遵循三个主题:(1)基础设施开发-PI和团队将开发一个可扩展的开放源代码软件系统,允许用户测试他们想要的声音映射;(2)声音映射量化-尽管声音已被用于在许多上下文中传达空间信息,但尚未确定用于将外围信息映射到空间声音属性的适当策略,因此,PI提出了一系列用户研究,以确定最成功地帮助用户关注其FOV之外的目标的映射;(3)实际应用-为了评估所提出的解决方案如何很好地减轻窄FOV的挑战,将进行用户研究,以确定3D音频的添加如何影响学习执行前列腺活检过程的步骤的参与者。
项目成果
期刊论文数量(2)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)
Computation of Head-Related Transfer Functions Using Graphics Processing Units and a Pereptual Validation of the Computed HRTFs against Measured HRTFs
使用图形处理单元计算与头部相关的传递函数,并对计算的 HRTF 与测量的 HRTF 进行感知验证
- DOI:
- 发表时间:2019
- 期刊:
- 影响因子:0
- 作者:Fan, Z;Arce, T;Zhang, K;Wu, T. W.;McMullen, K
- 通讯作者:McMullen, K
The Corsi Block-Tapping Test: Evaluating methodological practices with an eye towards modern digital frameworks
- DOI:10.1016/j.chbr.2021.100099
- 发表时间:2021-08-01
- 期刊:
- 影响因子:0
- 作者:Arce, Terek;McMullen, Kyla
- 通讯作者:McMullen, Kyla
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
数据更新时间:{{ journalArticles.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ monograph.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ sciAawards.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ conferencePapers.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ patent.updateTime }}
Kyla McMullen其他文献
Kyla McMullen的其他文献
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
{{ truncateString('Kyla McMullen', 18)}}的其他基金
CAREER: Audio RESCUE: Realistic Audio for RESponders in Complex Undetermined Environments
职业:音频救援:在复杂的不确定环境中为响应者提供逼真的音频
- 批准号:
1845324 - 财政年份:2019
- 资助金额:
$ 29.97万 - 项目类别:
Continuing Grant
Collaborative Research: Human-Centered Computing Scholars: Need-based, Extensive Support Through Degree Completion
协作研究:以人为本的计算学者:通过学位完成提供基于需求的广泛支持
- 批准号:
1833908 - 财政年份:2019
- 资助金额:
$ 29.97万 - 项目类别:
Standard Grant
相似国自然基金
昼夜节律性small RNA在血斑形成时间推断中的法医学应用研究
- 批准号:
- 批准年份:2024
- 资助金额:0.0 万元
- 项目类别:省市级项目
tRNA-derived small RNA上调YBX1/CCL5通路参与硼替佐米诱导慢性疼痛的机制研究
- 批准号:n/a
- 批准年份:2022
- 资助金额:10.0 万元
- 项目类别:省市级项目
Small RNA调控I-F型CRISPR-Cas适应性免疫性的应答及分子机制
- 批准号:32000033
- 批准年份:2020
- 资助金额:24.0 万元
- 项目类别:青年科学基金项目
Small RNAs调控解淀粉芽胞杆菌FZB42生防功能的机制研究
- 批准号:31972324
- 批准年份:2019
- 资助金额:58.0 万元
- 项目类别:面上项目
变异链球菌small RNAs连接LuxS密度感应与生物膜形成的机制研究
- 批准号:81900988
- 批准年份:2019
- 资助金额:21.0 万元
- 项目类别:青年科学基金项目
基于small RNA 测序技术解析鸽分泌鸽乳的分子机制
- 批准号:31802058
- 批准年份:2018
- 资助金额:26.0 万元
- 项目类别:青年科学基金项目
肠道细菌关键small RNAs在克罗恩病发生发展中的功能和作用机制
- 批准号:31870821
- 批准年份:2018
- 资助金额:56.0 万元
- 项目类别:面上项目
Small RNA介导的DNA甲基化调控的水稻草矮病毒致病机制
- 批准号:31772128
- 批准年份:2017
- 资助金额:60.0 万元
- 项目类别:面上项目
基于small RNA-seq的针灸治疗桥本甲状腺炎的免疫调控机制研究
- 批准号:81704176
- 批准年份:2017
- 资助金额:20.0 万元
- 项目类别:青年科学基金项目
水稻OsSGS3与OsHEN1调控small RNAs合成及其对抗病性的调节
- 批准号:91640114
- 批准年份:2016
- 资助金额:85.0 万元
- 项目类别:重大研究计划
相似海外基金
CHS: Small: Collaborative Research: Validating and Communiciating Model-Based Approaches for Data Visualization Ability Assessment
CHS:小型:协作研究:验证和交流基于模型的数据可视化能力评估方法
- 批准号:
2120750 - 财政年份:2020
- 资助金额:
$ 29.97万 - 项目类别:
Continuing Grant
CHS: Small: Collaborative Research: Shared Mobility Systems to Address Transportation Barriers of Underserved Urban and Rural Communities
CHS:小型:合作研究:共享出行系统,解决服务不足的城乡社区的交通障碍
- 批准号:
1910281 - 财政年份:2020
- 资助金额:
$ 29.97万 - 项目类别:
Standard Grant
CHS: Small: Collaborative Research: Optimizing the Human-Machine System for Citizen Science
CHS:小型:协作研究:优化公民科学的人机系统
- 批准号:
2006400 - 财政年份:2020
- 资助金额:
$ 29.97万 - 项目类别:
Continuing Grant
CHS: Small: Collaborative Research:Dynamic Computer-Aided Machining: Supporting Interactive Workflows for Digital Fabrication and Manufacturing
CHS:小型:协作研究:动态计算机辅助加工:支持数字制造和制造的交互式工作流程
- 批准号:
2007045 - 财政年份:2020
- 资助金额:
$ 29.97万 - 项目类别:
Continuing Grant
CHS: Small: Collaborative Research: Learning Maker Skills By Building Game Props
CHS:小型:协作研究:通过构建游戏道具来学习创客技能
- 批准号:
2008028 - 财政年份:2020
- 资助金额:
$ 29.97万 - 项目类别:
Standard Grant
CHS: Small: Collaborative Research: Catalyzing Youth Civic Engagement Through Innovations in Social Computing
CHS:小型:合作研究:通过社会计算创新促进青年公民参与
- 批准号:
2054741 - 财政年份:2020
- 资助金额:
$ 29.97万 - 项目类别:
Continuing Grant
CHS: Small: Collaborative Research: Optimizing the Human-Machine System for Citizen Science
CHS:小型:协作研究:优化公民科学的人机系统
- 批准号:
2006894 - 财政年份:2020
- 资助金额:
$ 29.97万 - 项目类别:
Continuing Grant
CHS: SMALL: Collaborative Research: Adaptive Development Environments: Modeling and Supporting Cognitive Styles of Software Developers
CHS:SMALL:协作研究:自适应开发环境:建模和支持软件开发人员的认知风格
- 批准号:
2008089 - 财政年份:2020
- 资助金额:
$ 29.97万 - 项目类别:
Standard Grant
CHS: Small: Collaborative Research: Learning Maker Skills By Building Game Props
CHS:小型:协作研究:通过构建游戏道具来学习创客技能
- 批准号:
2008116 - 财政年份:2020
- 资助金额:
$ 29.97万 - 项目类别:
Standard Grant
CHS: Small: Collaborative Research: Articulate+ - A Conversational Interface for Democr atizing Visual Analysis
CHS:小型:协作研究:Articulate - 用于民主化视觉分析的对话界面
- 批准号:
2007257 - 财政年份:2020
- 资助金额:
$ 29.97万 - 项目类别:
Continuing Grant