CHS: Medium: Collaborative Research: Augmented Reality Agents with Pervasive Awareness, Appearance, and Abilities

CHS：媒介：协作研究：具有普遍意识、外观和能力的增强现实代理

• 批准号: 1800961
• 负责人: Gregory Welch
• 金额: $ 67.43万
• 依托单位: The University of Central Florida Board of Trustees
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2018
• 资助国家: 美国
• 起止时间: 2018-08-15 至 2024-07-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1800961&HistoricalAwards=false
• 关键词: CHS; Medium; Collaborative; Research; Augmented

Voice-based assistants that respond to commands of people can be thought of as virtual companions that are always standing by to play music, tell us the weather, turn the lights off, etc. While their powers to respond and act on our behalf are increasing, unlike real companions they are largely unaware of our presence, take little initiative, look like appliances rather than interaction partners, and have limited abilities to both respond to queries and to sense and control real objects around us. This project will develop Augmented Reality Agents (ARAs) to embody these voice-based assistants, making them more are aware of our appearance, emotions, and behaviors, giving dynamic visual representations that make us aware of their state and behaviors; and leveraging the growth in "Internet of Things" (IoT) infrastructure and devices to increase the breadth and depth of their awareness. Together, these advances will lead to more effective and accepted voice-based assistants, both in the home and beyond. Such ARAs have a number of potential applications, including healthcare (by increasing the realism of clinical simulation and training, or providing support for caregiving through remote communication and virtual companionship) and education (by being more engaging tutors or representing historically important individuals). To develop embodied Augmented Reality Agents (ARAs) with pervasive contextual awareness, appearance, and abilities the researchers will undertake a program of research aimed at the nexus of concepts and technologies associated with Augmented Reality (AR), Intelligent Virtual Agents (IVA), and the Internet of Things (IoT). To maximize the expected knowledge outcomes the researchers have organized their plans into three categories. First, they will develop new understanding of and priorities for ARA awareness, appearance, and abilities in a manner that does not require, nor depend on, a specific technological realization of automated behaviors. Second, they will use off-the-shelf and custom components to realize pervasive ARA functionality, to facilitate formative experiments related to basic ARA behaviors, and develop domain-specific applications and experiments. Third, the researchers will use application-specific realizations to assess the potential usefulness related to companionship and two areas of healthcare training: pediatric patient simulators and wide-area team-based medical training. The healthcare-focused work will leverage relevant courses at UF and UCF, and UCF's NSF REU center on the Internet of Things to engage students beyond their core team, in meaningful research.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

对人们的指令做出反应的语音助手可以被认为是虚拟的伴侣，它们总是站在旁边播放音乐，告诉我们天气，关灯等等。虽然它们代表我们做出反应和行动的能力正在增强，但与真正的同伴不同，它们在很大程度上不知道我们的存在，很少采取主动，看起来更像设备而不是互动伙伴，而且在回应询问和感知和控制我们周围真实物体方面的能力有限。该项目将开发增强现实代理（ARAs）来体现这些基于语音的助手，使它们更加了解我们的外表、情绪和行为，并提供动态的视觉表现，使我们了解它们的状态和行为；并利用“物联网”（IoT）基础设施和设备的增长来提高他们意识的广度和深度。总之，这些进步将带来更有效、更容易被接受的语音助手，无论是在家里还是在外面。这样的ARAs有许多潜在的应用，包括医疗保健（通过增加临床模拟和培训的现实性，或通过远程通信和虚拟陪伴为护理提供支持）和教育（通过成为更有吸引力的导师或代表历史上重要的个人）。为了开发具有普遍上下文感知、外观和能力的具体增强现实代理（ara），研究人员将开展一项研究计划，旨在将增强现实（AR）、智能虚拟代理（IVA）和物联网（IoT）相关的概念和技术联系起来。为了最大限度地提高预期的知识成果，研究人员将他们的计划分为三类。首先，他们将以一种不需要也不依赖于自动化行为的特定技术实现的方式，开发对ARA感知、外观和能力的新理解和优先级。其次，他们将使用现成的和定制的组件来实现普遍的ARA功能，促进与基本ARA行为相关的形成性实验，并开发特定领域的应用程序和实验。第三，研究人员将使用特定应用实现来评估与陪伴和两个医疗保健培训领域相关的潜在有用性：儿科患者模拟器和广域团队医疗培训。这项以医疗保健为重点的工作将利用佛罗里达大学和UCF的相关课程，以及UCF的NSF REU物联网中心，让核心团队以外的学生参与有意义的研究。该奖项反映了美国国家科学基金会的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

Physical-Virtual Agents for Healthcare Simulation

用于医疗保健模拟的物理虚拟代理

• DOI: 10.1145/3267851.3267876
• 发表时间: 2018
• 期刊: International Conference on Intelligent Virtual Agents
• 作者: Daher, Salam;Hochreiter, Jason;Norouzi, Nahal;Gonzalez, Laura;Bruder, Gerd;Welch, Greg
• 通讯作者: Welch, Greg

Perceived Humanness Bias in Additive Light Model Displays

附加光模型显示中感知到的人性偏差

• 发表时间: 2022
• 期刊: Journal of vision
• 影响因子: 1.8
• 作者: Erickson, Austin;Bruder, Gerd;Welch, Gregory;Bynum, Isaac;Peck, Tabitha;Good, Jessica
• 通讯作者: Good, Jessica

Effects of Depth Information on Visual Target Identification Task Performance in Shared Gaze Environments

共享注视环境中深度信息对视觉目标识别任务表现的影响

• DOI: 10.1109/tvcg.2020.2973054
• 发表时间: 2020
• 期刊: IEEE Transactions on Visualization and Computer Graphics
• 影响因子: 5.2
• 作者: Erickson, Austin;Norouzi, Nahal;Kim, Kangsoo;LaViola, Joseph J.;Bruder, Gerd;Welch, Gregory F.
• 通讯作者: Welch, Gregory F.

Analysis of the Saliency of Color-Based Dichoptic Cues in Optical See-Through Augmented Reality

• DOI: 10.1109/tvcg.2022.3195111
• 发表时间: 2023-12-01
• 期刊: IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS
• 影响因子: 5.2
• 作者: Erickson，Austin;Bruder，Gerd;Welch，Gregory F.
• 通讯作者: Welch，Gregory F.

The advantages of virtual dogs over virtual people: Using augmented reality to provide social support in stressful situations

虚拟狗相对于虚拟人的优势：利用增强现实在压力情况下提供社交支持

• DOI: 10.1016/j.ijhcs.2022.102838
• 发表时间: 2022
• 期刊: International Journal of Human-Computer Studies
• 影响因子: 5.4
• 作者: Norouzi, Nahal;Kim, Kangsoo;Bruder, Gerd;Bailenson, Jeremy N.;Wisniewski, Pamela;Welch, Gregory F.
• 通讯作者: Welch, Gregory F.