HCC: Small: Super Reality -- Immersive Visual Interfaces with No Line-of-Sight Restriction

HCC:小:超现实——无视线限制的沉浸式视觉界面

基本信息

  • 批准号:
    2219842
  • 负责人:
  • 金额:
    $ 25万
  • 依托单位:
  • 依托单位国家:
    美国
  • 项目类别:
    Standard Grant
  • 财政年份:
    2022
  • 资助国家:
    美国
  • 起止时间:
    2022-10-01 至 2024-09-30
  • 项目状态:
    已结题

项目摘要

The project develops Super Reality, a new class of human-computer visual interfaces designed for efficient and effective 3D dataset exploration. Super Reality (SR) interfaces build upon conventional virtual reality interfaces, preserving their benefits of immersion, intuitiveness, and depth cues, while radically increasing the information bandwidth of the images shown to the user. SR interfaces let the user see more of the dataset from the current location by removing the line-of-sight restriction of conventional virtual reality interfaces. The user sees not only the regions of the dataset that are visible from the current viewpoint, but also regions that are hidden behind occluders. The user can preview an occluded dataset region from the current position, without having to navigate around occluders, thereby avoiding the wasted navigation when the occluded region proves to be of no interest. The user can compare distant dataset regions directly, in the same image, without having to rely on the memory of dataset regions seen earlier. With a SR interface, the user explores the dataset in parallel, from multiple viewpoints, but without the burden of a complex visualization interface based on a matrix of conventional images. Through the leap-forward increase of 3D dataset exploration efficiency and effectiveness, this project will lead to a foundational level innovation influencing the domains where data visualization is used. This SR interface has the potential to minimize user disorientation and cybersickness, which are triggered by mismatched user motion and user visual perception in the traditional virtual reality interfaces. The project will be carried out by involving a diverse group of undergraduate students in research.The goal of the project is the design and development of Super Reality (SR) interfaces that will remove the line-of-sight restriction through a generalization of the computational camera that projects the 3D dataset onto the 2D image plane. The linear rays of conventional cameras are replaced with curved rays that are routed around occluders to connect the user to dataset regions of interest. Super Reality interfaces essentially dispatch a team of virtual subordinate users that each image the dataset from their own viewpoint and present the user with an integration of the data captured from the multiple viewpoints. These integrated images are constructed to meet multiple design requirements: (a) image continuity, by bounding the difference between trajectories of neighboring rays; (b) image non-redundancy, by avoiding ray intersections; (c) adaptive image resolution, by routing more rays towards dataset regions of higher complexity or importance; (d) in-place disocclusion, by projecting the disoccluded region where the user would see it in the absence of the occluder; (e) minimal image distortion, by limiting the curvature of the non-linear rays; fast rendering, by designing the generalized cameras with a fast projection operation. The SR interfaces will be designed to render the part of these integrated images close to the user with the conventional, first-person view. This way, the part of the frame that corresponds to nearby geometry responds to the user’s view changes as the user expects, anchoring the user to avoid disorientation and cybersickness. Also, SR interface limits the number of degrees of freedom the user needs to manipulate in order to deploy and retract the desired disocclusion effects. The Super Reality interfaces are iteratively refined and validated in controlled user studies based on objective and subjective metrics that quantify the degree to which the design requirements are met, as well as the efficiency and effectiveness of 3D dataset exploration.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
该项目开发了超级现实,这是一种新的人机视觉界面,旨在高效和有效地探索3D数据集。超现实(SR)界面建立在传统虚拟现实界面的基础上,保留了沉浸感、直观性和深度提示的优势,同时从根本上增加了显示给用户的图像的信息带宽。SR界面通过消除传统虚拟现实界面的视线限制,使用户能够从当前位置看到更多数据集。用户不仅可以看到从当前视点可见的数据集区域,还可以看到隐藏在遮挡物后面的区域。用户可以从当前位置预览被遮挡的数据集区域,而不必绕过遮挡器导航,从而避免在被遮挡的区域被证明不感兴趣时浪费导航。用户可以在同一图像中直接比较遥远的数据集区域,而不必依赖于先前看到的数据集区域的记忆。通过SR界面,用户可以从多个视角并行浏览数据集,而无需承担基于传统图像矩阵的复杂可视化界面的负担。通过3D数据集勘探效率和效果的跨越式提高,该项目将导致一项基础性的创新,影响数据可视化应用领域。这种SR界面有可能最大限度地减少传统虚拟现实界面中由不匹配的用户运动和用户视觉感知引发的用户迷失方向和晕屏。该项目将通过让不同的本科生参与研究来实施。该项目的目标是设计和开发超现实(SR)界面,通过将3D数据集投影到2D图像平面上的计算相机的泛化来消除视线限制。传统相机的线性射线被曲线射线取代,曲线射线绕过遮挡器将用户连接到感兴趣的数据集区域。超现实界面本质上是派遣一组虚拟下属用户,每个用户从自己的视点对数据集进行成像,并向用户呈现从多个视点捕获的数据的集成。这些综合图像的构建是为了满足多种设计要求:(A)通过限制相邻光线的轨迹之间的差异来实现图像的连续性;(B)通过避免光线相交来实现图像的非冗余性;(C)通过将更多的光线投射到更复杂或更重要的数据集区域来实现自适应图像分辨率;(D)就地消除遮挡,方法是将错开的区域投影到用户在没有遮挡器的情况下可以看到的区域;(E)通过限制非线性光线的曲率来实现最小的图像失真;(D)通过设计具有快速投影操作的通用相机来实现快速渲染。SR界面将被设计为使用传统的第一人称视图将这些集成图像的部分呈现给用户。这样,框中与附近几何体对应的部分会像用户预期的那样响应用户的视图变化,从而锚定用户,以避免迷失方向和晕车。此外,SR界面限制了用户需要操纵的自由度数量,以便部署和收回所需的非咬合效果。超现实界面在受控用户研究中反复改进和验证,基于客观和主观指标,量化设计要求的满足程度,以及3D数据集探索的效率和有效性。该奖项反映了NSF的法定使命,并通过使用基金会的智力优势和更广泛的影响审查标准进行评估,被认为值得支持。

项目成果

期刊论文数量(1)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)
AR Interfaces for Disocclusion—A Comparative Study
{{ item.title }}
{{ item.translation_title }}
  • DOI:
    {{ item.doi }}
  • 发表时间:
    {{ item.publish_year }}
  • 期刊:
  • 影响因子:
    {{ item.factor }}
  • 作者:
    {{ item.authors }}
  • 通讯作者:
    {{ item.author }}

数据更新时间:{{ journalArticles.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ monograph.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ sciAawards.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ conferencePapers.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ patent.updateTime }}

Voicu Popescu其他文献

Fast Ray-Scene Intersection for Interactive Shadow Rendering with Thousands of Dynamic Lights
使用数千个动态灯光进行交互式阴影渲染的快速光线场景相交
A Partially-Sorted Concentric Layout for Efficient Label Localization in Augmented Reality
用于增强现实中高效标签定位的部分排序同心布局
GEARS: A General and Efficient Algorithm for Rendering Shadows
GEARS:一种通用且高效的阴影渲染算法
  • DOI:
    10.1111/cgf.12348
  • 发表时间:
    2014-09
  • 期刊:
  • 影响因子:
    2.5
  • 作者:
    Lili Wang;Shiheng Zhou;Wei Ke;Voicu Popescu
  • 通讯作者:
    Voicu Popescu
Look-over-there: Real-World Co-Located Cross-Referencing Using Augmented Reality
在那里查看:使用增强现实进行现实世界的协同定位交叉引用
  • DOI:
  • 发表时间:
    2024
  • 期刊:
  • 影响因子:
    0
  • 作者:
    Yuqi Zhou;Voicu Popescu
  • 通讯作者:
    Voicu Popescu
Quantifiable Fine-Grain Occlusion Removal Assistance for Efficient VR Exploration
可量化的细粒度遮挡去除辅助,可实现高效的 VR 探索

Voicu Popescu的其他文献

{{ item.title }}
{{ item.translation_title }}
  • DOI:
    {{ item.doi }}
  • 发表时间:
    {{ item.publish_year }}
  • 期刊:
  • 影响因子:
    {{ item.factor }}
  • 作者:
    {{ item.authors }}
  • 通讯作者:
    {{ item.author }}

{{ truncateString('Voicu Popescu', 18)}}的其他基金

Creating a High-Performance Computing Virtual Environment for Artificial Intelligence Education
为人工智能教育打造高性能计算虚拟环境
  • 批准号:
    2309564
  • 财政年份:
    2023
  • 资助金额:
    $ 25万
  • 项目类别:
    Standard Grant
Collaborative Research: CISE-MSI: DP: HCC: Buenas - Giving All a Seat at the Table Using Mixed Reality
协作研究:CISE-MSI:DP:HCC:布埃纳斯 - 使用混合现实为所有人提供席位
  • 批准号:
    2318657
  • 财政年份:
    2023
  • 资助金额:
    $ 25万
  • 项目类别:
    Standard Grant
EXP: Collaborative Research: A System of Animation Gestures for Effective Teaching Avatars
EXP:协作研究:用于有效教学头像的动画手势系统
  • 批准号:
    1217215
  • 财政年份:
    2012
  • 资助金额:
    $ 25万
  • 项目类别:
    Standard Grant
CRCD/EI: Effective Distance Learning Through Sustained Interactivity and Visual Realism
CRCD/EI:通过持续的交互性和视觉真实感实现有效的远程学习
  • 批准号:
    0417458
  • 财政年份:
    2004
  • 资助金额:
    $ 25万
  • 项目类别:
    Continuing Grant

相似国自然基金

昼夜节律性small RNA在血斑形成时间推断中的法医学应用研究
  • 批准号:
  • 批准年份:
    2024
  • 资助金额:
    0.0 万元
  • 项目类别:
    省市级项目
tRNA-derived small RNA上调YBX1/CCL5通路参与硼替佐米诱导慢性疼痛的机制研究
  • 批准号:
    n/a
  • 批准年份:
    2022
  • 资助金额:
    10.0 万元
  • 项目类别:
    省市级项目
Small RNA调控I-F型CRISPR-Cas适应性免疫性的应答及分子机制
  • 批准号:
    32000033
  • 批准年份:
    2020
  • 资助金额:
    24.0 万元
  • 项目类别:
    青年科学基金项目
Small RNAs调控解淀粉芽胞杆菌FZB42生防功能的机制研究
  • 批准号:
    31972324
  • 批准年份:
    2019
  • 资助金额:
    58.0 万元
  • 项目类别:
    面上项目
变异链球菌small RNAs连接LuxS密度感应与生物膜形成的机制研究
  • 批准号:
    81900988
  • 批准年份:
    2019
  • 资助金额:
    21.0 万元
  • 项目类别:
    青年科学基金项目
肠道细菌关键small RNAs在克罗恩病发生发展中的功能和作用机制
  • 批准号:
    31870821
  • 批准年份:
    2018
  • 资助金额:
    56.0 万元
  • 项目类别:
    面上项目
基于small RNA 测序技术解析鸽分泌鸽乳的分子机制
  • 批准号:
    31802058
  • 批准年份:
    2018
  • 资助金额:
    26.0 万元
  • 项目类别:
    青年科学基金项目
Small RNA介导的DNA甲基化调控的水稻草矮病毒致病机制
  • 批准号:
    31772128
  • 批准年份:
    2017
  • 资助金额:
    60.0 万元
  • 项目类别:
    面上项目
基于small RNA-seq的针灸治疗桥本甲状腺炎的免疫调控机制研究
  • 批准号:
    81704176
  • 批准年份:
    2017
  • 资助金额:
    20.0 万元
  • 项目类别:
    青年科学基金项目
水稻OsSGS3与OsHEN1调控small RNAs合成及其对抗病性的调节
  • 批准号:
    91640114
  • 批准年份:
    2016
  • 资助金额:
    85.0 万元
  • 项目类别:
    重大研究计划

相似海外基金

CISE-ANR: RI: Small: Numerically efficient reinforcement learning for constrained systems with super-linear convergence (NERL)
CISE-ANR:RI:小:具有超线性收敛 (NERL) 的约束系统的数值高效强化学习
  • 批准号:
    2315396
  • 财政年份:
    2023
  • 资助金额:
    $ 25万
  • 项目类别:
    Standard Grant
Advanced Image Analysis Tools for Super-Resolved MRI in Small Animals
用于小动物超分辨率 MRI 的高级图像分析工具
  • 批准号:
    10303505
  • 财政年份:
    2021
  • 资助金额:
    $ 25万
  • 项目类别:
Advanced Image Analysis Tools for Super-Resolved MRI in Small Animals
用于小动物超分辨率 MRI 的高级图像分析工具
  • 批准号:
    10468946
  • 财政年份:
    2021
  • 资助金额:
    $ 25万
  • 项目类别:
Assessing the impact of super-large and small wind turbine on biodiversity
评估超大型和小型风力发电机对生物多样性的影响
  • 批准号:
    20H04373
  • 财政年份:
    2020
  • 资助金额:
    $ 25万
  • 项目类别:
    Grant-in-Aid for Scientific Research (B)
Development of super-resolution mapping technology for endogenous proteins using optimized small molecule probes
使用优化的小分子探针开发内源蛋白质超分辨率作图技术
  • 批准号:
    20H02875
  • 财政年份:
    2020
  • 资助金额:
    $ 25万
  • 项目类别:
    Grant-in-Aid for Scientific Research (B)
CIF: Small: Super-Resolution Imaging in a Heavily Scattering Environment Enabled by Spatiotemporal Data
CIF:小:时空数据支持的高散射环境中的超分辨率成像
  • 批准号:
    1909660
  • 财政年份:
    2019
  • 资助金额:
    $ 25万
  • 项目类别:
    Standard Grant
Identification and Functional Analysis of the Target Molecule of Terrein, a Small Molecule Compound for Application in the Super-Aging Society
超老龄社会应用小分子化合物Terrein的靶分子鉴定及功能分析
  • 批准号:
    19K10108
  • 财政年份:
    2019
  • 资助金额:
    $ 25万
  • 项目类别:
    Grant-in-Aid for Scientific Research (C)
CIF: Small: Super-Resolution for Imaging Science
CIF:小:成像科学的超分辨率
  • 批准号:
    1909523
  • 财政年份:
    2019
  • 资助金额:
    $ 25万
  • 项目类别:
    Standard Grant
SaTC: CORE: Small: Super-Human Cryptanalysis for Scalable Side-Channel Analysis
SaTC:CORE:小型:用于可扩展侧信道分析的超人密码分析
  • 批准号:
    1814406
  • 财政年份:
    2018
  • 资助金额:
    $ 25万
  • 项目类别:
    Standard Grant
Super-Resolution Microscopy of Neuronal Synapses with Small Quantum Dots and Advanced Imaging Tools
使用小量子点和先进成像工具对神经元突触进行超分辨率显微镜检查
  • 批准号:
    9975253
  • 财政年份:
    2017
  • 资助金额:
    $ 25万
  • 项目类别:
{{ showInfoDetail.title }}

作者:{{ showInfoDetail.author }}

知道了