HCC: Small: Super Reality -- Immersive Visual Interfaces with No Line-of-Sight Restriction

HCC:小:超现实——无视线限制的沉浸式视觉界面

基本信息

  • 批准号:
    2219842
  • 负责人:
  • 金额:
    $ 25万
  • 依托单位:
  • 依托单位国家:
    美国
  • 项目类别:
    Standard Grant
  • 财政年份:
    2022
  • 资助国家:
    美国
  • 起止时间:
    2022-10-01 至 2024-09-30
  • 项目状态:
    已结题

项目摘要

The project develops Super Reality, a new class of human-computer visual interfaces designed for efficient and effective 3D dataset exploration. Super Reality (SR) interfaces build upon conventional virtual reality interfaces, preserving their benefits of immersion, intuitiveness, and depth cues, while radically increasing the information bandwidth of the images shown to the user. SR interfaces let the user see more of the dataset from the current location by removing the line-of-sight restriction of conventional virtual reality interfaces. The user sees not only the regions of the dataset that are visible from the current viewpoint, but also regions that are hidden behind occluders. The user can preview an occluded dataset region from the current position, without having to navigate around occluders, thereby avoiding the wasted navigation when the occluded region proves to be of no interest. The user can compare distant dataset regions directly, in the same image, without having to rely on the memory of dataset regions seen earlier. With a SR interface, the user explores the dataset in parallel, from multiple viewpoints, but without the burden of a complex visualization interface based on a matrix of conventional images. Through the leap-forward increase of 3D dataset exploration efficiency and effectiveness, this project will lead to a foundational level innovation influencing the domains where data visualization is used. This SR interface has the potential to minimize user disorientation and cybersickness, which are triggered by mismatched user motion and user visual perception in the traditional virtual reality interfaces. The project will be carried out by involving a diverse group of undergraduate students in research.The goal of the project is the design and development of Super Reality (SR) interfaces that will remove the line-of-sight restriction through a generalization of the computational camera that projects the 3D dataset onto the 2D image plane. The linear rays of conventional cameras are replaced with curved rays that are routed around occluders to connect the user to dataset regions of interest. Super Reality interfaces essentially dispatch a team of virtual subordinate users that each image the dataset from their own viewpoint and present the user with an integration of the data captured from the multiple viewpoints. These integrated images are constructed to meet multiple design requirements: (a) image continuity, by bounding the difference between trajectories of neighboring rays; (b) image non-redundancy, by avoiding ray intersections; (c) adaptive image resolution, by routing more rays towards dataset regions of higher complexity or importance; (d) in-place disocclusion, by projecting the disoccluded region where the user would see it in the absence of the occluder; (e) minimal image distortion, by limiting the curvature of the non-linear rays; fast rendering, by designing the generalized cameras with a fast projection operation. The SR interfaces will be designed to render the part of these integrated images close to the user with the conventional, first-person view. This way, the part of the frame that corresponds to nearby geometry responds to the user’s view changes as the user expects, anchoring the user to avoid disorientation and cybersickness. Also, SR interface limits the number of degrees of freedom the user needs to manipulate in order to deploy and retract the desired disocclusion effects. The Super Reality interfaces are iteratively refined and validated in controlled user studies based on objective and subjective metrics that quantify the degree to which the design requirements are met, as well as the efficiency and effectiveness of 3D dataset exploration.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
该项目开发了超级现实,这是一种新型的人机视觉界面,旨在高效和有效地探索3D数据集。超现实(SR)界面建立在传统的虚拟现实界面,保留其沉浸感,直观性和深度提示的好处,同时从根本上增加了显示给用户的图像的信息带宽。 SR界面通过消除传统虚拟现实界面的视线限制,让用户从当前位置看到更多的数据集。用户不仅可以看到从当前视点可见的数据集区域,还可以看到隐藏在遮挡物后面的区域。用户可以从当前位置预览被遮挡的数据集区域,而不必在遮挡物周围导航,从而避免当被遮挡区域被证明是不感兴趣的时浪费的导航。用户可以在同一图像中直接比较远处的数据集区域,而不必依赖于先前看到的数据集区域的记忆。使用SR界面,用户可以从多个视角并行探索数据集,但没有基于传统图像矩阵的复杂可视化界面的负担。通过3D数据集探索效率和有效性的飞跃式增长,该项目将导致基础层面的创新,影响数据可视化的使用领域。这种SR界面有可能最大限度地减少用户定向障碍和晕电病,这是由传统虚拟现实界面中不匹配的用户运动和用户视觉感知触发的。该项目将由不同的本科生参与研究,目标是设计和开发超级现实(SR)界面,通过将3D数据集投影到2D图像平面上的计算相机的泛化来消除视线限制。传统摄像机的线性射线被弯曲射线所取代,弯曲射线绕着遮挡器路由,以将用户连接到感兴趣的数据集区域。超级现实界面本质上是派遣一个虚拟下级用户团队,每个用户从自己的视角对数据集进行成像,并向用户呈现从多个视角捕获的数据的集成。构建这些集成图像以满足多个设计要求:(a)图像连续性,通过限制相邻射线的轨迹之间的差异;(B)图像非冗余性,通过避免射线交叉;(c)自适应图像分辨率,通过将更多射线路由到更高复杂性或重要性的数据集区域;(d)通过投影在没有遮挡器的情况下用户将看到的被遮挡区域,就地去除遮挡;快速渲染,通过设计具有快速投影操作的通用相机。SR界面将被设计为使用传统的第一人称视图将这些集成图像的一部分呈现给用户。这样,帧的对应于附近几何形状的部分响应于用户的视图改变,如用户期望的那样,锚定用户以避免迷失方向和晕电脑。此外,SR接口限制了用户需要操纵的自由度的数量,以便展开和缩回所需的解除咬合效果。超级现实界面在基于客观和主观指标的受控用户研究中进行了反复改进和验证,这些指标量化了设计要求的满足程度,以及3D数据集探索的效率和有效性。该奖项反映了NSF的法定使命,并被认为值得通过使用基金会的智力价值和更广泛的影响审查标准进行评估来支持。

项目成果

期刊论文数量(1)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)
AR Interfaces for Disocclusion—A Comparative Study
{{ item.title }}
{{ item.translation_title }}
  • DOI:
    {{ item.doi }}
  • 发表时间:
    {{ item.publish_year }}
  • 期刊:
  • 影响因子:
    {{ item.factor }}
  • 作者:
    {{ item.authors }}
  • 通讯作者:
    {{ item.author }}

数据更新时间:{{ journalArticles.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ monograph.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ sciAawards.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ conferencePapers.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ patent.updateTime }}

Voicu Popescu其他文献

Fast Ray-Scene Intersection for Interactive Shadow Rendering with Thousands of Dynamic Lights
使用数千个动态灯光进行交互式阴影渲染的快速光线场景相交
A Partially-Sorted Concentric Layout for Efficient Label Localization in Augmented Reality
用于增强现实中高效标签定位的部分排序同心布局
GEARS: A General and Efficient Algorithm for Rendering Shadows
GEARS:一种通用且高效的阴影渲染算法
  • DOI:
    10.1111/cgf.12348
  • 发表时间:
    2014-09
  • 期刊:
  • 影响因子:
    2.5
  • 作者:
    Lili Wang;Shiheng Zhou;Wei Ke;Voicu Popescu
  • 通讯作者:
    Voicu Popescu
Look-over-there: Real-World Co-Located Cross-Referencing Using Augmented Reality
在那里查看:使用增强现实进行现实世界的协同定位交叉引用
  • DOI:
  • 发表时间:
    2024
  • 期刊:
  • 影响因子:
    0
  • 作者:
    Yuqi Zhou;Voicu Popescu
  • 通讯作者:
    Voicu Popescu
Quantifiable Fine-Grain Occlusion Removal Assistance for Efficient VR Exploration
可量化的细粒度遮挡去除辅助,可实现高效的 VR 探索

Voicu Popescu的其他文献

{{ item.title }}
{{ item.translation_title }}
  • DOI:
    {{ item.doi }}
  • 发表时间:
    {{ item.publish_year }}
  • 期刊:
  • 影响因子:
    {{ item.factor }}
  • 作者:
    {{ item.authors }}
  • 通讯作者:
    {{ item.author }}

{{ truncateString('Voicu Popescu', 18)}}的其他基金

Creating a High-Performance Computing Virtual Environment for Artificial Intelligence Education
为人工智能教育打造高性能计算虚拟环境
  • 批准号:
    2309564
  • 财政年份:
    2023
  • 资助金额:
    $ 25万
  • 项目类别:
    Standard Grant
Collaborative Research: CISE-MSI: DP: HCC: Buenas - Giving All a Seat at the Table Using Mixed Reality
协作研究:CISE-MSI:DP:HCC:布埃纳斯 - 使用混合现实为所有人提供席位
  • 批准号:
    2318657
  • 财政年份:
    2023
  • 资助金额:
    $ 25万
  • 项目类别:
    Standard Grant
EXP: Collaborative Research: A System of Animation Gestures for Effective Teaching Avatars
EXP:协作研究:用于有效教学头像的动画手势系统
  • 批准号:
    1217215
  • 财政年份:
    2012
  • 资助金额:
    $ 25万
  • 项目类别:
    Standard Grant
CRCD/EI: Effective Distance Learning Through Sustained Interactivity and Visual Realism
CRCD/EI:通过持续的交互性和视觉真实感实现有效的远程学习
  • 批准号:
    0417458
  • 财政年份:
    2004
  • 资助金额:
    $ 25万
  • 项目类别:
    Continuing Grant

相似国自然基金

昼夜节律性small RNA在血斑形成时间推断中的法医学应用研究
  • 批准号:
  • 批准年份:
    2024
  • 资助金额:
    0.0 万元
  • 项目类别:
    省市级项目
tRNA-derived small RNA上调YBX1/CCL5通路参与硼替佐米诱导慢性疼痛的机制研究
  • 批准号:
    n/a
  • 批准年份:
    2022
  • 资助金额:
    10.0 万元
  • 项目类别:
    省市级项目
Small RNA调控I-F型CRISPR-Cas适应性免疫性的应答及分子机制
  • 批准号:
    32000033
  • 批准年份:
    2020
  • 资助金额:
    24.0 万元
  • 项目类别:
    青年科学基金项目
Small RNAs调控解淀粉芽胞杆菌FZB42生防功能的机制研究
  • 批准号:
    31972324
  • 批准年份:
    2019
  • 资助金额:
    58.0 万元
  • 项目类别:
    面上项目
变异链球菌small RNAs连接LuxS密度感应与生物膜形成的机制研究
  • 批准号:
    81900988
  • 批准年份:
    2019
  • 资助金额:
    21.0 万元
  • 项目类别:
    青年科学基金项目
基于small RNA 测序技术解析鸽分泌鸽乳的分子机制
  • 批准号:
    31802058
  • 批准年份:
    2018
  • 资助金额:
    26.0 万元
  • 项目类别:
    青年科学基金项目
肠道细菌关键small RNAs在克罗恩病发生发展中的功能和作用机制
  • 批准号:
    31870821
  • 批准年份:
    2018
  • 资助金额:
    56.0 万元
  • 项目类别:
    面上项目
Small RNA介导的DNA甲基化调控的水稻草矮病毒致病机制
  • 批准号:
    31772128
  • 批准年份:
    2017
  • 资助金额:
    60.0 万元
  • 项目类别:
    面上项目
基于small RNA-seq的针灸治疗桥本甲状腺炎的免疫调控机制研究
  • 批准号:
    81704176
  • 批准年份:
    2017
  • 资助金额:
    20.0 万元
  • 项目类别:
    青年科学基金项目
水稻OsSGS3与OsHEN1调控small RNAs合成及其对抗病性的调节
  • 批准号:
    91640114
  • 批准年份:
    2016
  • 资助金额:
    85.0 万元
  • 项目类别:
    重大研究计划

相似海外基金

CISE-ANR: RI: Small: Numerically efficient reinforcement learning for constrained systems with super-linear convergence (NERL)
CISE-ANR:RI:小:具有超线性收敛 (NERL) 的约束系统的数值高效强化学习
  • 批准号:
    2315396
  • 财政年份:
    2023
  • 资助金额:
    $ 25万
  • 项目类别:
    Standard Grant
Advanced Image Analysis Tools for Super-Resolved MRI in Small Animals
用于小动物超分辨率 MRI 的高级图像分析工具
  • 批准号:
    10303505
  • 财政年份:
    2021
  • 资助金额:
    $ 25万
  • 项目类别:
Advanced Image Analysis Tools for Super-Resolved MRI in Small Animals
用于小动物超分辨率 MRI 的高级图像分析工具
  • 批准号:
    10468946
  • 财政年份:
    2021
  • 资助金额:
    $ 25万
  • 项目类别:
Assessing the impact of super-large and small wind turbine on biodiversity
评估超大型和小型风力发电机对生物多样性的影响
  • 批准号:
    20H04373
  • 财政年份:
    2020
  • 资助金额:
    $ 25万
  • 项目类别:
    Grant-in-Aid for Scientific Research (B)
Development of super-resolution mapping technology for endogenous proteins using optimized small molecule probes
使用优化的小分子探针开发内源蛋白质超分辨率作图技术
  • 批准号:
    20H02875
  • 财政年份:
    2020
  • 资助金额:
    $ 25万
  • 项目类别:
    Grant-in-Aid for Scientific Research (B)
CIF: Small: Super-Resolution Imaging in a Heavily Scattering Environment Enabled by Spatiotemporal Data
CIF:小:时空数据支持的高散射环境中的超分辨率成像
  • 批准号:
    1909660
  • 财政年份:
    2019
  • 资助金额:
    $ 25万
  • 项目类别:
    Standard Grant
Identification and Functional Analysis of the Target Molecule of Terrein, a Small Molecule Compound for Application in the Super-Aging Society
超老龄社会应用小分子化合物Terrein的靶分子鉴定及功能分析
  • 批准号:
    19K10108
  • 财政年份:
    2019
  • 资助金额:
    $ 25万
  • 项目类别:
    Grant-in-Aid for Scientific Research (C)
CIF: Small: Super-Resolution for Imaging Science
CIF:小:成像科学的超分辨率
  • 批准号:
    1909523
  • 财政年份:
    2019
  • 资助金额:
    $ 25万
  • 项目类别:
    Standard Grant
SaTC: CORE: Small: Super-Human Cryptanalysis for Scalable Side-Channel Analysis
SaTC:CORE:小型:用于可扩展侧信道分析的超人密码分析
  • 批准号:
    1814406
  • 财政年份:
    2018
  • 资助金额:
    $ 25万
  • 项目类别:
    Standard Grant
Super-Resolution Microscopy of Neuronal Synapses with Small Quantum Dots and Advanced Imaging Tools
使用小量子点和先进成像工具对神经元突触进行超分辨率显微镜检查
  • 批准号:
    9975253
  • 财政年份:
    2017
  • 资助金额:
    $ 25万
  • 项目类别:
{{ showInfoDetail.title }}

作者:{{ showInfoDetail.author }}

知道了