CRI: II-NEW: HoloCamera: An Immersive Gigapixel Cyberinstrument for Creating Precision Virtual Environments

CRI：II-新：HoloCamera：用于创建精确虚拟环境的沉浸式十亿像素网络仪器

• 批准号: 1823321
• 负责人: Amitabh Varshney
• 金额: $ 99.99万
• 依托单位: University of Maryland, College Park
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2018
• 资助国家: 美国
• 起止时间: 2018-09-01 至 2022-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1823321&HistoricalAwards=false
• 关键词: CRI; II; NEW; HoloCamera; Immersive

Title: HoloCamera: An Immersive Gigapixel Cyberinstrument for Creating Precision Virtual Environments Virtual worlds need high-quality realism for effective use. The HoloCamera will meet these needs. Using several cameras and a computer cluster it will directly create dynamic virtual worlds. Users will be able to freely move about and observe these virtual worlds as if they were actually present there.The HoloCamera will advance the state of the art in light field capture and rendering, high-performance computing, and embedded signal processing. The facility will aid medical education and training, interactive imitation learning for robots, and capturing fluent sign-language use in native signers. Virtual and augmented reality offer exciting ways to educate students, particularly those from underrepresented groups in Science, Technology, Engineering and Mathematics (STEM) disciplines.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

职务名称：HoloCamera：用于创建精确虚拟环境的沉浸式千兆像素Cyberinstrument虚拟世界需要高质量的真实感才能有效使用。HoloCamera将满足这些需求。 使用几个摄像头和一个计算机集群，它将直接创建动态的虚拟世界。用户将能够自由地移动和观察这些虚拟世界，就像他们真的在那里一样。HoloCamera将推进光场捕获和渲染，高性能计算和嵌入式信号处理的最新技术。该设施将有助于医学教育和培训，机器人的交互式模仿学习，并捕捉本地签名者流利的手语使用。虚拟现实和增强现实为教育学生提供了令人兴奋的方式，特别是那些来自科学，技术，工程和数学（STEM）学科代表性不足的群体的学生。该奖项反映了NSF的法定使命，并通过使用基金会的智力价值和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

Project Geollery.com: Reconstructing A Live Mirrored World With Geotagged Social Media

• DOI: 10.1145/3329714.3338126
• 发表时间: 2019-07
• 期刊: Proceedings of the 24th International Conference on 3D Web Technology
• 作者: Ruofei Du;David Li;A. Varshney

Deep Depth Estimation on 360° Images with a Double Quaternion Loss

双四元数损失的 360° 图像深度估计

• DOI: 10.1109/3dv50981.2020.00062
• 发表时间: 2020
• 期刊: 2020 International Conference on 3D Vision (3DV
• 作者: Feng, Brandon Yushan;Yao, Wangjue;Liu, Zheyuan;Varshney, Amitabh
• 通讯作者: Varshney, Amitabh

A Log-Rectilinear Transformation for Foveated 360-degree Video Streaming

• DOI: 10.1109/tvcg.2021.3067762
• 发表时间: 2021-03
• 期刊: IEEE Transactions on Visualization and Computer Graphics
• 影响因子: 5.2
• 作者: David Li;Ruofei Du;Adharsh Babu;C. Brumar;Amitabh Varshney

Neural Subspaces for Light Fields

• DOI: 10.1109/tvcg.2022.3224674
• 发表时间: 2022-12
• 期刊: IEEE Transactions on Visualization and Computer Graphics
• 影响因子: 5.2
• 作者: Brandon Yushan Feng;Amitabh Varshney

Experiencing a Mirrored World with Geotagged Social Media in Geollery

通过 Geollery 中的地理标记社交媒体体验镜像世界

• DOI: 10.1145/3290607.3313273
• 发表时间: 2019
• 期刊: CHI EA '19: Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems
• 作者: Du, Ruofei;Li, David;Varshney, Amitabh
• 通讯作者: Varshney, Amitabh