CNS Core: Medium: Bringing the Spatial Web to Life

CNS 核心：Medium：将空间网络带入生活

• 批准号: 1956095
• 负责人: Srinivasan Seshan
• 金额: $ 119.95万
• 依托单位: Carnegie-Mellon University
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2020
• 资助国家: 美国
• 起止时间: 2020-10-01 至 2024-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1956095&HistoricalAwards=false
• 关键词: CNS; Core; Medium; Bringing; Spatial

The future of the Web lies in integration of Web content with the real-world through technologies such as augmented-reality. This overlay of virtual content on top of the physical world, called the Spatial Web, holds promise for dramatically changing many applications. For example, imagine being able to access an individual’s home page by looking at them, seeing directions from a mapping application shown overlaid on the actual roads, or seeing control interfaces for your appliances simply by looking at them. The Spatial Web will impact applications from navigation, to engineering, education and more. While the vision is promising, the reality is that Spatial Web applications are currently difficult to create. Early applications such as Google Maps AR interface are monolithic designs with a single goal. A broad range of new tools and infrastructure are needed to make the Spatial Web "real" and to make it easy for developers to create and publish Spatial Web content and applications. The goal of this project is to develop a coherent architecture for the Spatial Web. This includes tools and algorithms for each step in the process of generating a Spatial Web view for the user. The proposed research directly addresses the key challenges associated with creating Spatial Web applications today. For example, the PIs plan to develop novel localization and scene understanding tools to help accurately position the user and the objects in their view. The planned research will look at reducing deployment costs and accommodating greater heterogeneity in localization frameworks. The PIs also plan to design a system for spatial content management to simplify the process of finding relevant spatial content and propagating content updates to clients. Key challenges the PI address in this lookup system include scalably handling diverse spatial queries, enabling administrative control and management of Spatial Web lookups, and providing a low-latency publish-subscribe interface to enable real-time discovery and update of in-view Spatial Web content. Finally, the PIs plan to develop content encoding and transmission protocols that are particularly well-suited to the low-latency requirements of the Spatial Web. This includes new video codec and video transmission schemes that are optimized for low-latency interaction, designs for congestion control protocols that minimize queuing delay in environments with cross-traffic, and new QoE metrics to evaluate the performance of Spatial Web content delivery.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

Web的未来在于通过增强现实等技术将Web内容与现实世界集成。这种将虚拟内容叠加在物理世界之上的方式称为空间网络，有望极大地改变许多应用程序。例如，想象一下，通过查看个人主页，查看覆盖在实际道路上的地图应用程序的方向，或者只需查看设备的控制界面，就可以访问个人主页。空间网络将影响从导航到工程、教育等应用。虽然愿景是有希望的，但现实是，空间Web应用程序目前很难创建。 早期的应用程序，如Google Maps AR界面，是具有单一目标的单片设计。要使空间Web成为“真实的”，并使开发人员能够轻松创建和发布空间Web内容和应用程序，需要广泛的新工具和基础设施。这个项目的目标是为空间网络开发一个连贯的架构。这包括为用户生成Spatial Web视图过程中每个步骤的工具和算法。所提出的研究直接解决了与创建空间Web应用程序的关键挑战。例如，PI计划开发新的定位和场景理解工具，以帮助准确定位用户和他们视图中的对象。计划中的研究将着眼于降低部署成本，并在本地化框架中适应更大的异构性。项目执行人还计划设计一个空间内容管理系统，以简化查找相关空间内容和向客户传播内容更新的过程。PI在该查找系统中解决的关键挑战包括可扩展地处理各种空间查询，实现对空间Web查找的管理控制和管理，以及提供低延迟的搜索订阅接口以实现实时发现和更新视图中的空间Web内容。 最后，PI计划开发内容编码和传输协议，特别适合空间Web的低延迟需求。这包括新的视频编解码器和视频传输方案，这些方案针对低延迟交互进行了优化，设计了拥塞控制协议，以最大限度地减少交叉流量环境中的排队延迟，和新的QoE指标来评估空间Web内容交付的性能。该奖项反映了NSF的法定使命，并通过使用基金会的知识价值和更广泛的影响审查进行评估，被认为值得支持的搜索.

项目成果

Prism: Handling Packet Loss for Ultra-low Latency Video

Prism：处理超低延迟视频的丢包

• DOI: 10.1145/3503161.3547856
• 发表时间: 2022
• 期刊: MM '22: Proceedings of the 30th ACM International Conference on Multimedia
• 作者: Ray, Devdeep;Bobadilla Riquelme, Vicente;Seshan, Srinivasan
• 通讯作者: Seshan, Srinivasan

FLASH: Video-Embeddable AR Anchors for Live Events

FLASH：用于现场活动的视频嵌入式 AR 主播

• DOI: 10.1109/ismar52148.2021.00066
• 发表时间: 2021
• 期刊: 2021 IEEE International Symposium on Mixed and Augmented Reality (ISMAR
• 作者: Lu, Edward;Miller, John;Pereira, Nuno;Rowe, Anthony
• 通讯作者: Rowe, Anthony

Cappella: Establishing Multi-User Augmented Reality Sessions Using Inertial Estimates and Peer-to-Peer Ranging

• DOI: 10.1109/ipsn54338.2022.00041
• 发表时间: 2022-05
• 期刊: 2022 21st ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN)
• 作者: John Miller;Elahe Soltanaghai;R. Duvall;Jeff Chen;Vikram Bhat;Nuno Pereira;Anthony G. Rowe

Scaling VR Video Conferencing

扩展 VR 视频会议

• DOI: 10.1109/vr55154.2023.00080
• 发表时间: 2023
• 期刊: IEEE Conference Virtual Reality and 3D User Interfaces
• 作者: Dasari, Mallesham;Lu, Edward;Farb, Michael W.;Pereira, Nuno;Liang, Ivan;Rowe, Anthony
• 通讯作者: Rowe, Anthony

ARENA: The Augmented Reality Edge Networking Architecture

ARENA：增强现实边缘网络架构

• DOI: 10.1109/ismar52148.2021.00065
• 发表时间: 2021
• 期刊: 2021 IEEE International Symposium on Mixed and Augmented Reality (ISMAR
• 作者: Pereira, Nuno;Rowe, Anthony;Farb, Michael W;Liang, Ivan;Lu, Edward;Riebling, Eric
• 通讯作者: Riebling, Eric