Collaborative Research: CNS Core: Small: From Capture to Consumption: System Challenges in Pervasive 360-Degree Video Sharing

合作研究:CNS 核心:小型:从捕获到消费:普遍 360 度视频共享的系统挑战

基本信息

  • 批准号:
    2007153
  • 负责人:
  • 金额:
    $ 24.99万
  • 依托单位:
  • 依托单位国家:
    美国
  • 项目类别:
    Standard Grant
  • 财政年份:
    2020
  • 资助国家:
    美国
  • 起止时间:
    2020-10-01 至 2024-09-30
  • 项目状态:
    已结题

项目摘要

360-degree video allows users to explore a recorded scene at any angle from the camera position. This greater flexibility provided by the 360-degree video format has led to its increased popularity. However, widespread adoption has slowed because of the large amounts of resources required by the format. This work proposes methods to improve efficiency at each stage of the 360-degree video sharing path, from video capture at the sender side to consumption at the receiver side. The project addresses these challenges via four research thrusts. The first thrust explores approaches for generating high-quality frames during real-time stitching of multiple videos captured using commodity lenses. The proposed approach applies gradient decent to refine an initial rough stitching. The second thrust investigates mechanisms to spatially adapt content to be uploaded based on the available bandwidth. The third thrust aims to optimize the fine-grained representation of omnidirectional content to achieve high projection efficiency and view efficiency. The last thrust uses edge computing techniques to optimize the look-ahead window size on the receiver side to allow bandwidth-efficient content downloading.The techniques developed during the course of the project will allow users to enjoy more efficient 360-degree video streaming applications. These techniques are not only applicable to 360-degree video streaming but will also have applications in future generations of virtual reality (VR) technologies. The project will also motivate general student interest in computer science research, directly train students during the course of the project’s research, and contribute to curriculum development. The project will produce publications, code, data, and other research artifacts. All such artifacts will be made available publicly through the URLs http://www.cs.gmu.edu/~sqchen/ and http://www.cs.binghamton.edu/~yaoliu/ during the course of the project and remain available for at least five years after completion of the project. The code will be open sourced and will also be made available at code hosting website, e.g., GitHub.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
360-度视频允许用户从相机位置以任何角度探索记录的场景。360度视频格式提供的更大灵活性导致其越来越受欢迎。然而,由于该格式需要大量资源,广泛采用的速度已经放慢。这项工作提出了提高360度视频共享路径的每个阶段的效率的方法,从发送方的视频捕获到接收方的消费。该项目通过四个研究重点来应对这些挑战。第一个推力探索在使用商品镜头捕获的多个视频的实时拼接期间生成高质量帧的方法。所提出的方法应用梯度下降,以改善初始粗糙拼接。第二个推力调查机制,以空间适应内容上传的基础上可用的带宽。第三个目标是优化全向内容的细粒度表示,以实现高投影效率和查看效率。最后一个推力是使用边缘计算技术来优化接收器端的前瞻窗口大小,以实现带宽高效的内容下载。在项目过程中开发的技术将使用户能够享受更高效的360度视频流应用。这些技术不仅适用于360度视频流,而且还将在未来几代虚拟现实(VR)技术中得到应用。该项目还将激发学生对计算机科学研究的兴趣,在项目研究过程中直接培训学生,并为课程开发做出贡献。该项目将产生出版物,代码,数据和其他研究工件。所有这些工件将在项目过程中通过URLhttp://www.cs.gmu.edu/~sqchen/和http://www.cs.binghamton.edu/~yaoliu/公开提供,并在项目完成后至少五年内保持可用。代码将是开源的,也将在代码托管网站上提供,例如,该奖项反映了NSF的法定使命,并通过使用基金会的知识价值和更广泛的影响审查标准进行评估,被认为值得支持。

项目成果

期刊论文数量(6)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)
A Reality Check of Positioning in Multiuser Mobile Augmented Reality: Measurement and Analysis
多用户移动增强现实中定位的现实检查:测量和分析
EZPath: Expediting Container Network Traffic via Programmable Switches
EZPath:通过可编程交换机加快容器网络流量
Preserving privacy in mobile spatial computing
Towards Accurate Positioning in Multiuser Augmented Reality on Mobile Devices
实现移动设备上多用户增强现实的精确定位
  • DOI:
    10.1109/ism55400.2022.00048
  • 发表时间:
    2022
  • 期刊:
  • 影响因子:
    0
  • 作者:
    Wang, Na;Wang, Haoliang;Petrangeli, Stefano;Swaminathan, Viswanathan;Li, Fei;Chen, Songqing
  • 通讯作者:
    Chen, Songqing
Exploring Spherical Autoencoder for Spherical Video Content Processing
{{ item.title }}
{{ item.translation_title }}
  • DOI:
    {{ item.doi }}
  • 发表时间:
    {{ item.publish_year }}
  • 期刊:
  • 影响因子:
    {{ item.factor }}
  • 作者:
    {{ item.authors }}
  • 通讯作者:
    {{ item.author }}

数据更新时间:{{ journalArticles.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ monograph.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ sciAawards.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ conferencePapers.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ patent.updateTime }}

Songqing Chen其他文献

FAST : A Fog Computing , Distributed Analytics-based Fall Monitoring System for Stroke Mitigation
FAST:雾计算、基于分布式分析的跌倒监测系统,用于缓解中风
  • DOI:
  • 发表时间:
    2015
  • 期刊:
  • 影响因子:
    0
  • 作者:
    Yu Cao;Songqing Chen;Peng Hou;Donald Brown
  • 通讯作者:
    Donald Brown
Multiple weighted estimates for commutators of multilinear singular integrals with non-smooth kernels
非光滑核多线性奇异积分换向器的多重加权估计
SyncAttack: Double-spending in Bitcoin Without Mining Power
SyncAttack:没有算力的比特币双花
Honor among Thieves: Towards Understanding the Dynamics and Interdependencies in IoT Botnets
盗贼之间的荣誉:了解物联网僵尸网络的动态和相互依赖性
Will Metaverse Be NextG Internet? Vision, Hype, and Reality
元宇宙会成为下一代互联网吗?
  • DOI:
    10.1109/mnet.117.2200055
  • 发表时间:
    2022
  • 期刊:
  • 影响因子:
    9.3
  • 作者:
    Ruizhi Cheng;Nan Wu;Songqing Chen;Bo Han
  • 通讯作者:
    Bo Han

Songqing Chen的其他文献

{{ item.title }}
{{ item.translation_title }}
  • DOI:
    {{ item.doi }}
  • 发表时间:
    {{ item.publish_year }}
  • 期刊:
  • 影响因子:
    {{ item.factor }}
  • 作者:
    {{ item.authors }}
  • 通讯作者:
    {{ item.author }}

{{ truncateString('Songqing Chen', 18)}}的其他基金

The 2019 Joint Computer Systems Research and Networking Technology and Systems PI Meeting
2019年计算机系统研究与网络技术与系统PI联合会议
  • 批准号:
    1939947
  • 财政年份:
    2019
  • 资助金额:
    $ 24.99万
  • 项目类别:
    Standard Grant
CSR: Small: Towards Energy-efficient Internet Mobile Streaming
CSR:小:迈向节能的互联网移动流媒体
  • 批准号:
    1524462
  • 财政年份:
    2015
  • 资助金额:
    $ 24.99万
  • 项目类别:
    Standard Grant
CSR: Small: System Research to Advance Real-time Dust Storm Forecasting
CSR:小型:推进实时沙尘暴预报的系统研究
  • 批准号:
    1117300
  • 财政年份:
    2011
  • 资助金额:
    $ 24.99万
  • 项目类别:
    Standard Grant
CAREER: Internet Resource Management to Deliver High Quality Live and On-demand Streaming for Wireless Clients
职业:互联网资源管理,为无线客户端提供高质量的直播和点播流媒体
  • 批准号:
    0746649
  • 财政年份:
    2008
  • 资助金额:
    $ 24.99万
  • 项目类别:
    Continuing Grant
Collaborative Research: CSR-EHS: System Research on Media Streaming to Heterogeneous Mobile Devices
合作研究:CSR-EHS:异构移动设备媒体流系统研究
  • 批准号:
    0621631
  • 财政年份:
    2006
  • 资助金额:
    $ 24.99万
  • 项目类别:
    Standard Grant
CSR -- AES: Collaborative Research: Next Generation Internet Proxy Systems
CSR -- AES:协作研究:下一代互联网代理系统
  • 批准号:
    0509061
  • 财政年份:
    2005
  • 资助金额:
    $ 24.99万
  • 项目类别:
    Standard Grant

相似国自然基金

Research on Quantum Field Theory without a Lagrangian Description
  • 批准号:
    24ZR1403900
  • 批准年份:
    2024
  • 资助金额:
    0.0 万元
  • 项目类别:
    省市级项目
Cell Research
  • 批准号:
    31224802
  • 批准年份:
    2012
  • 资助金额:
    24.0 万元
  • 项目类别:
    专项基金项目
Cell Research
  • 批准号:
    31024804
  • 批准年份:
    2010
  • 资助金额:
    24.0 万元
  • 项目类别:
    专项基金项目
Cell Research (细胞研究)
  • 批准号:
    30824808
  • 批准年份:
    2008
  • 资助金额:
    24.0 万元
  • 项目类别:
    专项基金项目
Research on the Rapid Growth Mechanism of KDP Crystal
  • 批准号:
    10774081
  • 批准年份:
    2007
  • 资助金额:
    45.0 万元
  • 项目类别:
    面上项目

相似海外基金

Collaborative Research: CNS Core: Medium: Reconfigurable Kernel Datapaths with Adaptive Optimizations
协作研究:CNS 核心:中:具有自适应优化的可重构内核数据路径
  • 批准号:
    2345339
  • 财政年份:
    2023
  • 资助金额:
    $ 24.99万
  • 项目类别:
    Standard Grant
Collaborative Research: CNS Core: Small: A Compilation System for Mapping Deep Learning Models to Tensorized Instructions (DELITE)
合作研究:CNS Core:Small:将深度学习模型映射到张量化指令的编译系统(DELITE)
  • 批准号:
    2230945
  • 财政年份:
    2023
  • 资助金额:
    $ 24.99万
  • 项目类别:
    Standard Grant
Collaborative Research: NSF-AoF: CNS Core: Small: Towards Scalable and Al-based Solutions for Beyond-5G Radio Access Networks
合作研究:NSF-AoF:CNS 核心:小型:面向超 5G 无线接入网络的可扩展和基于人工智能的解决方案
  • 批准号:
    2225578
  • 财政年份:
    2023
  • 资助金额:
    $ 24.99万
  • 项目类别:
    Standard Grant
Collaborative Research: CNS Core: Medium: Movement of Computation and Data in Splitkernel-disaggregated, Data-intensive Systems
合作研究:CNS 核心:媒介:Splitkernel 分解的数据密集型系统中的计算和数据移动
  • 批准号:
    2406598
  • 财政年份:
    2023
  • 资助金额:
    $ 24.99万
  • 项目类别:
    Continuing Grant
Collaborative Research: CNS Core: Small: SmartSight: an AI-Based Computing Platform to Assist Blind and Visually Impaired People
合作研究:中枢神经系统核心:小型:SmartSight:基于人工智能的计算平台,帮助盲人和视障人士
  • 批准号:
    2418188
  • 财政年份:
    2023
  • 资助金额:
    $ 24.99万
  • 项目类别:
    Standard Grant
Collaborative Research: CNS Core: Small: Creating An Extensible Internet Through Interposition
合作研究:CNS核心:小:通过介入创建可扩展的互联网
  • 批准号:
    2242503
  • 财政年份:
    2023
  • 资助金额:
    $ 24.99万
  • 项目类别:
    Standard Grant
Collaborative Research: CNS Core: Small: Adaptive Smart Surfaces for Wireless Channel Morphing to Enable Full Multiplexing and Multi-user Gains
合作研究:CNS 核心:小型:用于无线信道变形的自适应智能表面,以实现完全复用和多用户增益
  • 批准号:
    2343959
  • 财政年份:
    2023
  • 资助金额:
    $ 24.99万
  • 项目类别:
    Standard Grant
Collaborative Research: CNS Core: Small: Efficient Ways to Enlarge Practical DNA Storage Capacity by Integrating Bio-Computer Technologies
合作研究:中枢神经系统核心:小型:通过集成生物计算机技术扩大实用 DNA 存储容量的有效方法
  • 批准号:
    2343863
  • 财政年份:
    2023
  • 资助金额:
    $ 24.99万
  • 项目类别:
    Standard Grant
Collaborative Research: CNS Core: Small: A Compilation System for Mapping Deep Learning Models to Tensorized Instructions (DELITE)
合作研究:CNS Core:Small:将深度学习模型映射到张量化指令的编译系统(DELITE)
  • 批准号:
    2341378
  • 财政年份:
    2023
  • 资助金额:
    $ 24.99万
  • 项目类别:
    Standard Grant
Collaborative Research: CISE-MSI: RCBP-RF: CNS: ESD4CDaT - Efficient System Design for Cancer Detection and Treatment
合作研究:CISE-MSI:RCBP-RF:CNS:ESD4CDaT - 癌症检测和治疗的高效系统设计
  • 批准号:
    2318573
  • 财政年份:
    2023
  • 资助金额:
    $ 24.99万
  • 项目类别:
    Standard Grant
{{ showInfoDetail.title }}

作者:{{ showInfoDetail.author }}

知道了