课题基金 / 基金详情

CNS Core: Medium: Collaborative Research: Scalable Dissemination and Navigation of Video 360 Content for Personalized Viewing

CNS Core: Medium: Collaborative Research: Scalable Dissemination and Navigation of Video 360 Content for Personalized Viewing
CNS 核心:媒介:协作研究:视频 360 内容的可扩展传播和导航以实现个性化观看
批准号:
1901137
负责人:
Michael Zink
金额:
$79.88万
依托单位国家:
美国
项目类别:
Continuing Grant
财政年份:
2019
资助国家:
美国
项目状态:
已结题
起止时间:
2019-10-01 至 2024-09-30

项目摘要

项目成果

Michael Zink的其他基金

相似基金

相关文献

中文摘要
翻译
360度视频是一种虚拟现实(VR)形式,允许观众以沉浸式方式体验媒体内容。与传统视频不同的是,360度视频是用一个特殊的摄像头录制的,几乎可以从各个方向捕捉到完整的周围环境。消费这种视频的观看者可以通过使用常规显示器上的指向设备或通过使用头戴式设备的头部移动来选择他们正在观看的方向。这种新格式允许观看者在观看视频时改变他们的观看方向,例如,观众可以从场地上的多个视角观看体育赛事。 然而,在互联网上大规模地创建、存储和传播360度视频带来了巨大的挑战。 这些挑战是该项目的重点,该项目将开发一个名为mi 360 World的新系统和框架,以使互联网上的任何用户都能顺利地交付360度视频并与之交互。 该项目如果成功,将显著改善360度视频传输,并将带来更丰富的教育、培训和娱乐体验。 它还将帮助培训一批新的多媒体系统研究人员和从业人员。用于通过互联网向全球分布的一组用户递送高质量、个性化360度视频的机制是一个尚未解决的科学问题,其带来以下挑战:1)超高带宽; 2)超低延迟; 3)视图自适应(针对用户头部移动); 4)复杂的视频元数据和递送; 5)视频体验质量(QoE)。多年来,传统视频QoE已经得到了广泛的研究;然而,对360视频QoE的贡献要少得多,需要构思和测量新的指标。 拟议中的mi 360 World系统包含三个主要研究方向来解决上述挑战:视频创建方向,通过生成导航图和电影摄影规则实现个性化观看,同时保持高QoE并减少晕机。导航图的构建和电影摄影规则的纳入代表了该项目的主要创新,并封装在360度视频的三层元数据表示中:传输层,语义层和交互式讲故事层。第二个重点是将360个视频可扩展地分发给全球不同的观众,利用导航图和电影摄影规则进行高效的过渡预测预取和缓存。第三个重点是QoE,目标是设计新的QoE指标和评估方法来评估晕网。系统架构和算法将通过模拟、仿真和基准测试进行广泛的评估,以评估拟议研究的成功与否。该奖项反映了NSF的法定使命,并通过使用基金会的知识价值和更广泛的影响审查标准进行评估,被认为值得支持。
英文摘要
360 video is a form of virtual reality (VR) that allows the viewer to experience media content in an immersive fashion. In contrast to traditional video, 360 video is recorded with a special camera that captures the complete surroundings from almost all directions. Viewers consuming such a video can select the direction they are looking at by using a pointing device on a regular display or through head movement using a head-mounted device. This new format allows a viewer to change their viewing direction when watching the video, e.g., a viewer can watch a sporting event from multiple perspectives on the field. However, creating, storing, and disseminating 360 videos at a large scale over the Internet poses significant challenges. These challenges are the focus of this project, which will develop a new system and framework, called mi360World, to enable smooth delivery of and interaction with 360 video by any user on the Internet. This project, if successful, will significantly improve 360 video delivery, and will enable new and much richer educational, training and entertainment experiences. It will also help train a new class of multimedia systems researchers and practitioners. The mechanisms for delivering a high-quality, personalized 360 video over the Internet to a globally distributed set of users is an unsolved scientific problem that entails the following challenges: 1) Ultra-high Bandwidth; 2) Ultra-low Delay; 3) View Adaptation (to user head movement); 4) Complex video metadata and delivery; 5) Video Quality of Experience (QoE). Traditional video QoE has seen extensive research over the years; however, what contributes to 360 video QoE is much less understood and will require conceiving of and measuring new metrics. The proposed mi360World system incorporates three major research thrusts to address the above challenges: A video creation thrust that enables personalized viewing by generating navigation graphs and cinematographic rules, while maintaining a high QoE and reducing cybersickness. The construction of navigation graphs and inclusion of cinematographic rules represent the main innovations of this project, and are encapsulated in a three-layered metadata representation of the 360 video: a transport layer, a semantic layer, and an interactive story-telling layer. The second thrust focuses on scalable distribution of 360 videos to a global set of diverse viewers, utilizing navigation graphs and cinematographic rules for highly efficient transition-predictive prefetching and caching. The third thrust focuses on QoE and has the goal of devising novel QoE metrics and evaluation methods to assess cybersickness. System architectures and algorithms will be extensively evaluated through simulation, emulation, and benchmarking using testbeds to assess the success of the proposed research.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
期刊论文(17)
专著(0)
科研奖励(0)
会议论文
DOI: 10.1145/3474085.3475673
发表时间: 2021-10
期刊: Proceedings of the 29th ACM International Conference on Multimedia
影响因子: --
作者: [Lingdong Wang;M. Hajiesmaili;R. Sitaraman]
通讯作者: Lingdong Wang;M. Hajiesmaili;R. Sitaraman
DOI: 10.1145/3485983.3494864
发表时间: 2021-12
期刊: Proceedings of the 17th International Conference on emerging Networking EXperiments and Technologies
影响因子: --
作者: [Mirko Palmer;Malte Appel;Kevin Spiteri;B. Chandrasekaran;A. Feldmann;R. Sitaraman]
通讯作者: Mirko Palmer;Malte Appel;Kevin Spiteri;B. Chandrasekaran;A. Feldmann;R. Sitaraman
DOI: 10.1145/3394171.3413512
发表时间: 2020-10
期刊: Proceedings of the 28th ACM International Conference on Multimedia
影响因子: --
作者: [Yunzhuo Liu;Bo Jiang;Tian Guo;R. Sitaraman;D. Towsley;Xinbing Wang]
通讯作者: Yunzhuo Liu;Bo Jiang;Tian Guo;R. Sitaraman;D. Towsley;Xinbing Wang
DOI: 10.1109/ism55400.2022.00025
发表时间: 2022-12
期刊: 2022 IEEE International Symposium on Multimedia (ISM)
影响因子: --
作者: [Shivi Vats;Jounsup Park;K. Nahrstedt;M. Zink;R. Sitaraman;H. Hellwagner]
通讯作者: Shivi Vats;Jounsup Park;K. Nahrstedt;M. Zink;R. Sitaraman;H. Hellwagner
共 14 条
    EAGER: SPRITE: Sensor Processing and Realtime Intelligence at The Edge - Supporting the National Discovery Cloud for Climate with Advanced Networking, Cloud, and Edge Computing
    • 批准号:
      2335335
    • 项目类别:
      Standard Grant
    • 资助金额:
      $30.0万
    • 财政年份:
      2023
    • 负责人:
      Michael Zink
    • 依托单位:
    CC* Compute: COllaborative Next-generation Technology In the Northeast: the UMassUnity Machine (CONTINUUM)
    • 批准号:
      2201106
    • 项目类别:
      Standard Grant
    • 资助金额:
      $39.97万
    • 财政年份:
      2022
    • 负责人:
      Michael Zink
    • 依托单位:
    EAGER: Collaborative Research: CNS: PRATE: P4 Research enabled by Accelerators in national TestbEds
    • 批准号:
      2130907
    • 项目类别:
      Standard Grant
    • 资助金额:
      $14.98万
    • 财政年份:
      2021
    • 负责人:
      Michael Zink
    • 依托单位:
    CC* Integration-Large: An 'On-the-fly' Deeply Programmable End-to-end Network-Centric Platform for Edge-to-Core Workflows
    • 批准号:
      2018074
    • 项目类别:
      Standard Grant
    • 资助金额:
      $75.0万
    • 财政年份:
      2020
    • 负责人:
      Michael Zink
    • 依托单位:
    国内基金
    海外基金
    胆固醇羟化酶CH25H非酶活依赖性促进乙型肝炎病毒蛋白Core及Pre-core降解的分子机制研究
    • 批准号:
      82371765
    • 项目类别:
      面上项目
    • 资助金额:
      50万元
    • 批准年份:
      2023
    • 负责人:
      谭广云
    • 依托单位:
    锕系元素5f-in-core的GTH赝势和基组的开发
    • 批准号:
      22303037
    • 项目类别:
      青年科学基金项目
    • 资助金额:
      30万元
    • 批准年份:
      2023
    • 负责人:
      鲁俊波
    • 依托单位:
    基于合成致死策略搭建Core-matched前药共组装体克服肿瘤耐药的机制研究
    • 批准号:
      --
    • 项目类别:
      --
    • 资助金额:
      52万元
    • 批准年份:
      2022
    • 负责人:
      孙丙军
    • 依托单位:
    鼠伤寒沙门氏菌LPS core经由CD209/SphK1促进树突状细胞迁移加重炎症性肠病的机制研究
    • 批准号:
      --
    • 项目类别:
      青年科学基金项目
    • 资助金额:
      30万元
    • 批准年份:
      2022
    • 负责人:
      叶成林
    • 依托单位: