Projection-Based Ultra Wide-Angle and 360° Video Coding
基于投影的超广角和 360° 视频编码
基本信息
- 批准号:418866191
- 负责人:
- 金额:--
- 依托单位:
- 依托单位国家:德国
- 项目类别:Research Grants
- 财政年份:2019
- 资助国家:德国
- 起止时间:2018-12-31 至 2020-12-31
- 项目状态:已结题
- 来源:
- 关键词:
项目摘要
Both surveillance and automotive applications make use of ultra wide-angle cameras to capture a field of view of more than 180 degrees. With 360-degree cameras, a horizontal field of view of 360 degrees is even possible. Such sequences offer a complete surround view of the captured scene and are thus of particular interest in the context of virtual reality applications, where they provide an immersive experience. In order to provide a sufficient visual quality, a resolution of the single video frames of 4K or 8K is used, which leads to an immense amount of data that cannot be transmitted or stored without compression. Conventional coding techniques do not consider the non-perspective projection functions of ultra wide-angle and 360-degree cameras, leading to suboptimal coding gains. The goal of this project is thus the development of novel compression techniques for ultra wide-angle and 360-degree video sequences to achieve an efficient storage and transmission. In a first phase of the project, a novel motion compensation technique has been developed that outperforms the the state-of-the-art projection-based approach and the traditional translational approach by 2.40 dB and almost 3.00 dB on average, a substantially improved handling of beyond 90-degrees incident angles has been derived, and a real-time interactive visualization tool demonstrating the developed algorithms has been established. In a second phase of the project, it shall be researched how and to what extend projection-based approaches can improve the compression efficiency of hybrid video coding and learning-based video compression network building upon the investigations from the first phase of the project. Thereby, the project addresses research on novel projection-based extensions to hybrid video coding, where special effort goes into the exploration of holistic approaches that take all dependent elements in the coding chain into account. Furthermore, due to the fast-paced development of promising end-to-end learned video compression techniques, the applicability of projection-based methods to end-to-end optimized video compression networks is researched aiming for improved compression efficiency of ultra wide-angle and 360-degree video. The generation and publication of suitable 360-degree datasets for training and testing of the developed techniques for hybrid and learning-based video coding is also part of the project.
监控和汽车应用都使用超广角摄像头来捕获超过180度的视野。使用360度摄像机,甚至可以实现360度的水平视野。这样的序列提供所捕获的场景的完整环绕视图,并且因此在虚拟现实应用的上下文中特别感兴趣,其中它们提供沉浸式体验。为了提供足够的视觉质量,使用4K或8K的单个视频帧的分辨率,这导致在没有压缩的情况下无法传输或存储的大量数据。传统的编码技术不考虑超广角和360度相机的非透视投影函数,导致次优编码增益。因此,本项目的目标是开发用于超广角和360度视频序列的新型压缩技术,以实现高效的存储和传输。在该项目的第一阶段中,已经开发了一种新颖的运动补偿技术,其比最先进的基于投影的方法和传统的平移方法平均高出2.40 dB和几乎3.00 dB,已经导出了对超过90度入射角的显著改进的处理,并建立了一个实时交互式可视化工具来演示所开发的算法。在项目的第二阶段,将在项目第一阶段的调查基础上,研究基于投影的方法如何以及在多大程度上提高混合视频编码和基于学习的视频压缩网络的压缩效率。因此,该项目致力于对混合视频编码的基于投影的新扩展的研究,其中特别努力探索考虑编码链中所有相关元素的整体方法。此外,由于有前途的端到端学习视频压缩技术的快速发展,基于投影的方法的适用性,端到端优化的视频压缩网络的研究,旨在提高超广角和360度视频的压缩效率。生成和发布合适的360度数据集,用于混合和基于学习的视频编码技术的培训和测试也是该项目的一部分。
项目成果
期刊论文数量(0)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)
数据更新时间:{{ journalArticles.updateTime }}
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
数据更新时间:{{ journalArticles.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ monograph.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ sciAawards.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ conferencePapers.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ patent.updateTime }}
Professor Dr.-Ing. André Kaup其他文献
Professor Dr.-Ing. André Kaup的其他文献
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
{{ truncateString('Professor Dr.-Ing. André Kaup', 18)}}的其他基金
Video Coding for Deep Learning-Based Machine-to-Machine Communication
基于深度学习的机器对机器通信的视频编码
- 批准号:
426084215 - 财政年份:2019
- 资助金额:
-- - 项目类别:
Research Grants
Model-based mesh-to-grid image resampling with application to robust object detection, recognition and tracking
基于模型的网格到网格图像重采样,应用于稳健的对象检测、识别和跟踪
- 批准号:
402837983 - 财政年份:2018
- 资助金额:
-- - 项目类别:
Research Grants
Reconstruction of Irregularly Sampled Image Signals Using Sparse Representations
使用稀疏表示重建不规则采样图像信号
- 批准号:
225074913 - 财政年份:2012
- 资助金额:
-- - 项目类别:
Research Grants
Efficient Scalable Analysis and Coding of Hypervolume Data
超容量数据的高效可扩展分析和编码
- 批准号:
175165638 - 财政年份:2010
- 资助金额:
-- - 项目类别:
Research Grants
Extrapolation mehrdimensionaler diskreter Signale und deren Anwendung in der Bild- und Videokommunikation
多维离散信号外推及其在图像视频通信中的应用
- 批准号:
5446991 - 财政年份:2005
- 资助金额:
-- - 项目类别:
Research Grants
Camera Array for Hyperspectral Video Imaging Using Cross-Spectral Multi-View Fusion
使用跨光谱多视图融合进行高光谱视频成像的相机阵列
- 批准号:
491814627 - 财政年份:
- 资助金额:
-- - 项目类别:
Research Grants
Advanced Image Sensing Using Arbitrarily Shaped Pixels and Neural Network Reconstruction
使用任意形状的像素和神经网络重建的高级图像传感
- 批准号:
516695992 - 财政年份:
- 资助金额:
-- - 项目类别:
Research Grants
Learning-Based Wavelet Video Coding Using Deep Adaptive Lifting
使用深度自适应提升的基于学习的小波视频编码
- 批准号:
461649014 - 财政年份:
- 资助金额:
-- - 项目类别:
Research Grants
Losless and lossy compression of screen-content data using machine learning
使用机器学习对屏幕内容数据进行无损和有损压缩
- 批准号:
438221930 - 财政年份:
- 资助金额:
-- - 项目类别:
Research Grants
相似国自然基金
Data-driven Recommendation System Construction of an Online Medical Platform Based on the Fusion of Information
- 批准号:
- 批准年份:2024
- 资助金额:万元
- 项目类别:外国青年学者研究基金项目
Incentive and governance schenism study of corporate green washing behavior in China: Based on an integiated view of econfiguration of environmental authority and decoupling logic
- 批准号:
- 批准年份:2024
- 资助金额:万元
- 项目类别:外国学者研究基金项目
Exploring the Intrinsic Mechanisms of CEO Turnover and Market Reaction: An Explanation Based on Information Asymmetry
- 批准号:W2433169
- 批准年份:2024
- 资助金额:万元
- 项目类别:外国学者研究基金项目
A study on prototype flexible multifunctional graphene foam-based sensing grid (柔性多功能石墨烯泡沫传感网格原型研究)
- 批准号:
- 批准年份:2020
- 资助金额:20 万元
- 项目类别:
基于tag-based单细胞转录组测序解析造血干细胞发育的可变剪接
- 批准号:81900115
- 批准年份:2019
- 资助金额:21.0 万元
- 项目类别:青年科学基金项目
应用Agent-Based-Model研究围术期单剂量地塞米松对手术切口愈合的影响及机制
- 批准号:81771933
- 批准年份:2017
- 资助金额:50.0 万元
- 项目类别:面上项目
Reality-based Interaction用户界面模型和评估方法研究
- 批准号:61170182
- 批准年份:2011
- 资助金额:57.0 万元
- 项目类别:面上项目
Multistage,haplotype and functional tests-based FCAR 基因和IgA肾病相关关系研究
- 批准号:30771013
- 批准年份:2007
- 资助金额:30.0 万元
- 项目类别:面上项目
差异蛋白质组技术结合Array-based CGH 寻找骨肉瘤分子标志物
- 批准号:30470665
- 批准年份:2004
- 资助金额:8.0 万元
- 项目类别:面上项目
GaN-based稀磁半导体材料与自旋电子共振隧穿器件的研究
- 批准号:60376005
- 批准年份:2003
- 资助金额:20.0 万元
- 项目类别:面上项目
相似海外基金
CAREER: CRISPR-based biosensors for the ultra-accurate detection of disease-related single nucleotide polymorphisms (SNPs)
职业:基于 CRISPR 的生物传感器,用于超准确检测与疾病相关的单核苷酸多态性 (SNP)
- 批准号:
2421137 - 财政年份:2024
- 资助金额:
-- - 项目类别:
Continuing Grant
CAREER: CRISPR-based biosensors for the ultra-accurate detection of disease-related single nucleotide polymorphisms (SNPs)
职业:基于 CRISPR 的生物传感器,用于超准确检测与疾病相关的单核苷酸多态性 (SNP)
- 批准号:
2339868 - 财政年份:2024
- 资助金额:
-- - 项目类别:
Continuing Grant
EAGER: Flexible and compressible e-Skin integrated with soft magnetic coil based ultra-thin actuator and touch sensor for robotics applications
EAGER:灵活且可压缩的电子皮肤与基于软磁线圈的超薄执行器和触摸传感器集成,适用于机器人应用
- 批准号:
2337074 - 财政年份:2023
- 资助金额:
-- - 项目类别:
Standard Grant
Development of Si-based phase change materials at ultra-high temperature for high-efficiency thermal energy storage systems
开发用于高效热能存储系统的超高温硅基相变材料
- 批准号:
23KJ0032 - 财政年份:2023
- 资助金额:
-- - 项目类别:
Grant-in-Aid for JSPS Fellows
Ultra-Precision Agriculture Using Fluorescence Based Label Free Technology for Green Fruit
利用基于荧光的无标签技术实现绿色水果的超精准农业
- 批准号:
22KF0179 - 财政年份:2023
- 资助金额:
-- - 项目类别:
Grant-in-Aid for JSPS Fellows
Scaling up a novel low-emission fungal fermentation-based production system to commercialise ultra-realistic meat whole-cuts alternatives
扩大基于真菌发酵的新型低排放生产系统,以实现超现实肉类全切替代品的商业化
- 批准号:
10076671 - 财政年份:2023
- 资助金额:
-- - 项目类别:
Collaborative R&D
The Realization of Next-Generation Integrated Millimeter-Wave Systems Based On Ultra-Low-Noise Frequency Synthesis Techniques
基于超低噪声频率合成技术的下一代集成毫米波系统的实现
- 批准号:
22KJ0659 - 财政年份:2023
- 资助金额:
-- - 项目类别:
Grant-in-Aid for JSPS Fellows
Ultra-Low-Cost Perovskite Solar Cells based on Printed Inorganic Nanoporous Electrodes
基于印刷无机纳米多孔电极的超低成本钙钛矿太阳能电池
- 批准号:
22KJ2631 - 财政年份:2023
- 资助金额:
-- - 项目类别:
Grant-in-Aid for JSPS Fellows
Ultra-Low-Cost and Highly-Stable Perovskite Solar Cells Based on Inorganic-Carbon Materials
基于无机碳材料的超低成本、高稳定性钙钛矿太阳能电池
- 批准号:
23KJ1175 - 财政年份:2023
- 资助金额:
-- - 项目类别:
Grant-in-Aid for JSPS Fellows
Development of ultra-high-speed image-based technology for the study of lightning and lightning interactions
开发用于研究闪电和闪电相互作用的超高速图像技术
- 批准号:
2751179 - 财政年份:2022
- 资助金额:
-- - 项目类别:
Studentship