Performance evaluation of projection and compression in 3D 360 video

3D 360 视频中投影和压缩的性能评估

• 批准号: 523516-2018
• 负责人: Coulombe, Stéphane
• 金额: $ 1.82万
• 依托单位: École de technologie supérieure
• 依托单位国家: 加拿大
• 项目类别: Engage Grants Program
• 财政年份: 2018
• 资助国家: 加拿大
• 起止时间: 2018-01-01 至 2019-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=648193
• 关键词: Performance; evaluation; projection; compression; 3D

Omnidirectional (360) video applications are diverse and increasingly popular. They include immersive films,**live-streamed concerts, gaming, tourism, shopping and telepresence. Due to human peripheral vision being**limited to a small area of the 360 videos, and the area in view must be of sufficiently high-enough resolution, it**forces the capture of 360 videos at minimum of 4K or even 8K resolutions. Such high-resolution videos lead to**high computational complexity and huge data rates. These problems are aggravated with stereo (3D) 360**videos which are highly desirable to deliver a true immersive experience. Summit Tech offers 360 video**solutions and faces challenges with current streaming capabilities within networks constrained in delivering**optimal performance due to changing network conditions. It needs to assess which projections and encoders**can provide the best compression/ quality/ computational complexity trade-offs. Moreover, Summit Tech plans**to offer 3D 360 video solutions. Therefore, it needs to determine if the projections that are successful on 360**monoscopic video still perform well on 3D 360 videos. It must also determine if 3D codecs, which exploit the**disparity between views, can perform significantly better than the monoscopic ones on 3D content. The main**objective of this project is to develop software tools that permit to evaluate the performance of various 3D 360**components (e.g. projections and encoders) under various quality metrics. The projections will include**well-known projections as well as newer ones from the literature. The quality metrics will include PSNR-based**as well as novel panoramic and 3D objective quality metrics from the literature. The developed software will**be an extension of MPEG's JVET 360Lib supporting a wider range of projections, encoders and quality**metrics. The proposed software will also be reengineered to support the processing and performance evaluation**of 3D 360 videos which is currently lacking in 360Lib. This new software tool, the first supporting 3D 360**videos, will provide crucial information to orient the strategic technical directions and designs of new and**improved Summit Tech products and ensure their continuous world leadership and success.

全向（360）视频应用是多样的并且越来越受欢迎。它们包括沉浸式电影，** 直播音乐会，游戏，旅游，购物和网真。由于人类的周边视觉 ** 仅限于360视频的一小部分区域，并且视野中的区域必须具有足够高的分辨率，因此它 ** 强制以至少4K甚至8 K的分辨率捕获360视频。这样的高分辨率视频导致 ** 高计算复杂度和巨大的数据速率。这些问题随着立体（3D）360** 视频而加剧，立体（3D）360** 视频非常期望提供真正的沉浸式体验。Summit Tech提供360度视频 ** 解决方案，但由于网络条件不断变化，当前网络中的流媒体功能在提供 ** 最佳性能方面受到限制，因此面临挑战。它需要评估哪些投影和编码器 ** 可以提供最佳的压缩/质量/计算复杂性权衡。此外，Summit Tech计划提供3D 360视频解决方案。因此，需要确定在360** 单视场视频上成功的投影是否仍然在3D 360视频上表现良好。它还必须确定利用视图之间的 ** 差异的3D编解码器是否可以在3D内容上比单视场编解码器表现得更好。该项目的主要目标是开发软件工具，允许在各种质量指标下评估各种3D 360** 组件（例如投影和编码器）的性能。这些预测将包括 ** 众所周知的预测以及文献中较新的预测。质量指标将包括基于PSNR的 ** 以及来自文献的新颖的全景和3D客观质量指标。开发的软件将 ** 是MPEG的JVET 360 Lib的扩展，支持更广泛的投影、编码器和质量 ** 指标。拟议的软件也将重新设计，以支持360 Lib目前缺乏的3D 360视频的处理和性能评估 **。这款新的软件工具是第一个支持3D 360** 视频的软件工具，将提供重要信息，以确定新的和 ** 改进的Summit Tech产品的战略技术方向和设计，并确保其持续的世界领导地位和成功。