Performance evaluation of projection and compression in 3D 360 video

全方位(360)视频应用程序多种多样，越来越受欢迎。它们包括身临其境的电影、**现场直播音乐会、游戏、旅游、购物和远程呈现。由于人类的周边视觉**局限于360个视频中的一小部分，而且视野区域必须足够高的分辨率，所以它**强制捕捉360个视频的最低4K甚至8K分辨率。这样的高分辨率视频会导致**高计算复杂度和巨大的数据速率。立体声(3D)360**视频加剧了这些问题，这些视频非常需要提供真正的身临其境体验。Summit Tech提供360视频**解决方案，但由于不断变化的网络条件，网络中当前的流媒体能力在提供**最佳性能方面受到限制，因此面临挑战。IT需要评估哪些投影和编码器**可以提供最佳的压缩/质量/计算复杂性折衷。此外，顶峰科技计划**提供3D 360视频解决方案。因此，它需要确定在360**单视角视频上成功的投影在3D 360视频上是否仍然表现良好。它还必须确定，利用视点之间**差异的3D编解码器在3D内容上的表现是否能明显好于单画面编解码器。该项目的主要**目标是开发软件工具，允许在各种质量指标下评估各种3D 360**组件(例如投影和编码器)的性能。这些预测将包括**众所周知的预测以及文献中较新的预测。质量指标将包括基于PSNR的**以及来自文献的新颖的全景和3D客观质量指标。开发的软件将**是MPEGJVET 360Lib的扩展，支持更广泛的投影、编码器和质量**指标。拟议的软件还将进行重新设计，以支持目前缺乏360Lib的3D360视频的处理和性能评估**。这个新的软件工具是第一个支持3D 360**视频的软件工具，它将提供至关重要的信息，以指导新的和**改进的Summit Tech产品的战略技术方向和设计，并确保它们继续保持世界领先地位和成功。

Omnidirectional (360) video applications are diverse and increasingly popular. They include immersive films,**live-streamed concerts, gaming, tourism, shopping and telepresence. Due to human peripheral vision being**limited to a small area of the 360 videos, and the area in view must be of sufficiently high-enough resolution, it**forces the capture of 360 videos at minimum of 4K or even 8K resolutions. Such high-resolution videos lead to**high computational complexity and huge data rates. These problems are aggravated with stereo (3D) 360**videos which are highly desirable to deliver a true immersive experience. Summit Tech offers 360 video**solutions and faces challenges with current streaming capabilities within networks constrained in delivering**optimal performance due to changing network conditions. It needs to assess which projections and encoders**can provide the best compression/ quality/ computational complexity trade-offs. Moreover, Summit Tech plans**to offer 3D 360 video solutions. Therefore, it needs to determine if the projections that are successful on 360**monoscopic video still perform well on 3D 360 videos. It must also determine if 3D codecs, which exploit the**disparity between views, can perform significantly better than the monoscopic ones on 3D content. The main**objective of this project is to develop software tools that permit to evaluate the performance of various 3D 360**components (e.g. projections and encoders) under various quality metrics. The projections will include**well-known projections as well as newer ones from the literature. The quality metrics will include PSNR-based**as well as novel panoramic and 3D objective quality metrics from the literature. The developed software will**be an extension of MPEG's JVET 360Lib supporting a wider range of projections, encoders and quality**metrics. The proposed software will also be reengineered to support the processing and performance evaluation**of 3D 360 videos which is currently lacking in 360Lib. This new software tool, the first supporting 3D 360**videos, will provide crucial information to orient the strategic technical directions and designs of new and**improved Summit Tech products and ensure their continuous world leadership and success.