Performance evaluation of projection and compression in 3D 360 video

点击翻译按钮获取中文摘要

Omnidirectional (360) video applications are diverse and increasingly popular. They include immersive films,**live-streamed concerts, gaming, tourism, shopping and telepresence. Due to human peripheral vision being**limited to a small area of the 360 videos, and the area in view must be of sufficiently high-enough resolution, it**forces the capture of 360 videos at minimum of 4K or even 8K resolutions. Such high-resolution videos lead to**high computational complexity and huge data rates. These problems are aggravated with stereo (3D) 360**videos which are highly desirable to deliver a true immersive experience. Summit Tech offers 360 video**solutions and faces challenges with current streaming capabilities within networks constrained in delivering**optimal performance due to changing network conditions. It needs to assess which projections and encoders**can provide the best compression/ quality/ computational complexity trade-offs. Moreover, Summit Tech plans**to offer 3D 360 video solutions. Therefore, it needs to determine if the projections that are successful on 360**monoscopic video still perform well on 3D 360 videos. It must also determine if 3D codecs, which exploit the**disparity between views, can perform significantly better than the monoscopic ones on 3D content. The main**objective of this project is to develop software tools that permit to evaluate the performance of various 3D 360**components (e.g. projections and encoders) under various quality metrics. The projections will include**well-known projections as well as newer ones from the literature. The quality metrics will include PSNR-based**as well as novel panoramic and 3D objective quality metrics from the literature. The developed software will**be an extension of MPEG's JVET 360Lib supporting a wider range of projections, encoders and quality**metrics. The proposed software will also be reengineered to support the processing and performance evaluation**of 3D 360 videos which is currently lacking in 360Lib. This new software tool, the first supporting 3D 360**videos, will provide crucial information to orient the strategic technical directions and designs of new and**improved Summit Tech products and ensure their continuous world leadership and success.