AI-empowered Point Cloud Video Streaming

点云视频是全息和体视频最流行的表现形式，是VR/AR/MR中先行自然内容的媒介，有望成为下一代视频，为用户提供更好的沉浸式观看体验。点云视频在Society 5.0中有着广泛的应用，例如在线教育和娱乐。为了进一步增强这些应用，网络点云视频的需求非常迫切。本项目旨在解决高质量点云视频流的核心技术问题，推动点云视频在Society 5.0中的应用。在过去的一年里，我们开发了基于人工智能的流媒体算法，为用户提供了更高的视频质量。此外，我们对MEC进行了优化，以提供短延迟的额外计算能力。为了评估性能，我们创建了原型。我们的一些研究结果已经发表或提交给IEEE/ACM期刊和会议。

Point cloud video is the most popular representation of hologram and volumetric video, which is the medium to precedent natural content in VR/AR/MR, and is expected to be the next generation video by providing users with better immersive viewing experience. Point cloud video has wide applications in Society 5.0 such as for online education and entertainment. To further enhance these applications, networked point cloud video is in critical demand. This project aims to solve the core technical questions towards a high quality point cloud video streaming and promote the applications of point cloud video in Society 5.0.In the past year, we have developed AI-based streaming algorithms that deliver enhanced video quality to users. Additionally, we have optimized the MEC to provide short-delay additional computation capability. To evaluate performance, we have created prototypes. Some of our findings have been published or submitted to IEEE/ACM journals and conferences.