Design and Implementation of an Immersive Network Collaborative Environment Using OpenPose with 360VR Camera and WebXR
Design and Implementation of an Immersive Network Collaborative Environment Using OpenPose with 360VR Camera and WebXR
复制标题
使用 OpenPose 与 360VR 相机和 WebXR 设计和实现沉浸式网络协作环境
DOI：
10.1007/978-3-031-08812-4_54
复制
发表时间：
2022
期刊：
影响因子：
--
通讯作者：
Y.
中科院分区：
文献类型：
--
作者：
Xu;J.;Shi;W.;& Okada;Y.
最近，像 Oculus Quest 2 这样的 VR 眼镜开始流行，因为这种眼镜比以往任何时候都更便携、更便宜。因此，使用这种护目镜实现的元宇宙将作为沉浸式网络协作环境之一而变得流行。因此，在本文中，作者提出了相应的设计和实现。对于多人的网络协作，需要同时捕获他们的动作的功能。因此，作者建议在设计中使用 OpenPose 和 360VR 摄像头，因为 OpenPose 几乎实时地从视频中生成多人的姿势信息，而 360VR 摄像头生成的视频覆盖了包括多人的广阔区域。另一方面，这种沉浸式网络协作环境非常复杂，开发起来并不容易。因此，作者还建议在设计中使用 Three.js 的 WebXR，因为 Three.js 是流行的 Web 内容 3D 图形库之一，并且它提供了支持 VR 护目镜的 WebXR 所需的功能。为了证明所提出的设计的合理性，作者实现了一个沉浸式网络协作环境的原型系统。本文解释了所提出的设计和原型系统的细节。
Recently, VR goggles like Oculus Quest 2 have become popularized because such goggles are more portable and cheaper than ever. As a result, Metaverse to be realized using such goggles will become popular as one of the immersive network collaborative environments. So, in this paper, the authors propose the design and implementation for that. For multiple persons’ network collaborations, the functionality to capture their actions simultaneously is required. So, the authors propose the use of OpenPose with 360VR camera in their design because OpenPose generates multiple persons’ pose information from a video almost in real-time and 360VR camera generates a video that covers a wide area including multiple persons. On the other hand, such immersive network collaborative environments are very complicated and their development is not easy. So, the authors also propose the use of WebXR of Three.js in their design because Three.js is one of the popular 3D graphics libraries for web contents and it provides functionality required for WebXR that supports VR goggles. For justifying the proposed design, the authors implemented a prototype system of an immersive network collaborative environment. This paper explains the proposed design and the details of the prototype system.