The study on realization of multi-user interaction between real and virtual world with pervasive equipments

近年来，关于增强现实/混合现实(AR/MR)的研究很多。这些技术允许远程用户参与在真实空间举行的购物、展览、体育和游戏等社交活动。然而，AR和MR通常需要特殊的设备(例如，运动捕捉套装、沉浸式显示器、摄像机阵列等)来捕捉用户在真实世界中的动作并将其反映到虚拟空间中。为了更好地利用虚拟环境和AR/MR技术，低成本地实现这些技术是非常必要的。本研究旨在实现多用户实时信息共享的中间件，即具有普适设备的现实世界和虚拟世界之间的交互(如CSCW、远程教育、虚拟购物、游戏等)。作为2年的研究成果，发表了1篇国内文章、3篇国际会议论文集和6篇国内研讨会论文集。这些进展详细介绍了系统实现的各个基本技术：(1)基于上下文估计的Qos自适应控制，以有效利用无线网络带宽；(2)针对低处理能力的移动终端的轻量级虚拟3D空间技术；(3)用于叠加真实世界和虚拟空间的传感器位置确定算法。此外，为了实现一个通用版本，我正在实现中间件。

Recently, there are many studies regarding to Augmented Reality/Mixed Reality (AR/MR). These technologies allow remote users to participate in social activities such as shopping, exhibition, sports, and game which are held in real space. However, AR and MR often require special devices (e.g. a motion capturing suit, an immersive display, a camera array, and so on) for capturing movements of users in a real world and reflecting them into a virtual space. In order to utilize VE and AR/MR for various purposes, a technology for realizing these techniques with low cost is essential.In this study, I aimed at the realization of the middleware for multi-user real-time information sharing that is interaction (such as CSCW, remote education, virtual shopping, game, and so on) between real and virtual worlds with pervasive equipments.As research results for 2 years, 1 domestic article, 3 international conference proceedings and 6 domestic workshop proceedings were published. These proceedings detailed each elemental techniques for the implementation of the system; (1) QoS adaptation control based on the context estimation to use wireless network bandwidth, effectively, (2) Light-weight virtual 3D space technique for mobile terminals that is low processing capacity, and (3) Algorithm to decide the position of the sensor for superimposing real worlds and virtual spaces. In addition, toward a general release, I am implementing middleware.