Study on a Ubiquitous Mixed Reality Technology for Integrating First Person Haptic Media and Wireless Network

我们研究了如何构建一个逼真的泛在混合现实（UMR）环境。这项研究的目的是开发一种新的技术框架，以有效地支持新的模式，如触觉界面设备，除了传统的图像和声音媒体。设计和开发基础技术和软件系统。本研究产生了以下结果：1。我们设计并实现了一些基本技术，如触觉渲染优化方法和高效共享触觉媒体的高性能网络协议。触觉优化方法允许即使是新手也可以直观地优化触觉设备，而无需关注任何设备特定的特性。新开发的协议使用一种称为航位推算的方法来保持有效和稳定的触觉通信。我们利用第1项实现的技术设计和开发了一些应用系统。所开发的系统包括支持协同三维操作的分布式虚拟环境和用于手写体教学的远程教学系统。我们进一步增强了第2项中描述的应用程序系统，使其可以在网络上使用。实验试验台是利用一些国际、国家和地区千兆网络搭建的。然后，我们在日本和韩国的几个合作者的站点部署了应用系统，并进行了实验来验证所开发的方法和系统的有效性。我们特别分析了网络延迟、抖动和数据包丢失如何影响触觉通信的可用性和用户友好性，以及我们开发的方法如何补偿这些退化。整个系统的概念、提出的方法、实验系统配置以及实验结果和分析都发表在各种会议论文和期刊论文中。

We have studied on how to construct a realistic ubiquitous mixed reality (UMR) environment. The purpose of the research is to develop a new technological framework to effectively support new modalities such as haptic interface devices in addition to the traditional image and sound media. Basic technologies and software systems are designed and developed. This study has produced the following results :1. We devised and implemented some fundamental technologies such as a haptic rendering optimization method and a high performance network protocol for efficiently sharing haptic media. The haptic optimization method allows even novices to intuitively optimize haptic devices without paying attention to any device-specific characteristics. The newly developed protocol uses a method called dead reckoning to preserve efficient and stable haptic communications.2. We designed and developed some application systems by using the technologies implemented in item 1. The developed systems include a distributed virtual environment for supporting collaborative 3D operations and a remote instruction system for teaching handwritten characters.3. We further enhanced the application systems as described in item 2 to be usable on the network. The experimental test-bed was constructed by using some international, national and regional gigabit networks. Then, we deployed the application systems in several collaborators' sites in Japan and Korea and conducted experiments to verify the effectiveness of the developed methods and systems. We especially analyzed how network delays, jitters, and packet losses impact the usability and user-friendliness on haptic communications and how our developed methods compensate for the degradations. The whole system concepts, proposed methods, experimental system configurations, and experimental results and analyses are published in various conference papers and journal papers.