权益分类	功能权益	普通用户	{{item.name}}会员
{{category.name}}	{{benefitItem.name}}

A Study for Manipulation and Editing System with Multi Modal Interface

多模态界面操作编辑系统的研究

基本信息

批准号：
09480075
负责人：
KISHINO Fumio
金额：
$ 9.41万
依托单位：
Osaka University
依托单位国家：
日本
项目类别：
Grant-in-Aid for Scientific Research (B)
财政年份：
1997
资助国家：
日本
起止时间：
1997 至 1999
项目状态：
已结题

来源：
https://kaken.nii.ac.jp/grant/KAKENHI-PROJECT-09480075/
关键词：
Multi Modal Interface Virtual Reality Virtual Nature Environment Real Environment Display Manegement and Editing System Virtual Object マルチモーダルインターフェイス樹木

项目摘要

In this research, we discussed the method of cooperative virtual reality system which harmonize the virtual objects and real world. The proposed system does not model all the real scene into the virtual world, but take it in to the system as the images. Moreover, virtual objects are generated and edited with the use of multimodal interface system. Our goal is to establish the essential technology for the proposed system. The main results are as follows :Manipulation in the virtual nature environmentAs a first step towards the system, in which the user is able to operate plant models inside the virtual environment freely with natural interface, we explore the method about dynamic object data reconstruction. So, we can arrange the operations of plant in order and investigate the method that is able to divide plant models according to their parts.Navigation in an enormous virtual environmentWe propose a manipulation technique to intuitively control the "bird's eye" overview display of an entire large-scale virtual environment in a display system that present a user with both overviews (global views) and a life-size virtual environment (local view) simultaneously. It enables efficient navigation even in enormous and complicated environments using both global and local views. The motion of the bird's eye viewpoint interlocks with the relative motion of the user's viewpoint and his/her hand, therefore, the user can control the "bird's eye" viewpoint by intuitive manipulation.Panoramic real images for real-time walk-throughWe proposed a method to create a realistic distant scenery in a virtual environment using panoramic real images taken by an omnidirectional stereo imaging sensor. The system can represent motion parallax following viewpoints according to user's movement.

在本研究中，我们讨论了协调虚拟对象和现实世界的协作式虚拟现实系统的方法。该系统不是将所有真实场景建模为虚拟世界，而是将其作为图像输入到系统中。利用多模态接口系统生成和编辑虚拟对象。我们的目标是为提议的系统建立必要的技术。主要研究成果如下：虚拟自然环境中的操作作为实现用户在虚拟环境中通过自然界面自由操作植物模型的第一步，我们探索了动态对象数据重建方法。因此，我们可以对工厂的操作进行有序安排，并研究按部件划分工厂模型的方法。我们提出了一种操作技术，可以在显示系统中直观地控制整个大型虚拟环境的“鸟瞰”全景显示，同时向用户展示全景（全局视图）和真人大小的虚拟环境（局部视图）。即使在巨大和复杂的环境中，它也可以使用全局和局部视图进行有效的导航。鸟眼视点的运动与用户视点与手的相对运动互锁，因此，用户可以通过直观的操作来控制“鸟眼”视点。我们提出了一种利用全向立体成像传感器拍摄的全景实景图像，在虚拟环境中创建逼真的远处风景的方法。该系统可以根据用户的运动表现出视点的运动视差。