Building Virtual Environment by using Objective Multi-modal Interface

点击翻译按钮获取中文摘要

For an establishment of the basic human interface technology, this research proposed the object-oriented multi-modal interface which allows users to manipulate various objects by making use of user's intuition and user's senses to the full. And it was evaluated by using the interaction system that makes the virtual environment by using our proposed interface.In this research, we developed the interface which consists of special blocks as the object-oriented interface. This interface can secure consistency between real and virtual environment for realizing the user's intuition to the system directly. We measured the detailed characteristics of this interface. From this result, we made an interface for. cognitive assessment and a system which allows users to retrieve 3D object by using this interface by making use of the characteristic of our proposed interface fully.Furthermore, we developed an interaction method of natural object like tree models which have complex shapes and growth factor. This method is reconstructing data structure of tree models in accordance with user's operational intention by using two-handed manipulation. Moreover, we developed an interactive system which allows users to generate, manipulate and edit shapes of tree models based on a growth simulation.