Building Virtual Environment by using Objective Multi-modal Interface

为建立基本的人机介面技术，本研究提出面向对象的多模态介面，让使用者能充分利用直觉与感官来操控各种物件。在本研究中，我们开发了一个由特定区块组成的介面，作为物件导向介面，并以互动系统来建构虚拟环境。该接口保证了真实的环境与虚拟环境的一致性，实现了用户对系统的直观感受。我们测量了这个接口的详细特性。根据这个结果，我们制作了一个接口。认知评估和系统，允许用户使用该接口检索三维物体，充分利用我们提出的接口的特点，并开发了一种自然对象的交互方法，如具有复杂的形状和生长因子的树木模型。该方法是根据用户的双手操作意图，重构树模型的数据结构。此外，我们开发了一个交互式系统，允许用户生成，操作和编辑的形状的树木模型的基础上的生长模拟。

For an establishment of the basic human interface technology, this research proposed the object-oriented multi-modal interface which allows users to manipulate various objects by making use of user's intuition and user's senses to the full. And it was evaluated by using the interaction system that makes the virtual environment by using our proposed interface.In this research, we developed the interface which consists of special blocks as the object-oriented interface. This interface can secure consistency between real and virtual environment for realizing the user's intuition to the system directly. We measured the detailed characteristics of this interface. From this result, we made an interface for. cognitive assessment and a system which allows users to retrieve 3D object by using this interface by making use of the characteristic of our proposed interface fully.Furthermore, we developed an interaction method of natural object like tree models which have complex shapes and growth factor. This method is reconstructing data structure of tree models in accordance with user's operational intention by using two-handed manipulation. Moreover, we developed an interactive system which allows users to generate, manipulate and edit shapes of tree models based on a growth simulation.