权益分类	功能权益	普通用户	{{item.name}}会员
{{category.name}}	{{benefitItem.name}}

Study on gesture-based learning system with immersive virtual environments

沉浸式虚拟环境中基于手势的学习系统研究

基本信息

批准号：
15500653
负责人：
ASAI Kikuo
金额：
$ 2.11万
依托单位：
National Institute of Multimedia Education
依托单位国家：
日本
项目类别：
Grant-in-Aid for Scientific Research (C)
财政年份：
2003
资助国家：
日本
起止时间：
2003 至 2005
项目状态：
已结题

项目摘要

In this research, interface using body position, which controls virtual space, was developed, aiming to construct efficient learning system using the body position. What kinds of interface we use in immersive virtual environment is an important factor that dominates usability of applications. Thus, we designed the interface system for detecting body position without wired connection, so that a user can intuitively manipulate immersive virtual environments.The control interface with image processing was developed to smoothly make body position interaction in immersive virtual environments. Using the image processing enables users to move their hands and legs, instead of wired connection. The function of tracking position of the user's head and arms was developed by acquiring depth images with processing video images from plural viewpoints, adapting the function to the immersive virtual environment system that surrounds users. We established infrastructure that was used as an interface, … More detecting body position of the user in real time in immersive projection display.The user performance was evaluated after implementing the control interface of virtual space by body position to the function of viewpoint motion control in virtual environments. The user test was performed, comparing the interface with conventional device (i.e., joystick) and hand-arm gestures. The test result showed that the body position interface was suitable for moving around the virtual environments fast rather than preceding the designated path correctly.When the control interface of virtual environments by body position interaction was developed, the following researches are done for the basic knowledge or their applications ; the visualization systems that presented the contents of interplanetary plasma and lunar surface in the virtual environment, usability test of HMD that makes us hands-free presentation as a display device of virtual environments, the network characteristics for constructing a virtual shared space, and augmented instructions that uses augmented reality technology overlaying virtual objects onto the real world. Less

在本研究中，开发了控制虚拟空间的身体姿势界面，旨在构建有效的身体姿势学习系统。在沉浸式虚拟环境中使用什么样的界面是决定应用程序可用性的一个重要因素。为此，我们设计了无需有线连接的人体位置检测接口系统，使用户能够直观地操作沉浸式虚拟环境，并开发了具有图像处理功能的控制接口，使人体位置在沉浸式虚拟环境中的交互更加流畅。使用图像处理使用户能够移动他们的手和腿，而不是有线连接。通过从多个视点处理视频图像来获取深度图像，开发了跟踪用户的头部和手臂的位置的功能，使该功能适合于围绕用户的沉浸式虚拟环境系统。我们建立了基础设施，作为一个接口， ...更多信息在沉浸式投影显示中，实时真实的检测用户的身体位置，并对虚拟空间的身体位置控制接口实现虚拟环境中视点运动控制功能后的用户表现进行评价。进行了用户测试，将接口与传统设备（即，操纵杆）和手臂手势。测试结果表明，该体位交互界面适合于在虚拟环境中快速移动，而不是按照指定的路径正确行进。在虚拟环境中显示行星际等离子体和月球表面内容的可视化系统，HMD的可用性测试，使我们免提演示作为虚拟环境的显示设备，用于构建虚拟共享空间的网络特性，以及使用增强现实技术将虚拟对象叠加到真实的世界上的增强指令。少

项目成果

期刊论文数量（43）

专著数量（0）

科研奖励数量（0）

会议论文数量（0）

专利数量（0）

Augmented Instructions-a fusion of a augmented reality and printed learning materials.

增强说明 - 增强现实和印刷学习材料的融合。

DOI：
发表时间：
2005
期刊：
Proc. IEEE International Conference on Advanced Learning Technologies(ICALT2005)
影响因子：
0
作者：
Kikuo Asai;Hideaki Kobayashi;Tomotsugu Kondo
通讯作者：
Tomotsugu Kondo

Study on head mounted display for operation support system

手术支持系统头戴式显示器研究