An Immersive Programming Support System with Perceptual Interfaces that utilize Humans' Body

具有利用人体的感知界面的沉浸式编程支持系统

基本信息

批准号：
14380090
负责人：
OSAWA Noritaka
金额：
$ 6.21万
依托单位：
National Institute of Multimedia Education
依托单位国家：
日本
项目类别：
Grant-in-Aid for Scientific Research (B)
财政年份：
2002
资助国家：
日本
起止时间：
2002 至 2004
项目状态：
已结题

项目摘要

We have investigated and developed an immersive programming learning support system that effectively uses a stereoscopic view of 3D visualization, direct manipulation by hand, and perceptual feedback.We have created a 3D jigsaw-puzzle-like glyph representation for visualizing grammatical rules or constraints of programming in an immersive 3D virtual environment. It represents constraints by matching convex and concave shapes. We also conducted experiments using types of representations: textual representation typically used in programming, a sequence representation of numbers and symbols, 2D glyphs, and 3D glyphs. The experiments showed that the proposed jigsaw-puzzle-like representation is effective and that 3D glyph representation is easy for novice users to learn. This result was also supported by subjective evaluation using questionnaires.Moreover, we studied interaction techniques using hands and devices to improve the usability of manipulating virtual objects in immersive virtual environments. We proposed and investigated manipulation using virtual gearbox widgets combined with direct manipulation by hand, and using direct manipulation by hand with automatic adjustments without widgets. Experimental evaluation showed that the proposed techniques are superior to conventional interaction techniques in immersive virtual environments.Furthermore, we studied aromatic feedback for non-intrusive and ambient information display, and developed a multipoint transmission system using IPv6 multicasting for stereoscopic video in immersive environments, which facilitates efficient, cooperative work among remote virtual environments.This study enabled us to create our effective programming learning support system for novice users in immersive virtual environments.

我们已经调查并开发了一种沉浸式的编程学习支持系统，该系统有效地使用了3D可视化，手工直接操纵和感知反馈的立体视图。我们创建了一个3D拼图式插针样的字形表示，以可视化在沉浸式3D虚拟环境中编程的语法规则或约束。它通过匹配凸形和凹形形状来表示约束。我们还使用表示类型进行了实验：编程中通常使用的文本表示，数字和符号，2D字形和3D字形的序列表示。实验表明，所提出的类似拼图式插头的表示是有效的，并且新手用户可以轻松学习3D字形表示。此结果还通过问卷的主观评估支持。此外，我们使用手和设备研究了交互技术，以提高在沉浸式虚拟环境中操纵虚拟对象的可用性。我们使用虚拟变速箱小部件结合了手工直接操纵，并通过手动进行直接操纵，并使用自动调整无小部件进行了直接操纵，我们提出并调查了操作。实验评估表明，所提出的技术优于沉浸式虚拟环境中的常规交互技术。事实上，我们研究了芳族反馈，以显示非侵入性和环境信息显示的芳香反馈，并开发了使用IPV6多播种的多点传输系统，用于在临时环境中促进远程的环境，从而促进了远程研究，从而促进了有效的工作。适用于沉浸式虚拟环境中的新手用户。