Research on the Application to the Educational System Using New Generation Multimedia Technology

本研究的目的是开发一个易于利用的新一代多媒体技术的教育支持系统，这是目前的实际使用阶段。并以此为目的，对教材的实际使用方法进行了实践和评价。特别是，提出了以立体视觉、3D触觉界面和角色动画作为3D虚拟主体的各种教材原型。此外，在触觉的教育应用方面，研究了触觉与视觉等其他感觉的关系，以及网络延迟的影响。具体成果是以下几个方面的系统和成果的构建和研究。开发了基于混合现实技术的交互建模界面，能够识别学生绘制的三视图，并以立体图形的形式显示出来，并在初中教学中得到了应用。构建了能够根据情感表达行事的动画角色分享环境，并提出了如何嵌入到网络学习的Scrom教材中。在利用模拟的多媒体教材中加入了3D动画表达。利用这些教材进行网络学习，考察学习效果。采用心理物理学的方法考虑了网络延迟或视觉信息在触觉显示中的影响。此外，这幅画。考虑了利用触觉设备对教材进行复杂建模的方法，并开发了其创作系统。建立了虚拟现实与立体视觉相结合的立体图形或物理实验学习系统。使用Web Service技术构建了着色器编程的WBT系统。即使该系统在客户端没有着色器环境，也可以由服务器端执行着色器程序并将其显示在客户端。

In this research, it is the purpose to develop an educational support system using easily the multimedia technology of the new generation that is the present practical use stage. It is also making to practice and evaluate the practical use method of the teaching materials using such technology into the purpose. Especially, various prototypes of teaching materials using a stereo vision, 3D haptic interface and character animation as a 3D virtual agent were proposed. Moreover, about educational use of the haptic, a relation with other feelings, such as vision, and the influence of network delay were studied. A detailed result is construction and research of the following systems and results.1. The interactive modeling interface using the mixed-reality technology which is able to recognize orthographic views of student drew and to display as a solid figure developed, and it practiced in the education of the junior high school.2. The character share environment of animation that is able to act according to feeling expression has been built, and it proposed about how to build into the SCROM teaching materials of e-learning.3. 3D animation expression was added to the multimedia teaching materials that utilized the simulation. E-learning using these teaching materials examined the learning effect.4. The influence which the network delay or the vision information in a haptic display has was considered using psychological physics method. Moreover, the drawing. method of the complex model for the teaching materials using a haptic device was considered, and its authoring system is developed. As a result, a learning system of a solid figure or a physics experiment was built combining virtual reality and a stereo vision to it.5. The WBT system for shader programming was built using the technology of a Web Service. Even if this system does not have shader environment in the client side, a shader program is executed by the server side and it can be displayed on the client side.