Study of multimedia experiential education system using human interface devices

1.提出了一种在线测试和演练管理框架Drills。它集日常演练和各种考试的执行方式于一体，具有多种教育目的。我们开发了一些与各种答疑类型相对应的系统。Drills-F提供了填充式答案源代码和程序阅读问题的流程图。Drills-H是Drills-F的独立版本，适用于无网络学习的家庭学习Drills-M提供使用地图和图形中的人机界面设备进行科学和地理问题的操作类型回答。用手写板实现点位、画区、描线等操作类型的答疑。本文的主要工作如下：1.在Drills服务器上利用SQL和XML构建了多媒体题库，进行了实际实验。提出了一种具有3D输入设备和立体图形显示的基础动力学实验VR仿真教材建设框架，并利用C++设备驱动程序开发了用于控制各种人机接口设备的执行接口Prelude。我们还开发了组件库Interlude作为Java 3D API，用于按原始项设计教材。为动力学实验的VR仿真提供了两个方面的内容。微观世界方面描述了高中科学教育的基本Negron动力学。演示方面为基于3D实验操作模型的3D输入设备提供了灵活的用户界面。它采用了变形的非真实感表现和游戏化的观感作为娱乐方式。针对教育目的和用户层面的学习项目，提出了典型动态场景和问题点的内容构建原则。我们还提出了机器人控制和游戏竞赛项目中的乐高编程的教学框架。我们开发了支持系统Goalpost，用于战略设计和团队沟通。

1. We proposed an online test and drill management framework Drills. It integrates execution styles of daily drill exercises and various examinations in several educational purpose. We developed some systems corresponding to various answering type. DrilLs-F offers fill-in type answering in source code and flowchart for program reading problem. DrilLs-H is the stand-alone version of DrilLs-F for home learning without network DrilLs-M offers operation type answering using human interface devices in map and figure for science and geography problem. The operation type answering is implemented about position pointing, area drawing and line tracing with pen tablet. We constructed multimedia problem DB in Drills server by SQL and XML for practical experiment.2. We proposed a construction framework of VR simulation teaching materials with 3D input devices and stereo graphic display for elementary dynamics experiment We developed execution interface Prelude for control of various human interface devices as Java API related with C++ device driver. We also developed component library Interlude as Java 3D API for design of teaching materials by primitive items. It offers two aspects of VR simulation for dynamics experiment. The microworld aspect describes elementary Negron dynamics for high school science education. The presentation aspect offers flexible user-interface for 3D input devices based on 3D experiment manipulation model. It adopts non-reality representation with deformation and game-like outlook as edutainment approach. We also proposed the content construction guideline for typical dynamics scene and questioning point of learning items for educational purpose and user level. We also proposed educational framework of LEGO programming for robot control and in game contest event. We developed support system GoalPost for strategy design and group communication.