Study of multimedia experiential education system using human interface devices

1.我们提出了一个在线测试和演练管理框架Drills。它集成了日常演习练习和各种考试的执行方式在几个教育目的。我们开发了一些系统，对应于不同的回答类型。DrilLs-F提供了程序阅读问题的源代码和流程图的填充式回答。DrilLs-H是DrilLs-F的独立版本，用于无网络的家庭学习DrilLs-M使用地图和图形中的人机界面设备为科学和地理问题提供操作型回答。操作型答疑实现了用笔写字板进行位置指示、区域绘制和直线跟踪等操作。在Drills服务器上，通过SQL和XML构建了多媒体试题库，并进行了实际的实验.提出了一种具有三维输入设备和立体图形显示的基础动力学实验虚拟现实仿真教材的构建框架，开发了用于控制各种人机接口设备的执行接口Prelude作为Java API，并与C++设备驱动程序相关联。开发了组件库Interlude作为Java 3D API，用于基于图元的教材设计。介绍了动力学实验虚拟现实仿真的两个方面。微观世界方面描述了高中科学教育的基本Negron动力学。演示方面提供了灵活的用户界面的基础上的三维实验操作模型的三维输入设备。它采用变形的非现实表现和游戏般的外观作为寓教于乐的方法。提出了典型动态场景的内容构建原则和教育目的和用户层面的学习项目提问点。提出了机器人控制和游戏竞赛中乐高编程的教学框架。我们开发了支持系统GoalPost的策略设计和群体沟通。

1. We proposed an online test and drill management framework Drills. It integrates execution styles of daily drill exercises and various examinations in several educational purpose. We developed some systems corresponding to various answering type. DrilLs-F offers fill-in type answering in source code and flowchart for program reading problem. DrilLs-H is the stand-alone version of DrilLs-F for home learning without network DrilLs-M offers operation type answering using human interface devices in map and figure for science and geography problem. The operation type answering is implemented about position pointing, area drawing and line tracing with pen tablet. We constructed multimedia problem DB in Drills server by SQL and XML for practical experiment.2. We proposed a construction framework of VR simulation teaching materials with 3D input devices and stereo graphic display for elementary dynamics experiment We developed execution interface Prelude for control of various human interface devices as Java API related with C++ device driver. We also developed component library Interlude as Java 3D API for design of teaching materials by primitive items. It offers two aspects of VR simulation for dynamics experiment. The microworld aspect describes elementary Negron dynamics for high school science education. The presentation aspect offers flexible user-interface for 3D input devices based on 3D experiment manipulation model. It adopts non-reality representation with deformation and game-like outlook as edutainment approach. We also proposed the content construction guideline for typical dynamics scene and questioning point of learning items for educational purpose and user level. We also proposed educational framework of LEGO programming for robot control and in game contest event. We developed support system GoalPost for strategy design and group communication.