Development of a new human-friendly input method for education by eye movement and hand action

▽利用眼球运动的指向设备的可能性=为阅读文件和欣赏图片而提供的眼球运动信息=现有的眼球相机需要固定头部，因此很难使用。在这项研究中，我们介绍了一种改进的眼摄像头，用户可以移动他们的头。我们测量了阅读文件和欣赏图片时的眼球运动。在阅读文件时，眼球运动遵循文件的顺序。在欣赏图片时，可以通过集中在特定部位的眼球运动来估计用户的兴趣点。通过实验结果表明，我们的眼相机可以作为一种指向装置，对零件进行粗略的指示。使用立体摄像机测量书写字母-视频平板电脑-电脑支持的书写练习系统一般使用手写平板电脑。但是，带有专用笔和专用垫的平板电脑不能与普通的书写材料和纸张一起使用。在本研究中，我们提出了一种视频平板电脑，并对其进行了评价。视频平板电脑通过一对CCD摄像机（一种立体摄像机）实时观察手写数据和过程。我们确认我们的视频平板可以用于笔画提取，并且可以适用于笔画宽度可变的书写材料，比如毛笔。面向中国留学生的多媒体式汉字学习系统的应用学习日语的中国留学生可以使用汉字。然而，在中国和日本使用的汉字在发音、意义和字母形状上都有细微的差异。这些差异使中国学生在日语学习中感到困惑。在这项研究中，我们开发了一个多媒体风格的汉字学习系统，主要针对汉语和日语的汉字差异。此外，我们尝试将新的输入法应用到系统中，并验证了其有效性。

Possibility of pointing devices using eye movement - Eye movement information for reading documents and appreciating pictures -Existing eye cameras are hard to use, because users must fix their heads. In this research, we introduced an improved eye camera which users can move their heads. We measured eye movements for reading documents and appreciating pictures. With regard to reading documents, the eye movement followed the document order. With regard to appreciating pictures, the eye movement concentrated into specific parts and the interesting points of users could be estimated. Through the results, it is revealed that our eye camera can be used as a pointing device which roughly indicates parts.Measurement of writing letters using a stereo camera - Video tablet -Computer supported writing exercise systems generally use a pen tablet. However, Tablets with special pens and special pads cannot be used with common writing materials and papers. In this research, we proposed a video tablet and evaluated it. The video tablet gets handwriting data and the process by observing them with a pair of CCD cameras (a stereo camera) on real time. We confirmed that our video tablet could be used for stroke extraction and could apply to writing materials of which the stroke width is changeable such as a brush.Application to a multimedia style Kanji learning system for international students from ChineInternational students from China who learn Japanese can use Kanji. However, Kanji used in both Chine and Japan has subtle differences in pronunciations, meanings, and letter shapes. These differences confuse Chinese students in Japanese learning. In this research, we developed a multimedia style Kanji learning system focusing on the differences of Kanji between Chinese and Japanese. In addition, we tried to adopt our new input method to the system and confirmed its effectiveness.