Development of a new human-friendly input method for education by eye movement and hand action

使用眼球运动的定点设备的可能性-用于阅读文档和欣赏图片的眼球运动信息-现有的眼睛摄像头很难使用，因为用户必须固定头部。在这项研究中，我们介绍了一种改进的眼睛摄像头，用户可以移动他们的头。我们测量了阅读文档和欣赏图片时的眼动。关于阅读文件，眼球运动遵循文件顺序。在欣赏图片方面，眼球运动集中在特定的部位，可以估计用户的兴趣点。结果表明，我们的眼睛摄像头可以作为一个指向设备，粗略地指示部件。使用立体声摄像头-视频平板电脑-计算机支持的书写练习系统通常使用笔式平板电脑来测量字母。然而，带有特殊笔和特殊衬垫的平板电脑不能与普通书写材料和纸张一起使用。在这项研究中，我们提出了一款视频平板电脑，并对其进行了评估。这款视频平板电脑通过一对CCD摄像头(立体摄像头)实时观察手写数据和过程，从而获得手写数据和过程。我们证实，我们的视频平板可以用于笔画提取，可以应用于笔画宽度可变的书写材料，如毛笔。应用于面向中国留学生的多媒体汉字学习系统中国留学生学习日语的学生可以使用汉字。然而，中日两国使用的汉字在发音、意义和字母形状上都有细微的差异。这些差异使中国学生在学习日语时感到困惑。在本研究中，我们针对中日汉字的差异，开发了一个多媒体汉字学习系统。此外，我们尝试将我们的新输入法应用到系统中，并验证了其有效性。

Possibility of pointing devices using eye movement - Eye movement information for reading documents and appreciating pictures -Existing eye cameras are hard to use, because users must fix their heads. In this research, we introduced an improved eye camera which users can move their heads. We measured eye movements for reading documents and appreciating pictures. With regard to reading documents, the eye movement followed the document order. With regard to appreciating pictures, the eye movement concentrated into specific parts and the interesting points of users could be estimated. Through the results, it is revealed that our eye camera can be used as a pointing device which roughly indicates parts.Measurement of writing letters using a stereo camera - Video tablet -Computer supported writing exercise systems generally use a pen tablet. However, Tablets with special pens and special pads cannot be used with common writing materials and papers. In this research, we proposed a video tablet and evaluated it. The video tablet gets handwriting data and the process by observing them with a pair of CCD cameras (a stereo camera) on real time. We confirmed that our video tablet could be used for stroke extraction and could apply to writing materials of which the stroke width is changeable such as a brush.Application to a multimedia style Kanji learning system for international students from ChineInternational students from China who learn Japanese can use Kanji. However, Kanji used in both Chine and Japan has subtle differences in pronunciations, meanings, and letter shapes. These differences confuse Chinese students in Japanese learning. In this research, we developed a multimedia style Kanji learning system focusing on the differences of Kanji between Chinese and Japanese. In addition, we tried to adopt our new input method to the system and confirmed its effectiveness.