A multi-modal mobile device for learning japanese kanji characters through mnemonic stories
A multi-modal mobile device for learning japanese kanji characters through mnemonic stories
复制标题
通过助记故事学习日语汉字的多模式移动设备
DOI：
10.1145/1322192.1322250
复制
发表时间：
2007
期刊：
影响因子：
--
通讯作者：
K. Mase
中科院分区：
文献类型：
--
作者：
Norman Lin;S. Kajita;K. Mase
我们设计了一种新颖的多模态移动计算机系统，通过创建助记故事来支持外国学生学习日本汉字。我们的系统将复杂的汉字形状视为较小形状的分层组合（遵循Heisig， 1986），并允许超链接导航快速跟踪整体-部分关系。通过用户提供的有声助记故事，增强汉字形意的视觉显示，从而将学习信息多模态划分为视听两种模态。设备命名方案和颜色编码允许在不同用户的设备之间异步共享音频助记符故事。我们描述了我们的移动多模态界面的设计决策，并根据初学汉字的学习者的反馈给出了初步的可用性结果。我们将助记故事、视听方式和移动设备相结合，为计算机辅助汉字学习提供了一个新的有效系统。
We describe the design of a novel multi-modal, mobile computer system to support foreign students in learning Japanese kanji characters through creation of mnemonic stories. Our system treats complicated kanji shapes as hierarchical compositions of smaller shapes (following Heisig, 1986) and allows hyperlink navigation to quickly follow whole-part relationships. Visual display of kanji shape and meaning are augmented with user-supplied mnemonic stories in audio form, thereby dividing the learning information multi-modally into visual and audio modalities. A device-naming scheme and color-coding allow for asynchronous sharing of audio mnemonic stories among different users' devices. We describe the design decisions for our mobile multi-modal interface and present initial usability results based on feedback from beginning kanji learners. Our combination of mnemonic stories, audio and video modalities, and mobile device provide a new and effective system for computer-assisted kanji learning.