Development and evaluation of computer aided multimedia system for learnig braille music

本研究的目的是开发一个支援多种输入输出设备的计算机辅助学习系统，使视力障碍者能够愉快、有兴趣地学习盲文音乐，并从教学工具的角度对该系统进行评价。盲文页面上的盲文分数由扫描仪扫描，系统将盲文分数轻松准确地转换为打印分数。此外，乐谱是由乐器演奏的。2.教师（视力正常者）可以在学生（视力残疾者）面前输入符合教学内容的音符，也可以方便地制作乐谱，因为在计算机CRT显示器上显示的五线谱上，可以通过简单的鼠标操作排列出音符头、谱号等图形化的音乐符号.打印分数自动转换为盲文分数，盲文分数显示在盲文针显示器上。然后，根据班级的要求，灵活的课程成为可能，因为学生能够通过手指触摸在真实的时间感知盲文分数。4.音乐键盘的支持和语音响应/指导将使系统从盲人音乐教育的角度更实用。学生能够同时通过声音和盲文音符和符号两种媒体学习乐谱的功能，作为教学工具发挥着重要作用.即使一个不懂盲文音乐复杂规则的人也可以很容易地将它从印刷乐谱翻译成盲文乐谱。这种轻松导致了翻译的社会公益活动。

The purpose of this research is to develop the computer aided learning system supporting multiple input/output device to make a handicapped person in sight able study the braille music with joy and interest, and to evaluate the system from the viewpoint of a teaching tool.Features of the system developed here are as follows :1. The braille score on a braille page is scanned by a scanner and the system translates the braille score into the print score easily and exactly. Also the score is played by MIDI instruments.2. Teachers (unhandicapped in sight) are able to input the musical note that conformed to the content properly in front of the student (handicapped in sight) or to prepare a print score easily by using this system, because graphical musical symbols such as note heads, clef signs and so on are able to be arranged by simple mouse operation on the staff notation displayed on the computer CRT display.3. A print score is translated automatically into the braille score and the braille score is displayed on the braille pin-display. Then, a flexible lesson becomes possible according to the requirements of the class because students are able to perceive the braille score by finger touch in a real time.4. The support of a musical keyboard and of the verbal response/guidance will make the system more practical from the viewpoint of musical education for the blind.5. The function that students are able to learn simultaneously the score by both media, sound and braille notes and symbols, plays an important role as a teaching tool.6. Even a person who does not know complicated rules in braille music can translate it from the print score into the braille score easily. This ease leads to the social welfare activities of the translation.