Development and evaluation of computer aided multimedia system for learnig braille music

本研究的目的在于开发一套支援多种输入输出装置的电脑辅助学习系统，让视障人士能愉快而有兴趣地学习盲文音乐，并从教学工具的角度对系统进行评估。本文开发的系统特点如下：通过扫描仪扫描盲文页面上的盲文分数，系统可以轻松准确地将盲文分数转换为打印分数。此外，分数是由MIDI乐器演奏。使用本系统，教师（视障人士）可以在视障人士面前正确输入符合内容的音符，也可以方便地打印乐谱，因为在计算机CRT显示器上显示的五线谱上，只需简单的鼠标操作就可以排列音符头、谱号等图形化的音乐符号。打印分数自动转换为盲文分数，盲文分数显示在盲文针式显示器上。这样，学生就可以通过手指触摸实时感知盲文分数，从而可以根据班级的需要进行灵活的教学。从盲人音乐教育的角度来看，音乐键盘和口头回应/指导的支持将使该系统更加实用。5 .学生可以通过声音和盲文笔记符号两种媒介同时学习乐谱，这是一种重要的教学工具。即使一个人不知道盲文音乐的复杂规则，也可以很容易地把它从印刷乐谱翻译成盲文乐谱。这就引出了翻译的社会福利活动。

The purpose of this research is to develop the computer aided learning system supporting multiple input/output device to make a handicapped person in sight able study the braille music with joy and interest, and to evaluate the system from the viewpoint of a teaching tool.Features of the system developed here are as follows :1. The braille score on a braille page is scanned by a scanner and the system translates the braille score into the print score easily and exactly. Also the score is played by MIDI instruments.2. Teachers (unhandicapped in sight) are able to input the musical note that conformed to the content properly in front of the student (handicapped in sight) or to prepare a print score easily by using this system, because graphical musical symbols such as note heads, clef signs and so on are able to be arranged by simple mouse operation on the staff notation displayed on the computer CRT display.3. A print score is translated automatically into the braille score and the braille score is displayed on the braille pin-display. Then, a flexible lesson becomes possible according to the requirements of the class because students are able to perceive the braille score by finger touch in a real time.4. The support of a musical keyboard and of the verbal response/guidance will make the system more practical from the viewpoint of musical education for the blind.5. The function that students are able to learn simultaneously the score by both media, sound and braille notes and symbols, plays an important role as a teaching tool.6. Even a person who does not know complicated rules in braille music can translate it from the print score into the braille score easily. This ease leads to the social welfare activities of the translation.