A multimedia communication system for the visually and hearing impaired

我们研究了视障者和听障者信息提供方式的可能性和存在的问题。因此，我们对计算机网络上的通信，面对面的通信等进行了评估和考虑。1.基于字符的计算机网络通信系统我们开发了一个聊天应用程序，该应用程序具有针对视力和听力障碍者的用户界面。然后，我们对视觉障碍和听觉障碍的被试进行了交流实验。从研究结果可以看出，视障者的首要任务是无障碍，如何实现听障者在网络上的自然交流等。2.视障者与听障者的面对面交流我们评估了以下几种交流情况：（1）直接交流（如唇阅读）、（2）写、（3）通过手语/语音翻译、（4）使用聊天等。特别是聊天由于可靠性而获得了良好的评价。3.听力障碍者与听力正常者之间的交互式通信支持系统我们研究了如何正确地呈现文本信息以支持交互式通信。因此，我们有一些建议，“重要的是要清楚地表明文本数据呈现给听力受损的人的时间顺序。”，“有必要注意说话者与他/她的文本信息之间关系的强度。”，等等。

We studied about the possibilities and the problems of the way to supplying information for the visually impaired and the hearing impaired. So we evaluated and considered about the communication on computer network, face-to-face communication, and so on.1.Character Based Communication System on Computer NetworkWe developed a chat application that has the user interface for the visually and the hearing impaired. Then, we did a communication experiments by the subjects with visually or hearing impairments. It got obvious from the results, that the most priority task especially for visually impaired is the accessibility, that how it realizes a natural communication on the network for hearing impaired, and so on.2.Face-to-Face Communication Between Visually Impaired and Hearing ImpairedWe evaluated several situations of communication as (1) directly (as lip reading), (2) writing, (3) via sign language /voice interpreter, (4) using chat, and so on. Especially, the chat took a good evaluation because of the reliability. There was a request for down sizing of the system like PDA.3.Support System of Interactive Communication Between Hearing Impaired and Hearing PersonsWe examined the proper way to present the text information to support interactive communication. As a result, we had some suggestion that "it is important to clearly indicate the time order that the text data are presented to a hearing impaired person.", " it is necessary to take notice of the intensity of the relation between a speaker and his/her text information.", and so on.