A multimedia communication system for the visually and hearing impaired

我们研究了为视障人士和听障人士提供信息的可能性和存在的问题。因此，我们对计算机网络交流、面对面交流等方面进行了评估和思考。1.基于特征的计算机网络交流系统我们开发了一个具有视觉障碍和听障用户界面的聊天应用程序。然后，我们对有视觉或听力障碍的受试者进行了交流实验。从结果可以明显看出，尤其是对于视障人士来说，最重要的任务是无障碍，以及如何实现听障人士在网络上的自然交流等等。2.视障和听障之间的面对面交流我们评估了几种交流的情况，包括(1)直接(作为唇读)，(2)写作，(3)通过手语/语音翻译，(4)使用聊天等。特别是，由于可靠性，聊天得到了很好的评价。有人要求像PDA这样的系统缩小规模。3.听力障碍者和听力障碍者之间交互交流的支持系统我们研究了支持交互交流的文本信息的适当呈现方式。因此，我们提出了一些建议，如“必须清楚地指出文本数据呈现给听障人士的时间顺序”、“必须注意说话者与其文本信息之间的关系的强度”等等。

We studied about the possibilities and the problems of the way to supplying information for the visually impaired and the hearing impaired. So we evaluated and considered about the communication on computer network, face-to-face communication, and so on.1.Character Based Communication System on Computer NetworkWe developed a chat application that has the user interface for the visually and the hearing impaired. Then, we did a communication experiments by the subjects with visually or hearing impairments. It got obvious from the results, that the most priority task especially for visually impaired is the accessibility, that how it realizes a natural communication on the network for hearing impaired, and so on.2.Face-to-Face Communication Between Visually Impaired and Hearing ImpairedWe evaluated several situations of communication as (1) directly (as lip reading), (2) writing, (3) via sign language /voice interpreter, (4) using chat, and so on. Especially, the chat took a good evaluation because of the reliability. There was a request for down sizing of the system like PDA.3.Support System of Interactive Communication Between Hearing Impaired and Hearing PersonsWe examined the proper way to present the text information to support interactive communication. As a result, we had some suggestion that "it is important to clearly indicate the time order that the text data are presented to a hearing impaired person.", " it is necessary to take notice of the intensity of the relation between a speaker and his/her text information.", and so on.