Study of Network Communication System for the Visually Impaired

研究并开发了基于Windows PC、多媒体和网络的视觉障碍者人机交互界面。1）远程通信环境我们制作了远程控制扬声器和麦克风的服务器/客户端软件和远程控制摄像机的服务器/客户端软件。通过这些软件的使用，我们可以在互联网上通过声音和图像为视障者提供远程通信、远程指导和远程咨询等多种支持。2）直接访问Windows屏幕的接口我们开发了一种新的ActiveX类型的触摸屏驱动软件在Windows95/98/NT操作系统下，3）听觉图像我们提出了一个新的概念，我们称之为“听觉图像”。它用非语言的声音为盲人呈现图形。听觉图像可以简单地说是指耳对非语言声音和指尖位置的协同感知所形成的“图形”。最后，我们展示了这些接口的一些应用。

We studied and developed some human communication interfaces for the visually impaired by the use of Windows PC (Personal Computer), multimedia, and network. The purpose and usage of them are following 3's.1) An environment for remote communicationWe made the server/client software which controls loudspeaker and microphone remotely, and the server/client software which controls video camera remotely. By the use of these software, we can give the visually impaired several supports such as remote communication, remote guidance and remote consultation through sound and image on the internet.2) A direct access interface to the Windows screenWe developed a new ActiveX type driver software for a touch panel (famous Nomad Pad in the world of DOS system) working under Windows95/98/NT, and enabled direct access to PC screen for the visually impaired instead of the use of mouse.3) Hearing pictureWe present a new concept what we call "hearing picture" which presents graphics figures for the blind using non-verbal sounds. The hearing picture is simply said "figures observed by finger and ear" formed by the cooperative perception of non-verbal sound and fingertip position.At the end, we show some applications of these interfaces.