A SYSTEM FOR HELPING BLIND CHILDREN ACQUIRE SPATIAL AWARENESS AND FUNDAMENTAL

帮助盲童获得空间意识和基础知识的系统

• 批准号: 10558133
• 负责人: OHNISHI Noboru
• 金额: $ 3.52万
• 依托单位: NAGOYA UNIVERSITY
• 依托单位国家: 日本
• 项目类别: Grant-in-Aid for Scientific Research (B).
• 财政年份: 1998
• 资助国家: 日本
• 起止时间: 1998 至 2000
• 项目状态: 已结题
• 来源: https://kaken.nii.ac.jp/en/grant/KAKENHI-PROJECT-10558133/
• 关键词: Blind Children; Spatial Awareness; Spatial Mobility; Object Manipulation; Learning; Feedback; Character Information Extraction; 歩行能力

We studied and developed a system for helping blind children, especially the congenital blind, acquire spatial awareness and mobility with supplement feedback via auditory and tactile senses. Furthermore we conducted experiments at the school for the blind and obtained satisfactory results demonstrating the effectiveness of our system.The system consists of two subsystems.The one supports the blind to learn spatial awareness such as size and shape of an object and positional relation among objects. This system consists of a personal computer, an image-capture board, and a camera with three charge couple devices. There are four tasks - object selection (circle, triangle and square), object location, a tic-tac-toe game, and Hukuwarai (arranging face parts). The last two tasks are included so that blind children may enjoy performing them. A blind user is asked to arrange blocks of different shapes according to vocal commands presented by the system. When the user completes the arrangement … More task, the camera captures a picture of the block layout. The system analyzes the shape and location of each block by image processing and outputs the result as speech-whether it is correct or not, and the correction, if necessary. The system realizes a rapid response of less than two seconds and has a simple interface requiring only mouse clicking. By repeating tasks using auditory corrections instead of the help of sighted persons, the user acquires spatial awareness. We conducted experiments with three blind students, including a congenitally blind child, and two sighted children who were blindfolded. All of the subjects were interested in the system and the tasks, especially those involving games. We obtained the results with the hope that the proposed system will help blind children gain spatial awareness.The other subsystem helps visually impaired children who have difficulty in simpler locomotion, and need orientation and mobility (O&M) training. We developed a computer-assisted instruction (CAI) system that helps visually impaired children to improve abilities of orientation and mobility. A user realizes a task given by a tactile map and synthesized speech. The user walks around a room according to the task. The system gives the gap of walking path from its target path via auditory feedback to a walking user, and via both auditory and tactile feedback after the end of a task. The user's walking path is measured by the system using an omnidirectional camera. Then the user can understand how well the user walked and will learn how to walk just as the user intends. We had an experiment with three visually impaired children using this system. One subject improved the result in walking as a straight line and another subject learned kinesthetic perception of absolute distance. Less

我们研究并开发了一种通过听觉和触觉的辅助反馈帮助盲童，特别是先天性盲人获得空间意识和移动能力的系统。该系统由两个子系统组成，一个子系统支持盲人学习空间意识，如物体的大小、形状和物体之间的位置关系，另一个子系统支持盲人学习空间意识。该系统由一台个人计算机、一块图像采集板和一台带有三个电荷耦合器件的摄像机组成。有四个任务-对象选择（圆形，三角形和正方形），对象定位，井字游戏，和Hukuwarai（安排面部部位）。最后两项任务包括在内，以便盲童可以享受执行它们。一个盲人用户被要求安排不同形状的块根据语音命令所提出的系统。当用户完成排列时 ...更多信息 任务时，相机捕获块布局的图片。该系统通过图像处理分析每个块的形状和位置，并将结果以语音形式输出-无论是否正确，以及必要时的校正。该系统实现了不到两秒的快速响应，界面简单，只需点击鼠标即可。通过使用听觉校正而不是视力正常的人的帮助来重复任务，用户获得空间意识。我们对三名盲人学生进行了实验，其中包括一名先天失明的儿童和两名被蒙上眼睛的视力正常的儿童。所有被试都对系统和任务感兴趣，尤其是涉及游戏的任务。我们希望这个系统能帮助盲童获得空间知觉，而另一个子系统则能帮助视障儿童在简单的运动中有困难，需要定向和移动训练。我们开发了一个计算机辅助教学（CAI）系统，帮助视障儿童提高定向和移动能力。用户实现由触觉地图和合成语音给出的任务。用户根据任务在房间里走动。该系统通过听觉反馈给步行用户，并在任务结束后通过听觉和触觉反馈给出步行路径与其目标路径的差距。系统使用全向摄像机测量用户的行走路径。然后，用户可以了解用户行走的情况，并将学习如何按照用户的意图行走。我们用这个系统对三个视力受损的孩子做了一个实验。一名受试者改善了直线行走的结果，另一名受试者学习了绝对距离的动觉感知。少

项目成果

T.Yoneda 他4名: "A System for Blind Children to Improve Fundamental Abilities of Mobility"Proc.of 7th Int.Conf.on Computers Helping People with Special Needs. 537-544 (2000)

T.Yoneda 和其他 4 人：“盲童提高基本移动能力的系统”Proc.of 7th Int.Conf.on Computers Helping People with Special Needs 537-544 (2000)。

Y.Liu 他3名: "Distortion Rectification and Discrimination of Signboards in a Scene Image for Robot Navigation"Proc.of the International Conference on Imaging Science, Systems, and Technology (CISST'99). Y.Liu. 52-58 (1999)

Y.Liu 和其他 3 人：“机器人导航场景图像中招牌的畸变校正和判别”Proc. of the International Conference on Imaging Science, Systems, and Technology (CISST99) (Y.Liu. 1999）

Y.Liu 他3名: "Identification and distortion rectification of signboards in a real scene image for robot navigation"7th International Conference on Computers Helping People with Special Needs. 171-180 (2000)

Y.Liu 等 3 人：“用于机器人导航的实景图像中招牌的识别和失真校正”第七届国际计算机帮助特殊需要者会议 171-180（2000）。

Y.Liu 他3名: "Extraction and Distortion Rectification of Signboards in a Scene Image for Robot Navigation"電気学会論文誌C. 120・7. 1026-1034 (2000)

Y. Liu 等 3 人：“机器人导航场景图像中招牌的提取和畸变校正”IEEJ Transactions C. 120・7 (2000)。

T.Yoneda et al.: "A System for Blind Children to Improve Fundamental Abilities of Mobility"Intelligent Robots and Computer Vision XIX. 537-544 (2000)

T.Yoneda 等人：“盲童提高基本移动能力的系统”智能机器人和计算机视觉 XIX。