权益分类	功能权益	普通用户	{{item.name}}会员
{{category.name}}	{{benefitItem.name}}

Development of HMD having eye-gaze detection function and realization of advanced bilateral communication for ALS patients

开发具有视线检测功能的HMD并为ALS患者实现先进的双边通信

基本信息

批准号：
17300183
负责人：
EBISAWA Yoshinobu
金额：
$ 9.6万
依托单位：
Shizuoka University
依托单位国家：
日本
项目类别：
Grant-in-Aid for Scientific Research (B)
财政年份：
2005
资助国家：
日本
起止时间：
2005 至 2006
项目状态：
已结题

来源：
https://kaken.nii.ac.jp/grant/KAKENHI-PROJECT-17300183/
关键词：
eye gaze detection head mounted display welfare equipment and device remote operation human-friendly mobile robot bilateral communication amyotrophic lateral sclerosis patient pointing device 身代わりロボット意思伝達

项目摘要

The purpose of this study is make it possible for ALS (amyotrophic lateral sclerosis) patients to communicate with surrounding people and to operate remote human-friendly mobile robots by inputting characters and selecting menu options using residual function of the patients, a light of sight.The HMD (head mounted display) has eye-gaze detection function. It is attached to one eye and characterized that it can detect the exact eye gaze point on the HMD screen in spite of deviation of the eye and the HMD. Image from a PC is presented on the screen. At the same time, irradiation near-infrared light of an LED for the eye, and grabbing and processing the eye image and then detecting the centers of the pupil and the corneal reflection produced by the LED light source. The eye gaze point is calculated by the relative position of these centers. In fiscal 2005, eye gaze detection was difficult in the trial product because ghost images of the light source fell on the eye image. So in fiscal 200 … More 6, the reason of the ghost images was investigated. By changing light source arrangement, the problem was solved. However, its total size was bigger than expected. Moreover, due to their dispersion the signal of eye gaze points was smoothed. However, the characteristics which can compensate eye gaze points against deviation of the eye and the HMD is demonstrated.The remote control experiment was carried out in which the developed HMD was used as an I/O interface in a remote operation system of mobile robot. The robot has omni-directional mobile mechanism with the camera to take pictures in remote site and the range sensor to acquire distance information. The operation screen shown by HMD is low resolution, 640 by 480. However, we developed the operation interface including five functions as a minimum function to operate the robot remotely - a remote environmental map, the live images, the button to operate robot, the button to operate camera system, and the display of camera direction. When cursor was placed for two seconds on the robot operation button the operation which the button indicates was made to be performed considering safety. Moreover taking care of the characteristic of detecting the direction of gaze, the stop buttons are arranged in the four corners of operation screen. It has been confirmed that both the mobile robot and the camera system could be operated from operation experiment. Less

本研究的目的是使肌萎缩侧索硬化症（ALS）患者能够与周围的人进行交流，并利用患者的视觉残留功能，通过输入字符和选择菜单选项来操作远程人性化的移动的机器人。它被附接到一只眼睛，并且其特征在于，它可以检测HMD屏幕上的准确眼睛注视点，而不管眼睛和HMD的偏差。来自PC的图像显示在屏幕上。同时，将LED的近红外光照射到眼睛上，对眼睛图像进行采集和处理，然后检测LED光源产生的瞳孔中心和角膜反射。通过这些中心的相对位置来计算眼睛注视点。在2005年度，由于光源的重影落在眼睛图像上，因此在试用产品中难以检测眼睛注视。所以在200财年 ...更多信息 6、分析了产生重影的原因。通过改变光源布置，解决了这一问题。然而，它的总规模比预期的要大。此外，由于它们的分散，眼睛注视点的信号被平滑。然而，该特性可以补偿眼睛注视点对偏差的眼睛和HMDs.The远程控制实验中，所开发的HMD被用作I/O接口的移动的机器人的远程操作系统中进行。该机器人具有全方位的移动的机构，带有摄像头可以在远程现场拍照，距离传感器可以获取距离信息。HMD显示的操作屏幕是低分辨率的，640 × 480。然而，我们开发了包括五个功能的操作界面，作为远程操作机器人的最低功能-远程环境地图、实时图像、操作机器人的按钮、操作相机系统的按钮以及显示相机方向。当光标在机器人操作按钮上放置两秒钟时，考虑到安全性，进行按钮指示的操作。此外，考虑到检测注视方向的特性，停止按钮被布置在操作屏幕的四个角。实验结果表明，该移动的机器人和摄像系统均能正常工作。少