Development of a Remote-Controlled Drone System by Using Only Eye Movements: Design of a Control Screen Considering Operability and Microsaccades

Development of a Remote-Controlled Drone System by Using Only Eye Movements: Design of a Control Screen Considering Operability and Microsaccades
复制标题

仅使用眼动开发遥控无人机系统:考虑可操作性和微扫视的控制屏幕设计

DOI:
--
复制
发表时间:
2021
期刊:
J. Robotics Mechatronics
影响因子:
--
通讯作者:
Yoshihiro Kai
Yoshihiro Kai
中科院分区:
--
文献类型:
--
作者:
Atsunori Kogawa;Moeko Onda;Yoshihiro Kai

文献摘要

被引文献

相似文献

近年来,由于医疗和长期护理技术的进步,随着人口老龄化,卧床不起的患者,包括肌萎缩侧索硬化症(ALS)患者的数量不断增加。眼球运动是一种相对难以受到影响的身体功能,即使 ALS 症状有所进展。针对这一点,在本文中,为了提高包括 ALS 患者在内的卧床患者的生活质量(QOL),我们提出了一种连接到互联网的无人机系统,只需用眼睛即可远程控制。为了仅用眼睛来控制无人机,该系统中使用了控制屏幕和眼球追踪设备。例如,通过使用该系统,纽约的患者可以仅用眼睛操作京都的无人机,欣赏风景并与京都的人们交谈。在该无人机系统中,由于根据互联网使用环境可能会出现时间延迟,因此需要灵活的操作来远程控制无人机。因此,我们介绍控制屏幕的设计重点关注遥控可操作性和人眼运动(微跳视)。此外,考虑到该系统未来的广泛使用,最好使用商用无人机。因此,我们描述了操纵杆控制设备的设计,以物理控制各种无人机控制器的操纵杆。最后,我们提供了实验结果来验证该系统的有效性,包括控制屏幕和操纵杆控制装置。
In recent years, the number of bedridden patients, including amyotrophic lateral sclerosis (ALS) patients, has been increasing with the aging of the population, owing to advances in medical and long-term care technology. Eye movements are physical functions that are relatively difficult to be affected, even if the symptoms of ALS progress. Focusing on this point, in this paper, in order to improve the quality of life (QOL) of bedridden patients, including ALS patients, we propose a drone system connected to the Internet that can be remotely controlled using only their eyes. In order to control the drone by using only their eyes, a control screen and an eye-tracking device were used in this system. By using this system, for example, the patients in New York can operate the drone in Kyoto using only their eyes, enjoy the scenery, and talk with people in Kyoto. In this drone system, since a time delay could occur depending on the Internet usage environment, agile operation is required for remotely controlling the drone. Therefore, we introduce the design of the control screen focused on remote control operability and human eye movements (microsaccades). Furthermore, considering the widespread future use of this system, it is desirable to use a commercial drone. Accordingly, we describe the design of a joystick control device to physically control the joysticks of various drone controllers. Finally, we present experimental results to verify the effectiveness of this system, including the control screen and the joystick control device.