MirrARbilitation: A clinically-related gesture recognition interactive tool for an AR rehabilitation system
MirrARbilitation: A clinically-related gesture recognition interactive tool for an AR rehabilitation system
复制标题
DOI：
10.1016/j.cmpb.2016.07.014
复制
发表时间：
2016-10-01
影响因子：
6.1
通讯作者：
Fallavollita, Pascal
中科院分区：
文献类型：
--
作者：
Fontes Da Gama, Alana Elza;Chaves, Thiago Menezes;Fallavollita, Pascal
背景与目的：交互式康复系统已被广泛研究用于激励目的。然而，应该更多地关注识别和分类用户动作的方式。本文旨在评估基于国际生物力学标准（ISB）报告人体关节运动的临床相关手势识别工具的功效，用于开发交互式增强现实（AR）康复系统。方法：本工作提出了一个基于ISB标准的AR康复系统，使系统能够根据治疗需求进行交互和配置。利用Kinect （TM）骨骼跟踪技术，开发了一种新的运动识别方法来识别和分类生物力学运动。此外，我们的镜像仲裁系统提供锻炼指导，同时激励患者。该系统在33名患者、物理治疗师和软件开发人员进行肩外展治疗练习时进行了评估。测试分三个时刻进行：(i)用户在没有系统帮助的情况下进行练习，直到他们感到疲倦；（ii）使用镜像仲裁来激励和指导，但情况相同；（iii）用户在没有系统的情况下再次进行练习。用户在没有系统帮助的情况下进行运动作为基准参考。结果：我们证明，通过我们开发的运动分析方法测量的正确运动百分比，当用户与mirrARbilitation互动时，从69.02%提高到93.73%。练习重复次数也从34.06次提高到66.09次，说明我们的系统提高了用户的积极性。该系统还可以防止用户以完全错误的方式进行练习。最后，在我们的系统的帮助下，用户的最差结果是正确执行73.68%的康复动作。除了参与，这些结果表明，使用生物力学标准来识别运动在指导用户进行康复训练时是有价值的。结论：所提出的系统被证明是有效的，提高了用户的参与度和运动表现的结果。结果还表明，使用生物力学标准来识别运动在指导用户进行康复训练时是有价值的。2016爱思唯尔爱尔兰有限公司版权所有。
Background and Objective: Interactive systems for rehabilitation have been widely investigated for motivational purposes. However, more attention should be given to the manner in which user movements are recognized and categorized. This paper aims to evaluate the efficacy of using a clinically-related gesture recognition tool, based on the international biomechanical standards (ISB) for the reporting of human joint motion, for the development of an interactive augmented reality (AR) rehabilitation system-mirrARbilitation.Methods: This work presents an AR rehabilitation system based on ISB standards, which enables the system to interact and to be configured according to therapeutic needs. The Kinect (TM) skeleton tracking technology was exploited and a new movement recognition method was developed to recognize and classify biomechanical movements. Further, our mirrARbilitation system provides exercise instructions while simultaneously motivating the patient. The system was evaluated on a cohort of 33 patients, physiotherapists, and software developers when performing shoulder abduction therapy exercises. Tests were performed in three moments: (i) users performed the exercise until they feel tired without the help of the system, (ii) the same however using the mirrARbilitation for motivation and guidance, and (iii) users performed the exercise again without the system. Users performing the movement without the help of the system worked as baseline reference.Results: We demonstrated that the percentage of correct exercises, measured by the movement analysis method we developed, improved from 69.02% to 93.73% when users interacted with the mirrARbilitation. The number of exercise repetitions also improved from 34.06 to 66.09 signifying that our system increased motivation of the users. The system also prevented the users from performing the exercises in a completely wrong manner. Finally, with the help of our system the users' worst result was performing 73.68% of the rehabilitation movements correctly. Besides the engagement, these results suggest that the use of biomechanical standards to recognize movements is valuable in guiding users during rehabilitation exercises.Conclusion: The proposed system proved to be efficient by improving the user engagement and exercise performance outcomes. The results also suggest that the use of biomechanical standards to recognize movements is valuable in guiding users during rehabilitation exercises. (C) 2016 Elsevier Ireland Ltd. All rights reserved.