Developing Real-time Interaction and Motion Tracking in Immersive Virtual Reality for Telerehabilitation

摘要 技术的不断突破将塑造未来的医疗诊断、治疗和 送货。远程康复提供远程康复保健，以克服空间、 时间和经济障碍。远程康复对患者的疗效已经显现 有骨科和创伤性损伤，退行性中枢神经系统疾病，以及 心血管疾病。随着全球慢性疾病和残疾人口的不断增长 长辈们，远程康复的需求在不断增长。然而，目前的远程康复 这些方法主要基于音频/视频交互，而没有对运动的客观测量 功能。这一限制阻碍了精确医疗的交付，并在很大程度上限制了 远程康复的有效性和潜力。面向患者和治疗师的技术解决方案 描述了由Move，LLC开发的，并提出了改进建议 极大地改变了目前的远程康复诊断和干预模式。具体来说， 运动跟踪与3D沉浸式虚拟现实(VR)相结合，以实现对用户的实时渲染 沉浸式VR和REAL中的交互和同步运动跟踪与分析 环境。Move的软件与有线/无线硬件运动传感器和 3D VR耳机，可轻松部署在家中或诊所。在我们建议的第一阶段STTR工作中，移动 将与基于大学的跨学科专家合作，在准备过程中实现三个目标 用于第二阶段的验证和商业化。目标1交叉验证运动数据的精度 通过引入无线光学运动传感器并根据 现有的有线磁性运动传感器。目标2构建并测试远程数据的网络代码 通过互联网协议传输和交互，这将优化远程交付，即使在 网速/连接速度较低的位置。AIM 3聘请物理治疗师担任伪 患者/-远程康复的设计、开发、实施和测试中的治疗师 诊断和治疗VR交互任务。目标1和目标2的结果是产生 最低限度可行的产品(目标3)，这是进一步的治疗师知情的发展的核心 应用和特定的诊断和治疗远程康复练习(类似游戏 活动)。最终目标是一个以患者为中心、基于VR的交互式远程康复系统 通过增强的反馈和治疗师的远程呈现。拟议的工作将为 通过多点临床试验为第二阶段技术优化奠定基础。最终，一个 将进行商业部署，以渗透爆炸性的远程医疗市场和健康 由于这款产品为受限制的人提供服务，差距将降至最低 诊所和康复服务。

Abstract Unceasing breakthroughs in technology will shape future healthcare diagnosis, treatment, and delivery. Telerehabilitation delivers rehabilitative healthcare remotely to overcome spatial, temporal and economic barriers. Effectiveness of telerehabilitation has been seen for patients with orthopedic and traumatic injuries, degenerative central nervous system disorders, and cardiovascular diseases. With the globally growing population of chronically ill and disabled elders, telerehabilitation is in ever growing demand. However, the current telerehabilitation methods are predominantly based on audio/video interaction without objective measure of motor functions. This limitation prevents the delivery of precision medicine and largely constrains the efficacy and potential of telerehabilitation. A patient- and therapist-facing technology solution developed by MoVE, LLC, is described, and with proposed advancement is positioned to dramatically shift the current telerehabilitation diagnosis and intervention paradigm. Specifically, motion tracking is merged with 3D immersive virtual reality (VR) to render real-time user interaction and simultaneous motion tracking and analysis in the immersive VR and real environments. MoVE’s software interfaces with wired/wireless hardware motion sensors and a 3D VR headset for easy deployment at home or clinic. In our proposed Phase I STTR work, MoVE will collaborate with interdisciplinary university-based experts to achieve three aims in preparation for Phase II validation and commercialization. Aim 1 cross validates the precision of motion data captured in VR by introducing wireless optical motion sensors and validating them against the existing wired magnetic motion sensors. Aim 2 builds and tests the network code for remote data transmission and interaction via Internet Protocols, which will optimize remote delivery even in low internet speed/connectivity locations. Aim 3 engages physical therapists serving as pseudo- patients/-therapists in the design, development, implementation, and testing of a telerehabilitation diagnostic and therapeutic VR interaction task. Aim 1 and 2 outcomes are requisite to generating the minimally viable product (Aim 3) that is central to further therapist-informed development of applications and specific diagnostic and treatment telerehabilitation exercises (gaming-like activities). The ultimate goal is a patient-centered VR-based interactive telerehabilitation system with augmented feedback and tele-presence of a therapist. The proposed work will lay a foundation for a Phase II technology optimization via multi-site clinical trials. Ultimately, a commercial deployment will be made to penetrate the exploding telehealth market and health disparities will be minimized by virtue of this product serving people with constrained access to clinics and rehabilitation services.