PostureCheck: A vision-based compensatory-posture-detection tool to enhance performance of the BURT® upper-extremity stroke-therapy device

项目摘要/摘要 该小型企业创新研究(SBIR)第二阶段项目建议部署人工智能支持的 名为PostureCheck™的图像处理工具，可自动检测患者何时执行不受欢迎的操作 机器人辅助上肢(UE)康复训练中的补偿动作。该系统是 基于NIH第一阶段开发的标准摄像机和人工智能(AI)软件 项目。状态检查™将与巴雷特科技现有的BURT®UE康复机器人完全集成， 确保向患者提供适当和及时的反馈，以鼓励正确的表现 不需要治疗师持续监督的治疗练习。 Burt®是一款FDA列出的UE康复机器人，它支持患者的手臂和手的重量，同时 患者移动手臂与屏幕上的游戏互动。BURT®提供导引辅助、视觉和触觉 反馈、活动和评估都有助于训练患者和衡量进展。临床研究 已证明BURT®可用于改善患者在与治疗师进行的一对一治疗中的表现。 然而，该系统缺乏一名治疗师监控和处理多名患者和 一次安装BURT®系统。 拟议的SBIR第二阶段活动有三个目标。在目标1中，带注释的数据集生成 在第一阶段，将用于开发三个独立的人工智能模块。这些模块将被集成到一个框架中 这使得治疗师可以监控模块的结果，并通过反馈使系统能够自动- 适应不断提高绩效。在目标2中，利益相关者的反馈将被收集并整合到 为位置检查™工具设计多个用户界面。将创建特定接口以供使用 治疗师在RT治疗期间和之后。状态检查™将与BURT®设备集成，以增强 治疗师向患者提供有效的反馈，并阻止使用代偿性运动。最后，在 目的3，42名卒中幸存者将被招募参加一项使用PostareCheck™和 BURT®系统。受试者将以个人或集体治疗的形式接受18次RT治疗。马达 将比较组之间的性能，以收集有关组合的适宜性的信息 未来康复中心的多患者RT治疗系统。 该项目的长期商业目标是提供实用的BURT®Plus-PostureCheck™系统，以 使治疗师能够通过一系列有用的功能同时监督多名患者。这个 该系统将适合在诊所以及康复中心，如健康健身房部署。

Project Summary/Abstract This Small Business Innovation Research (SBIR) Phase-II project proposes the deployment of an AI-powered image-processing tool, named PostureCheck™, to automatically detect when patients perform undesirable compensatory movements during robot-assisted upper-extremity (UE) rehabilitation exercises. The system is based on a standard video camera and the artificial intelligence (AI) software developed under the NIH Phase-I project. PostureCheck™ will be fully integrated with Barrett Technology's existing Burt® UE rehabilitation robot, ensuring that patients are provided appropriate and timely feedback to encourage the correct performance of therapeutic exercises without requiring constant therapist supervision. Burt® is an FDA-listed UE rehabilitation robot that supports the weight of a patient's arm and hand while the patient moves his/her arm to interact with on-screen games. Burt® offers guided assistance, visual and haptic feedback, and activities and assessments to both help train the patient and measure progress. Clinical studies have shown that Burt® can be used to improve patients' performance in one-on-one sessions with a therapist. However, the system lacks the capability for a single therapist to monitor and work with several patients and Burt® systems at one time. The proposed SBIR Phase-II activities are organized in three aims. In Aim 1, the annotated dataset generated in Phase-I will be used to develop three separate AI modules. These modules will be integrated into a framework that allows therapists to monitor the outcome of the modules, and, through feedback, enable the system to auto- adapt to improve performance continuously. In Aim 2, stakeholder feedback will be gathered and integrated to design multiple user interfaces for the PostureCheck™ tool. Specific interfaces will be created for use by therapists during and after RT sessions. PostureCheck™ will be integrated with the Burt® device to empower therapists to provide effective feedback to patients and deter the use of compensatory movements. Finally, in Aim 3, forty-two stroke survivors will be recruited in an interventional study deploying the PostureCheck™ and Burt® systems. Subjects will undergo eighteen RT sessions in either an individual or group therapy format. Motor performance between groups will be compared to gather information about the suitability of the combined systems for multi-patient RT therapy in future rehabilitation centers. The long-term commercial goal of the project is to provide a practical Burt®-plus-PostureCheck™ system to empower therapists to supervise multiple patients simultaneously through a gamut of useful functionalities. The system will be suitable for deployment in clinics as well as rehabilitation centers such as wellness gyms.