SCH: INT: Collaborative Research: Replicating Clinic Physical Therapy at Home: Touch, Depth, and Epidermal Electronics in an Interactive Avatar System

物理治疗经常因为找不到治疗师，以及缺乏对家庭治疗方案的坚持而受到阻碍。这项研究开发了一个家庭使用的物理治疗辅助系统，重点是中风的康复。当一个人锻炼时，廉价的摄像头观察颜色和深度，不显眼的纹身传感器监测详细的肌肉活动。3D运动轨迹被导出，并与专家治疗师所做的练习进行比较。患者观看屏幕头像，其中箭头和颜色编码引导患者正确移动。除了推进运动跟踪、皮肤传感器和辅助系统等领域外，该项目还有可能产生广泛的影响，通过与健康有关的工程课程和项目吸引妇女和代表性不足的少数群体从事工程，而且因为家庭物理治疗援助特别可以帮助农村和服务不足的人口。本项目利用生物电子学、计算机视觉、计算机游戏、高维机器学习和人的因素开发了一套家庭理疗辅助系统。在家庭锻炼期间，患者的运动学和生理学通过Kinect彩色/深度相机和无线表皮电子设备进行监测，这些电子设备可以通过临时纹身转移到皮肤上。该项目涉及用于表皮电子设备的电极设计和无线信号的优化，以监测肌肉招募的时空方面，对快速运动和闭塞具有健壮性的手和身体姿势估计和跟踪算法，以及开发用于多模式传感器融合的机器学习和化身渲染算法，以及针对云和本地使用的经专家培训的最优控制指导逻辑。该系统旨在提供实时反馈，使家庭治疗与专家治疗师的办公室访问一样有效，减少完全康复所需的时间和金钱。

Physical therapy is often hampered by lack of access to therapists, and lack of adherence to home therapy regimens. This research develops a physical therapy assistance system for home use, with emphasis on stroke rehabilitation. As a person exercises, inexpensive cameras observe color and depth, and unobtrusive tattoo sensors monitor detailed muscle activity. The 3D movement trajectory is derived and compared against the exercise done with an expert therapist. The patient watches a screen avatar where arrows and color coding guide the patient to move correctly. In addition to advancing fields such as movement tracking, skin sensors, and assistive systems, the project has the potential for broad impact by attracting women and under-represented minorities to engineering through health-related engineering coursework and projects, and because home physical therapy assistance can especially help rural and under-served populations. This project uses bio-electronics, computer vision, computer gaming, high-dimensional machine learning, and human factors to develop a home physical therapy assistance system. During home exercises, patient kinematics and physiology are monitored with a Kinect color/depth camera and wireless epidermal electronics transferable to the skin with a temporary tattoo. The project involves optimization of electrode design and wireless signaling for epidermal electronics to monitor spatiotemporal aspects of muscle recruitment, hand and body pose estimation and tracking algorithms that are robust to rapid motion and occlusions, and development of machine learning and avatar rendering algorithms for multi-modal sensor fusion and expert-trained optimal control guidance logic, for both cloud and local usage. The system aims to provide real-time feedback to make home sessions as effective as office visits with an expert therapist, reducing the time and money required for full recovery.