CHS: Medium: Collaborative Research: Electromyography (EMG)-Based Assistive Human-Machine Interface Design: Cognitive Workload and Motor Skill Learning Assessment

CHS：媒介：协作研究：基于肌电图 (EMG) 的辅助人机界面设计：认知工作量和运动技能学习评估

• 批准号: 1856441
• 负责人: He Huang
• 金额: $ 36万
• 依托单位: North Carolina State University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2019
• 资助国家: 美国
• 起止时间: 2019-10-01 至 2023-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1856441&HistoricalAwards=false
• 关键词: CHS; Medium; Collaborative; Research; Electromyography

CHS: Medium: Collaborative Research: Electromyography (EMG)-based Assistive Human-Machine Interface Design: Cognitive Workload and Motor Skill Learning AssessmentOver 100,000 people in the United States have upper limb amputations. Such amputations are usually associated with substantial disabilities. Activities of daily living may no longer be possible or require additional effort and time. To restore functional ability as fully as possible, amputee patients use upper-limb prostheses controlled by Electromyography (EMG)-based human-machine interfaces (HMIs). However, over 50% of prosthetic users report device dissatisfaction and abandonment due to frustration in use. In order to increase accessibility and utility of EMG-based assistive HMIs, it is critical to investigate the cognitive workload associated with using these systems for supporting motor skill rehabilitation and activities of daily living. In addition, with differences in individual muscle make-up and control, it is necessary to customize EMG-based assistive HMIs to particular patient conditions. However, at this time, there exists little to no general guidance on what interface control features may be more or less conducive to supporting learning and performance of psychomotor tasks. By testing various control interface prototypes in a validated motor skill learning simulation as well as high-demand, real-time tasks, specifically simulated driving, the investigators seek to provide design guidance for engineers to develop EMG-based assistive HMI technologies for various applications. This project also provides education and training for young industrial, computer science, and biomedical engineering students in assistive technology design and development.The technical aims of the project are divided into three thrusts including (1) identifying cognitive load costs of EMG-based HMIs using computational cognitive performance models and machine learning algorithms - The developed cognitive workload models will be used for predicting learning potential and performance outcomes of variations of control interface designs, (2) demonstrating fundamental motor skill training through integration of the EMG-based HMI with virtual reality (VR) simulations - In particular, the investigators are interested in assessing whether the difference in cognitive load of using EMG-based HMIs translates to variations in learning potential and retention of psychomotor task skills, (3) translating fundamental motion components trained in the VR psychomotor test to a real-world application by demonstrating the possibility of operational driving control with an EMG-based HMI in a high-fidelity driving simulator - This thrust provides empirical validation for the findings regarding differences in cognitive load of using EMG-based HMIs, as well as the potential for increased learning and operational task performance.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

- 你好介质：合作研究：基于肌电图（EMG）的辅助人机界面设计：认知障碍和运动技能学习评估美国有超过10万人上肢截肢。这种截肢通常与严重残疾有关。日常生活活动可能不再可能或需要额外的努力和时间。为了尽可能完全地恢复功能能力，截肢患者使用由基于肌电图（EMG）的人机界面（HMI）控制的上肢假肢。然而，超过50%的假体使用者报告由于使用中的挫折而对设备不满意和放弃。为了增加基于EMG的辅助HMI的可访问性和实用性，关键是要调查与使用这些系统支持运动技能康复和日常生活活动相关的认知工作量。此外，由于个体肌肉组成和控制的差异，有必要针对特定患者状况定制基于EMG的辅助HMI。然而，在这个时候，几乎没有关于什么界面控制功能可能或多或少有助于支持学习和心理任务的执行的一般指导。通过在经过验证的运动技能学习模拟中测试各种控制界面原型，以及高要求的实时任务，特别是模拟驾驶，研究人员试图为工程师提供设计指导，以开发用于各种应用的基于EMG的辅助HMI技术。该项目还为年轻的工业、计算机科学、该项目的技术目标分为三个方面，包括（1）使用计算认知性能模型和机器学习算法确定基于EMG的HMI的认知负荷成本-开发的认知负荷模型将用于预测控制界面设计的变化的学习潜力和性能结果，（2）通过将基于EMG的HMI与虚拟现实（VR）模拟相结合来展示基本的运动技能训练-特别是，研究人员感兴趣的是评估使用基于EMG的HMI的认知负荷的差异是否转化为学习潜力和心理任务技能保持的变化，（3）通过演示在高性能环境中使用基于EMG的HMI进行操作驾驶控制的可能性，将在VR心理测试中训练的基本运动分量转化为现实世界的应用。保真度驾驶模拟器-这一推力提供了实证验证的发现，关于认知负荷的差异，使用基于肌电图的人机界面，该奖项反映了美国国家科学基金会的法定使命，并被认为是值得通过使用基金会的智力价值和更广泛的影响审查进行评估来支持的的搜索.

项目成果

Harnessing Machine Learning and Physiological Knowledge for a Novel EMG-Based Neural-Machine Interface

• DOI: 10.1109/tbme.2022.3210892
• 发表时间: 2023-04-01
• 期刊: IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING
• 影响因子: 4.6
• 作者: Berman, Joseph;Hinson, Robert;Huang, He
• 通讯作者: Huang, He

Offline Evaluation Matters: Investigation of the Influence of Offline Performance of EMG-Based Neural-Machine Interfaces on User Adaptation, Cognitive Load, and Physical Efforts in a Real-Time Application

• DOI: 10.1109/tnsre.2023.3297448
• 发表时间: 2023-07
• 期刊: IEEE Transactions on Neural Systems and Rehabilitation Engineering
• 影响因子: 4.9
• 作者: Robert M. Hinson;Joseph Berman;I-Chieh Lee;William G. Filer;H. Huang

Cognitive Workload Classification of Upper-limb Prosthetic Devices

• DOI: 10.1109/ichms56717.2022.9980676
• 发表时间: 2022-11
• 期刊: 2022 IEEE 3rd International Conference on Human-Machine Systems (ICHMS)
• 作者: Junho Park;Joseph Berman;Albert Dodson;Yunmei Liu;Armstrong Matthew;H. Huang;D. Kaber;Jaime Ruiz

Using Reinforcement Learning to Estimate Human Joint Moments From Electromyography or Joint Kinematics: An Alternative Solution to Musculoskeletal-Based Biomechanics

使用强化学习根据肌电图或关​​节运动学估计人体关节力矩：基于肌肉骨骼的生物力学的替代解决方案

• DOI: 10.1115/1.4049333
• 发表时间: 2021
• 期刊: Journal of Biomechanical Engineering
• 作者: Wu, Wen;Saul, Katherine R.;Huang, He
• 通讯作者: Huang, He

Development of a Wearable Human-Machine Interface to Track Forearm Rotation via an Optical Sensor

• DOI: 10.1109/embc46164.2021.9629851
• 发表时间: 2021-11
• 期刊: 2021 43rd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC)
• 作者: Fiona Popp;Ming Liu;H. Huang