CAREER: Synergy-based Human Machine Interfaces

职业：基于协同的人机界面

• 批准号: 1845197
• 负责人: Ramana Vinjamuri
• 金额: $ 50万
• 依托单位: Stevens Institute of Technology
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2019
• 资助国家: 美国
• 起止时间: 2019-09-01 至 2020-12-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1845197&HistoricalAwards=false
• 关键词: CAREER; Synergy; based; Human; Machine

With a brain controlled exoskeleton, an individual with spinal cord injury performed a symbolic-kickoff of for the World Cup in Brazil in 2014. Human-machine interfaces have not only become popular technologies but have become the hope of many individuals for restoring their lost limb function. Decades of research went into making the interface between the human and the machine seamless, but scientists were unable to effectively address the inherent challenges, namely, complexity, adaptability and variability. To overcome the above challenges, it is critical to computationally understand and quantitatively characterize how humans control their senses and motor abilities. Biomimetically inspired models can help to understand this process, and can enable efficient control of the machine. The human hand has many dimensions and is an ideal testbed to understand sensorimotor control while interacting with computers and other machines. Hence the goal of this project is to design and develop biomimetic models that control the human hand and extend these models to the control of multidimensional machines. The societal impacts of the proposed project will be the development of new designs of artificial limbs for individuals with disabilities that are as close to natural in their functions. The educational and outreach impacts of the project will create opportunities for students and working engineers to learn the importance of human machine interfaces. The project will facilitate mentored international research and educational opportunities for students. The hands-on modules developed as an outflow of the proposed research will ignite interest in science and technology among students at all levels, particularly women and underrepresented minorities.The means by which the central nervous system effortlessly controls the high dimensional human hand is still an unsolved mystery. To address this high dimensional control problem, many bioinspired motor control models have been proposed, one of which is based on synergies. According to this model, instead of controlling individual motor units, central nervous system simplifies the control using coordinated control of groups of motor units called synergies. However, there are several unanswered questions today. Where are synergies present? What is their role in motor control and motor learning? To answer these fundamental questions, this project takes a holistic and comprehensive approach. It combines the concepts of human motor control, computational neuroscience, machine learning and validation with noninvasive human experiments. The research objectives of this project are: to model the generation of synergies in human hand movements and validate the model with noninvasive human experiments using computational models, electroencephalography and transcranial magnetic stimulation, to model the behavior and the role of synergies in motor learning and to apply these synergies in multidimensional machine control and machine-assisted learning.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

通过大脑控制的外骨骼，一名脊髓损伤的人在2014年巴西世界杯上进行了象征性的开球。人机界面不仅已成为流行的技术，而且已成为许多人恢复其失去的肢体功能的希望。数十年的研究致力于使人类和机器之间的界面无缝连接，但科学家们无法有效地解决固有的挑战，即复杂性，适应性和可变性。为了克服上述挑战，至关重要的是计算理解和定量描述人类如何控制他们的感官和运动能力。仿生学启发的模型可以帮助理解这一过程，并可以实现对机器的有效控制。人手有许多尺寸，是理解与计算机和其他机器交互时感觉运动控制的理想测试平台。因此，该项目的目标是设计和开发控制人手的仿生模型，并将这些模型扩展到多维机器的控制。拟议项目的社会影响将是为残疾人开发新设计的假肢，使其功能接近自然。该项目的教育和推广影响将为学生和工程师创造机会，学习人机界面的重要性。该项目将为学生提供有指导的国际研究和教育机会。作为拟议研究成果的一部分，开发的实践模块将激发各级学生对科学和技术的兴趣，特别是女性和代表性不足的少数民族。中枢神经系统轻松控制高维人手的方法仍然是一个未解之谜。为了解决这个高维控制问题，许多仿生电机控制模型已被提出，其中之一是基于协同作用。根据这个模型，中枢神经系统不是控制单个运动单元，而是使用称为协同作用的运动单元组的协调控制来简化控制。然而，今天有几个问题没有得到解答。协同作用体现在哪里？它们在运动控制和运动学习中的作用是什么？为了回答这些基本问题，该项目采取了整体和全面的方法。它将人类运动控制，计算神经科学，机器学习和验证的概念与非侵入性人体实验相结合。本项目的研究目标是：对人手运动中协同作用的产生进行建模，并使用计算模型、脑电图和经颅磁刺激，为运动学习中协同作用的行为和作用建模，并将这些协同作用应用于多维机器控制和机器-该奖项反映了NSF的法定使命，并被认为是值得通过使用基金会的知识价值和更广泛的影响审查标准进行评估的支持。

项目成果

Dynamic Control of Virtual Hand Grasp Using Spatiotemporal Synergies

• DOI: 10.1109/access.2019.2932956
• 发表时间: 2019-08
• 期刊: IEEE Access
• 影响因子: 3.9
• 作者: Martin K. Burns;Dingyi Pei;R. Vinjamuri

Lateralization and Model Transference in a Bilateral Cursor Task

双边光标任务中的偏侧化和模型迁移

• DOI: 10.1109/embc44109.2020.9176496
• 发表时间: 2020
• 期刊: Proceedings of IEEE EMBS Conference on Biomedical Engineering Sciences
• 作者: M. Burns, R. Vinjamuri

Myoelectric Control of a Soft Hand Exoskeleton Using Kinematic Synergies

• DOI: 10.1109/tbcas.2019.2950145
• 发表时间: 2019-12-01
• 期刊: IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS
• 影响因子: 5.1
• 作者: Burns, Martin K.;Pei, Dingyi;Vinjamuri, Ramana
• 通讯作者: Vinjamuri, Ramana