Project Title: Integrating computer vision with neural interfacing for semi-autonomous control of robotic limbs.

项目名称：将计算机视觉与神经接口相结合，实现机器人肢体的半自主控制。

• 批准号: 2134998
• 金额: --
• 依托单位: Imperial College London
• 依托单位国家: 英国
• 项目类别: Studentship
• 财政年份: 2018
• 资助国家: 英国
• 起止时间: 2018 至 无数据
• 项目状态: 已结题
• 来源: https://gtr.ukri.org/projects?ref=studentship-2134998
• 关键词: Project; Title; Integrating; computer; vision

Background: Humans depend on their hands for a multitude of everyday activities and tasks, thus the loss of one's hand can have a large impact on the way in which they interact with other objects. Use of a prosthesis can enhance an amputee's lifestyle to some extent, acting as a partial substitute for the lost limb. Most prosthetic systems rely on sequential and proportional control, such that the user drives the prosthesis to adjust multiple degrees of freedom through input actions [1]. Thus, the user is responsible for most of the steps of grasping, which biologically takes place through a sequence of phases, from planning to execution, and involves the integration of sensory information from multiple sources [1].Aims: In this project we will pursue the notion that sensory information, including visual information, can be collected and input through the robotic system itself, allowing for semi-autonomous control of the prosthesis, such that the user needs to perform fewer input actions to grasp an object in the correct alignment. Thus, the project will study the potential for using shared control for grasping objects in prosthesis. Cameras and potentially other sensors, such as accelerometers, will be placed on the prosthetic itself, and the system will receive information both from these sensors and from the user themselves (e.g. myoelectric control). The end goal is to have the full system as a complete embedded solution.Research steps: Alongside performing a thorough literature review surrounding the research subject, we will choose the sensors to be incorporated into the prosthetic, as well as their mounting points. Computer vision and machine learning algorithms will be implemented in order to select the optimal grasp type to be used based on multiple factors, such as the object and the most appropriate contact points. Alongside this, we will be fortifying a robust electromyography (EMG) interface incorporated with a prosthesis. The computer vision, grasp-selective system will then be incorporated into the prosthesis to create a prototype involving the fully-embedded, shared control of the two systems. Finally, studies will be performed to understand whether or not the completed system improves an individual's grip compared to a standard multiple degree of freedom prosthesis.

背景资料：人类依靠他们的手进行大量的日常活动和任务，因此失去一只手可能会对他们与其他物体互动的方式产生很大的影响。使用假肢可以在一定程度上改善截肢者的生活方式，作为失去的肢体的部分替代品。大多数假肢系统依赖于顺序和比例控制，这样用户就可以通过输入动作驱动假肢来调节多个自由度[1]。因此，用户负责抓取的大部分步骤，从生物学上讲，抓取是通过一系列阶段（从计划到执行）发生的，并且涉及来自多个来源的感觉信息的整合[1]。在这个项目中，我们将追求的概念，感官信息，包括视觉信息，可以收集和输入通过机器人系统本身，从而允许假体的半自主控制，使得用户需要执行较少的输入动作来以正确的对准来抓握物体。因此，该项目将研究在假肢中使用共享控制抓取物体的可能性。摄像机和可能的其他传感器，如加速度计，将被放置在假肢本身，系统将接收来自这些传感器和用户本身的信息（例如肌电控制）。最终目标是将整个系统作为一个完整的嵌入式解决方案。研究步骤：除了围绕研究主题进行全面的文献综述外，我们还将选择要集成到假肢中的传感器及其安装点。将实施计算机视觉和机器学习算法，以便根据多个因素（如物体和最合适的接触点）选择要使用的最佳抓取类型。除此之外，我们还将加强与假肢结合的强大肌电图（EMG）接口。然后，计算机视觉，抓取选择系统将被整合到假肢中，以创建一个涉及两个系统的完全嵌入式共享控制的原型。最后，将进行研究以了解与标准多自由度假肢相比，完整的系统是否能改善个人的抓握能力。