Towards perceptive and self-aware robots

迈向有感知力和自我意识的机器人

• 批准号: 2742381
• 金额: --
• 依托单位: University of Oxford
• 依托单位国家: 英国
• 项目类别: Studentship
• 财政年份: 2022
• 资助国家: 英国
• 起止时间: 2022 至 无数据
• 项目状态: 未结题
• 来源: https://gtr.ukri.org/projects?ref=studentship-2742381
• 关键词: Towards; perceptive; self; aware; robots

Robots are typically applied in manufacturing and assembly processes to perform tasks such as welding, painting, assembly, pick and place and packing just to name a few. These tasks are usually executed in a confined space separated from the human workspace. However, researchers are pushing to make robots more collaborative and to bring them closer to humans, supporting them in different activities. This transition from industry to the human workspace is not easy: the human environment could be unstructured and cluttered, and robots are expected to perform several tasks without harming the humans or the environment itself.To be able to safely execute operations in such conditions, robots must be equipped with proper sensing capabilities that allow them to detect the presence of objects or humans or track their motions to anticipate possible impacts. Furthermore, the robot should be able to explore the surrounding space by interacting with it and manipulate and recognise objects. In this case, it becomes paramount to properly control the forces arising during the contact.These two aspects are usually treated separately in the state of the art. Indeed, most of the work proposes to control robots to avoid collisions using cameras or lidar sensors [1-3]. However, impacts cannot always be avoided, and robots could be required to properly deal with them to safely interact with the environment and humans. Recent work has shown that contact with the environment can be measured with tactile sensors and exploited to perform tasks in unstructured space [4-6] or to identify or handle objects [7-11]. Although these studies propose methods to apply controlled interactions, they do not consider the problem of approaching objects in a controlled manner to avoid high-impact forces.In this respect, it would be of interest to fuse information provided by diverse types of sensing modalities to compensate for the lack of one feedback with another one. As an example, proximity and tactile feedback could be exploited together to predict in advance a possible collision and to control the robot to measure and minimise the resulting impact force. Similarly, proximity information can be used while exploring the object with the sense of touch to approach the surface of interest in a proper way. This research project will focus on the development of methods that take advantage of multimodal feedback to properly control the robot in the execution of tasks in unstructured environments. Multimodal sensing will be exploited to perceive the surroundings and to detect contacts occurring on the robot body. In particular, the use of Time of Flight (ToF) and tactile sensors will be considered. The two sensing modalities will be combined to provide the robot with awareness of its surrounding area. The idea is to build an augmented model of the environment where ToF and tactile sensors can be used to retrieve the shape of the objects and their mechanical properties. This model can be refined and updated over time by controlling the robot to perform movements aimed at exploring new areas or to distinguish between fixed or movable objects and measure their relative speed. Machine learning techniques can be then leveraged to process and interpret the events that change the state of the model. For example, the robot can discriminate between a possible dangerous collision and a possible interaction with humans and trigger a proper reaction in turn. More in general, this would allow for implementing methods where multimodal feedback is interpreted and the robot can be controlled to perform different actions.This project is well aligned with the "EPSRC artificial intelligence and robotics" theme as it aims to develop new methodologies that will enable robots to perceive the environment, the way it evolves and behave accordingly.

机器人通常应用于制造和装配过程中，以执行焊接、喷漆、装配、拾放和包装等任务。这些任务通常在与人类工作空间分开的有限空间中执行。然而，研究人员正在努力让机器人更具协作性，让它们更接近人类，支持它们进行不同的活动。从工业到人类工作空间的转变并不容易：人类环境可能是非结构化且杂乱的，机器人需要在不伤害人类或环境本身的情况下执行多项任务。为了能够在这种条件下安全地执行操作，机器人必须配备适当的传感功能，使它们能够检测物体或人类的存在或跟踪它们的运动以预测可能的影响。此外，机器人应该能够通过与其交互来探索周围的空间并操纵和识别物体。在这种情况下，正确控制接触过程中产生的力变得至关重要。在现有技术中，这两个方面通常是分开处理的。事实上，大多数工作都建议使用摄像头或激光雷达传感器来控制机器人以避免碰撞[1-3]。然而，影响总是无法避免，机器人可能需要正确处理这些影响，以便安全地与环境和人类互动。最近的研究表明，与环境的接触可以通过触觉传感器进行测量，并用于在非结构化空间中执行任务 [4-6] 或识别或处理物体 [7-11]。尽管这些研究提出了应用受控相互作用的方法，但它们没有考虑以受控方式接近物体以避免高冲击力的问题。在这方面，融合不同类型的传感方式提供的信息以补偿一种反馈与另一种反馈的缺乏将是有意义的。例如，可以同时利用接近度和触觉反馈来提前预测可能的碰撞，并控制机器人测量和最小化所产生的冲击力。类似地，在用触觉探索物体时可以使用邻近信息以适当的方式接近感兴趣的表面。该研究项目将重点开发利用多模态反馈来正确控制机器人在非结构化环境中执行任务的方法。将利用多模态传感来感知周围环境并检测机器人身体上发生的接触。特别是，将考虑使用飞行时间（ToF）和触觉传感器。这两种传感方式将结合起来，为机器人提供对其周围区域的感知。这个想法是建立一个环境的增强模型，其中 ToF 和触觉传感器可用于检索物体的形状及其机械特性。通过控制机器人执行旨在探索新区域的运动或区分固定或可移动物体并测量它们的相对速度，该模型可以随着时间的推移进行完善和更新。然后可以利用机器学习技术来处理和解释改变模型状态的事件。例如，机器人可以区分可能的危险碰撞和可能与人类的互动，并依次触发适当的反应。更一般地说，这将允许实现解释多模态反馈的方法，并且可以控制机器人执行不同的动作。该项目与“EPSRC人工智能和机器人”主题非常吻合，因为它旨在开发新的方法，使机器人能够感知环境、其演化方式并相应地表现。