Towards perceptive and self-aware robots

机器人通常应用于制造和装配过程中，以执行诸如焊接、喷漆、装配、拾取和放置以及包装等任务。这些任务通常在与人类工作空间分离的有限空间中执行。然而，研究人员正在努力使机器人更具协作性，并使它们更接近人类，支持它们进行不同的活动。从工业到人类工作空间的转变并不容易：人类环境可能是非结构化的和杂乱的，并且机器人被期望在不伤害人类或环境本身的情况下执行若干任务。为了能够在这样的条件下安全地执行操作，机器人必须配备适当的传感能力，使它们能够探测物体或人的存在，或跟踪它们的运动，以预测可能的情况。影响。此外，机器人应该能够通过与它互动来探索周围的空间，并操纵和识别物体。在这种情况下，正确控制接触过程中产生的力变得至关重要。这两个方面通常在现有技术中分开处理。实际上，大多数工作都建议使用摄像机或激光雷达传感器控制机器人以避免碰撞[1-3]。然而，影响并不总是可以避免的，机器人可能需要适当地处理它们，以安全地与环境和人类互动。最近的工作表明，与环境的接触可以用触觉传感器测量，并用于在非结构化空间中执行任务[4-6]或识别或处理物体[7-11]。尽管这些研究提出了应用受控交互的方法，但它们没有考虑以受控方式接近物体以避免高冲击力的问题，在这方面，将不同类型的传感模态提供的信息融合以补偿一种反馈与另一种反馈的缺乏将是有趣的。例如，可以一起利用接近度和触觉反馈来提前预测可能的碰撞，并控制机器人测量和最小化产生的冲击力。类似地，可以在利用触觉探索对象的同时使用接近度信息，以适当的方式接近感兴趣的表面。该研究项目将专注于开发利用多模态反馈来正确控制机器人在非结构化环境中执行任务的方法。将利用多模态传感来感知周围环境并检测机器人身体上发生的接触。特别是，将考虑使用飞行时间（ToF）和触觉传感器。这两种传感方式将结合起来，为机器人提供其周围区域的意识。这个想法是建立一个增强的环境模型，其中ToF和触觉传感器可以用来检索物体的形状及其机械特性。该模型可以通过控制机器人进行旨在探索新区域的运动或区分固定或可移动物体并测量它们的相对速度来进行改进和更新。然后可以利用机器学习技术来处理和解释改变模型状态的事件。例如，机器人可以区分可能的危险碰撞和可能与人类的互动，并依次触发适当的反应。更一般地说，这将允许实现多模态反馈的解释方法，并可以控制机器人执行不同的动作。该项目与“EPSRC人工智能和机器人技术”主题保持一致，因为它旨在开发新的方法，使机器人能够感知环境，并相应地进化和行为。

Robots are typically applied in manufacturing and assembly processes to perform tasks such as welding, painting, assembly, pick and place and packing just to name a few. These tasks are usually executed in a confined space separated from the human workspace. However, researchers are pushing to make robots more collaborative and to bring them closer to humans, supporting them in different activities. This transition from industry to the human workspace is not easy: the human environment could be unstructured and cluttered, and robots are expected to perform several tasks without harming the humans or the environment itself.To be able to safely execute operations in such conditions, robots must be equipped with proper sensing capabilities that allow them to detect the presence of objects or humans or track their motions to anticipate possible impacts. Furthermore, the robot should be able to explore the surrounding space by interacting with it and manipulate and recognise objects. In this case, it becomes paramount to properly control the forces arising during the contact.These two aspects are usually treated separately in the state of the art. Indeed, most of the work proposes to control robots to avoid collisions using cameras or lidar sensors [1-3]. However, impacts cannot always be avoided, and robots could be required to properly deal with them to safely interact with the environment and humans. Recent work has shown that contact with the environment can be measured with tactile sensors and exploited to perform tasks in unstructured space [4-6] or to identify or handle objects [7-11]. Although these studies propose methods to apply controlled interactions, they do not consider the problem of approaching objects in a controlled manner to avoid high-impact forces.In this respect, it would be of interest to fuse information provided by diverse types of sensing modalities to compensate for the lack of one feedback with another one. As an example, proximity and tactile feedback could be exploited together to predict in advance a possible collision and to control the robot to measure and minimise the resulting impact force. Similarly, proximity information can be used while exploring the object with the sense of touch to approach the surface of interest in a proper way. This research project will focus on the development of methods that take advantage of multimodal feedback to properly control the robot in the execution of tasks in unstructured environments. Multimodal sensing will be exploited to perceive the surroundings and to detect contacts occurring on the robot body. In particular, the use of Time of Flight (ToF) and tactile sensors will be considered. The two sensing modalities will be combined to provide the robot with awareness of its surrounding area. The idea is to build an augmented model of the environment where ToF and tactile sensors can be used to retrieve the shape of the objects and their mechanical properties. This model can be refined and updated over time by controlling the robot to perform movements aimed at exploring new areas or to distinguish between fixed or movable objects and measure their relative speed. Machine learning techniques can be then leveraged to process and interpret the events that change the state of the model. For example, the robot can discriminate between a possible dangerous collision and a possible interaction with humans and trigger a proper reaction in turn. More in general, this would allow for implementing methods where multimodal feedback is interpreted and the robot can be controlled to perform different actions.This project is well aligned with the "EPSRC artificial intelligence and robotics" theme as it aims to develop new methodologies that will enable robots to perceive the environment, the way it evolves and behave accordingly.