NRI: FND: Scalable Multimodal Tactile Sensing for Robotic Manipulators in Manufacturing

这项研究的重点是传感器和软件，以使机器人拥有人工触觉。目前的机器人手和抓手很少有感知环境的能力；它们通过精确重复预先编程的动作来操作。这防止了在世界状态预先未知的应用中使用机器人，因为这种使用需要机器人感知和对意外事件做出反应。该项目将设计新颖而复杂的触摸传感器，并为机器人的手配备这些传感器。传感器将包括多种类型的触摸传感器，并将它们集成在一起，以检测不同类型和不同特征的接触：快与慢、瞬时与持续等。这些数据将由学习如何利用新获得的触摸数据的软件算法进行解释。这种方法的灵感来自人类的手，它还配备了多种类型的触觉传感元件，将信息传递到神经系统。这项工作的近期目标是为杂乱环境中的材料处理制造工具，这项任务可以使电子商务和供应链更有效地运行，帮助制造商变得更有效率和竞争力，并通过协助执行已知会导致伤害的重复性任务来减少对工人的伤害。新的传感器设计、计算和规划将整合在一起，赋予机器人触觉，从而能够在杂乱的环境中进行操作。在硬件层面，传感器将结合压电式和阻性应变传感来捕捉瞬时、高频响应和绝对应变测量。传感器薄片将堆叠在多个感测层中，以提供不同于通常采用的“一个位置，一个分类”方法的丰富信号集，并通过结合基于模型和数据驱动的方法来定义电机控制基元，最大限度地利用丰富的数据。这些将结合在一起，实现电机控制和规划的算法，这些算法在目标任务中使用触觉数据：在制造中挑选垃圾箱和配套件。总体目标是一种紧凑、多模式、可扩展的机器人操作手触觉感知系统，以及使用触觉数据在杂乱中进行操作的低级运动技能和高级规划算法。

The research focuses on sensors and software to enable robots to have an artificial sense of touch. Current robot hands and grippers rarely have the ability to sense their environments; they operate by precisely repeating pre-programmed motions. This prevents the use of robots in applications where the state of the world is unknowable in advance, since such use requires a robot to sense and react to unexpected events. The project will design novel and sophisticated touch sensors and equip robot hands with them. The sensors will include multiple types of touch sensors and integrate them to detect different types and characteristics of contacts: fast versus slow, transitory versus maintained, etc. These data will be interpreted by software algorithms that learn how to make use of the newly acquired touch data. This approach takes its inspiration from the human hand, which is also equipped with multiple types of tactile sensing elements relaying information to the nervous system. The proximate goal of the work is to build tools for material handling in cluttered environments, a task that can enable e-commerce and supply chains to run more efficiently, help manufacturers become more efficient and competitive, and reduce injuries to workers by assisting with repetitive tasks that are known to cause injuries.Novel sensor design, computation and planning will be integrated to endow robots with a sense of touch, thereby enabling manipulation in cluttered environments. At the hardware level, the sensors will combine piezoelectric and resistive strain sensing to capture both transient, high-frequency responses and absolute strain measurements. Sensor sheets will be stacked in multiple sensing layers to provide a rich signal set that departs from the "one location, one taxel" approach that is normally taken and maximum use will be made of the rich data by combining model-based and data-driven approaches to define motor control primitives. These will be combined to implement algorithms for motor control and planning that use the tactile data in a target task: bin-picking and kitting in manufacturing. The overall goal is a compact, multi-modal, scalable tactile sensing system for robotic manipulators, along with the low-level motor skills and high level planning algorithms that use tactile data for manipulating in clutter.