Together at Last: Perception and Learning for Collaborative Robots Operating in Human-Centric Environments

CoBot或协作机器人是一类机器，旨在与人类在共享空间进行物理互动。这一定义涵盖了大量的硬件系统和应用领域(从制造到自动驾驶汽车)。在接下来的五年里，这一新兴的细分市场预计将蓬勃发展所有主要的机器人制造商都已在这一类别建立了新产品。拟议的研究计划的目标是显著提高协作机器人的技术水平，使Cobots比目前更有能力和更安全。这项研究将弥合这一差距，并有助于让Cobots在实验室之外无处不在。该项目有四个关键研究主题：1)内省，传感器融合，传感器和执行器自校准，2)语义映射，3)基于信任的交互意图识别，4)形式测试和验证。这些主题通过先进感知处理的统一线索联系在一起，目的是为现实世界创建灵活的合作机器人平台。四个主题(或项目领域)的研究活动将建立在机器人学和机器学习的结果的基础上。将从低级别的数据融合开始，导致高级别的语义理解，从而开发出层次化感知的一般框架。来自新的传感模式的数据将被融合到一致的环境表示中；通过自我校准和自省，将始终保持基线水平的功能和安全。然后将处理多模式传感器数据以生成语义图，该语义图将包括关于对象及其关系的信息(允许对交互进行推理)。这些地图将使用聚类和监督学习来生成。通过扩展语义感知，人类的意图和活动识别将成为可能。意图识别和响应学习将显著增强安全性，确保每一方(人类和机器人)能够预测对方的行动。最后，所有能力都将在广泛的测试活动中得到验证，其中包括使用先进的移动机械手进行正式验证。拟议的研究计划可能会在广泛的行业产生革命性的影响，从根本上改变人们使用机器人的方式，进而利用机器人技术来提高生产率和生活质量。研究成果将创造可随时转让给加拿大公司的新技术解决方案，为它们提供进入具有巨大增长潜力的新经济领域所需的工具。其中许多市场，包括服务机器人和先进制造(例如，航空航天)，对加拿大在全球市场保持竞争优势至关重要。

Cobots, or collaborative robots, are a class of machines intended to physically interact with humans in a shared space. This definition encompasses a large variety of hardware systems and application domains (from manufacturing to autonomous vehicles). Over the next five years, this nascent market segment is expected to boom all major robotics manufacturers have established new products in this category. The goal of the proposed research program is to dramatically advance the state of the art in collaborative robotics, making cobots more capable and more safe than at present. This research will bridge the gap and help make cobots ubiquitous outside of laboratories. The program has four key research themes: 1) introspection, sensor fusion, and sensor and actuator self-calibration, 2) semantic mapping, 3) intention recognition for trust-based interaction, and 4) formal testing and validation. These themes are tied together by the unifying thread of advanced perceptual processing, with the aim of creating flexible cobot platforms for the real world.Research activities across the four themes (or project areas) will build upon results from robotics and machines learning. A general framework for hierarchical perception will be developed, beginning with low-level data fusion and leading to high-level semantic understanding. Data from novel sensing modalities will be fused into consistent environment representations; through self-calibration and introspection, a baseline level of functionality and safety will be maintained at all times. Multimodal sensor data will then be processed to generate semantic maps, which will include information about objects and their relationships (allowing for reasoning about interactions). The maps will be produced using clustering and supervised learning. By extending semantic perception, human intention and activity recognition will become possible. Intention recognition and response learning will significantly enhance safety, ensuring that each party (human and robot) is able to anticipate the actions of the other. Finally, all capabilities will be verified in an extensive test campaign that includes formal validation, using an advanced mobile manipulator.The proposed research program has the potential for transformative impact in a wide range of industries, fundamentally changing the way people work with robots and, in turn, leveraging robotics to enhance productivity and quality of life. Research outputs will create new technological solutions that will be readily transferable to Canadian companies, giving them the tools they need to enter new economic areas that have tremendous growth potential. Many of these markets, including service robotics and advanced manufacturing (for, e.g., aerospace) will be of critical importance to Canada in maintaining a competitive edge in the global marketplace.