Implicit mobile human-robot communication for spatial action coordination with context-specific semantic environment modeling

通过上下文特定的语义环境建模实现空间动作协调的隐式移动人机通信

• 批准号: 502483052
• 负责人: Professor Dr.-Ing. Ayoub Al-Hamadi
• 金额: --
• 依托单位: Zentrum für Kognitive Interaktionstechnologie
• 依托单位国家: 德国
• 项目类别: Research Grants
• 资助国家: 德国
• 项目状态: 未结题
• 来源: https://gepris.dfg.de/gepris/projekt/502483052?language=en
• 关键词: Implicit; mobile; human; robot; communication

The use of robots in the industry as well as in the work and everyday life is becoming more and more flexible. Current methods for machine learning and adaptive motion planning are leading to a more robust behavior and a higher autonomy of the robots. Nevertheless, collaborative human-robot interactions still happen to have interruptions and breakdowns in cases where the human is not able to comprehend the robot's movement behavior. A common cause is that the human has an incorrect or limited picture of what the robot is currently perceiving and what its internal state is. This could be avoided if the robot could understand and incorporate the mental states and the perspective of the interaction partner in its own action generation in order to actively generate a common understanding of the interaction.A key competence for such a collaboration between humans and robots is the ability of communication and mutual coordination via implicit signals of body language and movement. The project investigates the implicit human-robot communication in collaborative actions by using the example of the joint construction of a shelf. In experimental studies, situations will be created and recorded in which the interaction and perception between the human and the robot is disturbed. On the one hand, new perception methods are explored, that robustly detect interaction-relevant features based on head and body poses and facial expressions against occlusions. These are interpreted in the context of the action and the environment, so that implicit communication signals (e.g., turning toward, turning away, compliance, hinting, etc.) and internal states (e.g., approval, disapproval, willingness to interact, etc.) can be inferred. On the other hand, new methods are being explored to make the robot infer the perspective and the state of the human interlocutor in its own action planning and actively requests user reactions.This leads to a spatial coordination of the partners during the construction of the shelf by taking into consideration the mutual perception and the goal of the action. Via an active use of body pose, relative orientation and movement of the robot, conflict situations can be solved in advance without the need for explicit instructions to the robot.

机器人在工业以及工作和日常生活中的使用正变得越来越灵活。目前机器学习和自适应运动规划的方法正在导致机器人更健壮的行为和更高的自主性。然而，在人类无法理解机器人的运动行为的情况下，人与机器人的协作交互仍然会碰巧发生中断和故障。一个常见的原因是，人类对机器人当前感知的内容及其内部状态的了解不正确或有限。如果机器人能够理解并将交互伙伴的心理状态和视角融入到自己的动作生成中，以便主动地生成对交互的共同理解，则可以避免这种情况。人类和机器人之间这种协作的关键能力是通过肢体语言和运动的隐含信号进行沟通和相互协调的能力。以联合搭建货架为例，研究了协同行动中人-机器人的内隐沟通问题。在实验研究中，将创造和记录人类和机器人之间的交互和感知受到干扰的情况。一方面，探索了新的感知方法，基于头部和身体姿势以及针对遮挡的面部表情来稳健地检测与交互相关的特征。这些是在动作和环境的上下文中解释的，从而隐含的通信信号(例如，转向、转向、顺从、暗示等)和内部状态(例如，同意、不同意、愿意互动等)可以推断。另一方面，人们正在探索新的方法，使机器人在自己的行动规划中推断人类对话者的视角和状态，并主动请求用户做出反应，从而在架子建造过程中通过考虑相互感知和行动目标来实现合作伙伴的空间协调。通过主动使用机器人的身体姿势、相对方向和运动，可以提前解决冲突情况，而不需要向机器人发出明确的指令。