Real-time 3D object/body pose estimation

随着人们对人类和机器人交互的应用越来越感兴趣，对简单的机器人编程以及对它们从周围环境中理解的需求已经成为优先事项。特别是，在许多工业和商业应用中，包括远程呈现、安全和健康监测在内的各个领域对机器人系统的需求非常强烈。以前的大多数方法是在多年前开发的，是针对有各种限制的环境而设计的，不适用于商业产品。此外，它们主要是为实验室条件或亚马逊大挑战等受控挑战而设计的。该行业的一个主要挑战是快速而稳健地理解机器人所看到的环境中的物体或物体，并准确地估计它们的3D姿势。Croswing正在追求的目标是，通过其获得专利的虚拟METMIPR平台，将领先的媒体设备与半自动运动系统相结合，使家人、朋友、购物者、旅行者、医生、临床医生、安全和办公室工作人员能够与他人接触。因此，他们计划迎接挑战，在从医疗保健到个人安全的各个领域提供低成本但现实世界的功能。该方法的发展和整合将扩大公司的市场和竞争力。除了对公司的好处外，拟议的工作还将为参与该项目和/或继续进行该项目的研究生和博士后研究员创造培训和就业机会。

With increasing interest in the applications of human and robot interactions, the need for easy robotprogramming and their understanding from their surrounding has become a priority. In particular, there is astrong demand for robotic systems in various fields including telepresence, security and health monitoring thathave become very popular in many industrial and commercial applications. Majority of the previousapproaches, developed many years ago, are designed for an environment under various limitations and are notapplicable to commercial products. Besides they have been mainly devised for laboratory conditions orcontrolled challenges such as Amazon grand challenge.A major challenge of the industry is to develop fast and robust understanding of the objects or bodies in theenvironment seen by the robot and estimate their 3D poses accurately. Crosswing is pursuing the goal toempower family, friends, shoppers, travelers, doctors, clinicians, security and office staff to reach out to othersby coupling leading media devices with semi-autonomous motion systems, through its patented virtualMETMIPR platform. As a result, they plan to meet the challenge of delivering low cost, yet real-world functionality infields spanning from health care to personal security. Development and integration of the proposed poseestimation method will expand the company's market and competitiveness. In addition to the benefits to thecompany, the proposed work will create training and job opportunities for the graduate students andpostdoctoral fellows engaged in this project and/or its continuation.