Development of Self-Adaptable Visual-Servo Pick-and-Place Robot Technology for Manufacturing Automation

拾取式机器人已被广泛用于人工操作员自动化繁重的任务，以提高生产率，降低劳动力成本，减少工伤索赔，同时确保高速一致的产品质量。然而，为某些产品和工艺专门设计的拾取和放置机器人已不再适应当前快速变化的制造工艺和产品，其中可能会处理不同的产品。因此，许多中小型汽车零部件制造商的车间仍然在自动化流水线的末端保留人工操作员来取货和分拣成品零件。拟议研究的目标是开发一种编程框架，用于可自我调节的视觉伺服拾取和放置机器人技术，该技术可以容易地实施到商业工业机器人中。这项研究将把计算机视觉和机器人控制技术与人工智能和机器学习相结合，以取代人类操作员。计算机视觉将使用人工智能工具进行编程，以增强在车间环境中成功识别和识别零件形状和姿势的能力。然后，在空间和操作要求的约束下，自动为拾取放置任务规划机器人末端执行器的路径。视觉和路径信息将被动态地馈送到机器人内部控制系统以执行任务。拟议的研究成果为中小型汽车零部件制造商提供了最后一英里的机器人技术，目前主要的工业机器人制造商没有涵盖这一点。位于安大略省的TiGold Automotive North America Co Ltd已经确定了这一利基市场，并支持拟议的开发。拟议中的技术将提高安大略省汽车工业部门的生产率和竞争力。它不仅将通过增加更多的服务能力为我们的工业合作伙伴增加就业机会，而且还将增加当地供应商的就业机会。除了上面概述的对加拿大的经济和技术好处外，该项目还将培训三名HQP，使工业合作伙伴、其员工、当地供应商和服务提供商受益。

Pick-and-place Robots have been widely used to automate laborious and repetitive tasks by human operators to increase productivity, lower labour costs and reduce workplace injury claims, while ensuring consistent quality of products at high speed. However, specially designed pick-and-place robots for certain products and processes can no longer fit the current fast changing manufacturing process and products, where different products may be handled. As a result, many shops of small and medium auto parts manufacturers still retain human operators at the end of automated assembly lines to pick up and sort finished parts. The objective of the proposed research is to develop a programming framework for self-adjustable visual-servo pick-and-place robotic technology that can be readily implemented into commercial industrial robots. The research will integrate the computer vision and robotic control technologies with artificial intelligence and machine learning to replace human operators. The computer vision will be programmed with artificial intelligence tools to enhance the ability in successful identification and recognition of parts' shape and pose in shop environment. Then, a path for the end-effector of the robot will be planned automatically for a pick-and-place task, subject to the constraint of space and operation requirements. The visual and path information will be fed dynamically into the inner robot control system to execute the task. The outcome of the proposed research provides a last-mile delivery of robotic technologies to small and medium sized auto parts manufacturers, which is currently not covered by major manufacturers of industrial robots. TiGold Automotive North America Co Ltd in Ontario has identified this niche market and supports the proposed development. The proposed technology will increase the productivity and competitability of Ontario's automotive industry sector. It will not only increase jobs to our industrial partner by adding more service capability but also the local suppliers. In addition to the economic and technical benefits to Canada outlined above, this project will train three HQP, benefit the industrial partner, its employees, local suppliers and service providers.