Smart augmented reality instructional system for mechanical assembly towards worker-centered intelligent manufacturing
Smart augmented reality instructional system for mechanical assembly towards worker-centered intelligent manufacturing
复制标题
DOI：
10.1016/j.jmsy.2020.02.010
复制
发表时间：
2020-04-01
影响因子：
12.1
通讯作者：
Yin, Zhaozheng
中科院分区：
文献类型：
--
作者：
Lai, Ze-Hao;Tao, Wenjin;Yin, Zhaozheng
质量和效率是任何制造企业的关键指标。许多公司都面临着在整个生产线上缺乏有经验的工人来完成复杂的组装任务的问题。为了减少装配任务中的时间和错误，介绍了一种以工人为中心的系统，该系统由多模态增强现实（AR）指令组成，并支持深度学习网络用于工具检测。集成的AR设计用于提供现场指令，包括各种视觉渲染，使用经过微调的基于区域的卷积神经网络，该网络在合成工具数据集上进行训练。该数据集使用工具的CAD模型生成，并在不使用真实工具图像的情况下显示在2D场景中。通过对数控雕刻机的机械装配进行实验，实验结果表明，该系统可将给定装配任务的时间和误差分别减少33.2%和32.4%。通过集成系统，构建并演示了一个高效、可定制的智能AR指导系统，该系统能够感知、表征需求并提高工人的绩效。
Quality and efficiency are crucial indicators of any manufacturing company. Many companies are suffering from a shortage of experienced workers across the production line to perform complex assembly tasks. To reduce time and error in an assembly task, a worker-centered system consisting of mull-modal Augmented Reality (AR) instructions with the support of a deep learning network for tool detection is introduced. The integrated AR is designed to provide on-site instructions including various visual renderings with a fine-tuned Region-based Convolutional Neural Network, which is trained on a synthetic tool dataset. The dataset is generated using CAD models of tools and displayed onto a 2D scene without using real tool images. By experimenting the system to a mechanical assembly of a CNC carving machine, the result of a designed experiment shows that the system helps reduce the time and errors of the given assembly tasks by 33.2 % and 32.4 %, respectively. With the integrated system, an efficient, customizable smart AR instruction system capable of sensing, characterizing requirements, and enhancing worker's performance has been built and demonstrated.