An augmented reality-based training system with a natural user interface for manual milling operations
An augmented reality-based training system with a natural user interface for manual milling operations
复制标题
DOI：
10.1007/s10055-019-00415-8
复制
发表时间：
2019-12
期刊：
影响因子：
4.2
通讯作者：
Chih-Kai Yang;Yu-Hsi Chen;Tung-Jui Chuang;Kalpana Shankhwar;Shana Smith
中科院分区：
文献类型：
--
作者：
Chih-Kai Yang;Yu-Hsi Chen;Tung-Jui Chuang;Kalpana Shankhwar;Shana Smith
本研究开发了一种基于增强现实 (AR) 的培训系统，用于传统手动铣削操作。 HTC Vive 头戴式显示器上安装了英特尔实感 R200 深度摄像头和 Leap Motion 控制器，让用户可以在房间大小的 AR 环境中自由走动，利用自然的操作行为徒手操作全尺寸虚拟铣床，就像在现实世界中操作真实铣床一样，无需额外佩戴或手持设备。利用GPU并行计算处理动态遮挡并加速加工仿真，实现实时仿真。使用开发的基于AR的培训系统，新手可以在安全的环境中接受实践培训，而不会造成任何伤害或损坏。用户测试结果表明，使用开发的基于 AR 的培训比使用视频培训的失败率和查询时间更低。用户还表示，基于AR的培训很有趣，有助于新手学习基本的手动铣削操作技术。
This study developed an augmented reality (AR)-based training system for conventional manual milling operations. An Intel RealSense R200 depth camera and a Leap Motion controller were mounted on an HTC Vive head-mounted display to allow users freely walk around in a room-size AR environment to operate a full-size virtual milling machine with their barehands, using their natural operation behaviors, as if they were operating a real milling machine in the real world, without additional worn or handheld devices. GPU parallel computing was used to handle dynamic occlusions and accelerate the machining simulation to achieve a real-time simulation. Using the developed AR-based training system, novices can receive a hands-on training in a safe environment, without any injury or damage. User test results showed that using the developed AR-based training resulted in lower failure rates and inquiry times than using video training. Users also commented that the AR-based training was interesting and helpful for novices to learn the basic manual milling operation techniques.