Free-hand interaction for handheld augmented reality using an RGB-depth camera
Free-hand interaction for handheld augmented reality using an RGB-depth camera
复制标题
使用 RGB 深度相机进行手持式增强现实徒手交互
DOI：
10.1145/2543651.2543667
复制
发表时间：
2013
期刊：
影响因子：
--
通讯作者：
M. Billinghurst
中科院分区：
文献类型：
--
作者：
Huidong Bai;Lei Gao;Jihad El;M. Billinghurst
在本文中，我们提出了一种新的基于手势的交互方法，手持增强现实（AR）的平板电脑上实现的RGB深度相机连接。与传统的以设备为中心的交互方法（如键盘、手写笔或触摸屏输入）相比，基于自然手势的界面为AR应用提供了更直观的体验。结合深度信息，手势界面可以将手持AR交互扩展到完整的3D空间。在我们的系统中，我们检索的3D手骨架的颜色和深度帧，映射的结果，在AR场景中的虚拟对象的相应操作。我们的方法允许用户在3D空间中使用他们的赤手空拳控制虚拟对象，并执行操作，如平移，旋转和缩放。
In this paper, we present a novel gesture-based interaction method for handheld Augmented Reality (AR) implemented on a tablet with an RGB-Depth camera attached. Compared with conventional device-centric interaction methods like keypad, stylus, or touchscreen input, natural gesture-based interfaces offer a more intuitive experience for AR applications. Combining with depth information, gesture interfaces can extend handheld AR interaction into full 3D space. In our system we retrieve the 3D hand skeleton from color and depth frames, mapping the results to corresponding manipulations of virtual objects in the AR scene. Our method allows users to control virtual objects in 3D space using their bare hands and perform operations such as translation, rotation, and zooming.