Virtual pottery: a virtual 3D audiovisual interface using natural hand motions
Virtual pottery: a virtual 3D audiovisual interface using natural hand motions
复制标题
DOI：
10.1007/s11042-013-1382-3
复制
发表时间：
2014-11-01
影响因子：
3.6
通讯作者：
Han, Byeong-jun
中科院分区：
文献类型：
--
作者：
Han, Yoon Chung;Han, Byeong-jun
在本文中，我们提出了我们的方法设计和实现一个虚拟的三维声音造型界面，创建视听效果，使用手部动作在真实的时间。在“虚拟陶艺”界面中，我们使用陶艺创作的隐喻，以便将自然的手部动作应用于3D空间雕塑。用户可以通过在真实的时间里改变手的位置来创作自己的陶片，也可以根据预先存在的音乐创作规则来生成3D声音雕塑。虚拟陶器的界面可以根据形状设计和摄像头传感类型进行分类。本文介绍了我们如何开发的两个版本的虚拟陶器和实现的接口的技术方面。此外，我们调查的方式翻译成音乐的声音手部动作。手部运动检测的准确性对于将自然手部运动转化为虚拟现实至关重要。根据初步评估的结果，无论是运动捕捉跟踪系统和便携式深度传感相机的精度是一样高的实际数据。我们进行了用户研究，其中考虑到有关这两个展览的信息沿着与不同年龄的用户。总的来说，虚拟陶艺是虚拟环境和传统艺术实践之间的桥梁，其结果是它可以导致虚拟乐器和未来艺术教育计划的深层潜力的培养。
In this paper, we present our approach towards designing and implementing a virtual 3D sound sculpting interface that creates audiovisual results using hand motions in real time. In the interface "Virtual Pottery," we use the metaphor of pottery creation in order to adopt the natural hand motions to 3D spatial sculpting. Users can create their own pottery pieces by changing the position of their hands in real time, and also generate 3D sound sculptures based on pre-existing rules of music composition. The interface of Virtual Pottery can be categorized by shape design and camera sensing type. This paper describes how we developed the two versions of Virtual Pottery and implemented the technical aspects of the interfaces. Additionally, we investigate the ways of translating hand motions into musical sound. The accuracy of the detection of hand motions is crucial for translating natural hand motions into virtual reality. According to the results of preliminary evaluations, the accuracy of both motion-capture tracking system and portable depth sensing camera is as high as the actual data. We carried out user studies, which took into account information about the two exhibitions along with the various ages of users. Overall, Virtual Pottery serves as a bridge between the virtual environment and traditional art practices, with the consequence that it can lead to the cultivation of the deep potential of virtual musical instruments and future art education programs.