Research on Construction of a Database for the Traditional Folk Dance and its Applications

我们提出了一个Buyo-fu（三维数字舞蹈音符）来记录传统的民间舞蹈。一个Buyo-fu是通过分割的运动捕捉（MOCAP）捕捉到的人体运动数据成基元。为了使Buyo-fu的实际应用，本研究探讨了以下课题：1）Buyo-fu的自动生成：为了自动生成Buyo-fu，我们开发了两种方法：一种是利用MOCAP数据波形中包含的特征，另一种是基于自组织映射。2）Buyo-fu数据库的构建：我们已经建立了一个Buyo-fu数据库，具有方便的搜索能力。当检索请求的内容时，我们可以使用手势名称或动作名称作为搜索关键字。3）舞蹈创作者的开发：我们开发了一个舞蹈创作者，通过在PC上连接Buyo-fu来创建舞蹈。4）舞蹈查看器的开发：我们开发了一个舞蹈查看器，通过它我们可以在PC上欣赏舞蹈。我们还讨论了一种方法，通过该方法可以在具有无线LAN连接的PDA上显示舞蹈。我们可以通过互联网从数据库中下载舞蹈数据，并在任何地方欣赏舞蹈。5）建立舞蹈数据库供公众用途：在记录舞蹈时，照片，视频和音乐一起记录。由于我们认为Buyo-fu也被用作CG材料，因此希望以多种格式记录Buyo-fu。因此，我们开发了一种可以使用MPEG-7方案以多种格式全面记录数据的存档方法，以供公众使用。我们在两年内完成了实际使用Buyo-fu的基础研究。在取得丰硕成果的基础上，我们将为几个传统领域的专家技能开发一种传承技术。

We have proposed a Buyo-fu (3-dimensional digital dance note) to document a traditional folk dance. A Buyo-fu is made by segmenting human movement data captured by a motion capture (MOCAP) into primitives. In this research, we have discussed the following subject in order to make practical use of the Buyo-fu.1) Automatic generation of a Buyo-fu: In order to automatically generate a Buyo-fu, we have developed two methods: one exploits the characteristics included in waveforms of MOCAP data, and the other is based on the self-organizing map.2) Construction of a Buyo-fu database: We have constructed a Buyo-fu database with easy searching capability. When retrieving requested contents, we can use a gesture name or motion name as a search key.3) Development of a dance composer: We have developed a dance composer to create a dance by concatenating Buyo-fu's on a PC.4) Development of a dance viewer: We have developed a dance viewer by which we can appreciate a danced on a PC. We have also discussed a method by which a dance can be displayed on a PDA with wireless LAN connectivity. We can download dance data from a database via the Internet and appreciate a dance anywhere.5) Construction of a dance database for public use: When documenting a dance, photographs, videos and music are recorded together. Since we consider that the Buyo-fu is also exploited as CG materials, it is desired to record a Buyo-fu in several formats. Hence, we have developed an archiving method that can comprehensively record the data in several formats using a MPEG-7 scheme for public use.We have completed fundamental research on making practical use of the Buyo-fu in two years. Based on the fruitful results, we will develop a bequeathing technique for the skill of experts in several traditional fields.