Research of action analysis of the child using the data of a sound and video, and an acceleration sensor

在幼儿园教育中，音乐是提高幼儿表达能力的一个特别重要的渠道。然而，对于没有经验的幼儿园教师或护士来说，很难仔细观察每一个弹钢琴的婴儿。为了解决这一问题，本文提出了一种基于传感器、视频和声音数据集成的幼儿音乐教育支持系统。具体而言，该系统将注意力集中在带有内置红色LED制造商和两轴加速度计的指挥棒的运动上。婴儿在钢琴伴奏下摇棒，标记跟踪结果和加速度计输出图形化表示。在幼儿园的实验表明，1)标记跟踪是可靠的，2)加速度计检测到视频数据无法观察到的详细运动。

In the education of kindergarten and nursery schools, music is an especially important channel for infant's expression ability improvement. For inexperienced kindergarten teachers or nurses, however, it is difficult to observe every infant carefully with playing the piano. To resolve the problem, this paper proposes an infant music education support system based on the integration of sensor, video, and sound data. Concretely, the proposed system focuses attention to motion of a baton with build-in red LED maker and 2-axis accelerometer. The infant shakes the baton accompanied by piano and the marker tracking result and accelerometer output are represented graphically. The experiment at kindergarten school shows 1) the marker tracking is reliable, and 2) the accelerometer detects detailed motion that could not be observed through the video data.