Research of action analysis of the child using the data of a sound and video, and an acceleration sensor

点击翻译按钮获取中文摘要

In the education of kindergarten and nursery schools, music is an especially important channel for infant's expression ability improvement. For inexperienced kindergarten teachers or nurses, however, it is difficult to observe every infant carefully with playing the piano. To resolve the problem, this paper proposes an infant music education support system based on the integration of sensor, video, and sound data. Concretely, the proposed system focuses attention to motion of a baton with build-in red LED maker and 2-axis accelerometer. The infant shakes the baton accompanied by piano and the marker tracking result and accelerometer output are represented graphically. The experiment at kindergarten school shows 1) the marker tracking is reliable, and 2) the accelerometer detects detailed motion that could not be observed through the video data.