Posture and Gesture Recognition for Wireless Musical Gloves

Mimu手套是一款无线传感器手套，用于创作和表演音乐。该项目将为该手套开发先进的姿势和手势识别算法，以便手势（例如“拳头”或“单指”）和时变手势可以作为一种新的方式来控制计算机的音乐创作和表演。我们将比较各种不同的机器学习技术应用于我们手套的弯曲传感器数据。我们还将改变参数，如传感器的数量/位置、姿势的数量和机器学习可用的训练数据量。最后，我们将探讨时变姿势或手势的识别。这个项目将a)扩展我们硬件手套的功能，这样我们就可以开发一个完全手势音乐制作设备，没有类似的市场竞争对手；b)让我们能够捕捉到有关手部运动的信息，从而将我们的潜在应用扩展到音乐以外的领域——例如视频游戏、虚拟现实、医学和设计。该项目将由mimu Limited领导，并与西英格兰大学的Tom Mitchell博士合作进行

Mimu Gloves are wireless, sensor-enabled gloves for creating and performing music. This project will develop advanced posture and gesture recognition algorithms for this glove so that hand postures (e.g. ‘fist’ or ‘one finger point’) and time-varying gestures can be used as a new way to control the composition and performance of music with computers. We will compare a variety of different machine learning techniques applied to the flex sensor data from our glove. We will also vary parameters such as the number/placement of sensors, the number of postures and the amount of training data available for machine learning. Finally, we will explore the recognition of time-varying postures - or gestures. This project will a) extend the capabilities of our hardware glove so that we can develop a fully gestural music making device, with no comparable market competitor; and b) allow us to capture such information about the movement of the hand that we could extend our potential applications beyond music - e.g. video games, virtual reality, medicine and design. The project will be led by mimu Limited and conducted collaboratively with Dr. Tom Mitchell of the University of West England