Posture and Gesture Recognition for Wireless Musical Gloves

MIMU手套是一种无线传感器手套，用于创作和演奏音乐。该项目将为这款手套开发先进的姿势和手势识别算法，以便将手势(例如“拳头”或“一个指点”)和时变手势作为一种新的方式，用计算机控制音乐的创作和演奏。我们将比较各种不同的机器学习技术应用于手套上的FLEX传感器数据。我们还将改变参数，如传感器的数量/位置、姿势的数量和可用于机器学习的训练数据量。最后，我们将探索对时变姿势或手势的识别。该项目将a)扩展我们硬件手套的功能，以便我们能够开发一种完全手势的音乐制作设备，而这是市场上无与伦比的竞争对手；以及b)使我们能够捕获有关手的运动的信息，从而我们可以将我们的潜在应用扩展到音乐之外--例如视频游戏、虚拟现实、医学和设计。该项目将由MIMU有限公司领导，并与西英格兰大学的汤姆·米切尔博士合作进行

Mimu Gloves are wireless, sensor-enabled gloves for creating and performing music. This project will develop advanced posture and gesture recognition algorithms for this glove so that hand postures (e.g. ‘fist’ or ‘one finger point’) and time-varying gestures can be used as a new way to control the composition and performance of music with computers. We will compare a variety of different machine learning techniques applied to the flex sensor data from our glove. We will also vary parameters such as the number/placement of sensors, the number of postures and the amount of training data available for machine learning. Finally, we will explore the recognition of time-varying postures - or gestures. This project will a) extend the capabilities of our hardware glove so that we can develop a fully gestural music making device, with no comparable market competitor; and b) allow us to capture such information about the movement of the hand that we could extend our potential applications beyond music - e.g. video games, virtual reality, medicine and design. The project will be led by mimu Limited and conducted collaboratively with Dr. Tom Mitchell of the University of West England