Posture and Gesture Recognition for Wireless Musical Gloves

无线音乐手套的姿势和手势识别

• 批准号: 132056
• 金额: $ 4.52万
• 依托单位: MI.MU LIMITED
• 依托单位国家: 英国
• 项目类别: Feasibility Studies
• 财政年份: 2015
• 资助国家: 英国
• 起止时间: 2015 至 无数据
• 项目状态: 已结题
• 来源: https://gtr.ukri.org/projects?ref=132056
• 关键词: Posture; Gesture; Recognition; Wireless; Musical

Mimu Gloves are wireless, sensor-enabled gloves for creating and performing music. This project will develop advanced posture and gesture recognition algorithms for this glove so that hand postures (e.g. ‘fist’ or ‘one finger point’) and time-varying gestures can be used as a new way to control the composition and performance of music with computers. We will compare a variety of different machine learning techniques applied to the flex sensor data from our glove. We will also vary parameters such as the number/placement of sensors, the number of postures and the amount of training data available for machine learning. Finally, we will explore the recognition of time-varying postures - or gestures. This project will a) extend the capabilities of our hardware glove so that we can develop a fully gestural music making device, with no comparable market competitor; and b) allow us to capture such information about the movement of the hand that we could extend our potential applications beyond music - e.g. video games, virtual reality, medicine and design. The project will be led by mimu Limited and conducted collaboratively with Dr. Tom Mitchell of the University of West England

Mimu手套是一款无线传感器手套，用于创作和表演音乐。该项目将为这种手套开发先进的姿势和手势识别算法，以便手部姿势（例如“拳头”或“一个手指点”）和随时间变化的手势可以作为一种新的方式来控制计算机音乐的创作和演奏。我们将比较各种不同的机器学习技术应用于我们手套的Flex传感器数据。我们还将改变参数，例如传感器的数量/位置，姿势的数量和可用于机器学习的训练数据量。最后，我们将探索时变姿势或手势的识别。该项目将a）扩展我们的硬件手套的功能，以便我们可以开发一个完全手势音乐制作设备，没有可比的市场竞争对手;和B）使我们能够捕获有关手部运动的信息，我们可以扩展我们的潜在应用超越音乐-例如视频游戏，虚拟现实，医学和设计。该项目将由mimu有限公司领导，并与西英格兰大学的Tom Mitchell博士合作进行