ALIVEmusic - Augmented Live music performance using Immersive Visualisation and Emotion

ALIVEmusic项目研究了如何通过混合现实利用基于物联网和人工智能的音乐表达和情感分析，以有意义的方式增强现场音乐表演。我们采用参与式设计方法，以更好地了解数字时代观众和表演者的需求和期望，并鼓励内容驱动的解决方案，提高观众的参与度。该项目将融合智能乐器所利用的表演数据，以及表现表演者和观众情绪状态的数据，形成一个有凝聚力的美学可视化。通过映射技术，计算机生成的视觉内容将在真实的时间内动态地层叠在舞台元素上。最初的原型将被评估，使观众能够使用混合现实耳机，如微软HoloLens或增强现实移动的手机前所未有的沉浸式体验。

The ALIVEmusic project investigates how live music performances can be enhanced in meaningful ways by Mixed Reality leveraging musical expression and emotional analytics based on Internet of Things and Artificial Intelligence. We adopt a participatory design approach to better understand the needs and expectations of audiences and performers in our digital age and instigate content-driven solutions boosting audience engagement. This project will blend performative data harnessed by smart musical instruments with data characterising the emotional states of performer sand audiences into a cohesive aesthetic visualisation. Through mapping techniques, computer-generated visual content will be dynamically layered over stage elements in real time. Initial prototypes will be assessed enabling audiences unprecedented immersive experiences using either Mixed Reality headsets such as Microsoft HoloLens or Augmented Reality on mobile phones.