ALIVEmusic - Augmented Live music performance using Immersive Visualisation and Emotion

ALIVEmusic项目旨在研究如何通过基于物联网和人工智能的混合现实技术，利用音乐表达和情感分析，以有意义的方式增强现场音乐表演。我们采用参与式设计方法，以更好地了解数字时代观众和表演者的需求和期望，并发起以内容为导向的解决方案，提高观众参与度。该项目将智能乐器的表演数据与表演者和观众的情感状态数据融合在一起，形成一种有凝聚力的美学视觉效果。通过映射技术，计算机生成的视觉内容将实时在舞台元素上动态分层。最初的原型将被评估，为观众提供前所未有的沉浸式体验，使用混合现实头戴设备，如微软HoloLens或增强现实在手机上。

The ALIVEmusic project investigates how live music performances can be enhanced in meaningful ways by Mixed Reality leveraging musical expression and emotional analytics based on Internet of Things and Artificial Intelligence. We adopt a participatory design approach to better understand the needs and expectations of audiences and performers in our digital age and instigate content-driven solutions boosting audience engagement. This project will blend performative data harnessed by smart musical instruments with data characterising the emotional states of performer sand audiences into a cohesive aesthetic visualisation. Through mapping techniques, computer-generated visual content will be dynamically layered over stage elements in real time. Initial prototypes will be assessed enabling audiences unprecedented immersive experiences using either Mixed Reality headsets such as Microsoft HoloLens or Augmented Reality on mobile phones.