ViMuSe - a video-based AI music recommendation engine to improve creative efficiency and diversity.

点击翻译按钮获取中文摘要

This project aims to develop an AI tool which will instantly recommend music tracks that would go well with a specific video clip (i.e. movie trailer). Our proposed recommendation engine will be able to dynamically recommend music tracks that are well-suited to the video content, even if the user does not have a specific music track in mind.This project unites Pyrsos' outstanding research capabilities with DAACI's existing music catalogue and software platform infrastructure to build cutting edge machine learning technology and make it available to a broad audience. It builds upon state-of-the art representation learning for multimedia and advances it by training a neural network that can map video and music excerpts into a shared semantic space. Extensive user testing will be conducted during the project to evaluate the technology and provide feedback.