A Cross-Media Music Retrieval System by Converting Color Changes into Tonal Changes
A Cross-Media Music Retrieval System by Converting Color Changes into Tonal Changes
复制标题
将颜色变化转化为音调变化的跨媒体音乐检索系统
DOI：
10.1109/mdm.2014.51
复制
发表时间：
2014
期刊：
影响因子：
--
通讯作者：
Yoshiyuki Kato and Shuichi Kurabayashi
中科院分区：
文献类型：
--
作者：
Toshiyuki Yasuda;Akitoshi Adachi;and Kazuhiro Ohkura;森田高州，菊地毅，石井千春;Yoshiyuki Kato and Shuichi Kurabayashi
我们提出了一个跨媒体的音乐检索系统，为用户提供了一个工具包，制定自己的查询，通过描述他们的情感需求的音乐作为一个序列的图像的情绪变化。为了解释查询，系统使用度量空间将图像中的颜色变化转换为音乐中的连续音调变化，反之亦然。该系统为音乐和图像提供delta函数，以将变化计算为度量空间中的距离值。我们的系统通过比较它们的计算距离值来计算查询和音乐的面向情感的相关性得分。该系统的优点在于，它通过将图像的视觉印象转换为面向时间的无形音乐印象，在异构图像和音乐标准之间提供了一座桥梁。这种桥接操作是我们可视化查询构造方法的基础。这种方法允许用户通过检测音乐的情绪作为图像中的颜色变化，以试错的方式巧妙地操纵查询的形式来搜索音乐。该方法适用于在存储有多种类型音乐的基于Web的音乐资源中搜索满足用户偏好的未知音乐，而不需要任何与音乐相关的发布信息。
We propose a cross-media music retrieval system that provides its users with a toolkit for formulating their own query by describing their emotional requirements for changes in mood of music as a sequence of images. To interpret the query, the system uses a metric space to convert the color changes in images into continuous tonal changes in music, and vice versa. The system provides delta functions for music and images to compute the changes as distance values in the metric space. Our system calculates the sentiment-oriented relevance score of the query and music by comparing their computed distance values. The advantage of the system is that it provides a bridge between heterogeneous image and music criteria by converting the visual impressions of images into a time-oriented invisible impression of music. This bridging operation is the foundation of our visual query construction method. This method allows users to search for music by subtly manipulating the form of a query in a trial-and-error manner by detecting the moods of music as color changes in images. This method is suitable for searching for unknown music that satisfies the preferences of users in web-based music resources that store many types of music, but without any publishing information related to the music.