Musical Information Processing by using Sound Ontology

(1)发明了用音高依赖性多元正态分布来表示乐器声学特征的音高依赖性，用多元正态分布的均值和方差来表示乐器声学特征的F0依赖性和F0依赖性。结果表明，在单个乐器水平上，乐器识别性能提高了16.48%，在类别水平上，乐器识别性能提高了20.6%。(2)音色相似与定位相结合的音乐声源分离方法通过声源定位解决了频率成分重叠引起的复调音乐的歧义。在此基础上，开发了复调音乐的乐器识别系统，该系统首先通过同步分组提取单音，然后通过顺序分组构成部分流。(3)打击乐器识别采用低通滤波器和高通滤波器分别对鼓和钹进行识别。前者通过无监督学习来识别，以吸收单个乐器和演奏的差异，而钹和小鼓的模糊性则通过启发式自动学习来解决其错误模式。(4)声音本体的系统构建从f0相关的多元正态分布所表示的特征中，创建了乐器的分层表示。从而建立了系统生成健全本体的方法。此外，对乐器层次的音高依赖性也有了新的观察

(1) Musical instrument identification by using pitchdependencyF0-dependent multivariate normal distribution is invented to represent the F0 (pitch) dependency of acoustical features of musical instruments so that F0-dependency and F0-independency are represented by the mean and variance of the F0-dependent multivariate normal distribution. The resulting performance of musical instrument identification is improved by 16.48% at individual instrument level and by 20.6% at category level(2) Musical sound source separation by combining timbre similarity and localizationThe ambiguities of polyphony music caused by overlapping frequency components are resolved by using sound source localization. Based on this schema, musical instrument identification system of polyphony music has been developed, which first extracts mono-tones by simultaneous grouping and then constitutes part streams by sequential grouping. The effectiveness of the proposed system was proved by using quartet performance recorded in an anechoic room(3) Percussion instrument identificationThe drums and cymbals are discriminated by low-pass and high-pass filters. The former is identified by unsupervised learning to absorb the differences of individual instruments and performance, while the ambiguities of cymbals and snare drums are resolved by automatic learning of heuristics concerning their error patterns(4) Systematic construction of sound ontologyFrom the features represented by F0-dependent multivariate normal distribution, the hierarchical representation of musical instruments has been created. Thus the method of systematic generation of sound ontology is established. In addition, new observation concerning the pitch-dependency of musical instrument hierarchy has been obtained