Musical Information Processing by using Sound Ontology

点击翻译按钮获取中文摘要

(1) Musical instrument identification by using pitchdependencyF0-dependent multivariate normal distribution is invented to represent the F0 (pitch) dependency of acoustical features of musical instruments so that F0-dependency and F0-independency are represented by the mean and variance of the F0-dependent multivariate normal distribution. The resulting performance of musical instrument identification is improved by 16.48% at individual instrument level and by 20.6% at category level(2) Musical sound source separation by combining timbre similarity and localizationThe ambiguities of polyphony music caused by overlapping frequency components are resolved by using sound source localization. Based on this schema, musical instrument identification system of polyphony music has been developed, which first extracts mono-tones by simultaneous grouping and then constitutes part streams by sequential grouping. The effectiveness of the proposed system was proved by using quartet performance recorded in an anechoic room(3) Percussion instrument identificationThe drums and cymbals are discriminated by low-pass and high-pass filters. The former is identified by unsupervised learning to absorb the differences of individual instruments and performance, while the ambiguities of cymbals and snare drums are resolved by automatic learning of heuristics concerning their error patterns(4) Systematic construction of sound ontologyFrom the features represented by F0-dependent multivariate normal distribution, the hierarchical representation of musical instruments has been created. Thus the method of systematic generation of sound ontology is established. In addition, new observation concerning the pitch-dependency of musical instrument hierarchy has been obtained