Towards single-channel unsupervised source separation of speech mixtures: the layered harmonics/formants separation-tracking model
Towards single-channel unsupervised source separation of speech mixtures: the layered harmonics/formants separation-tracking model
复制标题
面向语音混合物的单通道无监督源分离：分层谐波/共振峰分离跟踪模型
DOI：
10.7916/d8v69tzr
复制
发表时间：
2004
期刊：
影响因子：
--
通讯作者：
D. Ellis
中科院分区：
文献类型：
--
作者：
M. Reyes;N. Jojic;D. Ellis
用于盲源分离的说话人模型通常基于由大量状态组成的用于捕获源频谱变化的HISTORY，并且在大量孤立语音上训练。由于观测值在源之间可能是相似的，因此推断依赖于来自状态转移矩阵的顺序约束，然而，这些约束相当弱。为了避免这些问题，我们提出了一种策略，捕捉局部变形的时频能量分布。由于连续的频谱帧是高度相关的，每个帧可以准确地描述为它的前任的非均匀变形。变形的平滑模式指示单个扬声器，并且变形场中的悬崖可以指示扬声器开关。此外，语音的对数谱可以被分解成两个附加层，分别描述谐波和共振峰结构。我们在这两个层的隐藏变换变量的平滑变形模型，使用MRF重叠的子窗口作为观察，假设是一个嘈杂的两层的总和。循环置信传播提供了有效的推理。在没有任何预先训练的语音或说话人模型的情况下，这种方法可以用于填充缺失的时频观测，并且变形场的局部熵指示用于分离的源边界。
Speaker models for blind source separation are typically based on HMMs consisting of vast numbers of states to capture source spectral variation, and trained on large amounts of isolated speech. Since observations can be similar between sources, inference relies on sequential constraints from the state transition matrix which are, however, quite weak. To avoid these problems, we propose a strategy of capturing local deformations of the time-frequency energy distribution. Since consecutive spectral frames are highly correlated, each frame can be accurately described as a nonuniform deformation of its predecessor. A smooth pattern of deformations is indicative of a single speaker, and the cliffs in the deformation fields may indicate a speaker switch. Further, the log-spectrum of speech can be decomposed into two additive layers, separately describing the harmonics and formant structure. We model smooth deformations as hidden transformation variables in both layers, using MRFs with overlapping subwindows as observations, assumed to be a noisy sum of the two layers. Loopy belief propagation provides for efficient inference. Without any pre-trained speech or speaker models, this approach can be used to fill in missing time-frequency observations, and the local entropy of the deformation fields indicate source boundaries for separation.