Redundancy Reduction Twins Network: A Training framework for Multi-output Emotion Regression
Redundancy Reduction Twins Network: A Training framework for Multi-output Emotion Regression
复制标题
冗余减少双胞胎网络：多输出情绪回归的训练框架
DOI：
10.48550/arxiv.2206.09142
复制
发表时间：
2022
期刊：
影响因子：
--
通讯作者：
B. Schuller
中科院分区：
文献类型：
--
作者：
Xin Jing;Meishu Song;Andreas Triantafyllopoulos;Zijiang Yang;B. Schuller
在本文中，我们提出了Redundancy Reduction Twins Network（RRTN），这是一种冗余减少训练框架，通过测量同一网络的输出之间的互相关矩阵来最大限度地减少冗余，该网络提供了失真的样本版本，并使其尽可能接近单位矩阵。RRTN还应用了一个新的损失函数，巴洛双胞胎损失函数，以帮助最大限度地提高从样本的不同失真版本获得的表示的相似性。然而，由于损失的分布可能会导致网络的性能波动，我们还建议使用约束不确定性权重损失（RUWL）或联合训练来确定损失函数的最佳权重。我们在CNN14上使用所提出的方法的最佳方法在ExVo多任务开发集上获得了0.678的CCC超过情绪回归，比0.647的香草CNN 14 CCC增加了4.8%，这在95%置信区间（双尾）实现了显著差异。
In this paper, we propose the Redundancy Reduction Twins Network (RRTN), a redundancy reduction training framework that minimizes redundancy by measuring the cross-correlation matrix between the outputs of the same network fed with distorted versions of a sample and bringing it as close to the identity matrix as possible. RRTN also applies a new loss function, the Barlow Twins loss function, to help maximize the similarity of representations obtained from different distorted versions of a sample. However, as the distribution of losses can cause performance fluctuations in the network, we also propose the use of a Restrained Uncertainty Weight Loss (RUWL) or joint training to identify the best weights for the loss function. Our best approach on CNN14 with the proposed methodology obtains a CCC over emotion regression of 0.678 on the ExVo Multi-task dev set, a 4.8% increase over a vanilla CNN 14 CCC of 0.647, which achieves a significant difference at the 95% confidence interval (2-tailed).