Optical Flow Training under Limited Label Budget via Active Learning

Optical Flow Training under Limited Label Budget via Active Learning
复制标题

DOI:
10.48550/arxiv.2203.05053
复制
发表时间:
2022-03
期刊:
ArXiv
影响因子:
--
通讯作者:
Shuai Yuan;Xian Sun;Hannah Kim;Shuzhi Yu;Carlo Tomasi
Shuai Yuan;Xian Sun;Hannah Kim;Shuzhi Yu;Carlo Tomasi
中科院分区:
其他
文献类型:
--
作者:
Shuai Yuan;Xian Sun;Hannah Kim;Shuzhi Yu;Carlo Tomasi

文献摘要

相似文献

光流预测器的监督训练通常比无监督训练产生更好的准确性。然而,改进的性能通常伴随着较高的注释成本。半监督训练权衡了准确性和注释成本。我们使用一种简单而有效的半监督训练方法来证明,即使是一小部分标签也可以在无监督训练的基础上显著提高流的准确性。此外,我们还提出了基于简单算法的主动学习方法,以进一步减少实现相同目标精度所需的标签数量。我们在合成和真实的光流数据集上的实验表明,我们的半监督网络通常需要大约50%的标签才能达到接近全标签的准确度,而在Sintel上进行主动学习时,只需要大约20%。我们还分析并展示了可能影响主动学习表现的因素。代码可在https://github.com/duke-vision/optical-flow-active-learning-release上获得。
Supervised training of optical flow predictors generally yields better accuracy than unsupervised training. However, the improved performance comes at an often high annotation cost. Semi-supervised training trades off accuracy against annotation cost. We use a simple yet effective semi-supervised training method to show that even a small fraction of labels can improve flow accuracy by a significant margin over unsupervised training. In addition, we propose active learning methods based on simple heuristics to further reduce the number of labels required to achieve the same target accuracy. Our experiments on both synthetic and real optical flow datasets show that our semi-supervised networks generally need around 50% of the labels to achieve close to full-label accuracy, and only around 20% with active learning on Sintel. We also analyze and show insights on the factors that may influence active learning performance. Code is available at https://github.com/duke-vision/optical-flow-active-learning-release.