Noise correction to improve data and model quality for crowdsourcing
Noise correction to improve data and model quality for crowdsourcing
复制标题
噪声校正可提高众包的数据和模型质量
DOI：
10.1016/j.engappai.2019.04.004
复制
发表时间：
2019-06
影响因子：
8
通讯作者：
Xu Wenqiang
中科院分区：
文献类型：
--
作者：
Li Chaoqun;Jiang Liangxiao;Xu Wenqiang
In supervised learning, obtaining expert labeling of data is expensive and time-consuming in many cases. Crowdsourcing services provide a cheap and efficient way to acquire the labels of data. In crowdsourcing scenario, each instance obtains a multiple noisy label set from multiple different labelers, then ground truth inference algorithms are employed to obtain integrated labels of instances. In spite of the effectiveness of ground truth inference methods, a certain level of class (label) noise still exists in integrated labels, and thus class noise correction methods are dedicated to mitigate the effects of the class noise. However, to our best knowledge, there is little work, up to the present, on exploiting the information in the crowdsourcing scenario. This paper proposes a novel class noise correction method which takes advantage of the information of the multiple noisy label sets. We call our method between-class margin-based noise correction (BMNC). In BMNC, a preliminary filtering is performed before building filters to filter class noise. By the preliminary filtering, some potentially noise instances are first removed. Afterwards, a filter is built to further filter out noise instances. After these two filtering steps, a clean set and a noise set are obtained, and then a classifier is built on the clean set to relabel the instances in noise set. Experimental results on 22 simulated benchmark data sets and eight real-world crowdsourced data sets show that BMNC can significantly reduce the class noise level in integrated labels and thereby enhance the performance of target classifiers.
登录
查看更多内容
影响因子：
7.5
作者：
Wilson, DR;Martinez, TR
通讯作者：
Martinez, TR
DOI：
10.1109/cvpr.2005.16
发表时间：
2005-06
期刊：
2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05)
影响因子：
--
作者：
Li Fei-Fei-Li-Fei-Fei-48004138;P. Perona
通讯作者：
Li Fei-Fei-Li-Fei-Fei-48004138;P. Perona
DOI：
10.1145/2806416.2806627
发表时间：
2015-10
期刊：
Proceedings of the 24th ACM International on Conference on Information and Knowledge Management
影响因子：
--
作者：
J. Zhang;Victor S. Sheng;Jian Wu;Xiaoqin Fu;Xindong Wu
通讯作者：
J. Zhang;Victor S. Sheng;Jian Wu;Xiaoqin Fu;Xindong Wu
DOI：
--
发表时间：
2014
期刊：
Journal of management science
影响因子：
--
作者：
อนิรุธ สืบสิงห์
通讯作者：
อนิรุธ สืบสิงห์
DOI：
10.1109/icdm.2012.64
发表时间：
2012-12
期刊：
2012 IEEE 12th International Conference on Data Mining
影响因子：
--
作者：
Meng Fang;Xingquan Zhu;Bin Li;W. Ding;Xindong Wu
通讯作者：
Meng Fang;Xingquan Zhu;Bin Li;W. Ding;Xindong Wu