Active Ranking without Strong Stochastic Transitivity
Active Ranking without Strong Stochastic Transitivity
复制标题
DOI:
--
复制
发表时间:
2022
期刊:
影响因子:
--
通讯作者:
Hao Lou;Tao Jin;Yue Wu;Pan Xu;Quanquan Gu;Farzad Farnoud
中科院分区:
文献类型:
--
作者:
Hao Lou;Tao Jin;Yue Wu;Pan Xu;Quanquan Gu;Farzad Farnoud
Ranking from noisy comparisons is of great practical interest in machine learning. In this paper, we consider the problem of recovering the exact full ranking for a list of items under ranking models that do not assume the Strong Stochastic Transitivity property. We propose a δ -correct algorithm, Probe-Rank, that actively learns the ranking from noisy pairwise comparisons. We prove a sample complexity upper bound for Probe-Rank, which only depends on the preference probabilities between items that are adjacent in the true ranking. This improves upon existing sample complexity results that depend on the preference probabilities for all pairs of items. Probe-Rank thus outperforms existing methods over a large collection of instances that do not satisfy Strong Stochastic Transitivity. Thorough numerical experiments in various settings are conducted, demonstrating that Probe-Rank is significantly more sample-efficient than the state-of-the-art active ranking method.