Stable Conformal Prediction Sets

Stable Conformal Prediction Sets
复制标题

稳定的共形预测集

DOI:
--
复制
发表时间:
2021
期刊:
International Conference on Machine Learning
影响因子:
--
通讯作者:
Eugène Ndiaye
Eugène Ndiaye
中科院分区:
--
文献类型:
--
作者:
Eugène Ndiaye

文献摘要

参考文献

被引文献

相似文献

当观察一系列变量 $(x_1, y_1)、ldots、(x_n, y_n)$ 时,保形预测 (CP) 是一种方法,只需假设数据的分布是可交换的,就可以在给定 $x_{n+1}$ 的情况下估计 $y_{n+1}$ 的置信集。 CP 集保证覆盖任何有限的群体规模 $n$。虽然很吸引人,但这样一个集合的计算一般来说是不可行的,例如当未知变量 $y_{n+1}$ 连续时。瓶颈在于,它基于重新调整数据预测模型的过程,在该过程中,我们用所有可能的值替换未知目标,以选择最可能的目标。这需要计算无限数量的模型,这通常使其变得棘手。在本文中,我们将 CP 技术与经典算法稳定性界限相结合,导出可通过单个模型拟合计算的预测集。我们证明,我们提出的置信集不会失去任何覆盖范围保证,同时避免了文献中当前所做的数据分割的需要。我们提供了一些数值实验来说明当样本量足够大时,我们在合成数据集和真实数据集上的估计的严格性。
When one observes a sequence of variables $(x_1, y_1), ldots, (x_n, y_n)$, Conformal Prediction (CP) is a methodology that allows to estimate a confidence set for $y_{n+1}$ given $x_{n+1}$ by merely assuming that the distribution of the data is exchangeable. CP sets have guaranteed coverage for any finite population size $n$. While appealing, the computation of such a set turns out to be infeasible in general, e.g. when the unknown variable $y_{n+1}$ is continuous. The bottleneck is that it is based on a procedure that readjusts a prediction model on data where we replace the unknown target by all its possible values in order to select the most probable one. This requires computing an infinite number of models, which often makes it intractable. In this paper, we combine CP techniques with classical algorithmic stability bounds to derive a prediction set computable with a single model fit. We demonstrate that our proposed confidence set does not lose any coverage guarantees while avoiding the need for data splitting as currently done in the literature. We provide some numerical experiments to illustrate the tightness of our estimation when the sample size is sufficiently large, on both synthetic and real datasets.
DOI: 10.1214/22-aos2244
发表时间: 2023-02-01
影响因子: 4.5
作者:
Bates, Stephen;Candes, Emmanuel;Sesia, Matteo
通讯作者: Sesia, Matteo
DOI: --
发表时间: 2020-10
期刊: --
影响因子: --
作者:
Chen Xu;Yao Xie
通讯作者: Chen Xu;Yao Xie
通过影响函数大规模逼近完全保形预测
DOI: 10.1609/aaai.v37i6.25814
发表时间: 2023
期刊: Proceedings of the AAAI Conference on Artificial Intelligence
影响因子: --
作者:
Abad Martinez J
通讯作者: Abad Martinez J
DOI: 10.1214/20-aos1965
发表时间: 2021-02-01
影响因子: 4.5
作者:
Barber, Rina Foygel;Candes, Emmanuel J.;Tibshirani, Ryan J.
通讯作者: Tibshirani, Ryan J.