Bayesian optimization with partially specified queries

Bayesian optimization with partially specified queries
复制标题

使用部分指定查询的贝叶斯优化

DOI:
10.1007/s10994-021-06079-3
复制
发表时间:
2022
期刊:
影响因子:
7.5
通讯作者:
Hisashi Kashima
Hisashi Kashima
中科院分区:
计算机科学3区
文献类型:
--
作者:
Shogo Hayashi;Junya Honda;Hisashi Kashima

文献摘要

参考文献

相似文献

贝叶斯优化(BO)是一种优化计算代价昂贵的黑箱函数并依次确定输入变量值以计算函数的方法。但是,为所有输入变量指定值是昂贵的,并且在某些情况下很难指定值,例如,在外包场景中,使用许多输入变量生成输入查询涉及大量成本。在本文中,我们提出了一种新的高斯过程强盗问题,部分指定查询BO (BOPSQ)。在BOPSQ中,与标准的BO设置不同,学习者只指定一些输入变量的值,而未指定的输入变量的值是根据已知或未知的分布随机确定的。针对已知和未知输入分布的情况,我们提出了两种基于后验抽样的算法。我们进一步推导了它们的遗憾界,对于流行的核是次线性的。我们使用测试函数和真实世界的数据集证明了所提出算法的有效性。
Bayesian optimization (BO) is an approach to optimizing an expensive-to-evaluate black-box function and sequentially determines the values of input variables to evaluate the function. However, it is expensive and in some cases becomes difficult to specify values for all input variables, for example, in outsourcing scenarios where production of input queries with many input variables involves significant cost. In this paper, we propose a novel Gaussian process bandit problem, BO with partially specified queries (BOPSQ). In BOPSQ, unlike the standard BO setting, a learner specifies only the values of some input variables, and the values of the unspecified input variables are randomly determined according to a known or unknown distribution. We propose two algorithms based on posterior sampling for cases of known and unknown input distributions. We further derive their regret bounds that are sublinear for popular kernels. We demonstrate the effectiveness of the proposed algorithms using test functions and real-world datasets.
噪声和成本优化的非参数方法
DOI: --
发表时间: 2000
期刊: --
影响因子: --
作者:
Brigham S. Anderson;A. Moore;David A. Cohn
通讯作者: David A. Cohn
因果强盗:通过因果推理学习良好的干预措施
DOI: --
发表时间: 2016
期刊: Neural Information Processing Systems
影响因子: --
作者:
Finnian Lattimore;Tor Lattimore;Mark D. Reid
通讯作者: Mark D. Reid