Optimal anytime regret with two experts
Optimal anytime regret with two experts
复制标题
最佳随时后悔与两位专家
DOI:
10.4171/msl/38
复制
发表时间:
2020
期刊:
影响因子:
--
通讯作者:
Sikander Randhawa
中科院分区:
文献类型:
--
作者:
Nicholas J. A. Harvey;Christopher Liaw;E. Perkins;Sikander Randhawa
The multiplicative weights method is an algorithm for the problem of prediction with expert advice. It achieves the minimax regret asymptotically if the number of experts is large, and the time horizon is known in advance. Optimal algorithms are also known if there are exactly two or three experts, and the time horizon is known in advance.
In the anytime setting, where the time horizon is not known in advance, algorithms can be obtained by the doubling trick, but they are not optimal, let alone practical. No minimax optimal algorithm was previously known in the anytime setting, regardless of the number of experts.
We design the first minimax optimal algorithm for minimizing regret in the anytime setting. We consider the case of two experts, and prove that the optimal regret is $\gamma \sqrt{t} / 2$ at all time steps $t$, where $\gamma$ is a natural constant that arose 35 years ago in studying fundamental properties of Brownian motion. The algorithm is designed by considering a continuous analogue, which is solved using ideas from stochastic calculus.
DOI:
10.1137/1.9781611975994.52
发表时间:
2020
期刊:
Proceedings of the Annual ACMSIAM Symposium on Discrete Algorithms
影响因子:
--
作者:
Abbasi-Zadeh, S;Bansal, N;Guruganesh, G.;Nikolov, A;Schwartz, R;Singh, M.
通讯作者:
Singh, M.
影响因子:
3.1
作者:
Diakonikolas, Jelena;Orecchia, Lorenzo
通讯作者:
Orecchia, Lorenzo