ON EFFICIENCIES OF STOCHASTIC OPTIMIZATION PROCEDURES UNDER IMPORTANCE SAMPLING
ON EFFICIENCIES OF STOCHASTIC OPTIMIZATION PROCEDURES UNDER IMPORTANCE SAMPLING
复制标题
DOI:
10.1109/wsc.2018.8632321
复制
发表时间:
2018-12
期刊:
影响因子:
--
通讯作者:
H. Lam;Guangxin Jiang;M. Fu
中科院分区:
文献类型:
--
作者:
H. Lam;Guangxin Jiang;M. Fu
We study and compare the efficiencies of stochastic approximation (SA) and sample average approximation (SAA) for stochastic optimization problems when the decision variables are inside the generating probability distributions or when importance sampling can be applied (as in the case of simulation optimization with Monte Carlo samples). We explain how SA is statistically more efficient than SAA in such contexts, a behavior different from conventional situations where SAA is usually held as the statistically optimal procedure. We support our claim with a theoretical minimax framework and a weak duality argument. We also demonstrate our theoretical findings with some simple simulation examples.