Level-Based Analysis of the Univariate Marginal Distribution Algorithm
Level-Based Analysis of the Univariate Marginal Distribution Algorithm
复制标题
单变量边际分布算法的基于级别的分析
作者:
D. Dang;P. Lehre;P. Nguyen
Estimation of Distribution Algorithms (EDAs) are stochastic heuristics that search for optimal solutions by learning and sampling from probabilistic models. Despite their popularity in real-world applications, there is little rigorous understanding of their performance. Even for the Univariate Marginal Distribution Algorithm (UMDA)—a simple population-based EDA assuming independence between decision variables—the optimisation time on the linear problem OneMax was until recently undetermined. The incomplete theoretical understanding of EDAs is mainly due to the lack of appropriate analytical tools. We show that the recently developed level-based theorem for non-elitist populations combined with anti-concentration results yield upper bounds on the expected optimisation time of the UMDA. This approach results in the bound Onλlogλ+n2documentclass[12pt]{minimal} usepackage{amsmath} usepackage{wasysym} usepackage{amsfonts} usepackage{amssymb} usepackage{amsbsy} usepackage{mathrsfs} usepackage{upgreek} setlength{oddsidemargin}{-69pt} egin{document}$$mathcal {O}left( nlambda log lambda +n^2
ight) $$end{document} on the LeadingOnes and BinVal problems for population sizes λ>μ=Ω(logn)documentclass[12pt]{minimal} usepackage{amsmath} usepackage{wasysym} usepackage{amsfonts} usepackage{amssymb} usepackage{amsbsy} usepackage{mathrsfs} usepackage{upgreek} setlength{oddsidemargin}{-69pt} egin{document}$$lambda >mu =varOmega (log n)$$end{document}, where μdocumentclass[12pt]{minimal} usepackage{amsmath} usepackage{wasysym} usepackage{amsfonts} usepackage{amssymb} usepackage{amsbsy} usepackage{mathrsfs} usepackage{upgreek} setlength{oddsidemargin}{-69pt} egin{document}$$mu $$end{document} and λdocumentclass[12pt]{minimal} usepackage{amsmath} usepackage{wasysym} usepackage{amsfonts} usepackage{amssymb} usepackage{amsbsy} usepackage{mathrsfs} usepackage{upgreek} setlength{oddsidemargin}{-69pt} egin{document}$$lambda $$end{document} are parameters of the algorithm. We also prove that the UMDA with population sizes μ∈On∩Ω(logn)documentclass[12pt]{minimal} usepackage{amsmath} usepackage{wasysym} usepackage{amsfonts} usepackage{amssymb} usepackage{amsbsy} usepackage{mathrsfs} usepackage{upgreek} setlength{oddsidemargin}{-69pt} egin{document}$$mu in mathcal {O}left( sqrt{n}
ight) cap varOmega (log n)$$end{document} optimises OneMax in expected time Oλndocumentclass[12pt]{minimal} usepackage{amsmath} usepackage{wasysym} usepackage{amsfonts} usepackage{amssymb} usepackage{amsbsy} usepackage{mathrsfs} usepackage{upgreek} setlength{oddsidemargin}{-69pt} egin{document}$$mathcal {O}left( lambda n
ight) $$end{document}, and for larger population sizes μ=Ω(nlogn)documentclass[12pt]{minimal} usepackage{amsmath} usepackage{wasysym} usepackage{amsfonts} usepackage{amssymb} usepackage{amsbsy} usepackage{mathrsfs} usepackage{upgreek} setlength{oddsidemargin}{-69pt} egin{document}$$mu =varOmega (sqrt{n}log n)$$end{document}, in expected time Oλndocumentclass[12pt]{minimal} usepackage{amsmath} usepackage{wasysym} usepackage{amsfonts} usepackage{amssymb} usepackage{amsbsy} usepackage{mathrsfs} usepackage{upgreek} setlength{oddsidemargin}{-69pt} egin{document}$$mathcal {O}left( lambda sqrt{n}
ight) $$end{document}. The facility and generality of our arguments suggest that this is a promising approach to derive bounds on the expected optimisation time of EDAs.
DOI:
10.1145/2908812.2908895
发表时间:
2016-07
期刊:
Proceedings of the Genetic and Evolutionary Computation Conference 2016
影响因子:
--
作者:
T. Friedrich;Timo Kötzing;Martin S. Krejca
通讯作者:
T. Friedrich;Timo Kötzing;Martin S. Krejca
影响因子:
14.3
作者:
Friedrich, Tobias;Koetzing, Timo;Sutton, Andrew M.
通讯作者:
Sutton, Andrew M.