Robust and parallel Bayesian model selection

Robust and parallel Bayesian model selection
复制标题

鲁棒且并行的贝叶斯模型选择

DOI:
10.1016/j.csda.2018.05.016
复制
发表时间:
2018
影响因子:
1.8
通讯作者:
Lin, Lizhen
Lin, Lizhen
中科院分区:
数学3区
文献类型:
--
作者:
Zhang, Michael Minyi;Lam, Henry;Lin, Lizhen

文献摘要

参考文献

被引文献

相似文献

有效、准确的模型选择是现代数据分析中的一个重要问题。主要挑战之一是处理无法在一台机器上存储或处理的大型数据集所需的计算负担。另一个可能遇到的挑战是异常值和污染的存在,这些会损害推理质量。并行的分而治之的模型选择策略将整个数据集的观测数据划分成大致相等的子集,并在每个子集上独立地执行推理和模型选择。在局部子集推理后,该方法利用几何中值的概念,将后验模型概率或其他模型/变量选择准则进行聚合,得到最终的模型。这种方法提高了寻找“正确的”模型和模型参数的专注度,而且对异常值和数据污染也是被证明是健壮的。
Effective and accurate model selection is an important problem in modern data analysis. One of the major challenges is the computational burden required to handle large datasets that cannot be stored or processed on one machine. Another challenge one may encounter is the presence of outliers and contaminations that damage the inference quality. The parallel “divide and conquer” model selection strategy divides the observations of the full dataset into roughly equal subsets and perform inference and model selection independently on each subset. After local subset inference, this method aggregates the posterior model probabilities or other model/variable selection criteria to obtain a final model by using the notion of geometric median. This approach leads to improved concentration in finding the “correct” model and model parameters and also is provably robust to outliers and data contamination.
DOI: 10.1109/tac.1974.1100705
发表时间: 1974-01-01
影响因子: 6.8
作者:
AKAIKE, H
通讯作者: AKAIKE, H
DOI: --
发表时间: 2014-06
期刊: --
影响因子: --
作者:
Stanislav Minsker;Sanvesh Srivastava;Lizhen Lin;D. Dunson
通讯作者: Stanislav Minsker;Sanvesh Srivastava;Lizhen Lin;D. Dunson
DOI: --
发表时间: 2010
期刊: Journal of Machine Learning Research. 11
影响因子: --
作者:
B.K. Sriperumbudur;A. Gretton;K. Fukumizu;B. Scholkopf
通讯作者: B. Scholkopf