Negotiating Multicollinearity with Spike-and-Slab Priors.
Negotiating Multicollinearity with Spike-and-Slab Priors.
复制标题
DOI：
10.1007/s40300-014-0047-y
复制
发表时间：
2014-08-01
期刊：
影响因子：
0.8
通讯作者：
George EI
中科院分区：
文献类型：
--
作者：
Ročková V;George EI
In multiple regression under the normal linear model, the presence of multicollinearity is well known to lead to unreliable and unstable maximum likelihood estimates. This can be particularly troublesome for the problem of variable selection where it becomes more difficult to distinguish between subset models. Here we show how adding a spike-and-slab prior mitigates this difficulty by filtering the likelihood surface into a posterior distribution that allocates the relevant likelihood information to each of the subset model modes. For identification of promising high posterior models in this setting, we consider three EM algorithms, the fast closed form EMVS version of and two new versions designed for variants of the spike-and-slab formulation. For a multimodal posterior under multicollinearity, we compare the regions of convergence of these three algorithms. Deterministic annealing versions of the EMVS algorithm are seen to substantially mitigate this multimodality. A single simple running example is used for illustration throughout.
