Approximate Post-Selective Inference for Regression with the Group LASSO

Approximate Post-Selective Inference for Regression with the Group LASSO
复制标题

DOI:
--
复制
发表时间:
2020-12
期刊:
J. Mach. Learn. Res.
影响因子:
--
通讯作者:
Snigdha Panigrahi;Peter Macdonald;Daniel A Kessler
Snigdha Panigrahi;Peter Macdonald;Daniel A Kessler
中科院分区:
其他
文献类型:
--
作者:
Snigdha Panigrahi;Peter Macdonald;Daniel A Kessler

文献摘要

相似文献

在使用LASSO组(或广义变体,如重叠、稀疏或标准化LASSO组)进行选择后,在没有对选择偏倚进行调整的情况下,对所选参数的推断是不可靠的。在惩罚高斯回归设置,现有的方法提供了选择事件,可以表示为线性不等式的数据变量的调整。然而,这样的表示,未能举行选择与集团LASSO和实质上阻碍了范围内的后续后选择推理。关键问题的推理兴趣-例如,推理的影响,选定的变量的结果-仍然没有答案。在本文中,我们开发了一个一致的,后选择,贝叶斯方法来解决现有的差距,通过推导出一个似然调整因子和近似值,消除偏见的选择组。在模拟数据和Human Connectome Project数据上的实验表明,我们的方法可以恢复所选组内参数的影响,同时只需付出很小的代价进行偏差调整。
After selection with the Group LASSO (or generalized variants such as the overlapping, sparse, or standardized Group LASSO), inference for the selected parameters is unreliable in the absence of adjustments for selection bias. In the penalized Gaussian regression setup, existing approaches provide adjustments for selection events that can be expressed as linear inequalities in the data variables. Such a representation, however, fails to hold for selection with the Group LASSO and substantially obstructs the scope of subsequent post-selective inference. Key questions of inferential interest -- for example, inference for the effects of selected variables on the outcome -- remain unanswered. In the present paper, we develop a consistent, post-selective, Bayesian method to address the existing gaps by deriving a likelihood adjustment factor and an approximation thereof that eliminates bias from the selection of groups. Experiments on simulated data and data from the Human Connectome Project demonstrate that our method recovers the effects of parameters within the selected groups while paying only a small price for bias adjustment.