Regularized matrix regression.

Regularized matrix regression.
复制标题

DOI:
10.1111/rssb.12031
复制
发表时间:
2014-03-01
期刊:
Journal of the Royal Statistical Society. Series B, Statistical methodology
影响因子:
--
通讯作者:
Li L
Li L
中科院分区:
其他
文献类型:
--
作者:
Zhou H;Li L

文献摘要

参考文献

被引文献

相似文献

现代技术正在产生大量具有复杂结构的数据。例如,在二维数字成像、流式细胞术和脑电图中,当针对两个基础变量的每个组合获得测量值时,经常出现矩阵型协变量。为了解决这些数据产生的科学问题,需要采用矩阵作为协变量的新回归方法,由于矩阵数据的多维性和复杂结构,稀疏性或其他形式的正则化至关重要。流行的套索和相关的正则化方法取决于真实信号的稀疏性(根据其非零系数的数量)。然而,对于矩阵数据,真实信号通常是低秩结构,或者可以很好地近似于低秩结构。因此,稀疏性通常是以矩阵参数的低秩的形式,这可能严重违反经典套索的假设。提出了一类基于谱正则化的正则化矩阵回归方法。提出了一种高效、可扩展的估计算法,推导了沿正则化路径沿着选择模型的自由度公式,并通过仿真和真实的算例验证了该方法的上级性能.
Modern technologies are producing a wealth of data with complex structures. For instance, in two-dimensional digital imaging, flow cytometry and electroencephalography, matrix-type covariates frequently arise when measurements are obtained for each combination of two underlying variables. To address scientific questions arising from those data, new regression methods that take matrices as covariates are needed, and sparsity or other forms of regularization are crucial owing to the ultrahigh dimensionality and complex structure of the matrix data. The popular lasso and related regularization methods hinge on the sparsity of the true signal in terms of the number of its non-zero coefficients. However, for the matrix data, the true signal is often of, or can be well approximated by, a low rank structure. As such, the sparsity is frequently in the form of low rank of the matrix parameters, which may seriously violate the assumption of the classical lasso. We propose a class of regularized matrix regression methods based on spectral regularization. A highly efficient and scalable estimation algorithm is developed, and a degrees-of-freedom formula is derived to facilitate model selection along the regularization path. Superior performance of the method proposed is demonstrated on both synthetic and real examples.
DOI: 10.1198/jasa.2011.ap10089
发表时间: 2011
影响因子: 3.7
作者:
Crainiceanu CM;Caffo BS;Luo S;Zipunnikov VM;Punjabi NM
通讯作者: Punjabi NM
DOI: 10.1080/00401706.1970.10488634
发表时间: 1970-01-01
期刊: TECHNOMETRICS
影响因子: 2.5
作者:
HOERL, AE;KENNARD, RW
通讯作者: KENNARD, RW
DOI: 10.1007/s10208-009-9045-5
发表时间: 2009-12-01
影响因子: 3
作者:
Candes, Emmanuel J.;Recht, Benjamin
通讯作者: Recht, Benjamin
DOI: 10.1109/tac.1974.1100705
发表时间: 1974-01-01
影响因子: 6.8
作者:
AKAIKE, H
通讯作者: AKAIKE, H
DOI: 10.1137/080716542
发表时间: 2009-01-01
影响因子: 2.1
作者:
Beck, Amir;Teboulle, Marc
通讯作者: Teboulle, Marc