Restoring Definiteness via Shrinking, with an Application to Correlation Matrices with a Fixed Block
Restoring Definiteness via Shrinking, with an Application to Correlation Matrices with a Fixed Block
复制标题
DOI:
10.1137/140996112
复制
发表时间:
2016-01-01
期刊:
影响因子:
10.2
通讯作者:
Sego, Vedran
中科院分区:
文献类型:
--
作者:
Higham, Nicholas J.;Strabic, Natasa;Sego, Vedran
Indefinite approximations of positive semidefinite matrices arise in various data analysis applications involving covariance matrices and correlation matrices. We propose a method for restoring positive semidefiniteness of an indefinite matrix M-0 that constructs a convex linear combination S(alpha) = alpha M-1 + (1 - alpha) M-0 of M-0 and a positive semidefinite target matrix M-1. In statistics, this construction for improving an estimate M-0 by combining it with new information in M-1 is known as shrinking. We make no statistical assumptions about M-0 and define the optimal shrinking parameter as a* = min{alpha is an element of[0, 1] : S(alpha) is positive semidefinite}. We describe three algorithms for computing alpha*. One algorithm is based on the bisection method, with the use of Cholesky factorization to test definiteness; a second employs Newton's method; and a third finds the smallest eigenvalue of a symmetric definite generalized eigenvalue problem. We show that weights that reflect confidence in the individual entries of M-0 can be used to construct a natural choice of the target matrix M-1. We treat in detail a problem variant in which a positive semidefinite leading principal submatrix of M-0 remains fixed, showing how the fixed block can be exploited to reduce the cost of the bisection and generalized eigenvalue methods. Numerical experiments show that when applied to indefinite approximations of correlation matrices shrinking can be at least an order of magnitude faster than computing the nearest correlation matrix.