Exactly Uncorrelated Sparse Principal Component Analysis

Exactly Uncorrelated Sparse Principal Component Analysis
复制标题

完全不相关的稀疏主成分分析

DOI:
10.1080/10618600.2023.2232843
复制
发表时间:
2023
影响因子:
2.4
通讯作者:
Zou, Hui
Zou, Hui
中科院分区:
数学2区
文献类型:
--
作者:
Kwon, Oh-Ran;Lu, Zhaosong;Zou, Hui

文献摘要

参考文献

相似文献

稀疏主成分分析(PCA)旨在寻找原始输入变量子集的线性组合的主成分,而不牺牲经典主成分分析的保真度。现有的稀疏主成分分析方法大多产生相关的稀疏主成分。我们认为PCA的许多应用更倾向于不相关的主成分。然而,在稀疏PCA方法中处理稀疏性和不相关属性是不平凡的。本文提出了一种完全不相关的稀疏PCA方法EUSPCA,该方法的提出受到Pearson和Hotelling所倡导的PCA的原始观点和动机的启发。EUSPCA是一个非光滑约束非凸流形优化问题。结合增广拉格朗日法和非单调近端梯度法求解。通过模拟和实际数据示例,我们观察到EUSPCA产生了不相关的成分,并在调整后的总方差基础上保持了相似或更好的保真度。相比之下,现有的稀疏PCA方法产生了显著的相关成分。本文的补充材料可在网上获得。
Sparse principal component analysis (PCA) aims to find principal components as linear combinations of a subset of the original input variables without sacrificing the fidelity of the classical PCA. Most existing sparse PCA methods produce correlated sparse principal components. We argue that many applications of PCA prefer uncorrelated principal components. However, handling sparsity and uncorrelatedness properties in a sparse PCA method is nontrivial. This article proposes an exactly uncorrelated sparse PCA method named EUSPCA, whose formulation is motivated by original views and motivations of PCA as advocated by Pearson and Hotelling. EUSPCA is a non-smooth constrained non-convex manifold optimization problem. We solve it by combining augmented Lagrangian and non-monotone proximal gradient methods. We observe that EUSPCA produces uncorrelated components and maintains a similar or better level of fidelity based on adjusted total variance through simulated and real data examples. In contrast, existing sparse PCA methods produce significantly correlated components. Supplemental materials for this article are available online.
DOI: 10.1093/biomet/asw059
发表时间: 2014-03
期刊: arXiv: Methodology
影响因子: --
作者:
Yiyuan She
通讯作者: Yiyuan She
DOI: 10.1287/ijoo.2019.0032
发表时间: 2020-07
期刊: INFORMS J. Optim.
影响因子: --
作者:
Shixiang Chen;Shiqian Ma;Lingzhou Xue;H. Zou
通讯作者: Shixiang Chen;Shiqian Ma;Lingzhou Xue;H. Zou
DOI: 10.1016/j.combustflame.2017.08.012
发表时间: 2018-01-01
影响因子: 4.4
作者:
Malik, Mohammad Rafi;Isaac, Benjamin J.;Parente, Alessandro
通讯作者: Parente, Alessandro
DOI: 10.1038/nature16468
发表时间: 2016-01-21
期刊: Nature
影响因子: 64.8
作者:
Baden T;Berens P;Franke K;Román Rosón M;Bethge M;Euler T
通讯作者: Euler T
DOI: 10.1093/biostatistics/kxp008
发表时间: 2009-07-01
期刊: BIOSTATISTICS
影响因子: 2.1
作者:
Witten, Daniela M.;Tibshirani, Robert;Hastie, Trevor
通讯作者: Hastie, Trevor