Collaborative Research, MSPA-MCS: Sparse Multivariate Data Analysis

该提案开发和研究经典多元数据分析方法的稀疏变体。它主要集中在稀疏主成分分析（PCA）和相关的稀疏典型相关分析（CCA），但也打算探索稀疏变体的方法，如对应分析和判别分析。开发稀疏多变量分析算法的动机是它们产生比经典分析更可解释和更鲁棒的统计结果的潜力，同时尽可能少地放弃统计效率和表达能力。研究人员已经推导出稀疏PCA作为一个大规模半定规划的凸松弛。建议的研究首先研究这种松弛的理论和实际性能，以及在解决相应的半定程序的大规模实例中所涉及的计算复杂性。在下一步中，它专注于将这些结果扩展到上面引用的其他多变量数据分析方法。主成分分析（PCA）是一种经典的统计工具，用于研究具有大量变量（气象记录，基因表达系数，利率曲线，社交网络等）的实验数据。它主要用作降维工具：PCA产生一组减少的合成变量，捕获数据上的最大信息量。这使得在三维图形上表示具有数千个变量的数据集成为可能，同时仍然捕获原始数据的大部分特征，从而使可视化和解释更容易。不幸的是，PCA的主要缺点是这些新的合成变量是所有原始变量的加权和，这使得它们的物理解释变得困难。拟议的研究将研究用于计算稀疏PCA的算法，即，计算新的合成变量，这些新的合成变量是仅少数问题变量的加权和，同时保持原始数据集的大部分特征。稀疏PCA是一个很难的组合问题，但研究人员已经产生了一个松弛，可以有效地解决凸优化使用最近的结果。研究人员计划研究这种放松的理论和实践性能，并将这些结果扩展到其他统计方法。

This proposal develops and studies sparse variants of classic multivariate data analysis methods. It primarily focuses on sparse principal component analysis (PCA) and the related sparse canonical correlation analysis (CCA), but also intends to explore sparse variants of methods such as correspondence analysis and discriminant analysis. The motivation for developing sparse multivariate analysis algorithms is their potential for yielding statistical results that are more interpretable and more robust than classical analyses, while giving up as little as possible in the way of statistical efficiency and expressive power. The investigators have derived a convex relaxation for sparse PCA as a large-scale semidefinite program. The proposed research first studies the theoretical and practical performance of this relaxation as well as the computational complexity involved in solving large-scale instances of the corresponding semidefinite programs. In a next step, it focuses on extending these results to the other multivariate data analysis methods cited above. Principal Component Analysis (or PCA) is a classic statistical tool used to study experimental data with a very large number of variables (meteorological records, gene expression coefficients, the interest rate curve, social networks, etc). It is primarily used as a dimensionality reduction tool: PCA produces a reduced set of synthetic variables that captures a maximum amount of information on the data. This makes it possible to represent data sets with thousands of variables on a three dimensional graph while still capturing most of the features of the original data, thus making visualization and interpretation easier. Unfortunately, the key shortcoming of PCA is that these new synthetic variables are a weighted sum of all the original variables making their physical interpretation difficult. The proposed research will study algorithms for computing sparse PCA, i.e., computing new synthetic variables that are the weighted sum of only a few problem variables while keeping most of the features of the original data set. Sparse PCA is a hard combinatorial problem but the investigators have produced a relaxation that can be solved efficiently using recent results in convex optimization. The investigators plan to study the theoretical and practical performance of this relaxation and extend these results to other statistical methods.