Collaborative Research: Information Matrix Analysis for Nonparametric Multivariate Problems

该项目开发了一套新的工具，称为信息矩阵分析（IMA），用于探索多元数据的结构。借助现代化的数据采集设备和巨大的数据存储空间，研究人员可以轻松地收集高维数据，如生物技术数据、金融数据、卫星图像和高光谱图像。由于所谓的“维度诅咒”，对这种高维数据的分析给统计学家带来了巨大的挑战。IMA方法通过寻找较少数量的原始变量的线性组合来解决这个问题，这些原始变量将携带原始多变量数据的大部分信息。IMA是基于针对不同问题定义的信息矩阵的特征分析。所提出的信息矩阵的特征向量提供了变量的线性组合，由于其高信息量，这些变量最好地总结了数据的有用特征。通过将该方法与随机投影法相结合，也可以将IMA应用于超高维数据。另外，还可以使用IMA进行变量选择。本项目正在开发的新的数据分析工具，由于数据的革命，是及时的，并且具有广泛的适用性。所有的IMA方法都来自一个共同的基础，因此很容易用于解决新问题。该项目将大大提高统计工具和软件的可用性，用于统计建模和探索多元数据。这种新方法将使广泛的科学家和研究人员受益，他们希望分析各个领域的高维数据，包括医学研究、预防研究、公共卫生和社会科学。这个项目将加速对fisher信息矩阵的几何理解。这个项目的核心包括将IMA应用于三个非常不同的问题领域：构建模型、评估模型和比较人口。假设要建立一个模型来分析响应变量和多变量协变量之间的关系。已定义的协变量信息矩阵的IMA可以用于寻找原始协变量的较少数量的线性投影，以简化模型构建。新的预测变量有一个很好的解释，即通过定义的协变量信息来测量协变量与响应之间的关系，它携带了大多数信息。IMA也可以推广到找到可以在两个密度之间提供最佳区分的数据的线性组合。在应用中，一个密度将是真正的未知密度，要进行非参数估计，另一个密度将是数据的一些模型，可以是参数或半参数。或者，这两个密度可以代表人们希望比较的两个不同的种群。当两个总体是具有相同协方差矩阵的多元正态时，IMA提供与Fisher线性判别方向相同的线性投影。然而，IMA可以超越线性判别分析到多个线性判别分析。IMA将进一步应用于寻找数据的线性投影，这些线性投影对评估所提议模型的拟合有用，无论是参数模型、半参数模型还是非参数模型。这个项目将研究IMA在流行图形模型和独立组件分析模型中的应用。预计IMA将有更多的应用领域。对于高维数据，该提案将开发使用随机投影方法，首先降低原始变量的维数并限制可能的线性组合的空间。然后，IMA可以应用于更低维度的数据集。另外，可以通过施加信息预测的稀疏性来使用IMA进行变量选择。

This project develops a new set of tools, called Information Matrix Analysis (IMA), to explore the structure of multivariate data. With modern data gathering devices and vast data storage space, researchers can easily collect high-dimensional data, such as biotech data, financial data, satellite imagery, and hyperspectral imagery. Analysis of such high-dimensional data poses great challenges for statisticians due to the so-called "curse of dimensionality". The IMA methodology tackles this problem by finding a smaller number of linear combinations of the original variables that will carry most of the information of the original multivariate data. The IMA is based on the eigenanalysis of the Information Matrix as defined for different problems. The eigenvectors of the proposed information matrices provide the linear combinations of the variables that best summarize the useful features of the data due to their high information content. By combining the new method with the random projection method, one can also apply IMA to ultra high dimensional data. Alternatively, one can do variable selection with IMA. The new data analysis tool under development in this project is timely due to the data revolution, as well as broadly applicable. All of the IMA methodology springs from a common foundation, and so is easily transported to tackle new problems. This project will enhance significantly the availability of statistical tools and software for statistical modeling and exploration for multivariate data. The new method will benefit a broad range of scientists and researchers who want to analyze high-dimensional data in various fields, including medical studies, prevention studies, public health, and the social sciences.This project will accelerate geometric understanding of Fisherian information matrices. The core of this project consists of the application of IMA to three very different problem areas: building models, assessing models, and comparing populations. Suppose one wants to build a model to analyze the relationship between a response variable and multivariate covariates. The IMA of a defined covariate information matrix can be applied to find a smaller number of linear projections of the original covariates to simplify model building. The new projected variables have the nice explanation of carrying most information, as measured by the defined covariate information, about the relationship between the covariates and the response. The IMA can be also generalized to find linear combinations of the data that can provide the best discrimination between two densities. In the applications, one density will be the true unknown density, to be estimated nonparametrically, and the other density will be some model for the data, which could be parametric or semiparametric. Alternatively, the two densities could represent two distinct populations one wishes to compare. When the two populations are multivariate normal with the same covariance matrix, the IMA provides the same linear projection as the Fisher linear discriminant direction. However, the IMA can move beyond linear discriminant analysis to multiple linear discriminants. The IMA will be further applied to find linear projections of the data that are useful for assessing the fit of a proposed model, whether parametric, semiparametric, or nonparametric. This project will investigate the applications of IMA to popular graphical models and independent component analysis models. It is expected that IMA might have many more application areas. For high dimensional data, the proposal will develop the use of the random projection method to first reduce the dimension of the original variables and restrict the space of possible linear combinations. Then the IMA can be applied to a much lower dimensional data set. Alternatively, one can do variable selection with IMA by imposing the sparsity of the informative projections.