权益分类	功能权益	普通用户	{{item.name}}会员
{{category.name}}	{{benefitItem.name}}

Parameter estimation with constraints and its stability in statistical model

统计模型中带约束的参数估计及其稳定性

基本信息

批准号：
13680370
负责人：
TAGURI Masaaki
金额：
$ 2.3万
依托单位：
Chiba University
依托单位国家：
日本
项目类别：
Grant-in-Aid for Scientific Research (C)
财政年份：
2001
资助国家：
日本
起止时间：
2001 至 2003
项目状态：
已结题

来源：
https://kaken.nii.ac.jp/grant/KAKENHI-PROJECT-13680370/
关键词：
nonlinear optimization problem with constraints maximization of correlation quadratic constraint linear constraint singular value decomposition least squares solution stability of optimal solution カタストロフィックな変化非線形最適化問題相関係数最大化正準相関分析

项目摘要

In this project, we investigated a problem of maximizing correlation coefficient with quadratic and linear constraints. This problem is to determine the weight vector w so as to maximize the correlation between an objective variable and a weighted sum w'x of explanatory variables, where the parameter w must satisfy a quadratic constraint (w-w_0)' (w-w_0)≦^2 and a linear constraint A_w≦c. To solve this problem analytically, we first made the singular value decomposition (SVD) of the matrix (I-Q)Z, where Q is the projector and Z is the design matrix. Using the linear transformation induced by the SVD, we transformed the quantities defined on sample space to ones defined on parameter space. We then considered the convex cone which included the concentrated ellipsoid corresponding to the quadratic and linear constraints, and obtained the optimal solution through geometrical insight. In order to compare these optimal solutions with the least squares solutions, we systematically generated three dimensional artificial data sets. Also we used practical data sets such as entrance examination data sets. Based on these we examined the differences between two kinds of solutions. As the result, we found that the difference was very large when the vector transformed from an objective variable vector was far from the ellipsoid specified by the constraints, and so the resulting correlation coefficients were very different ; for example, 0.75 and 0.34. Further we investigated the influence on the parameter estimates by small change of data values. As the result, we found that some catastrophic change might happen in the optimal solution when the vector transformed from an objective variable vector was nearly perpendicular to the vector specified by the center of the constraint ellipsoid.

在本计画中，我们研究了二次与线性约束下的相关系数最大化问题。这个问题是确定权向量w，使得目标变量与解释变量的加权和w 'x之间的相关性最大，其中参数w必须满足二次约束（w-w_0）'（w-w_0）<$^2和线性约束A_w <$c。为了解析地解决这个问题，我们首先对矩阵（I-Q）Z进行奇异值分解（SVD），其中Q是投影矩阵，Z是设计矩阵。利用奇异值分解所产生的线性变换，将定义在样本空间上的量转化为定义在参数空间上的量。然后，我们考虑了凸锥，其中包括集中椭球对应的二次和线性约束，并通过几何的洞察力得到最优解。为了将这些最优解与最小二乘解进行比较，我们系统地生成了三维人工数据集。我们还使用了实际的数据集，如入学考试数据集。在此基础上，我们研究了两种解决方案之间的差异。结果发现，当从目标变量向量转换的向量远离约束条件指定的椭球时，差异非常大，因此得到的相关系数非常不同;例如，0.75和0.34。此外，我们研究了数据值的微小变化对参数估计的影响。结果发现，当目标变量向量转换后的向量与约束椭球中心所指定的向量近似垂直时，最优解可能会发生灾难性的变化。