Superefficient Fits to Linear Models

最近的收缩估计理论，技术从信号处理，和有效的算法计算标准正交基，现在有可能利用超效率的漏洞，在经典的信息界估计。在线性回归中，如果回归基中的前几个向量非常接近未知的均值向量，则将与不重要的基向量相关的回归系数缩小到零的估计量的风险可以比最小二乘估计量的风险小得多。这类收缩估计是一种特殊的对称线性平滑器，实现了C。Stein和M. S.平斯克关于高维或无穷维参数估计的开创性思想。研究的具体目标是：（a）构造和解释以超有效拟合为中心的置信集;（B）通过多重收缩处理所选基稀疏但不有序的情况;（c）发展观测内和观测间收缩技术来处理多元线性模型;（d）利用与使用离散余弦基或小波基的信号处理技术的关系。用最小二乘法拟合的回归模型广泛应用于科学研究和其他学科，以建立数据集之间的定量关系。例如，与环境和全球变化方案以及制造方案有关的研究。拟议的研究的广泛目标是通过用更好的自适应线性平滑器取代最小二乘法来提高这些拟合关系的可靠性。最近的统计理论支持这个项目的一般可行性。如何实现理论上的可能性是这部作品的本质。作者的REACT方法，在建议中的参考文献中描述，是一个实用的技术，回归一个响应变量，演示了最小二乘拟合的实时改进。REACT与当前的非参数回归方法竞争良好，同时提供某些优势，例如指示拟合质量的内置诊断。拟议的研究将扩展REACT方法，以寻找变量集之间的关系，并将开发实用的方法来评估估计的关系的不确定性。 最小二乘回归是现代统计软件包和电子表格中的标准函数，广泛用于数据分析。这种情况为改进最小二乘提供了强大的动力。

Recent theory for shrinkage estimators, techniques from signal-processing, and effective algorithms for computing orthonormal bases now make it possible to exploit the superefficiency loophole in classical information bounds for estimation. In linear regression, if the first few vectors in the regression basis closely approximate the unknown mean vector, then the risk of an estimator that shrinks to zero those regression coefficients associated with the unimportant basis vectors can be much smaller than the risk of the least squares estimator. Such shrinkage estimators, which are particular symmetric linear smoothers, realize the benefits of C. Stein's and M. S. Pinsker's pioneering ideas on estimation of high- or infinite-dimensional parameters. Specific goals of the research are: (a) to construct and interpret confidence sets centered at a superefficient fit; (b) to handle, through multiple shrinkage, cases where the chosen basis is sparse but not well-ordered; (c) to develop within- and between-observation shrinkage techniques to handle the multivariate linear model; (d) to draw on relations with signal-processing techniques that use the discrete cosine basis or wavelet bases. Regression models fitted by the method of least squares are widely used in scientific research and other disciplines to establish quantitative relationships within sets of data. Studies related to the program on Environment and Global Change and to the program on Manufacturing are examples. The broad goal of the proposed research is to improve the reliability of these fitted relationships by replacing least squares with better adaptive linear smoothers. Recent statistical theory supports the general feasibility of this project. How to realize what is possible in theory is the essence of the work. The author's REACT method, described with references in the proposal, is a practical technique for regression with one response variable that demonstrates real-worldimprovements over least squares fits. REACT competes well with current nonparametric regression methods while offering certain advantages, such as built-in diagnostics that indicate the quality of the fit. The proposed research will extend REACT methods to finding relationships among sets of variables and will develop practical methods for assessing the uncertainty of the estimated relationships. Least squares regression, a standard function in modern statistical packages and spreadsheets, is widely used in data-analysis. This circumstance provides strong motivation for improving on least squares.