Inference for Functionals in High-Dimensional Regression
Inference for Functionals in High-Dimensional Regression
批准号:
2113426
负责人:
Pragya Sur
金额:
$17.0万
依托单位:
依托单位国家:
美国
项目类别:
Continuing Grant
财政年份:
2021
资助国家:
美国
项目状态:
已结题
起止时间:
2021-07-01 至 2024-06-30
中文摘要
现代科学和工程应用涉及具有大量变量或特征的大数据集。在这方面的一个关键挑战是区分科学上相关的变量和不相关的变量--换句话说,信号和噪声。这些变量之间微妙的非线性关系使挑战变得更加复杂。广义线性模型是经典统计学中发现这种非线性关系的最常用工具,它们经常被使用,即使在当代的大数据环境中也是如此。不幸的是,传统上用来证明这些方法有效性的经典统计理论在这种制度下失败了。该项目将开发新的方法,在广义线性模型的框架内推断科学相关的参数,以适应高维或大数据的设置。发展的理论将有助于在基因组学、计算神经科学、信号和图像处理等应用中对观察变量之间的关系进行原则性推理。本研究项目将围绕两大主题:(1)信噪比类型泛函的频域推断;(2)连续收缩先验下泛函的贝叶斯推断。第一个主题将开发新的信噪比和遗传相关性估计器,这是统计遗传学中衡量多个性状之间共同遗传基础的信噪比的推广。第二个推力将在可计算的连续收缩先验下,为基础信号的分量构建数据驱动的可信区间。这两个推力都将发展出与潜在信号的稀疏程度无关的推理程序。为了实现这一目标,这项研究将专注于比例渐近高维机制,并利用最初在概率论、信息论和统计物理学中发展的近似信息传递理论的新见解。该奖项反映了NSF的法定使命,并通过使用基金会的智力优势和更广泛的影响审查标准进行评估,被认为值得支持。
英文摘要
Modern science and engineering applications involve large datasets with a multitude of variables or features. A key challenge in this context is to distinguish the scientifically relevant variables from the irrelevant ones - in other words, the signal from the noise. The challenge is compounded by subtle nonlinear relationships among these variables. Generalized linear models are the most often used tools in classical statistics for discovering such nonlinear relationships and they are routinely employed, even in contemporary big data settings. Unfortunately, classical statistical theory, traditionally used to justify the validity of these methods, fails in this regime. This project will develop novel approaches for inferring scientifically relevant parameters in the framework of generalized linear models, adapted to the setting of high-dimensional or big data. The theory developed will facilitate principled inference regarding the relations among observed variables in applications such as genomics, computational neuroscience, signal and image processing. The principal investigator will also engage graduate students in the project by mentoring them and develop courses that will incorporate results from this project.This research project will develop statistical theory and methods for inferring scientifically relevant low-dimensional functionals in high-dimensional generalized linear models, organized around two broad themes: (1) frequentist inference for signal-to-noise ratio type functionals; (2) Bayesian inference for functionals under continuous shrinkage priors. The first theme will develop novel estimators for the signal-to-noise ratio and the genetic relatedness, a generalization of the signal-to-noise ratio that measures the shared genetic basis between multiple traits in statistical genetics. The second thrust will construct data-driven credible intervals for components of the underlying signal under computationally tractable continuous shrinkage priors. Both thrusts will develop inference procedures agnostic to sparsity level of the underlying signal. To achieve this, the research will focus on the proportional asymptotics high-dimensional regime and utilize novel insights from approximate message passing theory, developed originally in probability, information theory, and statistical physics.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
期刊论文(1)
专著(0)
科研奖励(0)
会议论文
A Non-Asymptotic Moreau Envelope Theory for High-Dimensional Generalized Linear Models
高维广义线性模型的非渐近莫罗包络理论
DOI:
--
发表时间:
2022
期刊:
Advances in neural information processing systems
影响因子:
--
作者:
[Zhou, Lijia, Koehler, Frederic, Sur, Pragya, Sutherland, Danica J., Srebro, Nathan]
通讯作者:
Srebro, Nathan
海外基金