Foundations of High-Dimensional and Nonparametric Hypothesis Testing
Foundations of High-Dimensional and Nonparametric Hypothesis Testing
批准号:
2113684
负责人:
Sivaraman Balakrishnan
金额:
$25.0万
依托单位国家:
美国
项目类别:
Standard Grant
财政年份:
2021
资助国家:
美国
项目状态:
已结题
起止时间:
2021-07-01 至 2024-06-30
中文摘要
统计推断工具是从统计学学科到实证科学的主要出口,作为自然科学家解释观察结果和量化结论的不确定性的主要透镜。然而,在分析现代大型数据集时,我们可用的最常见的推理工具充满了陷阱,通常需要在有效应用之前检查各种技术条件。这反过来又导致了对推理工具的误用和随后对结果的误解。该研究项目旨在通过开发和分析在复杂环境中用于统计推断的新的用户友好方法来解决这一问题。我们开发的方法将广泛适用于物理和生物科学中各种具有挑战性的推理问题,将消除验证技术条件的需要,并最终在其应用中具有鲁棒性。主要和联合主要研究人员将参与为研究生提供建议和指导,课程和课程发展,并将该项目与物理科学统计方法研究小组(STAMPS)结合起来。该项目将沿着三个前沿推进我们对高维和非参数推理的理解。首先,我们的目标是开发在弱条件下有效的不规则模型的统计推理工具。我们将特别关注混合模型,以及使用样本分裂来避免强规则条件的方法。其次,我们将展示我们的方法以惊人的小统计价格实现这些强有力的保证。为了严格量化避免强正则性条件所付出的统计代价,我们将使用极大极小理论。然而,标准极大极小理论,在许多情况下,不能充分捕捉统计推理的难度,因为推理的难度可以在参数空间上有很大的变化。一种更精细的理论——称为局部极大极小理论——可以得出更准确的图像,我们将通过这个视角来研究我们的方法。最后,我们将讨论条件独立性(CI)测试的问题。尽管CI测试在回归诊断和概率图模型的研究中发挥着核心作用,但人们对CI测试的任务及其内在困难知之甚少。我们将通过研究适当校准CI测试的方法,以及开发和分析功能强大的新CI测试,来解决CI测试的两个基本方面。该奖项反映了美国国家科学基金会的法定使命,并通过使用基金会的知识价值和更广泛的影响审查标准进行评估,被认为值得支持。
英文摘要
Statistical inferential tools are the main export from the discipline of statistics to the empirical sciences, serving as the primary lens through which natural scientists interpret observations and quantify the uncertainty of their conclusions. However, in the analysis of modern large datasets the most common inferential tools available to us are fraught with pitfalls, often requiring various technical conditions to be checked before their valid application. This in turn has led to misuse of the inferential tools and subsequent misinterpretation of results. This research project will aim to address this issue by developing and analyzing new user-friendly methodologies for statistical inference in complex settings. The methods we develop will be broadly applicable to a wide variety of challenging inferential problems in the physical and biological sciences, will eliminate the need to verify technical conditions, and will ultimately be robust in their application. The principal and co-principal investigators will be involved in advising and mentoring graduate students, in curricular and course development, and in integrating the project with a research group on Statistical Methods in the Physical Sciences (STAMPS).This project will advance our understanding of high-dimensional and non-parametric inference along three frontiers. Firstly, we aim to develop statistical inferential tools for irregular models, which are valid under weak conditions. Our particular focus will be on mixture models, and on methods which use sample-splitting to avoid strong regularity conditions. Secondly, we will show that our methods achieve these strong guarantees at a surprisingly small statistical price. To rigorously quantify the statistical price paid for avoiding strong regularity conditions we will use minimax theory. However, standard minimax theory, in many cases, does not adequately capture the difficulty of statistical inference since the difficulty of inference can vary significantly across the parameter space. A more refined theory -- called local minimax theory -- leads to a more accurate picture, and we will study our methods via this lens. Finally, we will address the problem of conditional independence (CI) testing. Despite its central role in regression diagnostics, and in the study of probabilistic graphical models, the task of CI testing and its intrinsic difficulty is poorly understood. We will address two fundamental aspects of CI testing, by studying methods to appropriately calibrate CI tests, and by developing and analyzing powerful new CI tests.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
期刊论文(20)
专著(0)
科研奖励(0)
会议论文
登录
查看更多内容
DOI:
--
发表时间:
2022
期刊:
影响因子:
--
作者:
[Pranjal Awasthi;Sivaraman Balakrishnan;Aravindan Vijayaraghavan]
通讯作者:
Pranjal Awasthi;Sivaraman Balakrishnan;Aravindan Vijayaraghavan
DOI:
10.48550/arxiv.2207.13048
发表时间:
2022-07
期刊:
ArXiv
影响因子:
--
作者:
[S. Garg;Sivaraman Balakrishnan;Zachary Chase Lipton]
通讯作者:
S. Garg;Sivaraman Balakrishnan;Zachary Chase Lipton
DOI:
10.1093/biomet/asad017
发表时间:
2021-02
期刊:
Biometrika
影响因子:
2.7
作者:
[Edward H. Kennedy;Sivaraman Balakrishnan;L. Wasserman]
通讯作者:
Edward H. Kennedy;Sivaraman Balakrishnan;L. Wasserman
Domain Adaptation under Missingness Shift – Tackling Underreporting
缺失转变下的领域适应 — 解决漏报问题
DOI:
--
发表时间:
2023
期刊:
AISTATS
影响因子:
--
作者:
[Zhou, Helen, Balakrishnan, Sivaraman, Lipton Zachary]
通讯作者:
Lipton Zachary
DOI:
10.48550/arxiv.2302.03020
发表时间:
2023-02
期刊:
影响因子:
--
作者:
[S. Garg;Nick Erickson;J. Sharpnack;Alexander J. Smola;Sivaraman Balakrishnan;Zachary Chase Lipton]
通讯作者:
S. Garg;Nick Erickson;J. Sharpnack;Alexander J. Smola;Sivaraman Balakrishnan;Zachary Chase Lipton
共 17 条
High-dimensional Clustering: Theory and Methods
-
批准号:1713003
-
项目类别:Continuing Grant
-
资助金额:$38.0万
-
财政年份:2017
-
负责人:Sivaraman Balakrishnan
-
依托单位:
国内基金
海外基金
Scalable Learning and Optimization: High-dimensional Models and Online Decision-Making Strategies for Big Data Analysis
-
批准号:--
-
项目类别:合作创新研究团队
-
资助金额:--
-
批准年份:2024
-
负责人:姚韬
-
依托单位: