III: Small: Nonparametric Structure Learning for Complex Scientific Datasets

III：小：复杂科学数据集的非参数结构学习

• 批准号: 1116730
• 负责人: Han Liu
• 金额: $ 49.93万
• 依托单位: Johns Hopkins University
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2011
• 资助国家: 美国
• 起止时间: 2011-08-01 至 2013-04-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1116730&HistoricalAwards=false
• 关键词: III; Small; Nonparametric; Structure; Learning

The project brings together an interdisciplinary team of researchers from Johns Hopkins University, Carnegie Mellon University, and the University of Chicago to develop methods, theory and algorithms for discovering hidden structure from complex scientific datasets, without making strong a priori assumptions. The outcomes include practical models and provably correct algorithms that can help scientists to conduct sophisticated data analysis. The application areas include genomics, cognitive neuroscience, climate science, astrophysics, and language processing.The project has five aims: (i) Nonparametric structure learning in high dimensions: In a standard structure learning problem, observations of a random vector X are available and the goal is to estimate the structure of the distribution of X. When the dimension is large, nonparametric structure learning becomes challenging. The project develops new methods and establishes theoretical guarantees for this problem; (ii) Nonparametric conditional structure learning: In many applications, it is of interest to estimate the structure of a high-dimensional random vector X conditional on another random vector Z . Nonparametric methods for estimating the structure of X given Z are being developed, building on recent approaches to graph-valued and manifold-valued regression developed by the investigators; (iii) Regularization parameter selection: Most structure learning algorithms have at least one tuning parameter that controls the bias-variance tradeoff. Classical methods for selecting tuning parameters are not suitable for complex nonparametric structure learning problems. The project explores stability-based approaches for regularization selection; (iv) Parallel and online nonparametric learning: Handling large-scale data is a bottleneck of many nonparametric methods. The project develops parallel and online techniques to extend nonparametric learning algorithms to large scale problems; (v) Minimax theory for nonparametric structure learning problems: Minimax theory characterizes the performance limits for learning algorithms. Few theoretical results are known for complex, high-dimensional nonparametric structure learning. The project develops new minimax theory in this setting. The results of this project will be disseminated through publications in scientific journals and major conferences, and free dissemination of software that implements the nonparametric structure learning algorithms resulting from this research.The broader impacts of the project include: Creation of powerful data analysis techniques and software to a wide range of scientists and engineers to analyze and understand more complex scientific data; Increased collaboration and interdisciplinary interactions between researchers at multiple institutions (Johns Hopkins University, Carnegie Mellon University, and the University of Chicago); and Broad dissemination of the results of this research in different scientific communities. Additional information about the project can be found at: http://www.cs.jhu.edu/~hanliu/nsf116730.html.

该项目汇集了来自约翰霍普金斯大学，卡内基梅隆大学和芝加哥大学的跨学科研究人员团队，以开发从复杂的科学数据集中发现隐藏结构的方法，理论和算法，而无需进行强有力的先验假设。 成果包括实用的模型和可证明正确的算法，可以帮助科学家进行复杂的数据分析。该项目的应用领域包括基因组学、认知神经科学、气候科学、天体物理学和语言处理。该项目有五个目标：（i）高维非参数结构学习：在标准结构学习问题中，随机向量X的观测是可用的，目标是估计X的分布结构。 当维数很大时，非参数结构学习变得具有挑战性。 该项目开发了新的方法，并为这个问题建立了理论保证;（ii）非参数条件结构学习：在许多应用中，估计一个高维随机向量X的结构对另一个随机向量Z是有条件的。非参数方法估计结构的X给定Z正在开发中，最近的方法图值和流形值回归的研究人员开发的基础上;（iii）正则化参数选择：大多数结构学习算法至少有一个调整参数，控制偏差方差权衡。经典的调整参数选择方法不适用于复杂的非参数结构学习问题。 该项目探索了基于稳定性的正则化选择方法;（iv）并行和在线非参数学习：处理大规模数据是许多非参数方法的瓶颈。 该项目开发并行和在线技术，将非参数学习算法扩展到大规模问题;（v）非参数结构学习问题的Minimax理论：Minimax理论描述了学习算法的性能限制。 对于复杂的高维非参数结构学习，很少有理论结果。 该项目在此背景下开发了新的极大极小理论。该项目的成果将通过科学期刊和主要会议上的出版物进行传播，并免费传播实现该研究产生的非参数结构学习算法的软件。该项目更广泛的影响包括：为广泛的科学家和工程师创建强大的数据分析技术和软件，以分析和理解更复杂的科学数据;多个机构（约翰霍普金斯大学、卡内基梅隆大学和芝加哥大学）的研究人员之间加强合作和跨学科互动;以及在不同的科学界广泛传播这项研究的结果。 有关该项目的更多信息，请访问：http://www.cs.jhu.edu/~hanliu/nsf116730.html。