CDI-Type II: Collaborative Research: Sparse Inference: New Tools for Structural Knowledge Discovery

CDI-Type II：协作研究：稀疏推理：结构知识发现的新工具

• 批准号: 0835550
• 负责人: Laurent El Ghaoui
• 金额: $ 41.72万
• 依托单位: Princeton University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2008
• 资助国家: 美国
• 起止时间: 2008-09-15 至 2013-02-28
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0835550&HistoricalAwards=false
• 关键词: CDI; Type; II; Collaborative; Research

In most areas of human knowledge, the information revolution has resulted in a massive data explosion. The scale of data sets, their distributed and heterogeneous nature, and the need to quickly deliver results easily interpretable by non-experts, raise new theoretical and computational challenges for statistical learning, from variable selection and structural inference to visualization and online learning. This project uses sparse statistical inference as a powerful approach to meet these challenges. Its key insight is that seeking sparsity is a meaningful way of simultaneously stabilizing inference procedures, and highlighting structure in the underlying data. This work thus combines fundamental advances in sparse statistical learning with cutting-edge computational tools from mathematical programming to create a new framework for structural knowledge discovery in large-scale, streaming data sets. It is focused on two fundamental themes in sparse inference: variable selection and structural inference. Variable selection seeks to isolate a few key variables from high dimensional data sets and is a fundamental preprocessing tool in statistical learning. Structural inference then aims to consistently identify a few core dependence relationships among these variables to highlight its structure. From a computational point of view, many recent results in machine learning have relied on advanced methods from convex optimization such as semidefinite programming and robust optimization and this project seeks to improve the complexity of these algorithms and their capacity to handle very-large scale, streaming data. In practice, this project is motivated by the desire to help the public understand our democracies by analyzing large-scale political and social data sets, with a particular focus on voting records, online news sources, and polling data. Its approach is to apply statistical inference principles to social sciences, using collaborations with experts in political science and economics to forge the models and techniques under study. In carrying out the research, this project will be training graduate students from statistics, electrical engineering/financial engineering into interdisciplinary researchers at the interface of statistics, optimization, and subject matter areas such as finance and political science. In addition we plan to develop a web site, accessible first to a restricted set of social science researchers, to allow them to analyze mid-sized corpora of online news in text format, in the form of say, sparse graphs of words showing statistical associations between given keywords. The PIs plan to develop a software toolbox implementing these results, interfaced with common numerical packages such as MATLAB, R or python as well as an undergraduate course on ``Statistical Analysis of Online Data" at Berkeley and Princeton, incorporating some of the material produced in this project into the course program.

在人类知识的大多数领域，信息革命导致了大规模的数据爆炸。数据集的规模及其分布式和异构性，以及需要迅速提供非专家容易解释的结果，对统计学习提出了新的理论和计算挑战，从变量选择和结构推理到可视化和在线学习。该项目使用稀疏统计推断作为应对这些挑战的有力方法。它的关键见解是，寻求稀疏性是一种有意义的方式，可以同时稳定推理过程，并突出底层数据的结构。因此，这项工作将稀疏统计学习的基本进展与数学编程中的尖端计算工具相结合，创建了一个在大规模流数据集中发现结构化知识的新框架。它集中在稀疏推理中的两个基本主题：变量选择和结构推理。变量选择寻求从高维数据集中分离出几个关键变量，是统计学习中的基本预处理工具。然后，结构推理的目标是一致地识别这些变量之间的几个核心依赖关系，以突出其结构。从计算的角度来看，机器学习中的许多最新结果都依赖于凸优化的先进方法，如半定规划和稳健优化，该项目旨在提高这些算法的复杂性和处理超大规模流数据的能力。在实践中，这个项目的动机是希望通过分析大规模的政治和社会数据集，特别是投票记录、在线新闻来源和民意调查数据，帮助公众了解我们的民主制度。它的方法是将统计推理原理应用于社会科学，通过与政治学和经济学专家的合作来打造正在研究的模型和技术。在开展这项研究时，该项目将把统计学、电气工程/金融工程的研究生培养成统计学、最优化以及金融和政治学等学科领域的跨学科研究人员。此外，我们计划开发一个网站，首先对有限的社会科学研究人员开放，使他们能够以文本格式分析中等规模的在线新闻语料库，例如，以稀疏单词图的形式显示给定关键字之间的统计关联。投资促进机构计划开发一个实现这些结果的软件工具箱，与常见的数值工具包，如MATLAB、R或PYTHON以及在伯克利和普林斯顿大学开设的“在线数据的统计分析”的本科课程相结合，将该项目产生的一些材料纳入课程计划。