CIF: Small: Collaborative Research: A Unifying Approach for Identification of Sparse Interactions in Large Datasets

CIF：小型：协作研究：识别大型数据集中稀疏交互的统一方法

• 批准号: 1320547
• 负责人: George Atia
• 金额: $ 21.5万
• 依托单位: The University of Central Florida Board of Trustees
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2013
• 资助国家: 美国
• 起止时间: 2013-08-15 至 2017-07-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1320547&HistoricalAwards=false
• 关键词: CIF; Small; Collaborative; Research; Unifying

More than 2.5 quintillion bytes of data are created daily in the form of sensor measurements, web posts and clicks, surveillance videos, purchase transactions, and health-care records. However, not all data collected is informative and not all features are relevant to the outcomes of interest. While several researchers have focused attention on compressive sampling for minimum error data reconstruction to improve data storage and acquisition, the objective of this research is broader and is focused on salient feature discovery. The key insight is sparsity, namely, that there is a tight coupling between a small relevant set of observations and the outcomes of interest. This research is focused on the sparse identification of the most relevant observations that are essential to predicting the outcomes.The investigators will develop a new information-theoretic framework and algorithmic tools for understanding the intrinsic relationships and sparse interactions between outcomes of interest and a set of features/observations in order to improve inferencing capabilities for enhanced decision-making in the context of this data-deluge. The goal is to discover the most relevant sparse subset of features that are essential to predicting the outcomes, and to uncover the fundamental limits of the associated sparse models. The approach is based on a unifying Shannon information-theoretic framework, whereby the problem of salient feature identification is mapped to a problem of capacity analysis for an equivalent channel model. This research addresses challenges posed by models with correlated features, models with missing features, models with latent variables, and the non-linearities of the measurement processes, in a unified way. Furthermore, this research involves the development of data-driven sparse recovery algorithms that reinforce the value of information when the underlying statistical models are partially or completely unknown. The investigators will use the developed methods to enhance the detection of sparse mixtures of explosives with fluorescence sensor arrays, and to identify high-degree hubs in computer networks using network tomography.

每天以传感器测量、网络帖子和点击、监控视频、购买交易和医疗记录的形式创建超过2.5万亿字节的数据。然而，并非所有收集的数据都是信息性的，并非所有特征都与感兴趣的结果相关。虽然一些研究人员已经将注意力集中在压缩采样的最小误差数据重建，以改善数据存储和采集，这项研究的目标是更广泛的，并集中在显着的特征发现。关键的见解是稀疏性，即在一小部分相关的观察结果和感兴趣的结果之间存在紧密耦合。这项研究的重点是稀疏识别对于预测结果至关重要的最相关观察结果。研究人员将开发一种新的信息理论框架和算法工具，用于理解感兴趣的结果和一组特征之间的内在关系和稀疏相互作用/观察，以提高推理能力，从而在数据泛滥的背景下增强决策。目标是发现对预测结果至关重要的最相关的稀疏特征子集，并揭示相关稀疏模型的基本限制。该方法是基于一个统一的香农信息理论框架，从而显着特征识别的问题被映射到一个问题的等效信道模型的容量分析。本研究以统一的方式解决了具有相关特征的模型、具有缺失特征的模型、具有潜变量的模型以及测量过程的非线性所带来的挑战。此外，这项研究涉及数据驱动的稀疏恢复算法的开发，当底层统计模型部分或完全未知时，该算法可以增强信息的价值。研究人员将使用开发的方法来增强对荧光传感器阵列爆炸物稀疏混合物的检测，并使用网络断层扫描来识别计算机网络中的高度枢纽。