III: Small: Large-Scale Structured Sparse Learning

III：小：大规模结构化稀疏学习

• 批准号: 1539991
• 负责人: Jieping Ye
• 金额: $ 49.99万
• 依托单位: Regents of the University of Michigan - Ann Arbor
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2015
• 资助国家: 美国
• 起止时间: 2015-01-01 至 2019-07-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1539991&HistoricalAwards=false
• 关键词: III; Small; Large; Scale; Structured

Recent technological revolutions have lead to dramatically growing scale, diversity, and complexity of data. Modern data analysis is facing new challenges in handling this complexity. Although complex, the underlying representations of many real-world data are often sparse. This sparseness often exhibits intrinsic structure, e.g., spatial or temporal smoothness, graphs, trees, and groups. Finding effective sparse representations is fundamentally important for scientific discovery; the a-priori structure information may significantly improve the sparse learning model. This project is developing algorithms and tools (including open source software) to enable knowledge discovery from massive high-dimensional and complex data, as well as a new curriculum that incorporates the proposed research into the classroom.Most sparse learning algorithms are based on the L1 norm due to its sparsity-inducing property and strong theoretical guarantees, but this does not capture structure. This project is advancing structured sparse learning by (1) analyzing the so-called proximal operators associated with various feature structures, which explains how and why they can induce the desired structured sparsity; (2) developing efficient algorithms for computing the proximal operators, which plays a key building block role in the proposed optimization algorithms; (3) developing a structured sparse learning framework, which includes various sparse learning models and algorithms developed in this project.

最近的技术革命导致数据的规模、多样性和复杂性急剧增长。 现代数据分析在处理这种复杂性方面面临着新的挑战。 尽管很复杂，但许多现实世界数据的底层表示通常是稀疏的。 这种稀疏性通常表现出内在的结构，例如空间或时间平滑性、图形、树和组。找到有效的稀疏表示对于科学发现至关重要；先验结构信息可以显着改善稀疏学习模型。 该项目正在开发算法和工具（包括开源软件），以实现从海量高维和复杂数据中发现知识，以及将所提出的研究纳入课堂的新课程。大多数稀疏学习算法基于 L1 范数，因为其稀疏性诱导特性和强大的理论保证，但这并没有捕获结构。 该项目通过以下方式推进结构化稀疏学习：（1）分析与各种特征结构相关的所谓近端算子，这解释了它们如何以及为何能够产生所需的结构化稀疏性； (2) 开发计算邻近算子的有效算法，这在所提出的优化算法中起着关键的构建块作用； （3）开发结构化稀疏学习框架，包括本项目开发的各种稀疏学习模型和算法。