CAREER: Guaranteed Nonconvex Optimization for High-Dimensional Learning
CAREER: Guaranteed Nonconvex Optimization for High-Dimensional Learning
批准号:
1846369
负责人:
Mahdi Soltanolkotabi
金额:
$54.93万
依托单位国家:
美国
项目类别:
Continuing Grant
财政年份:
2019
资助国家:
美国
项目状态:
未结题
起止时间:
2019-02-01 至 2025-01-31
中文摘要
当代信号处理和机器学习中的非凸学习方法正在彻底改变我们以自然形式处理数据的能力,给现代生活带来革命性的变化,从网络搜索和社交网络到医疗保健、商业和成像。尽管这些学习方案在应用中取得了广泛的经验上的成功,但它们缺乏明确的数学基础,不仅可以进行严格的性能分析,而且可以基于对什么将起作用、何时起作用以及为什么起作用的理解来指导系统设计。该项目旨在开发一个统一的框架来设计和分析高效的非凸优化算法。由此产生的信号估计和学习算法将被部署在旨在从数据中学习可理解模型的新型应用中,这反过来将允许更好的系统能够更快地以更高的分辨率和质量获取数据。这个项目的组成部分被整合到一个高级研究生班级中,挑选出的结果将有助于激励K-12年级的学生在STEM(科学、技术、工程和数学)中追求职业生涯。在这个项目中,研究人员研究了一系列迭代算法,用于解决现代信号处理和人工智能中出现的非凸数据拟合问题,如无相位成像和神经网络训练。该项目的总体目标是了解这些算法何时收敛到全局最优解,并根据数据样本/观测的数量、关于模型的先验知识、初始化精度等关键量来表征它们的行为和收敛速度。理论研究利用了高维概率、统计学、最优化和控制中的非线性动力学的技术。理论分析指导设计更可靠的学习算法,这些算法可以无缝扩展到海量数据大小,并且对现代分布式计算环境中出现的节点故障具有健壮性。该奖项反映了NSF的法定使命,并通过使用基金会的智力优势和更广泛的影响审查标准进行评估,被认为值得支持。
英文摘要
Contemporary nonconvex learning approaches in signal processing and machine learning are revolutionizing our ability to process data in their natural form, bringing transformative changes to modern life ranging from web searches and social networks to healthcare, commerce, and imaging. Despite wide empirical success in applications, these learning schemes lack a clear mathematical foundation that can enable not only rigorous performance analysis but can guide system designs based on an understanding of what would work, when and why. This project aims to develop a unified framework to design and analyze efficient nonconvex optimization algorithms. The resulting signal estimation and learning algorithms will be deployed in novel applications aimed at learning understandable models from data, which in turn will allow for better systems that can acquire data faster and at higher resolution and quality. Components from this project are integrated into an advanced graduate class and select results will serve to motivate K-12 students to pursue careers in STEM (Science, Technology, Engineering and Math).In this project, the investigator studies a family of iterative algorithms for nonconvex data fitting problems that arise in modern signal processing and artificial intelligence, such as phaseless imaging and neural network training. The overarching goal of the project is to understand when these algorithms converge to globally optimal solutions and to characterize their behavior and convergence rate in terms of key quantities such as the number of data samples/observations, prior knowledge about the model, initialization accuracy, etc. The theoretical investigations utilize techniques from high-dimensional probability, statistics, optimization and nonlinear dynamics in control. The theoretical analysis guides the design of more reliable learning algorithms that can seamlessly scale to massive data sizes and are robust to node failures that arise in modern distributed computing environments.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
期刊论文(37)
专著(0)
科研奖励(0)
会议论文
登录
查看更多内容
DOI:
--
发表时间:
2021-04
期刊:
ArXiv
影响因子:
--
作者:
[Y. Balaji;M. Sajedi;N. Kalibhat;Mucong Ding;Dominik Stöger;M. Soltanolkotabi;S. Feizi]
通讯作者:
Y. Balaji;M. Sajedi;N. Kalibhat;Mucong Ding;Dominik Stöger;M. Soltanolkotabi;S. Feizi
DOI:
10.1109/tit.2019.2891653
发表时间:
2017-02
期刊:
IEEE Transactions on Information Theory
影响因子:
2.5
作者:
[M. Soltanolkotabi]
通讯作者:
M. Soltanolkotabi
DOI:
10.48550/arxiv.2307.00497
发表时间:
2023-07
期刊:
ArXiv
影响因子:
--
作者:
[Sara Babakniya;Zalan Fabian;Chaoyang He;M. Soltanolkotabi;S. Avestimehr]
通讯作者:
Sara Babakniya;Zalan Fabian;Chaoyang He;M. Soltanolkotabi;S. Avestimehr
DOI:
10.18653/v1/2022.findings-naacl.13
发表时间:
2021-04
期刊:
影响因子:
--
作者:
[Bill Yuchen Lin;Chaoyang He;ZiHang Zeng;Hulin Wang;Yufen Huang;M. Soltanolkotabi;Xiang Ren;S. Avestimehr]
通讯作者:
Bill Yuchen Lin;Chaoyang He;ZiHang Zeng;Hulin Wang;Yufen Huang;M. Soltanolkotabi;Xiang Ren;S. Avestimehr
DOI:
--
发表时间:
2018-12
期刊:
ArXiv
影响因子:
--
作者:
[Samet Oymak;M. Soltanolkotabi]
通讯作者:
Samet Oymak;M. Soltanolkotabi
共 36 条
CIF: Small: Precise Computational and Statistical Tradeoffs for Iterative Signal Estimation and Supervised Learning
-
批准号:1813877
-
项目类别:Standard Grant
-
资助金额:$49.07万
-
财政年份:2018
-
负责人:Mahdi Soltanolkotabi
-
依托单位:
海外基金