First-Order Methods for Large-Scale Optimization and Applications
First-Order Methods for Large-Scale Optimization and Applications
批准号:
341410-2012
负责人:
Lu, Zhaosong
金额:
$1.38万
依托单位:
依托单位国家:
加拿大
项目类别:
Discovery Grants Program - Individual
财政年份:
2015
资助国家:
加拿大
项目状态:
已结题
起止时间:
2015-01-01 至 2016-12-31
中文摘要
目前,大规模优化问题经常出现在工程和科学领域,特别是在生物信息学、数据挖掘、机器学习、医学、图像处理和统计学等领域。由于高维和密集的数据,他们往往是非常具有挑战性的二阶方法,即,
牛顿型方法,因为后者的每次迭代都需要求解一个典型的稠密线性系统。因此,开发有效的一阶方法来寻找低精度的解决方案是至关重要的。
本文的主要目的是发展求解大规模约束优化和单调包含问题的有效一阶方法,并探索其应用。本文的目标是:1)发展求解一般凸规划的一阶方法并建立其迭代复杂性:2)发展求解包含不精确或非Lipschitz连续算子和/或子问题不精确解的单调包含问题的一阶方法并建立其迭代复杂性; 3)发展了求解多个极大单调算子和单调包含问题的分解方法,并建立了它们的迭代复杂性; 4)研究了求解一般非凸优化问题的一阶线搜索方法,并建立了它们的迭代复杂度;(5)探索一阶方法在上述领域的应用。
这些工作的预期意义包括:1)为一阶方法提供了新的认识,提高了其求解更广泛的凸和非凸优化问题的效率和能力; 2)发展了求解单调包含问题的有效一阶方法,为求解一般鞍点、平衡、变分不等式和优化问题提供了强有力的工具;(3)开发适用于各种应用的一阶方法的高效软件。
英文摘要
Nowadays large-scale optimization problems frequently arise in engineering and sciences, especially in bioinformatics, data mining, machine learning, medical, image processing and statistics. Due to high dimensionality and dense data, they are often very challenging for second-order methods, namely,
Newton-type methods as each iteration of the latter methods requires solving a typically dense linear system. It is thus of paramount importance to develop efficient first-order methods for finding low accuracy solutions.
This proposal aims at developing efficient first-order methods for large-scale constrained optimization and monotone inclusion problems, and also exploring their applications. The objectives of this proposal consist of: 1) developing first-order methods for solving general convex programming and establishing their iteration complexity; 2) developing first-order methods for solving monotone inclusion problems where inexact or non-Lipschitz continuous operator is involved and/or subproblems are solved inexactly, and establishing their iteration complexity; 3) developing decomposition methods for solving monotone inclusion problem with sum of multiple maximal monotone operators and establishing their iteration complexity; 4) studying first-order line-search methods for solving general nonconvex optimization problems and establishing their iteration complexity; and 5) exploring applications of first-order methods in the aforementioned areas.
The anticipated significance of the proposed work includes: 1) providing new insights into first-order methods and enhancing their efficiency and capability for solving much broader convex and nonconvex optimization problems; 2) developing efficient first-order methods for solving the monotone inclusion problems, which will provide powerful tools for solving general saddle point, equilibrium, variational inequality and optimization problems; and 3) developing efficient software of first-order methods for various applications.
期刊论文(0)
专著(0)
科研奖励(0)
会议论文
Efficient methods for large-scale structural optimization with application to machine learning
-
批准号:RGPIN-2017-04169
-
项目类别:Discovery Grants Program - Individual
-
资助金额:$2.04万
-
财政年份:2020
-
负责人:Lu, Zhaosong
-
依托单位:
Efficient methods for large-scale structural optimization with application to machine learning
-
批准号:RGPIN-2017-04169
-
项目类别:Discovery Grants Program - Individual
-
资助金额:$2.04万
-
财政年份:2019
-
负责人:Lu, Zhaosong
-
依托单位:
Efficient methods for large-scale structural optimization with application to machine learning
-
批准号:RGPIN-2017-04169
-
项目类别:Discovery Grants Program - Individual
-
资助金额:$2.04万
-
财政年份:2018
-
负责人:Lu, Zhaosong
-
依托单位:
Efficient methods for large-scale structural optimization with application to machine learning
-
批准号:RGPIN-2017-04169
-
项目类别:Discovery Grants Program - Individual
-
资助金额:$2.04万
-
财政年份:2017
-
负责人:Lu, Zhaosong
-
依托单位:
Automatic problem identifier and parameter tuning in local optimization
-
批准号:483291-2015
-
项目类别:Engage Grants Program
-
资助金额:$1.82万
-
财政年份:2015
-
负责人:Lu, Zhaosong
-
依托单位:
First-Order Methods for Large-Scale Optimization and Applications
-
批准号:341410-2012
-
项目类别:Discovery Grants Program - Individual
-
资助金额:$1.38万
-
财政年份:2014
-
负责人:Lu, Zhaosong
-
依托单位:
First-Order Methods for Large-Scale Optimization and Applications
-
批准号:341410-2012
-
项目类别:Discovery Grants Program - Individual
-
资助金额:$1.38万
-
财政年份:2013
-
负责人:Lu, Zhaosong
-
依托单位:
First-Order Methods for Large-Scale Optimization and Applications
-
批准号:341410-2012
-
项目类别:Discovery Grants Program - Individual
-
资助金额:$1.38万
-
财政年份:2012
-
负责人:Lu, Zhaosong
-
依托单位:
Theory of cone programming and its applications
-
批准号:341410-2007
-
项目类别:Discovery Grants Program - Individual
-
资助金额:$1.24万
-
财政年份:2011
-
负责人:Lu, Zhaosong
-
依托单位:
Theory of cone programming and its applications
-
批准号:341410-2007
-
项目类别:Discovery Grants Program - Individual
-
资助金额:$1.24万
-
财政年份:2010
-
负责人:Lu, Zhaosong
-
依托单位:
Theory of cone programming and its applications
-
批准号:341410-2007
-
项目类别:Discovery Grants Program - Individual
-
资助金额:$1.24万
-
财政年份:2009
-
负责人:Lu, Zhaosong
-
依托单位:
Theory of cone programming and its applications
-
批准号:341410-2007
-
项目类别:Discovery Grants Program - Individual
-
资助金额:$1.24万
-
财政年份:2008
-
负责人:Lu, Zhaosong
-
依托单位:
Theory of cone programming and its applications
-
批准号:341410-2007
-
项目类别:Discovery Grants Program - Individual
-
资助金额:$1.24万
-
财政年份:2007
-
负责人:Lu, Zhaosong
-
依托单位:
国内基金
海外基金
基于Order的SIS/LWE变体问题及其应用
-
批准号:--
-
项目类别:面上项目
-
资助金额:53万元
-
批准年份:2022
-
负责人:杨少军
-
依托单位:
Poisson Order, Morita 理论,群作用及相关课题
-
批准号:19ZR1434600
-
项目类别:省市级项目
-
资助金额:--
-
批准年份:2019
-
负责人:朱灿
-
依托单位: