Several Problems of Stochastic Optimal Controls in Infinite Time Horizon

最优控制理论是在一段时间内为动态系统找到一个控制，使目标函数最优化。最优控制问题在工程、物理、经济和社会科学中经常遇到。最优控制问题的例子包括如何控制火箭推进器的点火，以最小的燃料消耗达到选定的目标，或如何实施货币政策，以最大限度地减少失业。当所考虑的问题的时间间隔变得无限大时，该理论的基本数学困难变得复杂，并且不确定性，即，随机效应，需要考虑。本项目将研究无限时域的随机最优控制问题，并通过引入当前模型的重要扩展来扩展该领域的知识，以纳入新的影响，以及新的模型，这两者都需要新的想法和方法进行分析。该项目还将为本科生和研究生参与这项研究提供机会。本计画将研究无限时域随机最优控制问题的几个重要方面，包括：（i）具平均场且涉及平均二次成本的线性随机微分方程的最优控制，经由不变测度;（ii）随机最优控制的收费公路性质;（iii）随机最优控制的极大值原理：（iv）随机沃尔泰拉积分方程的无穷时域最优控制.这些问题需要重新审视旧的方法和开发新的工具，以扩大范围和丰富的最优控制理论领域。这个奖项反映了NSF的法定使命，并已被认为是值得通过使用基金会的智力价值和更广泛的影响审查标准进行评估的支持。

Optimal control theory deals with finding a control for a dynamical system over a period of time such that an objective function is optimized. Optimal control problems are often encountered in engineering and in physical, economic, and social sciences. Examples of optimal control problems include how to control the firing of rocket thrusters to reach a selected target with minimum fuel expenditure, or how to implement monetary policy to minimize unemployment. The underlying mathematical difficulties of the theory are compounded when the time interval for the problem under consideration becomes infinite, and uncertainties, i.e., stochastic effects, need to be accounted for. This project will study stochastic optimal control problems with infinite horizon and extend the knowledge in the field through the introduction of significant extensions of current models to incorporate new effects, and also new models, both of which necessitate new ideas and approaches for their analysis. The project will also provide opportunities for the involvement of undergraduate and graduate students in this research. This project will investigate several important aspects of stochastic optimal control problems with infinite horizon, including: (i) Optimal control of linear stochastic differential equations (SDEs) having mean-field and involving average quadratic costs, via invariant measures; (ii) Turnpike properties of stochastic optimal controls for SDEs; (iii) maximum principle of stochastic optimal controls in infinite horizon for SDEs and for stochastic Volterra integral equations (SVIEs); (iv) Time-inconsistent optimal controls over infinite time horizon for SDEs. These problems necessitate the re-examination of old approaches and development of new tools to expand the scope and enrich the field of optimal control theory.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.