CAREER: AIS - An Integrated Optimization and Prediction Framework for Machine Intelligence based on Adaptive Dynamic Programming

研究目标和方法：本项目的目标是促进对基于自适应动态规划的优化和预测相结合的新学习框架的理解、原理和应用。该方法是将参考网络集成到自适应动态规划设计中，通过提供内部强化/目标表示来进行链接优化和预测。所提出的体系结构可以以分层的方式设计，其中可以开发不同级别的内部增强信号来表示智能系统的多级目标。智能优点：本项目为自适应动态规划设计提出了一种新的参考网络，以集成优化和预测能力，用于类脑智能研究。这种结构提供了一种新的方法，可以自适应地构建内部增援信号，而不是手工制作。使用内部强化/目标表征的基本原理和数学基础可能会使认知优化和预测更接近现实。更广泛的影响：这项研究有可能为广泛的应用开发创新技术，如电网控制和通信/网络系统。除了给学术界和工业界带来好处外，该项目还将有利于国家和政府的利益，例如为美国的能源安全和可持续发展目标(如智能电网)提供技术创新。综合研究和教育计划不仅将促进不同层次的卓越教育，还将丰富不同背景的学生的参与，并鼓励女性和少数族裔学生进入这一领域。

Research Objectives and Approaches:The objective of this project is to advance the understanding, principles, and applications of a new learning framework that integrates optimization and prediction based on adaptive dynamic programming. The approach is to integrate a reference network into the adaptive dynamic programming design to link optimization and prediction by providing the internal reinforcement/goal representation. The proposed architecture can be designed in a hierarchical way, in which different levels of internal reinforcement signals can be developed to represent multi-level goals for an intelligent system. Intellectual Merit: This project proposes a new reference network to the adaptive dynamic programming design to integrate optimization and prediction capabilities for brain-like intelligence research. This structure provides a new approach to adaptively build the internal reinforcement signal rather than crafted by hand. The underlying principle and mathematical foundation of using internal reinforcement/goal representation could potentially bring cognitive optimization and prediction closer to reality. Broader Impacts: This research has the potential to develop innovative techniques for a wide range of applications, such as power grid control and communication/network systems. In addition to the benefits for academia and industry, this project will also benefit national and government interests as well, such as providing technical innovations for the U.S. energy security and sustainability objective (e.g., smart grid). The integrated research and education plan will not only promote excellence in education at different levels, but it will also enrich the participation of students with different backgrounds and encourage women and minority students to enter this field.