权益分类	功能权益	普通用户	{{item.name}}会员
{{category.name}}	{{benefitItem.name}}

CRII: CPS: A Self-Learning Intelligent Control Framework for Networked Cyber-Physical Systems

CRII：CPS：网络信息物理系统的自学习智能控制框架

基本信息

批准号：
1850240
负责人：
Xiangnan Zhong
金额：
$ 17.44万
依托单位：
University of North Texas
依托单位国家：
美国
项目类别：
Standard Grant
财政年份：
2019
资助国家：
美国
起止时间：
2019-03-01 至 2019-09-30
项目状态：
已结题

来源：
https://www.nsf.gov/awardsearch/showAward?AWD_ID=1850240&HistoricalAwards=false
关键词：
CRII CPS Self Learning Intelligent

项目摘要

The goal of this project is to addresses challenges in machine learning for intelligent physical systems that interact with one another. The approach is to explore Reinforcement Learning (RL) strategies, where systems are rewarded when behaving correctly, for interacting physical systems when the systems with which they interact may react in inconsistent ways. The results are expected to contribute to a new self-learning intelligent control framework, where the systems under design can decide how to interact with their inconsistent neighbors in a way that will improve how they learn. This will advance reinforcement learning for networked cyber-physical systems (CPS) which can have emergent behaviors when they interact (for example, unmanned aerial systems) and are frequently inconsistent due to uncertainties in their distributed nature (for example, the smart grid).Three major fundamental contributions to the scientific field are expected. First, a new distributed RL algorithm will learn suitable reward functions automatically without requiring external supervisions. This work will relax human efforts and scale RL algorithms to more complex environment. Second, novel transfer learning-based RL architectures will be designed by reusing past knowledge from multiple sources. This design will further accelerate learning process in networked CPS. Third, this proposed method will be implemented on a multi-robot testbed to advance the learning in robot applications. Outreach and dissemination plans cultivate the scientific curiosity of K-12 students, and students from underrepresented groups, and motivate their interests in Science, Technology, Engineering, and Math (STEM) programs. Furthermore, the integration of the project's cutting-edge research results into new courses will aid retention of current STEM students.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

该项目的目标是解决相互交互的智能物理系统的机器学习挑战。该方法是探索强化学习（RL）策略，当系统与物理系统交互时，当与之交互的系统可能以不一致的方式做出反应时，系统会在行为正确时获得奖励。研究结果预计将有助于建立一个新的自学习智能控制框架，在该框架中，正在设计的系统可以决定如何与不一致的邻居进行交互，从而改善它们的学习方式。这将推进网络信息物理系统 (CPS) 的强化学习，这些系统在交互时可能会出现突发行为（例如，无人机系统），并且由于其分布式性质的不确定性而经常出现不一致（例如，智能电网）。预计会对科学领域做出三大基本贡献。首先，新的分布式强化学习算法将自动学习合适的奖励函数，而不需要外部监督。这项工作将放松人类的努力，并将强化学习算法扩展到更复杂的环境。其次，将通过重用来自多个来源的过去知识来设计新颖的基于迁移学习的强化学习架构。该设计将进一步加速网络 CPS 的学习过程。第三，该方法将在多机器人测试台上实施，以促进机器人应用的学习。外展和传播计划培养 K-12 学生和弱势群体学生的科学好奇心，并激发他们对科学、技术、工程和数学 (STEM) 项目的兴趣。此外，将该项目的前沿研究成果整合到新课程中将有助于保留现有的 STEM 学生。该奖项反映了 NSF 的法定使命，并通过使用基金会的智力价值和更广泛的影响审查标准进行评估，被认为值得支持。