Collaborative Research: Fast reinforcement learning using multiple models and state decompositions for apllications to Plug-in Hybrid Vehicles
Collaborative Research: Fast reinforcement learning using multiple models and state decompositions for apllications to Plug-in Hybrid Vehicles
批准号:
1408279
负责人:
Kumpati Narendra
金额:
$20.0万
依托单位:
依托单位国家:
美国
项目类别:
Standard Grant
财政年份:
2014
资助国家:
美国
项目状态:
已结题
起止时间:
2014-08-15 至 2017-07-31
中文摘要
一般来说,学习方案以其缓慢的收敛速度而闻名。该提案提出了提高学习速度的各种修改建议。首先是使用多种模型,这在系统论的其他领域已被证明是非常有效的。第二个修改是使用去中心化或部分去中心化的多代理状态分解方法。上述两种方法都将使一般的学习方案和特别是强化方案快速收敛,并适用于广泛的现实世界问题。所提出的研究将发展使用这两种广泛方法的快速强化学习的基础,并将这些方法应用于插电式混合动力汽车车队的最优控制。这项研究的结果将对以最佳方式控制插电式混合动力汽车车队以提高能源效率产生社会影响。拟议研究的应用将扩展到系统理论的其他领域,如神经生物学。研究生和本科生将接受多学科应用学习计划方面的培训。将通过一年两次的自适应和学习系统研讨会以及利用多学科数学建模和计算科学研究所(IMMCS)促进思想的交叉交流。该提案侧重于提高多个代理中学习方案的收敛速度,以克服维度的限制,以及代理之间不经常沟通的情况。创新之处在于利用多模型和状态分解来加快学习和收敛。该技术方法包括使用多个辨识模型;通过使用分散或部分分散的多智能体状态分解方法进行强化学习;以及在用于控制插电式混合动力汽车(PHEV)车队的应用试验台上评估快速强化学习。研究小组进一步计划量化学习速度和“学习解决方案”的质量之间的权衡。
英文摘要
Learning schemes in general, are known for their slow convergence rates. The proposal suggests various modifications for improving the speed of learning. The first is the use of multiple models which has proved very effective in other areas of systems theory. A second modification is the use of decentralized or partially decentralized multi-agent state decomposition approaches. Both of the above will make learning schemes in general and reinforcement schemes in particular fast converging and applicable to a wide class of real-world problems. The proposed research will develop the foundations of fast reinforcement learning using these two broad approaches, and will also apply these methods to the optimal control of a fleet of Plug-in Hybrid Electric Vehicles. The outcome of this research will have a societal impact for optimally controlling a fleet of Plug-in Hybrid Electric Vehicles for energy efficiency. The application of the proposed research will have extended application in other areas of systems theory such as neurobiology. Graduate and undergraduate students will be trained in learning schemes for multidisciplinary applications. Cross-fertilization of ideas will be facilitated through a bi-annual workshop on adaptive and learning systems and by leveraging a multidisciplinary Institute for Mathematical Modeling and Computational Science (iMMCS).The proposal focuses on improving convergence speed of learning schemes in multiple agents in order to overcome the limitations of dimensionality, as well as in situations where infrequent communication exists between agents. Innovation is in the use of multiple models and state decomposition to speed up the learning and convergence. The technical approach lies in using multiple identification models; reinforcement learning by using decentralized or partially decentralized multi-agent state decomposition approaches; and evaluating fast reinforcement learning in an application test-bed for controlling a fleet of Plug-in Hybrid Electric Vehicles (PHEVs). The Research Team further plans to quantify the trade-off between learning speed and quality of the "learned solutions".
期刊论文(0)
专著(0)
科研奖励(0)
会议论文
Collaborative Research: Mutual Learning: A Systems Theoretic Investigation
-
批准号:1930601
-
项目类别:Standard Grant
-
资助金额:$44.63万
-
财政年份:2019
-
负责人:Kumpati Narendra
-
依托单位:
How to adapt efficiently using distributed resources and multiple models to time varing dynamic systems
-
批准号:1503751
-
项目类别:Standard Grant
-
资助金额:$35.88万
-
财政年份:2015
-
负责人:Kumpati Narendra
-
依托单位:
Adaptive Control Based on the Use of Collective Information from Multiple Models
-
批准号:1102178
-
项目类别:Standard Grant
-
资助金额:$34.82万
-
财政年份:2011
-
负责人:Kumpati Narendra
-
依托单位:
Adaptive Control of Time-Varying Systems Using Multiple Models
-
批准号:0824118
-
项目类别:Standard Grant
-
资助金额:$39.27万
-
财政年份:2008
-
负责人:Kumpati Narendra
-
依托单位:
Adaptive Control of Time-Varying Systems Using Multiple Models
-
批准号:0601618
-
项目类别:Standard Grant
-
资助金额:$22.0万
-
财政年份:2006
-
负责人:Kumpati Narendra
-
依托单位:
Stability of Switched Dynamical Systems
-
批准号:0400306
-
项目类别:Standard Grant
-
资助金额:$0.0万
-
财政年份:2004
-
负责人:Kumpati Narendra
-
依托单位:
Adaptive Identification and Control of Dynamical Systems Using Neural Networks
-
批准号:0113239
-
项目类别:Standard Grant
-
资助金额:$39.99万
-
财政年份:2001
-
负责人:Kumpati Narendra
-
依托单位:
Adaptive Identification and Control of Dynamical Systems Using Neural Networks
-
批准号:9811390
-
项目类别:Standard Grant
-
资助金额:$43.63万
-
财政年份:1998
-
负责人:Kumpati Narendra
-
依托单位:
Adaptive Identification and Control of Dynamical Systems Using Neural Networks
-
批准号:9521405
-
项目类别:Continuing Grant
-
资助金额:$41.93万
-
财政年份:1995
-
负责人:Kumpati Narendra
-
依托单位:
Adaptive Identification and Control of Dynamical Systems Using Neural Networks
-
批准号:9203928
-
项目类别:Continuing Grant
-
资助金额:$41.31万
-
财政年份:1992
-
负责人:Kumpati Narendra
-
依托单位:
Intelligent Control Systems Design
-
批准号:9216823
-
项目类别:Standard Grant
-
资助金额:$20.8万
-
财政年份:1992
-
负责人:Kumpati Narendra
-
依托单位:
Stability, Robustness and Performance of Adaptive Systems
-
批准号:8921845
-
项目类别:Continuing Grant
-
资助金额:$6.04万
-
财政年份:1990
-
负责人:Kumpati Narendra
-
依托单位:
Adaptive Identification and Control of Dynamical Systems Using Neural Networks
-
批准号:8912397
-
项目类别:Continuing Grant
-
资助金额:$35.28万
-
财政年份:1989
-
负责人:Kumpati Narendra
-
依托单位:
Applicability of Learning Automata Theory to Neural Network Design
-
批准号:8814747
-
项目类别:Standard Grant
-
资助金额:$2.98万
-
财政年份:1988
-
负责人:Kumpati Narendra
-
依托单位:
Robust Adaptive Control
-
批准号:8520428
-
项目类别:Standard Grant
-
资助金额:$20.21万
-
财政年份:1986
-
负责人:Kumpati Narendra
-
依托单位:
Adaptive Control Problems Based on Reduced Order Models
-
批准号:8300223
-
项目类别:Continuing Grant
-
资助金额:$14.3万
-
财政年份:1983
-
负责人:Kumpati Narendra
-
依托单位:
Learning Automata Theory and Applications
-
批准号:8008034
-
项目类别:Standard Grant
-
资助金额:$11.4万
-
财政年份:1980
-
负责人:Kumpati Narendra
-
依托单位:
Learning Automata in Adaptive Control
-
批准号:7703664
-
项目类别:Continuing Grant
-
资助金额:$8.15万
-
财政年份:1977
-
负责人:Kumpati Narendra
-
依托单位:
Application of Learning Automata in Adaptive Control
-
批准号:7508616
-
项目类别:Standard Grant
-
资助金额:$6.93万
-
财政年份:1975
-
负责人:Kumpati Narendra
-
依托单位:
Special Foreign Currency Award (Including Indian Currency) For Participation in the U.S.-India Exchange of Scientists Program.
-
批准号:7516819
-
项目类别:Standard Grant
-
资助金额:$0.22万
-
财政年份:1975
-
负责人:Kumpati Narendra
-
依托单位:
国内基金
海外基金
登录
查看更多内容
Research on Quantum Field Theory without a Lagrangian Description
-
批准号:24ZR1403900
-
项目类别:省市级项目
-
资助金额:--
-
批准年份:2024
-
负责人:SATOSHI NAWATA
-
依托单位:
Cell Research
-
批准号:31224802
-
项目类别:专项基金项目
-
资助金额:24.0万元
-
批准年份:2012
-
负责人:程磊
-
依托单位:
Cell Research
-
批准号:31024804
-
项目类别:专项基金项目
-
资助金额:24.0万元
-
批准年份:2010
-
负责人:程磊
-
依托单位:
Cell Research (细胞研究)
-
批准号:30824808
-
项目类别:专项基金项目
-
资助金额:24.0万元
-
批准年份:2008
-
负责人:张爱兰
-
依托单位:
Research on the Rapid Growth Mechanism of KDP Crystal
-
批准号:10774081
-
项目类别:面上项目
-
资助金额:45.0万元
-
批准年份:2007
-
负责人:滕冰
-
依托单位: