Improving AI Performance in Complex Real-Time Scenarios with Hierarchical Reinforcement Learning and Counterfactual Regret Minimization

通过分层强化学习和反事实遗憾最小化提高复杂实时场景中的人工智能性能

• 批准号: 2590735
• 金额: --
• 依托单位: Queen Mary University of London
• 依托单位国家: 英国
• 项目类别: Studentship
• 财政年份: 2021
• 资助国家: 英国
• 起止时间: 2021 至 无数据
• 项目状态: 已结题
• 来源: https://gtr.ukri.org/projects?ref=studentship-2590735
• 关键词: Improving; AI; Performance; Complex; Real

Recent milestones in Game Artificial Intelligence (AI) brought forth expert solutions for playing the games of Go, Chess, Poker, Dota2, and StarCraft II. Especially the last title highlighted the applicability of AI in complex real-time scenarios, yet only through massive Neural Network (NN) architectures. Hierarchical Reinforcement Learning provides managerial structure to an agent's decision-making process, while Counterfactual Regret Minimization evaluates action-decision making by learning from hindsight. Combining both may reduce the network size, that agents require to handle environments equally difficult to StarCraft II, or even more complex ones, such as Wargames. Upon success, the methods developed in this study could reach state-of-the-art performance in Real-Time Strategy (RTS) games environments, which could not only be used to enhance the experience of players in diverse RTS games but also push forward AI employability in real-world decision-making scenarios.

游戏人工智能（AI）的最新里程碑为围棋、国际象棋、扑克、Dota2和星际争霸II等游戏带来了专家解决方案。特别是最后一个标题强调了人工智能在复杂实时场景中的适用性，但只有通过大规模神经网络（NN）架构。分层强化学习为智能体的决策过程提供了管理结构，而反事实后悔最小化则通过事后学习来评估行动决策。两者结合可以减少网络规模，智能体需要处理与星际争霸II一样困难的环境，甚至更复杂的环境，如战争游戏。一旦成功，本研究中开发的方法可以在实时战略（RTS）游戏环境中达到最先进的性能，这不仅可以用于增强玩家在各种RTS游戏中的体验，还可以推动AI在现实世界决策场景中的可应用性。