Learning to Efficiently Plan in Flexible Distributed Organizations

机器人团队有望给工业和社会其他领域带来革命性的变化。然而，这种所谓的多智能体系统（MASs）在不确定性下的决策在计算上是非常复杂的。分散式部分可观察马尔可夫决策过程（Dec-POMDP）框架促进了此类决策问题的原则性制定，但目前还没有可扩展的解决方法来保证任务性能。为了简化MASs中的协调，代理组织给每个代理分配一个抽象的、更容易的问题。通常，只有最严格的组织，即完全解耦代理，才会带来明显的计算效益。然而，这是以牺牲任务性能为代价的：完全解耦意味着代理不能再协作来分配工作负载。该项目将重点关注dec - pomdp的灵活分布式组织（FDOs），该组织将考虑的交互限制在空间附近的代理上，而不会强制完全解耦。目前，对于fdo来说，还没有可扩展的、能够保证任务性能的决策制定方法：该项目的主要目标是开发这样的方法以及支持其形式化的理论。为了实现这一目标，它将研究使用深度学习技术来学习fdo中“影响”的表示，并使用这些表示来开发新的规划方法。如果成功，这将提供概念证明，即学习的影响表征可以实现大规模的原则决策。这将是一个更大的研究项目的基础，研究不同形式抽象的影响表征，并将激发应用研究，研究开发的算法在真实机器人团队中的部署。

Teams of robots are expected to revolutionise industry and other other parts of society. However, decision making in such so-called multiagent systems (MASs) under uncertainty is computationally very complex. The decentralized partially observable Markov decision process (Dec-POMDP) framework facilitates principled formulation of such decision making problems, but currently there are no scalable solution methods that provide guarantees on task performance. To simplify coordination in MASs, agent organisations assign an abstracted, easier problem to each agent. Typically only the most rigid organisations, which completely decouple the agents, have led to clear computational benefits. However, these come at the expense of task performance: full decoupling means that agents can no longer collaborate to divide the workload. This project will focus on flexible distributed organisations (FDOs) for Dec-POMDPs, which restrict considered interactions to spatially nearby agents without imposing full decoupling. Currently no scalable decision making methods with guarantees on task performance exist for FDOs: the main goal of the project is to develop such methods along with the theory that supports their formalisation. To accomplish this goal, it will investigate the use of deep learning techniques to learn representations of 'influence' in FDOs and use those representations to develop novel planning methods. If successful, this will provide the proof-of-concept that learned influence representations can enable principled decision making in large-scale MASs. This will be the basis for a larger research program investigating such influence representations for different forms of abstraction and will spark applied research that investigates deployment of the developed algorithms in real robotic teams.