RI: Small: Collaborative Research: RUI: Scalable Decentralized Planning in Open Multiagent Environments

自动计划是关于找到一系列预期的行动，以成功完成手头的任务或最大化获得的奖励。当行动的结果不确定时，计划就会变得困难。如果存在其他行为者，其行为也会影响环境和奖励结果，则情况会更加复杂。虽然这两个挑战都受到了研究人员的广泛关注，但现实世界的背景往往表现出另一种特性——代理和任务的开放性。Agent开放性发生在Agent退出环境、恢复或新Agent进入时，任务开放性发生在Agent必须完成的任务发生变化，出现新任务和消失新任务时。这种开放性使规划过程变得复杂，因为智能体现在需要最优地考虑，例如，现有队友离开环境的可能性，或者成功奖励任务从环境中消失的可能性。该研究系统地推广自动化规划，以考虑这些新的和实际的挑战，同时仍然保持方法的计算可行性。这项研究涉及Oberlin学院（主要是本科生机构）、内布拉斯加州大学和乔治亚州大学的研究人员，他们密切合作，开发开放多智能体系统的规划方法，并在野火扑灭、动态拼车和其他展示开放性的领域进行演示。主要研究人员正在利用这项研究的成果来指导他们的课堂教学，奥柏林大学计划为中小学生开设人工智能营地。技术方法包括获得对代理和任务开放性对环境的影响的基本理解，并利用这种理解来开发和学习代表开放性的随机模型。这些模型被用于在这种环境中构建可处理的代理级规划的新算法。这些方法将利用系统级属性，如代理匿名性和统计总体抽样，允许从小样本中建模大群体，这在社会科学中已经成功地使方法可扩展到许多代理。这项研究促进了我们对智能代理如何在复杂环境中执行可扩展的、分散的规划的理解，并开发了一个框架——具有经验结果和见解——这可能会为人类代理交互、机器人和自动驾驶汽车的个人助理代理带来更强大的智能，其中代理会随着参与者及其任务随时间的变化而挑战环境动态。该奖项反映了美国国家科学基金会的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

Automated planning is about finding a sequence of actions that is anticipated to successfully complete the task at hand or maximize earned rewards. Planning becomes difficult when the outcomes of actions are uncertain. It is further complicated in the presence of other agents whose actions also affect the environment and reward outcomes. While both these challenges have received much attention from researchers, real-world contexts often exhibit another property -- that of agent and task openness. Agent openness comes about when agents exit the environment, resume, or new agents enter, and task openness occurs when the tasks that agents must complete change with new tasks appearing and some disappearing. Such openness complicates the planning process as agents now need to optimally consider, for example, the possibilities of existing teammates leaving the environment or a successfully rewarding task disappearing from the environment. The research is systematically generalizing automated planning to consider these new and practical challenges while still keeping the methods computationally feasible. This research involves investigators at Oberlin College (a primarily undergraduate institution), Universities of Nebraska and Georgia collaborating closely to develop methods for planning in open multi-agent systems and demonstrating them in domains such as wildfire suppression, dynamic ridesharing, and others that exhibit openness. The principal investigators are using the outcomes of this research to inform their classroom instructions, and artificial intelligence camps for elementary and middle school students are planned at Oberlin.The technical approach involves gaining a fundamental understanding of the impact of agent and task openness on the environment, and utilizing this understanding to develop and learn stochastic models that represent the openness. These models are being used to build new algorithms for tractable agent-level planning in such contexts. The methods will exploit system-level properties such as agent anonymity and statistical population sampling that allows modeling large populations from small samples, which has been successful in the social sciences to make the approaches scalable to many agents. This research is advancing our understanding of how intelligent agents should perform scalable, decentralized planning in complex environments, and developing a framework--with empirical results and insights--that could lead to more robust intelligence for personal assistant agents for human-agent interactions, robots, and autonomous vehicles, where the agents reason about challenging environmental dynamics as the actors and their tasks change over time.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.