CCRI: Planning-C: Developing a Minecraft-based Testbed for Evaluating Human-AI Teaming Research

CCRI：Planning-C：开发基于 Minecraft 的测试平台，用于评估人类-人工智能团队研究

• 批准号: 2213827
• 负责人: Wenlong Zhang
• 金额: $ 10万
• 依托单位: Arizona State University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2022
• 资助国家: 美国
• 起止时间: 2022-07-15 至 2023-06-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2213827&HistoricalAwards=false
• 关键词: CCRI; Planning; Developing; Minecraft; based

Human AI Teaming (HAT) is an emerging and rapidly evolving field where physical and virtual spaces require rapid strategic and tactical decision-making. In the context of national security, it is imperative to develop tools that can accelerate what is known as the observation to action loop, enabling decision makers to take swift and effective action that can reduce the impacts of our adversarial threats. It is common for teams to operate in dynamic and uncertain environments and they will require not only cooperation between human and artificial agents, but the use of artificial intelligence (AI) to help structure those teams, create plans of actions, execute those plans, and adapt plans as the environment and goals change. This integration between human and artificial agents can be used to enhance the speed and accuracy of human decision makers; automate the generation, evaluation, and execution of mission plans; and improve training effectiveness. This CISE Computing Research Infrastructure (CCRI) planning grant will undertake an exhaustive community-centric requirements gathering, testing and finalization process that would result in a comprehensive set of features necessary to build a software suite comprising of tools that would improve the effectiveness of human AI teams. Specifically, the proposed software testbed would be flexible and customizable to meet the needs of a broad community of AI researchers and helps them accelerate the development of AI agents that are designed to work in Human AI teams. By organizing the AI community into multiple working groups and disseminating the results via a workshop, the project aims to develop the requirements for modifying the popular Minecraft gaming platform including the data engineering, testing and evaluation requirements for tools that would achieve the desired goals within the HAT community of researchers. The team builds upon prior success in using Minecraft for conducting HAT experiments in Urban Search and Rescue (USR) based settings and broaden its use among AI researchers who would be interested in developing and testing HAT experiments. The resulting community feedback would be integrated into a CCRI full proposal that aims to build the software suite based on the requirements arising from the activities conducted via the planning grant.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

人类人工智能团队（HAT）是一个新兴和快速发展的领域，物理和虚拟空间需要快速的战略和战术决策。在国家安全的背景下，必须开发能够加速所谓观察到行动循环的工具，使决策者能够采取迅速有效的行动，减少我们的敌对威胁的影响。团队在动态和不确定的环境中运作是很常见的，他们不仅需要人类和人工代理之间的合作，还需要使用人工智能（AI）来帮助构建这些团队，创建行动计划，执行这些计划，并随着环境和目标的变化而调整计划。人类和人工智能体之间的这种整合可以用来提高人类决策者的速度和准确性；自动生成、评估和执行任务计划；提高培训效果。CISE计算研究基础设施（CCRI）计划拨款将进行详尽的以社区为中心的需求收集、测试和最终确定过程，这将产生一套全面的功能，以构建一个包含工具的软件套件，从而提高人类人工智能团队的效率。具体来说，拟议的软件测试平台将是灵活和可定制的，以满足广泛的人工智能研究人员社区的需求，并帮助他们加速设计用于人类人工智能团队的人工智能代理的开发。通过将AI社区组织成多个工作组并通过研讨会传播结果，该项目旨在开发修改流行的Minecraft游戏平台的需求，包括数据工程，测试和评估工具需求，这些工具将实现HAT研究人员社区的预期目标。该团队建立在先前成功使用Minecraft在城市搜索和救援（USR）环境中进行HAT实验的基础上，并在对开发和测试HAT实验感兴趣的AI研究人员中扩大其使用范围。社区的反馈意见将被整合到CCRI的完整建议中，该建议旨在根据通过规划补助金进行的活动所产生的需求来构建软件套件。该奖项反映了美国国家科学基金会的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。