CCRI: Planning-C: Developing a Minecraft-based Testbed for Evaluating Human-AI Teaming Research

CCRI：Planning-C：开发基于 Minecraft 的测试平台，用于评估人类-人工智能团队研究

• 批准号: 2213827
• 负责人: Wenlong Zhang
• 金额: $ 10万
• 依托单位: Arizona State University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2022
• 资助国家: 美国
• 起止时间: 2022-07-15 至 2023-06-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2213827&HistoricalAwards=false
• 关键词: CCRI; Planning; Developing; Minecraft; based

Human AI Teaming (HAT) is an emerging and rapidly evolving field where physical and virtual spaces require rapid strategic and tactical decision-making. In the context of national security, it is imperative to develop tools that can accelerate what is known as the observation to action loop, enabling decision makers to take swift and effective action that can reduce the impacts of our adversarial threats. It is common for teams to operate in dynamic and uncertain environments and they will require not only cooperation between human and artificial agents, but the use of artificial intelligence (AI) to help structure those teams, create plans of actions, execute those plans, and adapt plans as the environment and goals change. This integration between human and artificial agents can be used to enhance the speed and accuracy of human decision makers; automate the generation, evaluation, and execution of mission plans; and improve training effectiveness. This CISE Computing Research Infrastructure (CCRI) planning grant will undertake an exhaustive community-centric requirements gathering, testing and finalization process that would result in a comprehensive set of features necessary to build a software suite comprising of tools that would improve the effectiveness of human AI teams. Specifically, the proposed software testbed would be flexible and customizable to meet the needs of a broad community of AI researchers and helps them accelerate the development of AI agents that are designed to work in Human AI teams. By organizing the AI community into multiple working groups and disseminating the results via a workshop, the project aims to develop the requirements for modifying the popular Minecraft gaming platform including the data engineering, testing and evaluation requirements for tools that would achieve the desired goals within the HAT community of researchers. The team builds upon prior success in using Minecraft for conducting HAT experiments in Urban Search and Rescue (USR) based settings and broaden its use among AI researchers who would be interested in developing and testing HAT experiments. The resulting community feedback would be integrated into a CCRI full proposal that aims to build the software suite based on the requirements arising from the activities conducted via the planning grant.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

人工智能团队（HAT）是一个新兴且快速发展的领域，物理和虚拟空间需要快速的战略和战术决策。在国家安全方面，必须开发能够加快所谓的“观察到行动”循环的工具，使决策者能够采取迅速有效的行动，减少我们敌对威胁的影响。团队通常在动态和不确定的环境中运作，他们不仅需要人类和人工智能之间的合作，而且需要使用人工智能（AI）来帮助构建这些团队，创建行动计划，执行这些计划，并随着环境和目标的变化而调整计划。人类和人工智能体之间的这种集成可用于提高人类决策者的速度和准确性;自动生成、评估和执行使命计划;并提高训练效率。这项CISE计算研究基础设施（CCRI）规划拨款将进行以社区为中心的详尽需求收集，测试和最终确定过程，这将产生一套全面的功能，用于构建一个由工具组成的软件套件，以提高人类AI团队的效率。具体来说，拟议的软件测试平台将是灵活的和可定制的，以满足广泛的人工智能研究人员社区的需求，并帮助他们加速开发旨在在人类人工智能团队中工作的人工智能代理。通过将人工智能社区组织成多个工作组并通过研讨会传播结果，该项目旨在制定修改流行的Minecraft游戏平台的要求，包括数据工程，测试和评估工具的要求，以实现HAT社区研究人员的预期目标。该团队在之前成功使用Minecraft在基于城市搜索和救援（USR）的环境中进行HAT实验的基础上，扩大了对开发和测试HAT实验感兴趣的人工智能研究人员的使用范围。由此产生的社区反馈将被整合到CCRI的完整提案中，该提案旨在根据通过规划拨款进行的活动所产生的要求构建软件套件。该奖项反映了NSF的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。