Empathetic, interpretable, and explainable Artificial Intelligence

这项研究的首要目标是研究移情人工智能（AI）对高风险环境中人类-AI团队的影响。这项研究的结果可以帮助理解如何优化人类与人工智能的互动，以便在各种高风险领域取得更好的结果，包括军事行动、航空、医疗保健和法律等。与该项目的合作伙伴泰雷兹相关的一个具体用例是潜艇上的高压作业，声纳操作员面临着分析大量复杂数据集的挑战。该项目旨在探索如何在这种情况下整合移情AI可以减轻声纳操作员所经历的压力，同时提高团队的绩效。主要假设是，一个移情AI，适应人类操作员的压力源和需求，将培养更强大的人类与AI的关系，从而提高团队的整体效能。此外，这种同理心的关系不仅会使人类与人工智能建立融洽的关系，而且还会促进人类操作员认识到并尊重人工智能的局限性和需求的相互理解。这种双向的同理心，它被假设，将导致提高团队绩效和减少人类operator.The研究的认知负荷将利用一个严重的游戏环境来测试所提出的假设。这种受控但在生态上有效的设置将允许彻底调查移情AI对人类操作员的心理影响。该实验将被设计为评估操作员的表现和压力水平在三个不同的情况下：1。操作没有任何人工智能的援助，2.与常规的、非移情的AI一起操作，以及3.与具有同理心的人工智能一起运作。这些场景的比较分析将为同理心在提高人类-人工智能团队绩效方面的具体作用提供有价值的见解。这项研究的结果与UKRI的使命直接一致，因为在人类-人工智能团队中整合同理心的人工智能有望通过优化团队绩效，以及通过减轻操作员的压力和培养更好的操作实践来造福公众。这些理想进一步得到了博士培训中心（CDT）的响应，该中心支持该项目ART-AI（负责，负责和透明的AI），致力于开发维护这些价值观的AI系统。

The overarching aim of this research is to examine the impact of empathetic artificial intelligence (AI) on human-AI teaming in high-stakes contexts. Findings from this research could assist in understanding how human-AI interactions can be optimised for better outcomes in various high-stakes sectors, including military operations, aviation, healthcare, and law, among others. A specific use case pertinent to the collaborative partner of this project, Thales, is the high-pressure operations aboard submarines, where sonar operators face the challenge of analysing vast and complex data sets. This project aims to explore how integrating empathetic AI in such scenarios could alleviate the stress experienced by sonar operators while also improving the performance of the team.The primary hypothesis is that an empathetic AI, attuned to the stressors and needs of human operators, will foster a stronger human-AI relationship, thereby enhancing the overall efficacy of the team. Moreover, this empathetic relationship will not only condition humans to build rapport with the AI but will also foster a reciprocal understanding where the human operator recognises and respects the limitations and needs of the AI. This bidirectional empathy, it is hypothesised, will lead to improved team performance and a reduction in the cognitive load of the human operator.The research will utilise a serious game environment to test the proposed hypotheses. This controlled, yet ecologically valid, setting will allow for a thorough investigation of the psychological impacts of empathetic AI on human operators. The experiment will be designed to assess operator performance and stress levels in three distinct scenarios:1. Operation without any AI assistance,2. Operation with a regular, non-empathetic AI, and3. Operation with an empathetic AI.The comparative analysis of these scenarios will provide valuable insights into the specific role of empathy in enhancing human-AI team performance.The findings of this research directly align with the UKRI's mission, as the integration of empathetic AI in human-AI teams is poised to contribute to prosperity by optimising team performance, as well as to the public good by reducing operator stress and cultivating better operational practices. These ideals are further echoed by the Centre for Doctoral Training (CDT) underpinning this project, ART-AI (Accountable, Responsible, and Transparent AI), which is committed to developing AI systems that uphold these values.