user adaPtive Artificial iNtelligence fOR humAn coMputer interAction

Panorama的核心理念是“人机交互背景下的用户自适应AI”。首先，我们将对体现为会话代理的人工智能的用户适应性进行研究。当人们与他人交谈时，他们会根据对方的行为不断地改变他们的语言和非语言交际行为。因此，用户自适应是改善人-代理交互的一个重要问题。沟通方式也因文化不同而不同，在系统本地化中需要使代理行为适应目标文化。Panorama将使用机器学习来解决这些问题。然而，这种方法的一个瓶颈是标注用户的非语言行为来创建训练数据非常耗时。我们将通过开发可解释人工智能(XAI)技术来解决这个问题，通过该技术，系统预测的标签将根据与用户作为注释者的交互进行调整。因此，用户自适应人工智能能够支持用户创建多模式语料库，并改善人与主体的交互。此外，在Panorama中，用户适应性是通过心理学理论来考虑的，其中用户动机将在一个相关的用例(针对身体活动的个性化动机教练)中进行调查。因此，Panorama着眼于用户适应性的概念，为基于机器学习的特定文化会话代理提出了一种新的研究方法。PANORAMA旨在实现以下五个研究目标。(1)提出了一种基于XAI技术的用户自适应多通道标注工具，(2)利用该工具收集了三个国家(法国、德国和日本)的标注多通道语料库，(3)提出了开发具有多级适应功能的会话智能体的模型和方法，其中智能体的非语言信号和对话内容被适应于用户，(4)提供多任务学习和迁移学习技术，以利用(2)中获得的多文化语料库来学习模型，并使会话智能体适应每种文化，(5)基于心理学理论和评价研究，提出自适应人工智能系统的设计基础。

The key concept of PANORAMA is "user adaptive AI in the context of human-computer interaction". First, we will conduct research on user adaptivity of Artificial Intelligence embodied as a conversational agent. When people talk to other people, they change their verbal and nonverbal communication behaviors continuously according to those of the partner. Therefore, user adaptivity is an essential issue in improving human-agent interaction. Communication style is also different depending on the culture, and adapting the agent behaviors to a target culture is required in system localization. PANORAMA will tackle these problems with Machine Learning. However, a bottleneck of this approach is that annotating users’ nonverbal behaviors to create training data is time consuming. We will solve this problem by exploiting Explainable Artificial Intelligence (XAI) technique, through which labels predicted by the system are adapted based on the interaction with the user as an annotator. Thus, user adaptive AI enables to support users in creating multimodal corpus as well as improve human-agent interaction. Moreover, user adaptivity is considered in PANORAMA via psychological theories, in which user motivation will be investigated in one relevant use case (personalised motivational coaching for physical activity). Therefore, PANORAMA envisions a new research methodology for Machine-Learning-based culture-specific conversational agents by focusing on the concept of user adaptivity.PANORAMA aims to accomplish the following five research goals. (1) propose a user adaptive multimodal annotation tool based on XAI techniques, (2) exploit this tool to collect annotated multimodal corpora in three countries (France, Germany, and Japan), (3) propose models and methods for developing conversational agents with multi-level adaptation functionality, where nonverbal signals of the agent as well as the content of the dialogue are adapted to the user, (4) provide multitask learning and transfer learning techniques to learn models using the multi-cultural corpus obtained in (2) and adapt the conversational agent to each culture, and (5) propose the design basis of adaptive AI systems grounded in psychological theories and evaluation studies.