NRI: Music-based Interactive Robotic Orchestration for Children with ASD

描述(由申请人提供)： 我们建议开发一个具有基于音乐的交互的机器人体系结构，用于多模式刺激和情感机器人参与。通过这个项目，我们的目标是通过音乐刺激提高自闭症儿童在日常活动中的参与度，并建议设计情感域和空间域的双层参与度量，以进行情感和社会互动。在这个系统中，孩子们将被激发、引导并最终被挑战，通过音乐驱动的活动进行创造性的互动。这一过程将为ASD儿童对音乐刺激和身体活动的行为模式建立语义知识，从而产生新的治疗方案，为长期治疗和积极参与提供良好的基础。我们将追求的具体目标是：目标1：开发和评估使用听觉信号和音乐组件的音乐参与框架，以及游戏和舞蹈等活动的机器人演示。目的2：设计和评价机器人智能体和儿童参与音乐活动的相互学习过程，并定义音乐刺激和儿童空间-物理反应之间的个性化参数映射结构，以实现最大限度的交互。目标3：定义和开发用于评估在物理音乐会话期间与机器人代理的情感和社会参与的关键指标。这项拟议的研究将产生最先进的技术，促进机器人的自主交互方法，以有效地刺激儿童的情感和社交互动。这个 我们提出的研究的创新方面是利用音乐互动和活动为儿童情感和社会互动的有效发展提供一个新的治疗领域。

DESCRIPTION (provided by applicant): We propose to develop a robotic architecture with music-based interactions for multi-modal stimuli and emotional robotic engagement. Through this project, we aim to enhance the engagement of children with ASD in daily activities using musical stimuli, and we propose to design dual-layer metrics for engagement in both the emotional domain and the spatial domain for emotional and social interactions. With this system the children will be stimulated, guided, and finally challenged to perform creative interactions through musically driven activities. This process will build up a semantic knowledge for the behavioral pattern of the children with ASD in response to the musical stimulus and physical activities, leading to new therapeutic solutions, which will provide an excellent foundation for prolonged treatment and positive engagement. The specific aims we will pursue are: Aim 1: To develop and evaluate the framework for musical engagement using auditory signals and musical components as well as robotic demonstration of activities such as games and dances. Aim 2: To design and evaluate a mutual learning process between the robotic agent and a child for engaging in musical activities and define a structure of individually parameterized mappings between musical stimulus and spatio-physical response of the child for maximizing interaction. Aim 3: To define and develop key metrics for the evaluation of emotional and social engagement with the robotic agent during physio-musical sessions. This proposed research will produce state-of-the-art techniques that facilitate autonomous interaction methods for robots to effectively stimulate the emotional and social interactivity of children. The innovative aspect of our proposed research is the use of musical interaction and activities to provide a new therapeutic domain for effective development in the children's emotion and social interactions.