NRI: Music-based Interactive Robotic Orchestration for Children with ASD

描述（由申请人提供）： 我们建议开发一个机器人架构与基于音乐的多模态刺激和情感的机器人参与的互动。通过这个项目，我们的目标是提高自闭症儿童在日常活动中使用音乐刺激的参与度，我们建议设计双层指标，用于情感领域和空间领域的情感和社会互动。有了这个系统，孩子们将受到刺激，引导，并最终通过音乐驱动的活动进行创造性的互动。这一过程将为ASD儿童对音乐刺激和身体活动的行为模式建立语义知识，从而产生新的治疗方案，为长期治疗和积极参与提供良好的基础。我们将追求的具体目标是：目标1：使用听觉信号和音乐组件以及游戏和舞蹈等活动的机器人演示来开发和评估音乐参与的框架。目标二：设计和评估机器人代理和儿童之间的相互学习过程，用于参与音乐活动，并定义音乐刺激和儿童的空间物理响应之间的单独参数化映射结构，以最大限度地提高交互。目标3：定义和开发关键指标，用于评估在生理-音乐会话期间与机器人代理的情感和社会参与。这项拟议的研究将产生最先进的技术，促进机器人的自主互动方法，以有效地刺激儿童的情感和社会互动。的 本研究的创新之处在于运用音乐互动与活动，为儿童情感与社会互动的有效发展提供一个新的治疗领域。

DESCRIPTION (provided by applicant): We propose to develop a robotic architecture with music-based interactions for multi-modal stimuli and emotional robotic engagement. Through this project, we aim to enhance the engagement of children with ASD in daily activities using musical stimuli, and we propose to design dual-layer metrics for engagement in both the emotional domain and the spatial domain for emotional and social interactions. With this system the children will be stimulated, guided, and finally challenged to perform creative interactions through musically driven activities. This process will build up a semantic knowledge for the behavioral pattern of the children with ASD in response to the musical stimulus and physical activities, leading to new therapeutic solutions, which will provide an excellent foundation for prolonged treatment and positive engagement. The specific aims we will pursue are: Aim 1: To develop and evaluate the framework for musical engagement using auditory signals and musical components as well as robotic demonstration of activities such as games and dances. Aim 2: To design and evaluate a mutual learning process between the robotic agent and a child for engaging in musical activities and define a structure of individually parameterized mappings between musical stimulus and spatio-physical response of the child for maximizing interaction. Aim 3: To define and develop key metrics for the evaluation of emotional and social engagement with the robotic agent during physio-musical sessions. This proposed research will produce state-of-the-art techniques that facilitate autonomous interaction methods for robots to effectively stimulate the emotional and social interactivity of children. The innovative aspect of our proposed research is the use of musical interaction and activities to provide a new therapeutic domain for effective development in the children's emotion and social interactions.