Research and Development of an Automated, Interactive, and User-Configurable Conversational Agent for Always-Available Personalized Language Tutoring

研究和开发自动化、交互式和用户可配置的对话代理，以实现始终可用的个性化语言辅导

• 批准号: 21K17779
• 负责人: Zhang Xinlei
• 金额: $ 3万
• 依托单位: The University of Tokyo
• 依托单位国家: 日本
• 项目类别: Grant-in-Aid for Early-Career Scientists
• 财政年份: 2021
• 资助国家: 日本
• 起止时间: 2021-04-01 至 2022-03-31
• 项目状态: 已结题
• 来源: https://kaken.nii.ac.jp/en/grant/KAKENHI-PROJECT-21K17779/
• 关键词: Tutoring Agent; Speech Recognition; Multi-Modal Interface; Language Learning; Device Wakeup

During the six months of conducting this project, I mainly achieved two goals: 1) Developed a prototype system to allow users to generate and customize the agent through simple text editing. The system takes a text file containing the transcript of the template speech and the user's feedback mode, then creates the tutoring agent accordingly for adaptive and personalized tutoring. It is part of a paper published in EICS 2021 now.2) Developed a novel way to allow users to awake the device by changing the prosody when speaking the keyword (e.g., Alexa) for accurate device activations. Evaluation studies show significant advantages of this method compared to Keyword Spotting based method. The results are summarized into a top-conference paper which is under review.

在进行这个项目的六个月里，我主要实现了两个目标：1）开发了一个原型系统，允许用户通过简单的文本编辑来生成和定制代理。该系统采用一个文本文件包含的模板语音和用户的反馈模式的转录，然后创建相应的辅导代理自适应和个性化的辅导。这是EICS 2021发表的一篇论文的一部分。2）开发了一种新颖的方法，允许用户在说出关键字时通过改变韵律来唤醒设备（例如，Alexa）用于准确的设备激活。评价研究表明，该方法相比，基于关键字定位的方法显着的优势。研究结果被总结成一份正在审查的顶级会议文件。

项目成果

JustSpeak: Automated, User-Configurable, Interactive Agents for Speech Tutoring

JustSpeak：用于语音辅导的自动化、用户可配置的交互式代理

• DOI: 10.1145/3459744
• 发表时间: 2021
• 期刊: Proc. ACM Hum.-Comput. Interact. 5, EICS
• 作者: Xinlei Zhang;Takashi Miyaki;and Jun Rekimoto
• 通讯作者: and Jun Rekimoto