Deep Learning for Dialogic Spoken Language Assessment and Learning

全世界有超过10亿的英语学习者，对自动评估和提高口语水平的方法的需求日益增长。目前，所有的口语评估系统都假设独白（单个说话者）语音或非常受约束的对话语音。口语评估和学习的下一个基本挑战之一是在非常自然的交互场景中自动评估候选人。对话评估，通过2或3人的对话评估候选人，使他们能够通过最自然的互动形式展示他们的口语能力。这通常用于评估，包括雅思等高风险考试，以及学习/教学，并允许测量和提高语言和沟通技能。自动化对话评估提出了许多重大挑战，包括没有明确的方法来接近评估，有限的注释训练数据与标准的语音识别任务相比，具有广泛的口音和说话风格，以及需要在数据中自动识别说话者。这项工作旨在利用深度学习的最新进展，并将其应用于对话评估和学习。

There is a growing demand for automatic approaches for assessing and improving spoken language proficiency with over one billion learners of English world-wide. Currently all spoken language assessment systems assume monologic (single speaker) speech or very constrained dialogic speech. One of the next fundamental challenges in spoken language assessment and learning is automatically assessing candidates in very natural interactive scenarios. Dialogic assessment, where the candidate is assessed through a 2 or 3 person conversation, allows them to demonstrate their speaking ability through the most natural form of interaction. This is commonly used for assessment, including for high stakes exams such as IELTS, and in learning/teaching, and allows both linguistic and communicative skills to be measured and improved. Automating dialogic assessment presents a number of significant challenges including no clear methodology for approaching the assessment, limited annotated training data compared with standard speech recognition tasks, with a wide range of accents and speaking styles, and the need to identify speakers automatically in the data. This work aims to take the latest advances in deep learning and apply them to dialogic assessment and learning.