A Language Acquisition Support System that Presents Differences and Distances from Model Speech

A Language Acquisition Support System that Presents Differences and Distances from Model Speech
复制标题

呈现与模型语音的差异和距离的语言习得支持系统

DOI:
10.1145/3474349.3480225
复制
发表时间:
2021
期刊:
The Adjunct Publication of the 34th Annual ACM Symposium on User Interface Software and Technology. Association for Computing Machinery
影响因子:
--
通讯作者:
Kazuki Kawamura and Jun Rekimoto
Kazuki Kawamura and Jun Rekimoto
中科院分区:
--
文献类型:
--
作者:
Yang Li;Tatsuya Harada;Kazuki Kawamura and Jun Rekimoto

文献摘要

相似文献

语言学习者很难知道自己说得好不好,如果说得不好,也很难知道自己的语言与本族语者的语言有什么不同,以及他们的语言与本族语者的语言有多大不同。因此,我们提出了一个新的语言学习系统,解决这些问题。该系统使用自监督学习来确定用户的语音是否良好。该系统还通过突出显示用户语音波形上的对应位置来显示用户语音与母语者语音的不同之处。它还将学习者的语音和母语者的语音表示为二维坐标上的点,以向用户显示它们之间的距离。我们期望通过反复修改语音来消除这些差异,拉近距离,学习者的语音会逐渐变得更好。
It is difficult for language learners to know whether they are speaking well and, if not, to know where their speech differs from that of native speakers and how much their speech differs from that of native speakers. Therefore, we propose a novel language learning system that solves these problems. The system uses self-supervised learning to determine whether the user’s speech is good or not. The system also shows where the user’s speech differs from the native speaker’s speech by highlighting the corresponding places on the user’s speech waveform. It also represents the learner’s speech and the native speaker’s speech as points on a two-dimensional coordinate to show the user how far apart they are. We expect that the learner’s speech will gradually become better by repeatedly modifying the speech to eliminate these differences and bring the distance closer.