PunKtuator: A Multilingual Punctuation Restoration System for Spoken and Written Text
PunKtuator: A Multilingual Punctuation Restoration System for Spoken and Written Text
复制标题
PunKtuator：口语和书面文本的多语言标点符号恢复系统
DOI：
10.18653/v1/2021.eacl-demos.37
复制
发表时间：
2021
期刊：
影响因子：
--
通讯作者：
Varnith Chordia
中科院分区：
文献类型：
--
作者：
Varnith Chordia
没有标点符号或句子边界的文本转录对人类和机器来说都很难理解。标点符号通过为句子提供意义而发挥着至关重要的作用，标点符号的错误使用或放置通常会改变句子。这可能会影响人类和机器的下游任务，如语言翻译和理解，代词解析，文本摘要等。一个自动标点恢复（APR）系统，以最少的人为干预，可以提高理解的文本，并帮助用户写得更好。在本文中，我们描述了一个多任务建模方法作为一个系统来恢复标点符号在多个高资源-日耳曼语（英语和德语），罗马语（法语）-和低资源语言-印度雅利安语（印地语）达罗毗荼语（泰米尔语）-这并不需要广泛的知识的语法或语法的给定语言的口语和书面形式的文本。对于德语和给定的印度语为基础的语言，这是第一次恢复标点符号，可以作为未来工作的基线。
Text transcripts without punctuation or sentence boundaries are hard to comprehend for both humans and machines. Punctuation marks play a vital role by providing meaning to the sentence and incorrect use or placement of punctuation marks can often alter it. This can impact downstream tasks such as language translation and understanding, pronoun resolution, text summarization, etc. for humans and machines. An automated punctuation restoration (APR) system with minimal human intervention can improve comprehension of text and help users write better. In this paper we describe a multitask modeling approach as a system to restore punctuation in multiple high resource – Germanic (English and German), Romanic (French)– and low resource languages – Indo-Aryan (Hindi) Dravidian (Tamil) – that does not require extensive knowledge of grammar or syntax of a given language for both spoken and written form of text. For German language and the given Indic based languages this is the first towards restoring punctuation and can serve as a baseline for future work.