Collaborative Research: Language Documentation with an Artificial Intelligence (AI) Helper

协作研究：使用人工智能 (AI) 助手进行语言文档记录

• 批准号: 2109578
• 负责人: Antonios Anastasopoulos
• 金额: $ 23.97万
• 依托单位: George Mason University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2021
• 资助国家: 美国
• 起止时间: 2021-09-01 至 2025-02-28
• 项目状态: 未结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2109578&HistoricalAwards=false
• 关键词: Collaborative; Research; Language; Documentation; Artificial

Documentation of languages, especially endangered languages, is crucial for conserving humanity’s knowledge and cultural heritage, as well as for advancing an understanding of human language. Traditional documentation methods produce invaluable materials such as grammars, dictionaries, and annotated texts, but require more time than can be afforded to keep up with current language extinction rates. The most constructive response to this crisis is to complement documentation efforts by collecting data for as many languages as possible now and to make them accessible and interpretable so that they can be studied later by both linguists and members of the language communities. Digital technologies make it practical to obtain many hours of recordings in an endangered language along with translations. This project advances technologies for analyzing the recordings at the sub-word, word, and clause level so that they become accessible for a wide variety of documentary purposes.The project makes the information in digital recordings more interpretable for further linguistic analysis in three ways. First, the team is devising computational methods to automatically derive a basic phonological understanding and produce phonetic representations for languages, even if they do not have an established writing system. Second, the team is developing methods to automatically analyze the internal structure of words in languages where this structure is highly complex. Third, the team uses knowledge of more widely spoken languages to analyze related endangered languages. The resulting tool, the AI-helper toolbox, will be packaged with software that is currently widely in use by linguists and language communities in the language documentation process. All tools will be accessible through a web-based interface and the source code will be publicly available through GitHub.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

记录语言，特别是濒危语言，对于保存人类的知识和文化遗产以及促进对人类语言的理解至关重要。传统的文档方法产生了非常有价值的材料，如语法、词典和注释文本，但需要更多的时间来跟上当前的语言消失率。对这场危机最具建设性的对策是，现在通过收集尽可能多的语言的数据来补充文件工作，并使这些数据可供查阅和解释，以便以后供语言学家和语言界成员研究。数字技术使获得一种濒危语言的长达数小时的录音以及翻译成为现实。该项目提高了在子词、词和从句级别分析录音的技术，使它们可以用于各种纪录片目的。该项目使数字录音中的信息更具可解释性，以便从三个方面进行进一步的语言分析。首先，该团队正在设计计算方法，以自动获得基本的语音理解，并产生语言的语音表示，即使它们没有既定的书写系统。其次，该团队正在开发自动分析语言中单词内部结构的方法，这些语言的内部结构非常复杂。第三，该团队使用更广泛使用的语言知识来分析相关的濒危语言。由此产生的工具AI-Helper工具箱将与目前语言学家和语言社区在语言文件编制过程中广泛使用的软件打包在一起。所有工具将通过基于网络的界面访问，源代码将通过GitHub公开获得。该奖项反映了NSF的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

Revisiting the Effects of Leakage on Dependency Parsing

重新审视泄漏对依存句法分析的影响

• 发表时间: 2022
• 期刊: Transactions of the Association for Computational Linguistics
• 影响因子: 10.9
• 作者: Krasner, Nathaniel;Wanner, Miriam;Anastasopoulos, Antonios
• 通讯作者: Anastasopoulos, Antonios

Zambezi Voice: A Multilingual Speech Corpus for Zambian Languages

Zambezi Voice：赞比亚语言的多语言语音语料库

• DOI: 10.21437/interspeech.2023-1979
• 发表时间: 2023
• 期刊: Proc. INTERSPEECH 2023
• 作者: Sikasote, Claytone;Siaminwe, Kalinda;Mwape, Stanly;Zulu, Bangiwe;Phiri, Mofya;Phiri, Martin;Zulu, David;Nyirenda, Mayumbo;Anastasopoulos, Antonios
• 通讯作者: Anastasopoulos, Antonios

Script Normalization for Unconventional Writing of Under-Resourced Languages in Bilingual Communities

双语社区资源贫乏语言的非常规写作的脚本规范化

• DOI: 10.18653/v1/2023.acl-long.809
• 发表时间: 2023
• 期刊: Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics
• 作者: Ahmadi, Sina;Anastasopoulos, Antonios
• 通讯作者: Anastasopoulos, Antonios

PALI: A Language Identification Benchmark for Perso-Arabic Scripts

PALI：波斯阿拉伯文字的语言识别基准

• 发表时间: 2023
• 期刊: Varieties and Dialects (VarDial 2023
• 作者: Ahmadi, Sina;Agarwal, Milind;Anastasopoulos, Antonios
• 通讯作者: Anastasopoulos, Antonios

Approaches to Corpus Creation for Low-Resource Language Technology: the Case of Southern Kurdish and Laki

低资源语言技术的语料库创建方法：以南库尔德语和拉基语为例

• 发表时间: 2023
• 期刊: Proceedings of the Second Workshop on NLP Applications to Field Linguistics
• 作者: Ahmadi, Sina;Azin, Zahra;Belelli, Sara;Anastasopoulos, Antonios
• 通讯作者: Anastasopoulos, Antonios