CAREER: Modeling Language Evolution via Deep Probabilistic Factorization

当代和历史语言、方言和书写系统的广泛多样性对必须处理语言数据的人工智能(AI)系统(例如，自动识别手写或尝试从一种语言翻译成另一种语言的系统)提出了令人生畏的挑战。然而，在这种巨大的多样性中，有很强的规律性模式。历史语言学家已经证明，语言的许多方面都是随着时间的推移而演变的，包括口语、拼写，甚至符号的视觉外观。该项目旨在开发新的人工智能框架，通过自动分析由多种语言、方言和书写系统组成的大型且多样化的数据集，从而更好地理解语言多样性。该项目将产生一系列新的人工智能系统，跟踪语言的视觉和文本方面如何随着时间的推移而演变，以(1)更好地了解语言的变化和发展，以及(2)使下游的人工智能系统对语言多样性更加健壮。最后，这项研究还将支持加州大学圣地亚哥分校对不同学科的研究生进行跨学科培训，以及为对人工智能感兴趣的高中生开发跨学科教育模块。这个职业项目将开发一个新的计算框架，将矩阵和张量因式分解的方法与深度生成建模技术相结合，以支持对广泛的语言、方言和书写系统的语言演变的分析。该项目将创建一种学习范式，即(1)将先前的语言历史系统学知识作为结构化的先验知识，(2)支持使用神经解码器对历史语言形式进行有效的近似推理，(3)可以很容易地移植到各种语言领域和语言表达水平，以及(4)直接分析原始数据(例如，标志图像)，而不是人工编制的特征列表。此外，该框架将推广到视觉和文本两种形式，从而能够研究多模式的自然语言进化--例如，文字通过视觉变化进化，同源词通过语音或拼写变化进化--并可能为未来研究文字和方言如何共同进化或口语的文化进化研究奠定基础。最后，几项应用研究的每一项结果都可能为特定的历史和古地理假说带来新的证据。这一裁决反映了NSF的法定使命，并通过使用基金会的智力价值和更广泛的影响审查标准进行评估，被认为值得支持。

The broad diversity of contemporary and historical languages, dialects, and writing systems presents a daunting challenge for artificial intelligence (AI) systems that must process language data (e.g. systems that automatically recognize handwriting or attempt to translate from one language to another). However, within this great diversity, there are strong patterns of regularity. Historical linguists have shown that many aspects of language evolve over time in accordance with regular patterns of change, including spoken language, spelling, and even the visual appearance of symbols. This project aims to develop novel AI frameworks that can better understand language diversity by automatically analyzing large and diverse datasets consisting of many languages, dialects, and writing systems. The project will result in a collection of new AI systems that track how visual and textual aspects of language evolve over time in order to (1) provide better understanding of how languages change and develop and (2) make downstream AI systems more robust to language diversity. Finally, this research will also support interdisciplinary training of a diverse set of graduate students at the University of California San Diego, as well as the development of interdisciplinary educational modules for high school students interested in AI. This CAREER project will develop a novel computational framework that combines methods from matrix and tensor factorization with deep generative modeling techniques to support analysis of language evolution over a broad range of languages, dialects, and writing systems. The project will create a learning paradigm that (1) incorporates prior phylogenetic knowledge of language history as structured priors, (2) supports efficient approximate inference of historical language forms using neural decoders, (3) is easily portable to a variety of linguistic domains and levels of language representation, and (4) directly analyzes primary data (e.g. images of signs) rather than manually-curated feature lists. Further, the framework will generalize across both visual and textual modalities, allowing for study of the multi-modal nature language evolution -- e.g. scripts evolve through visual change, cognates through phonetic or orthographic change -- and potentially laying the groundwork for future work investigating how script and dialect co-evolve or cultural evolution studies of spoken audio. Finally, the outcomes of each of several applied studies may lead to new evidence for specific historical and paleographic hypotheses.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.