RI-Small: Unsupervised Learning of Meaning

本研究的目标是开发新一代鲁棒、高效的无监督和半监督意义提取模型。我们的关键方法见解包括使用全局推理方法来同时考虑任务的许多语言方面，使用丰富类型的词汇依赖关系，以及半监督地使用来自网络的结构化数据，如字典，同义词典，百科全书等。我们从三个层面提取意义：单词意义、命题意义和概念意义。在单词层面上，我们正在从原始文本和在线词典等结构化资源中学习词汇关系，如下位义（瘦素是一种激素）、同义词等。在命题层面，我们正在使用全局无监督聚类模型学习谓词-参数结构，并开发学习语义框架提取器的半监督方法。在更大的结构层面上，我们正在归纳动词之间的脚本和结构化的叙事关系。这些丰富的意义模型将产生更广泛的影响，为创建具有真正语言理解能力的系统提供了关键的一步。因此，研究结果可能会影响每个领域的自然语言应用程序的创建，从教育或教程应用程序，到像法律发现这样的信息提取任务，再到会话代理。该项目的所有可交付成果将在网上提供：WordNet扩展、诱导框架和脚本、我们的时间事件分类器、语义角色、框架和脚本诱导器。

The goal of this research to to develop a new generation of robust, highlyeffective unsupervised and semi-supervised models of meaningextraction. Our key methological insights include the use ofglobal methods of inference to simultaneously consider many linguisticaspects of the task, the use of rich typed lexical dependencies,and the semi-supervised use of structured data from the web, suchas dictionaries, thesauruses, encyclopedias, and so on. We areextracting meaning at three levels: word meaning, propositionalmeaning, and conceptual meaning. At the word level, we are learninglexical relations like hyponymy (leptin is-a hormone), synonymy,and others both from raw text and from structured sources like on-linedictionaries. At the propositional level, we are learningpredicate-argument structure using a global unsupervised clusteringmodel as well as developing semi-supervised methods of learning semantic frameextractors. At a larger structural level we are inducing scriptsand structured narrative relations between verbs. These rich modelsof meaning will have a broader impact by providing a critical steptowards the creation of systems with true language understandingcapabilities. The results could thus impact the creation ofnatural-language applications in every field, from educational ortutorial applications, to information extraction tasks like legaldiscovery, to conversational agents. All deliverables of thisproject will be available on the web: WordNet expansions, inducedframes and scripts, our temporal event classifier, and semanticrole, frame, and script inducers.