The psychometric, behavioral, and neurological role of empirically-identified semantic components

我的研究兴趣是理解单词如何有意义(语义学)。在过去，许多对语义的解释都是循环的，因为它们是根据语义规则、判断或特征进行的。我对自然语义学特别感兴趣，例如，用与生物科学中的其他工作兼容的术语来解释它，并且不对语言的特殊做出任何特殊的假设。这项应用特别关注研究人类行为与从语义计算模型(共现模型)中提取的主成分的关系，该计算模型是通过预测大型语料库中的单词上下文而得出的。共现模型将目标词在大型文本语料库中的上下文表示为对目标词的上下文进行编码的向量(一串数字)，从而从词的用法中引导词义。在共现模型中，词向量之间的距离可以用来估计两个词之间的语义相似度。单个词的向量与来自单个语义类别的多个词的平均向量之间的距离(我称之为类别定义向量，或CDV)是衡量类别成员资格的良好指标。例如，十种哺乳动物的媒介的最近邻居将是其他哺乳动物。最近的共现模型是预测模型，其中使用了一种令人惊讶的简单的计算工具(简单的三层神经网络)来预测单词的上下文。该模型与动物学习模型--Rescorla-Wagner模型密切相关。因此，新的预测模型令人兴奋，因为它们表明，词汇语义可能可以用比较心理学的标准判别学习原则来解释。我将进行一系列实验，帮助我们了解语义模型是如何组织的，以及它们的组织是否反映在人类心理组织中。这些实验寻找语义成分的行为或神经相关性，这些语义成分是从语言的预测共现模型中数学推导出来的(使用主成分分析)，该模型在30亿字的文本语料库上进行训练。行为相关性是人类反应的模式，可以反映语义成分的结构，即实验参与者应该更快地对我们在数学上找到的最重要的变异轴上负载最强的单词做出决定。神经学上的相关性是与这些变异轴相关的大脑活动模式。这项拟议的研究之所以重要，是因为它将测试动物学习理论对词汇语义学解释的行为和神经可信性，从而开辟一条将高级认知与这些成熟、充分指定和简单的学习模型统一起来的途径。

My research interest is in understanding how words have meaning (semantics). In the past many explanations of semantics have been circular since they have been cast in terms of semantic rules, judgments, or features. I am particularly interested in naturalizing' semantics, e.g. explaining it in terms that are compatible with other work in the biological sciences and that do not make any special assumptions about language as special'. This application focuses specifically on studying the relation of human behavior to the principal components extracted from a computational model of semantics derived from predicting word context in a large corpus (a co-occurrence model). Co-occurrence models represent a target word's context in a large corpus of text as a vector (a string of numbers) that encodes the target word's context, thereby bootstrapping word meaning from word usage. In co-occurrence models, the distance between word vectors can be used to estimate semantic similarity of two words. Distances of a single word's vector from the average vector of multiple words from a single semantic category (which I call the category-defining vector, or CDV) are good measure of category membership. For example, the closest neighbours of the vectors for ten mammals will be other mammals. Recent co-occurrence models are prediction models, in which a surprisingly simple computational tool (a simple three-layer neural network) is used to predict a word's context. This model is closely related to an animal learning model, the Rescorla-Wagner model. The new prediction models are therefore exciting because they suggest that lexical semantics may be explicable using standard discriminant learning principles from comparative psychology. I will undertake a series of experiments that can help us understand how semantic models are organized, and whether their organization is mirrored in human psychological organization. These experiments look for either behavioral or neurological correlates of semantic components that have been derived mathematically (using principal components analysis) from a prediction co-occurrence model of language trained on a corpus of three billion words of text. The behavioral correlates are patterns of human response that may reflect the structure of the semantic components, i.e. experimental participants should be faster to make decisions about the words most strongly loaded on the most important axes of variance that we have found mathematically. The neurological correlates are patterns of brain activity that correlate with those axes of variance. The proposed research is important because it will provide tests of the behavioral and neurological plausibility of animal learning theory accounts of lexical semantics, thereby opening a path to unifying higher-order cognition with these well-established, fully-specified, and simple models of learning.