The information conveyed by words in sentences
The information conveyed by words in sentences
复制标题
DOI：
10.1023/a:1022492123056
复制
发表时间：
2003-03-01
影响因子：
2
通讯作者：
Hale, J
中科院分区：
文献类型：
--
作者：
Hale, J
提出了一种方法，用于计算由说话者发出由双方已知的概率语法生成的句子传达给听者的信息量。该方法将 Grenander (1967) 的工作应用于自顶向下解析器的中间状态。这使得可以在句子中的每个点计算结构歧义的不确定性。在连续的点上减去这些值就可以得到句子中单词所传达的信息。所传达的逐字信息是针对几个小概率语法进行计算的，并且建议每个字所传达的位数是阅读时间和认知负荷的其他度量的决定因素。
A method is presented for calculating the amount of information conveyed to a hearer by a speaker emitting a sentence generated by a probabilistic grammar known to both parties. The method applies the work of Grenander (1967) to the intermediate states of a top-down parser. This allows the uncertainty about structural ambiguity to be calculated at each point in a sentence. Subtracting these values at successive points gives the information conveyed by a word in a sentence. Word-by-word information conveyed is calculated for several small probabilistic grammars, and it is suggested that the number of bits conveyed per word is a determinant of reading times and other measures of cognitive load.