The meta book and size-dependent properties of written language
The meta book and size-dependent properties of written language
复制标题
DOI：
10.1088/1367-2630/11/12/123015
复制
发表时间：
2009-12-10
影响因子：
3.3
通讯作者：
Minnhagen, Petter
中科院分区：
文献类型：
--
作者：
Bernhardsson, Sebastian;da Rocha, Luis Enrique Correa;Minnhagen, Petter
证据提出了一个系统的文本长度依赖于幂律指数伽马的一本书。随着文本长度的增加，估计的伽马值从2单调地减少到1。探讨了与扩展希普定律的直接联系。因此，如果Zipf定律是普遍适用的，那么无限的图书限制建议由gamma = 1给出，而不是期望的gamma = 2。此外，我们还探讨了系统的文本长度依赖可以用元书概念来描述的想法，元书概念是反映文本词频结构的抽象表示。根据这一概念，单个作者所写的一定长度的文本的词频分布与从同一作者所写的假想的无限完整语料库中提取的相同长度的文本具有相同的特征。
Evidence is presented for a systematic text-length dependence of the power-law index gamma of a single book. The estimated gamma values are consistent with a monotonic decrease from 2 to 1 with increasing text length. A direct connection to an extended Heap's law is explored. The infinite book limit is, as a consequence, proposed to be given by gamma = 1 instead of the value gamma = 2 expected if Zipf's law is universally applicable. In addition, we explore the idea that the systematic text-length dependence can be described by a meta book concept, which is an abstract representation reflecting the word-frequency structure of a text. According to this concept the word-frequency distribution of a text, with a certain length written by a single author, has the same characteristics as a text of the same length extracted from an imaginary complete infinite corpus written by the same author.