Axiomatic Characterizations of Information Measures
Axiomatic Characterizations of Information Measures
复制标题
DOI：
10.3390/e10030261
复制
发表时间：
2008-09-01
期刊：
影响因子：
2.7
通讯作者：
Csiszar, Imre
中科院分区：
文献类型：
--
作者：
Csiszar, Imre
对Shannon熵、Kullback I-散度和一些广义信息测度的公理化刻画进行了综述。三个方向处理：（A）表征的概率分布函数适合作为信息措施。(B)在{1，..}的子集上的集函数的特征N}，可由N维随机向量的分量的联合熵表示。(C)MaxEnt的公理化特征和相关推理规则。本文最后简要讨论了信息论的公理化方法的相关性。
Axiomatic characterizations of Shannon entropy, Kullback I-divergence, and some generalized information measures are surveyed. Three directions are treated: (A) Characterization of functions of probability distributions suitable as information measures. (B) Characterization of set functions on the subsets of {1,...,N} representable by joint entropies of components of an N-dimensional random vector. (C) Axiomatic characterization of MaxEnt and related inference rules. The paper concludes with a brief discussion of the relevance of the axiomatic approach for information theory.