An Information-Theoretic View of Stochastic Localization
An Information-Theoretic View of Stochastic Localization
复制标题
DOI:
10.1109/tit.2022.3180298
复制
发表时间:
2021-09
影响因子:
2.5
通讯作者:
Ahmed El Alaoui;A. Montanari
中科院分区:
文献类型:
--
作者:
Ahmed El Alaoui;A. Montanari
Given a probability measure $\mu $ over $\mathbb {R}^{n}$ , it is often useful to approximate it by the convex combination of a small number of probability measures, such that each component is close to a product measure. Recently, Ronen Eldan used a stochastic localization argument to prove a general decomposition result of this type. In Eldan’s theorem, the ‘number of components’ is characterized by the entropy of the mixture, and ‘closeness to product’ is characterized by the covariance matrix of each component. We present an elementary proof of Eldan’s theorem which makes use of an information theory (or estimation theory) interpretation. The proof is analogous to the one of an earlier decomposition result known as the ‘pinning lemma.’