Rethinking Collapsed Variational Bayes Inference for LDA
Rethinking Collapsed Variational Bayes Inference for LDA
复制标题
DOI:
--
复制
发表时间:
2012-06
期刊:
影响因子:
--
通讯作者:
Issei Sato;Hiroshi Nakagawa
中科院分区:
文献类型:
--
作者:
Issei Sato;Hiroshi Nakagawa
We propose a novel interpretation of the collapsed variational Bayes inference with a zero-order Taylor expansion approximation, called CVB0 inference, for latent Dirichlet allocation (LDA). We clarify the properties of the CVB0 inference by using the α-divergence. We show that the CVB0 inference is composed of two different divergence projections: α = 1 and -1. This interpretation will help shed light on CVB0 works.