Guided HTM: Hierarchical Topic Model with Dirichlet Forest Priors
Guided HTM: Hierarchical Topic Model with Dirichlet Forest Priors
复制标题
DOI：
10.1109/tkde.2016.2625790
复制
发表时间：
2017-02
影响因子：
8.9
通讯作者：
Su-Jin Shin;Il-Chul Moon
中科院分区：
文献类型：
--
作者：
Su-Jin Shin;Il-Chul Moon
尽管主题模型越来越多，但从概率模型中组织主题需要在两个方面进行改进：更好地结构化主题表示和在语料库中纳入领域知识。结构化的表示，即分层主题模型，有助于对类似主题进行分类；领域知识的引入使得混合参数学习中预定义关键字的集中采样成为可能。本文提出了一种引入领域知识的分层主题模型，称为引导分层主题模型（GHTM）。具体来说，我们将知识中的先验信息分配到Dirichlet Forest先验中。从先验的调整中，我们得到了以领域知识为导向的主题树。本文还列举了四种不同的知识提取方法，并将提取的知识应用于GHTM。我们从层次聚类精度方面评估了GHTM的性能，我们发现用F-measures测量的层次聚类有显著的改进。这种改进也通过困惑度分析得到了验证。此外，我们用KL-divergence和可视化来衡量主题质量，这些都证实了更好地分离主题分布的能力。最后，我们通过人体实验对分层主题质量进行了测试，这也揭示了来自指导的显著改进。
Despite the proliferation of topic models, the organization of topics from the probabilistic models needs improvement in two ways: the better structured presentation of topics and the incorporation of domain knowledge on the corpus. The structured presentation, i.e., the hierarchical topic model, helps in categorizing similar topics; the incorporation of domain knowledge enables the concentrated sampling of predefined keywords in the mixture parameter learning. This paper presents a hierarchical topic models with incorporated domain knowledge, called Guided Hierarchical Topic Model (GHTM). Specifically, we allocated the prior information from the knowledge to the Dirichlet Forest prior. From the prior adjustment, we obtained the topic tree guided by the domain knowledge. This paper also contributes in enumerating four different knowledge extraction methods and applying the extracted knowledge to GHTM. We evaluated the performance of GHTM in terms of the hierarchical clustering accuracy, and we found a significant improvement of hierarchical clustering measured by F-measures. This improvement is also verified by the perplexity analyses. Additionally, we measured topic quality with KL-divergence and visualization, and these confirm the ability to better separate topic distributions. Finally, we tested the hierarchical topic quality through human experiments, and this also revealed significant improvements originating from the guidance.