Hardness of Maximum Likelihood Learning of DPPs

Hardness of Maximum Likelihood Learning of DPPs
复制标题

DOI:
10.48550/arxiv.2205.12377
复制
发表时间:
2022-05
期刊:
Electron. Colloquium Comput. Complex.
影响因子:
--
通讯作者:
Elena Grigorescu;Brendan Juba;K. Wimmer;Ning Xie
Elena Grigorescu;Brendan Juba;K. Wimmer;Ning Xie
中科院分区:
其他
文献类型:
--
作者:
Elena Grigorescu;Brendan Juba;K. Wimmer;Ning Xie

文献摘要

相似文献

确定点过程(DPP)是一个较广泛的概率模型。 ize在有限的DPP家族中,或者使用局部改进的启发式方法没有提供最佳的理论保证。 RA, Rigolt and Urschel(2017a)猜测,与Kulesza的猜想相反,有一种多项式时算法,用于计算最大的可能性DPP。近似与地面DPP的最大对数似然性n个元素的集合是NP完整的。 ,聚类(Zou和2012; Kang, 2013;和Ghahramani,2013年),推荐系统(Zhou等,2010),收入最大化(Dughmi等,2009),多代理增强和AL。,2020
Determinantal Point Processes (DPPs) are a widely used probabilistic model for negatively corre-lated sets. DPPs have been successfully employed in Machine Learning applications to select a diverse, yet representative subset of data. In these applications, the parameters of the DPP need to be fitted to match the data; typically, we seek a set of parameters that maximize the likelihood of the data. The algorithms used for this task to date either optimize over a limited family of DPPs, or use local improvement heuristics that do not provide theoretical guarantees of optimality. It is natural to ask if there exist efficient algorithms for finding a maximum likelihood DPP model for a given data set. In seminal work on DPPs in Machine Learning, Kulesza conjectured in his PhD Thesis (2012) that the problem is NP-complete. The lack of a formal proof prompted Brunel, Moitra, Rigollet and Urschel (2017a) to conjecture that, in opposition to Kulesza’s conjecture, there exists a polynomial-time algorithm for computing a maximum-likelihood DPP. They also presented some preliminary evidence supporting their conjecture. In this work we prove Kulesza’s conjecture. In fact, we prove the following stronger hardness of approximation result: even computing a 1 − 1 polylog N -approximation to the maximum log-likelihood of a DPP on a ground set of N elements is NP-complete. At the same time, we also obtain the first polynomial-time algorithm that achieves a nontrivial worst-case approximation to the optimal log-likelihood: the approximation factor is unconditionally (for data sets that consist of al., 2013b; et al., 2015; Affandi et al., 2013a), signal processing (Xu and Ou, Krause et al., Guestrin et al., 2005), clustering (Zou and 2012; Kang, 2013; and Ghahramani, 2013), recommendation systems (Zhou et al., 2010), revenue maximization (Dughmi et al., 2009), multi-agent reinforcement and al., 2020), modeling neural sketching for linear and low-rank