Efficient Density Evaluation for Smooth Kernels
Efficient Density Evaluation for Smooth Kernels
复制标题
光滑内核的有效密度评估
DOI:
10.1109/focs.2018.00065
复制
发表时间:
2018
期刊:
影响因子:
--
通讯作者:
Paris Siminelakis
中科院分区:
文献类型:
--
作者:
A. Backurs;M. Charikar;P. Indyk;Paris Siminelakis
Given a kernel function k(.,.) and a dataset P⊂ R^d, the kernel density function of P at a point xε R^d is equal to KDF_P(x):= 1/|P| Σ_yεP k(x, y). Kernel density evaluation has numerous applications, in scientific computing, statistics, computer vision, machine learning and other fields. In all of them it is necessary to evaluate KDF_P(x) quickly, often for many inputs x and large point-sets P. In this paper we present a collection of algorithms for efficient KDF evaluation under the assumptions that the kernel k is "smooth", i.e. the value changes at most polynomially with the distance. This assumption is satisfied by several well-studied kernels, including the (generalized) t-student kernel and rational quadratic kernel. For smooth kernels, we give a data structure that, after O(dn log (Φ n)/ε^2) preprocessing, estimates KDF_P(x) up to a factor of 1 ± ε in O(dlog (Φ n)/ε^2) time, where Phi; is the aspect ratio. The log(Φn) term can be further replaced by log n under an additional decay condition on k, which is satisfied by the aforementioned examples. We further extend the results in two ways. First, we use low-distortion embeddings to extend the results to kernels defined for spaces other than ℓ_2. The key feature of this reduction is that the distortion of the embedding affects only the running time of the algorithm, not the accuracy of the estimation. As a result, we obtain (1+ε)-approximate estimation algorithms for kernels over other ℓ_p norms, Earth-Mover Distance, and other metric spaces. Second, for smooth kernels that are decreasing with distance, we present a general reduction from density estimation to approximate near neighbor in the underlying space. This allows us to construct algorithms for general doubling metrics, as well as alternative algorithms for l_p norms and other spaces.
影响因子:
3.7
作者:
Xu, Siyi;Huang, Jinlan;Xun, Zhen;Li, Shiqi;Fu, Ya;Lin, Ni;Wu, Wennan;Chen, Tianbin;Liu, Can;Ou, Qishui
通讯作者:
Ou, Qishui