Choosing lp norms in high-dimensional spaces based on hub analysis
Choosing lp norms in high-dimensional spaces based on hub analysis
复制标题
DOI:
10.1016/j.neucom.2014.11.084
复制
发表时间:
2015-12-02
期刊:
影响因子:
6
通讯作者:
Schnitzer, Dominik
中科院分区:
文献类型:
--
作者:
Flexer, Arthur;Schnitzer, Dominik
The hubness phenomenon is a recently discovered aspect of the curse of dimensionality. Hub objects have a small distance to an exceptionally large number of data points while anti-hubs lie far from all other data points. A closely related problem is the concentration of distances in high-dimensional spaces. Previous work has already advocated the use of fractional l(p) norms instead of the ubiquitous Euclidean norm to avoid the negative effects of distance concentration. However, which exact fractional norm to use is a largely unsolved problem. The contribution of this work is an empirical analysis of the relation of different l(P) norms and hubness. We propose an unsupervised approach for choosing an l(P) norm which minimizes hubs while simultaneously maximizing nearest neighbor classification. Our approach is evaluated on seven high-dimensional data sets and compared to three approaches that re-scale distances to avoid hubness. (C) 2015 The Authors. Published by Elsevier B.V. This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/).