Compressible spectral mixture kernels with sparse dependency structures for Gaussian processes
Compressible spectral mixture kernels with sparse dependency structures for Gaussian processes
复制标题
DOI：
10.1016/j.sigpro.2023.109179
复制
发表时间：
2023
期刊：
影响因子：
--
通讯作者：
Shuguang Cui
中科院分区：
文献类型：
--
作者：
Kai Chen;Feng Yin;Shuguang Cui
Spectral mixture (SM) kernels comprise a powerful class of generalized kernels for Gaussian processes (GPs) to describe complex patterns. This paper introduces model compression and time- and phase (TP) modulated dependency structures to the original (SM) kernel for improved generalization of GPs. Specifically, by adopting Bienaymé’s identity, we generalize the dependency structure through cross-covariance between the SM components. Then, we propose a novel SM kernel with a dependency structure (SMD) by using cross-convolution between the SM components. Furthermore, we ameliorate the expressiveness of the dependency structure by parameterizing it with time and phase delays. The dependency structure has clear interpretations in terms of spectral density, covariance behavior, and sampling path. To enrich the SMD with effective hyperparameter initialization, compressible SM kernel components, and sparse dependency structures, we introduce a novel structure adaptation (SA) algorithm in the end. A thorough comparative analysis of the SMD on both synthetic and real-life applications corroborates its efficacy.
