Regularized least square discriminant projection and feature selection

Regularized least square discriminant projection and feature selection
复制标题

正则化最小二乘判别投影和特征选择

DOI:
10.1117/1.jei.23.1.013003
复制
发表时间:
2014
影响因子:
1.1
通讯作者:
Chao Gao
Chao Gao
中科院分区:
计算机科学4区
文献类型:
--
作者:
Jun Shi;Zhiguo Jiang;Danpei Zhao;Hao Feng;Chao Gao

文献摘要

参考文献

被引文献

相似文献

抽象。传统的图嵌入框架使用欧氏距离来确定相邻样本的相似性,导致图结构对离群点敏感,缺乏物理解释。此外,图的构造受到邻居参数选择的困难。基于稀疏表示的图嵌入方法虽然可以自动选择邻域参数,但计算量较大。另一方面,大多数判别投影方法无法执行特征选择。在本文中,我们提出了一种新的联合鉴别分析和特征选择方法,采用正则化最小二乘法的图形建设和l2,1-范数最小化的投影矩阵的特征选择。具体来说,我们的方法首先使用正则化的最小二乘系数来衡量类内和类间的相似性,从重建的观点。基于这种图结构,我们制定了一个目标函数与散布差准则的学习判别投影,它可以避免小样本问题。同时,对投影矩阵进行l2,1-范数最小化,以获得行稀疏性,从而选择有用的特征。在ORL和AR两个人脸库和COIL-20目标库上的实验表明,该方法不仅具有更好的分类性能,而且具有更低的计算成本。
Abstract. Conventional graph embedding framework uses the Euclidean distance to determine the similarities of neighbor samples, which causes the graph structure to be sensitive to outliers and lack physical interpretation. Moreover, the graph construction suffers from the difficulty of neighbor parameter selection. Although sparse representation (SR) based graph embedding methods can automatically select the neighbor parameter, the computational cost of SR is expensive. On the other hand, most discriminant projection methods fail to perform feature selection. In this paper, we present a novel joint discriminant analysis and feature selection method that employs regularized least square for graph construction and l2,1-norm minimization on projection matrix for feature selection. Specifically, our method first uses the regularized least square coefficients to measure the intraclass and interclass similarities from the viewpoint of reconstruction. Based on this graph structure, we formulate an object function with scatter difference criterion for learning the discriminant projections, which can avoid the small sample size problem. Simultaneously, the l2,1-norm minimization on projection matrix is applied to gain row-sparsity for selecting useful features. Experiments on two face databases (ORL and AR) and COIL-20 object database demonstrate that our method not only achieves better classification performance, but also has lower computational cost than SR.
DOI: 10.1201/b10345-5
发表时间: 2010-11
期刊: Encyclopedia of Autism Spectrum Disorders
影响因子: --
作者:
Kim-Anh Lê Cao;Z. Welham
通讯作者: Kim-Anh Lê Cao;Z. Welham
DOI: 10.1109/tip.2009.2038764
发表时间: 2010-04-01
影响因子: 10.6
作者:
Cheng, Bin;Yang, Jianchao;Huang, Thomas S.
通讯作者: Huang, Thomas S.
DOI: 10.1002/047134608x.w5513.pub2
发表时间: 2019-02
期刊: Wiley Encyclopedia of Electrical and Electronics Engineering
影响因子: --
作者:
K. Kulkarni;P. Turaga;Anuj Srivastava;Rama Chellappa
通讯作者: K. Kulkarni;P. Turaga;Anuj Srivastava;Rama Chellappa
DOI: 10.1007/978-3-0348-5495-5_8
发表时间: 2015
期刊: RSC Advances
影响因子: 3.9
作者:
Lorenzo Vaquero;V. Brea;M. Mucientes
通讯作者: Lorenzo Vaquero;V. Brea;M. Mucientes
DOI: 10.1049/iet-bmt.2018.5117
发表时间: 2016
期刊: IET Biom.
影响因子: --
作者:
Sheng He;Lambert Schomaker
通讯作者: Sheng He;Lambert Schomaker