Rethinking statistical learning theory: learning using statistical invariants
Rethinking statistical learning theory: learning using statistical invariants
复制标题
DOI:
10.1007/s10994-018-5742-0
复制
发表时间:
2019-03-01
期刊:
影响因子:
7.5
通讯作者:
Izmailov, Rauf
中科院分区:
文献类型:
--
作者:
Vapnik, Vladimir;Izmailov, Rauf
This paper introduces a new learning paradigm, called Learning Using Statistical Invariants (LUSI), which is different from the classical one. In a classical paradigm, the learning machine constructs a classification rule that minimizes the probability of expected error; it is data-driven model of learning. In the LUSI paradigm, in order to construct the desired classification function, a learning machine computes statistical invariants that are specific for the problem, and then minimizes the expected error in a way that preserves these invariants; it is thus both data- and invariant-driven learning. From a mathematical point of view, methods of the classical paradigm employ mechanisms of strong convergence of approximations to the desired function, whereas methods of the new paradigm employ both strong and weak convergence mechanisms. This can significantly increase the rate of convergence.