An analysis of four missing data treatment methods for supervised learning
An analysis of four missing data treatment methods for supervised learning
复制标题
DOI：
10.1080/08839510390219309
复制
发表时间：
2003-05-01
影响因子：
2.8
通讯作者：
Monard, MC
中科院分区：
文献类型：
--
作者：
Batista, GEAPA;Monard, MC
数据质量的一个相关问题是数据缺失。尽管丢失数据问题频繁发生且具有相关性，但许多机器学习算法以相当幼稚的方式处理丢失数据。但是，缺失数据处理要慎重处理，否则可能会在知识诱导中引入偏差。在这项工作中，我们分析了k近邻作为一种imputation方法的使用。Imputation是一个术语，表示用一些合理的值替换数据集中缺失值的过程。这种方法的一个优点是缺失的数据处理与所使用的学习算法无关。这允许用户为每种情况选择最合适的插补方法。我们的分析表明，基于k近邻算法的缺失数据插入可以优于C4.5和CN2使用的内部方法来处理缺失数据，也可以优于均值或模式插入方法，这是一种广泛用于处理缺失值的方法。
One relevant problem in data quality is missing data. Despite the frequent occurrence and the relevance of the missing data problem, many machine learning algorithms handle missing data in a rather naive way. However, missing data treatment should be carefully treated, otherwise bias might be introduced into the knowledge induced. In this work, we analyze the use of the k-nearest neighbor as an imputation method. Imputation is a term that denotes a procedure that replaces the missing values in a data set with some plausible values. One advantage of this approach is that the missing data treatment is independent of the learning algorithm used. This allows the user to select the most suitable imputation method for each situation. Our analysis indicates that missing data imputation based on the k-nearest neighbor algorithm can outperform the internal methods used by C4.5 and CN2 to treat missing data, and can also outperform the mean or mode imputation method, which is a method broadly used to treat missing values.