An analysis of heuristic metrics for classifier ensemble pruning based on ordered aggregation
Cargando...
Fecha
2022-04
Título de la revista
ISSN de la revista
Título del volumen
Editor
Elsevier Ltd
Resumen
Classifier ensemble pruning is a strategy through which a subensemble can be identified via optimizing a predefined performance criterion. Choosing the optimum or suboptimum subensemble decreases the initial ensemble size and increases its predictive performance. In this article, a set of heuristic metrics will be analyzed to guide the pruning process. The analyzed metrics are based on modifying the order of the classifiers in the bagging algorithm, with selecting the first set in the queue. Some of these criteria include general accuracy, the complementarity of decisions, ensemble diversity, the margin of samples, minimum redundancy, discriminant classifiers, and margin hybrid diversity. The efficacy of those metrics is affected by the original ensemble size, the required subensemble size, the kind of individual classifiers, and the number of classes. While the efficiency is measured in terms of the computational cost and the memory space requirements. The performance of those metrics is assessed over fifteen binary and fifteen multiclass benchmark classification tasks, respectively. In addition, the behavior of those metrics against randomness is measured in terms of the distribution of their accuracy around the median. Results show that ordered aggregation is an efficient strategy to generate subensembles that improve both predictive performance as well as computational and memory complexities of the whole bagging ensemble.
Palabras clave
Classifier complementariness
Classifier ensemble
Difficult samples
Ensemble pruning
Ensemble selection
Heuristic optimization
Machine learning
Ordering-based pruning
Classifier ensemble
Difficult samples
Ensemble pruning
Ensemble selection
Heuristic optimization
Machine learning
Ordering-based pruning
Descripción
Materias
Cita
Mohammed, A. M., Onieva, E., Woźniak, M., & Martínez-Muñoz, G. (2022). An analysis of heuristic metrics for classifier ensemble pruning based on ordered aggregation. Pattern Recognition, 124. https://doi.org/10.1016/J.PATCOG.2021.108493