Performance of classification confidence measures in dynamic classifier systems

0423771 - ÚI 2014 RIV CZ eng J - Článek v odborném periodiku
Štefka, D. - Holeňa, Martin
Performance of classification confidence measures in dynamic classifier systems.
Neural Network World. Roč. 23, č. 4 (2013), s. 299-319. ISSN 1210-0552
Grant CEP: GA ČR GA13-17187S
Institucionální podpora: RVO:67985807
Klíčová slova: classifier combining * dynamic classifier systems * classification confidence
Kód oboru RIV: IN - Informatika
Impakt faktor: 0.412, rok: 2013

Classifier combining is a popular technique for improving classification quality. Common methods for classifier combining can be further improved by using dynamic classification confidence measures which adapt to the currently classified pattern. However, in the case of dynamic classifier systems, the classification confidence measures need to be studied in a broader context as we show in this paper, the degree of consensus of the whole classifier team plays a key role in the process. We discuss the properties which should hold for a good confidence measure, and we define two methods for predicting the feasibility of a given classification confidence measure to a given classifier team and given data. Experimental results on 6 artificial and 20 real-world benchmark datasets show that for both methods, there is a statistically significant correlation between the feasibility of the measure, and the actual improvement in classification accuracy of the whole classifier system; therefore, both feasibility measures can be used in practical applications to choose an optimal classification confidence measure.
Trvalý link: http://hdl.handle.net/11104/0229862