arrow
Return

Multithreshold Entropy Linear Classifier: Theory and applications

delete2015-08-01
delete23
delete
OA
AI
W
Wojciech Marian Czarnecki *
J
Jacek Tabor
DOI:10.1016/j.eswa.2015.03.007delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
This paper proposes a new multithreshold linear classifier (MELC) based on the Renyi's quadratic entropy and Cauchy-Schwarz divergence, combined with the adaptive kernel density estimation in the one dimensional projections space. Due to its nature MELC is especially well adapted to deal with unbalanced data. As the consequence of both used model and the applied density regularization technique, it shows strong regularization properties and therefore is almost unable to overfit. Moreover, contrary to SVM, in its basic form it has no free parameters, however, at the cost of being a non-convex optimization problem which results in the existence of local optima and the possible need for multiple initializations. In practice, MELC obtained similar or higher scores than the ones given by SVM on both synthetic and real data from the UCI repository. We also perform experimental evaluation of proposed method as a part of expert system designed for drug discovery problem. It appears that not only MELC achieves better results than SVM but also gives some additional insights into data structure, resulting in more complex decision support system. (C) 2015 Elsevier Ltd. All rights reserved.
Keywords:
Classification
Renyi's entropy
Density estimation
Multithreshold classifier
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Expert Systems with Applications cover
Expert Systems with Applications
IF:
7.5
Papers:
2.9W
Citations:
10.2W

Organization

J
jagiellonian university
Scholars:
2.2W
Papers: 1.8W
Citations: 11