arrow
Return

Neurodynamical classifiers with low model complexity

delete2020-12-01
delete1
delete
OA
AI
H
Himanshu Pant
S
Sumit Soman
J
Jayadeva *
A
Amit Bhaya
DOI:10.1016/j.neunet.2020.08.013delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
The recently proposed Minimal Complexity Machine (MCM) finds a hyperplane classifier by minimizing an upper bound on the Vapnik-Chervonenkis (VC) dimension. The VC dimension measures the capacity or model complexity of a learning machine. Vapnik's risk formula indicates that models with smaller VC dimension are expected to show improved generalization. On many benchmark datasets, the MCM generalizes better than SVMs and uses far fewer support vectors than the number used by SVMs. In this paper, we describe a neural network that converges to the MCM solution. We employ the MCM neurodynamical system as the final layer of a neural network architecture. Our approach also optimizes the weights of all layers in order to minimize the objective, which is a combination of a bound on the VC dimension and the classification error. We illustrate the use of this model for robust binary and multi-class classification. Numerical experiments on benchmark datasets from the UCI repository show that the proposed approach is scalable and accurate, and learns models with improved accuracies and fewer support vectors. (c) 2020 Elsevier Ltd. All rights reserved.
Keywords:
Linear programming
Neural network
VC dimension
Minimal Complexity Machine
Classification
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Neural Networks cover
Neural Networks
IF:
6.3
Papers:
7.8K
Citations:
3.0W

Organization

I
indian institute of technology (iit) - delhi
Scholars:
5.6K
Papers: 5.5K
Citations: 2
I
indian institute of technology system (iit system)
Scholars:
9.5W
Papers: 9.9W
Citations: 93