arrow
Return

Adaptive neural tree exploiting expert nodes to classify high-dimensional data

delete2020-04-01
delete10
PRE
AI
S
Shadi Abpeikar
M
Mehdi Ghatee
G
Gian Luca Foresti *
C
Christian Micheloni
DOI:10.1016/j.neunet.2019.12.029delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Classification of high dimensional data suffers from curse of dimensionality and over-fitting. Neural tree is a powerful method which combines a local feature selection and recursive partitioning to solve these problems, but it leads to high depth trees in classifying high dimensional data. On the other hand, if less depth trees are used, the classification accuracy decreases or over-fitting increases. This paper introduces a novel Neural Tree exploiting Expert Nodes (NTEN) to classify high-dimensional data. It is based on a decision tree structure, whose internal nodes are expert nodes performing multidimensional splitting. Any expert node has three decision-making abilities. Firstly, they can select the most eligible neural network with respect to the data complexity. Secondly, they evaluate the over-fitting. Thirdly, they can cluster the features to jointly minimize redundancy and overlapping. To this aim, metaheuristic optimization algorithms including GA, NSGA-II, PSO and ACO are applied. Based on these concepts, any expert node splits a class when the over-fitting is low, and clusters the features when the over-fitting is high. Some theoretical results on NTEN are derived, and experiments on 35 standard data show that NTEN reaches good classification results, reduces tree depth without over-fitting and degrading accuracy. (C) 2020 Elsevier Ltd. All rights reserved.
Keywords:
Neural tree
Expert systems
High-dimensional features
Data complexity
Feature clustering
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Neural Networks cover
Neural Networks
IF:
6.3
Papers:
7.8K
Citations:
3.0W

Organization

A
Amirkabir University of Technology
Scholars:
1.1W
Papers: 1.1W
Citations: 1.0W
U
University of Udine
Scholars:
8.3K
Papers: 6.8K
Citations: 6.7K