arrow
Return

HCFNN: High-order coverage function neural network for image classification

delete2022-11-01
delete103
PRE
AI
宁欣 (Xin Ning)
W
Weijuan Tian
Z
Zaiyang Yu
李威君 (Weijun Li) *
X
Xiao Bai *
Y
Yuebao Wang
DOI:10.1016/j.patcog.2022.108873delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Recent advances in deep neural networks (DNNs) have mainly focused on innovations in network ar-chitecture and loss function. In this paper, we introduce a flexible high-order coverage function (HCF) neuron model to replace the fully-connected (FC) layers. The approximation theorem and proof for the HCF are also presented to demonstrate its fitting ability. Unlike the FC layers, which cannot handle high-dimensional data well, the HCF utilizes weight coefficients and hyper-parameters to mine under-lying geometries with arbitrary shapes in an n-dimensional space. To explore the power and poten-tial of our HCF neuron model, a high-order coverage function neural network (HCFNN) is proposed, which incorporates the HCF neuron as the building block. Moreover, a novel adaptive optimization method for weights and hyper-parameters is designed to achieve effective network learning. Compre-hensive experiments on nine datasets in several domains validate the effectiveness and generalizability of the HCF and HCFNN. The proposed method provides a new perspective for further developments in DNNs and ensures wide application in the field of image classification. The source code is available at https://github.com/Tough2011/HCFNet.git (c) 2022 Elsevier Ltd. All rights reserved.
Keywords:
DNNs
Neuron modeling
Heuristic algorithm
Back propagation
Computer vision

Journal

Pattern Recognition cover
Pattern Recognition
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

U
university of chinese academy of sciences, cas
Scholars:
4.1W
Papers: 3.8W
Citations: 75
C
chinese academy of sciences
Scholars:
56.5W
Papers: 44.9W
Citations: 704