arrow
Return

VexNet: Vector-Composed Feature-Oriented Neural Network

delete2025-05-07
delete0
delete
OA
AI
X
Xiao Du
Z
Ziyou Guo
Z
Zihao Li
Y
Yang Cao
X
Xing Chen
伍铁如 cover
伍铁如 (Tieru Wu) *
DOI:10.3390/electronics14091897delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Extracting robust features against geometric transformations and adversarial perturbations remains a critical challenge in deep learning. Although capsule networks exhibit resilience through vector-encapsulated features and dynamic routing, they suffer from computational inefficiency due to iterative routing, dense matrix operations, and extra activation scalars. To address these limitations, we propose a method that integrates (1) compact vector-grouped neurons to eliminate activation scalars, (2) a non-iterative voting algorithm that preserves spatial relationships with reduced computation, and (3) efficient weight-sharing strategies that balance computational efficiency with generalizability. Our approach outperforms existing methods in image classification on CIFAR-10 and SVHN, achieving up to a 0.31% increase in accuracy with fewer parameters and lower FLOPs. Evaluations demonstrate superior performance over competing methods, with 0.31% accuracy gains on CIFAR-10/SVHN (with reduced parameters and FLOPs) and 1.93%/1.09% improvements in novel-view recognition on smallNORB. Under FGSM and BIM attacks, our method reduces attack success rates by 47.7% on CIFAR-10 and 32.4% on SVHN, confirming its enhanced robustness and efficiency. Future work will extend vexel representations to MLPs and RNNs and explore applications in computer graphics, natural language processing, and reinforcement learning.
Keywords:
deep learning
computer vision
image classification
adversarial attack
feature extraction

Journal

Electronics cover
Electronics
IF:
2.6
Papers:
1.1W
Citations:
4.7W

Organization

No organization information available
Cited Papers

Cited Papers

Backpropagation Applied to Handwritten Zip Code Recognition
err1989-12-01
err0
PREAI
errY. LeCun; B. Boser; J. S. Denker; D. Henderson; R. E. Howard; W. Hubbard; L. D. Jackel
errShare
errSave
Learning Spatiotemporal Features with 3D Convolutional Networks
err2015-12-01
err0
errOAAI
errDu Tran; Lubomir Bourdev; Rob Fergus; Lorenzo Torresani; Manohar Paluri
errShare
errSave
ImageNet Large Scale Visual Recognition Challenge
err2015-04-11
err2.7W
PREAI
errRussakovsky, Olga; Deng, Jia; Su, Hao; Krause, Jonathan; Satheesh, Sanjeev; Ma, Sean; Huang, Zhiheng; Karpathy, Andrej; Khosla, Aditya; Bernstein, Michael; Berg, Alexander C.; Fei-Fei, Li
errShare
errSave
ImageNet Classification with Deep Convolutional Neural Networks
err2017-05-24
err8.3W
errOAAI
errKrizhevsky, Alex; Sutskever, Ilya; Hinton, Geoffrey E.
errShare
errSave
Neural Networks for Pattern Recognition
err
IF0
err2023-10-31
err0
errOAAI
errChristopher M Bishop
errShare
errSave
Capsule Networks With Residual Pose Routing
err2025-02-01
err22
errOAAI
errLiu, Yi; Cheng, De; Zhang, Dingwen; Xu, Shoukun; Han, Jungong
errShare
errSave
A Stochastic Approximation Method
err1951-09-01
err0
errOAAI
errHerbert Robbins; Sutton Monro
errShare
errSave
researcher View more