arrow
Return

Optimize TSK Fuzzy Systems for Classification Problems: Minibatch Gradient Descent With Uniform Regularization and Batch Normalization

delete2020-12-01
delete55
delete
OA
AI
Y
Yuqi Cui
D
Dongrui Wu
J
Jian Huang *
DOI:10.1109/TFUZZ.2020.2967282delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Takagi-Sugeno-Kang (TSK) fuzzy systems are flexible and interpretable machine learning models; however, they may not be easily optimized when the data size is large, and/or the data dimensionality is high. This article proposes a minibatch gradient descent (MBGD) based algorithm to efficiently and effectively train TSK fuzzy classifiers. It integrates two novel techniques: First, uniform regularization (UR), which forces the rules to have similar average contributions to the output, and hence to increase the generalization performance of the TSK classifier; and, second, batch normalization (BN), which extends BN from deep neural networks to TSK fuzzy classifiers to expedite the convergence and improve the generalization performance. Experiments on 12 UCI datasets from various application domains, with varying size and dimensionality, demonstrated that UR and BN are effective individually, and integrating them can further improve the classification performance.
Keywords:
Training
Fuzzy systems
Neural networks
Convergence
Optimization
Evolutionary computation
Standards
Batch normalization (BN)
minibatch gradient descent
Takagi– Sugeno– Kang (TSK) fuzzy classifier
uniform regularization (UR)
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Fuzzy Systems cover
IEEE Transactions on Fuzzy Systems
IF:
11.9
Papers:
4.9K
Citations:
2.9W

Organization

No organization information available