arrow
Return

Discrimination Neural Network Model for Binary Classification Tasks on Tabular Data

delete2023-01-01
delete1
delete
OA
AI
M
Munkhdalai, Lkhagvadorj
T
Tsendsuren Munkhdalai
J
Jang‐Eui Hong
V
Van-Huy Pham
N
Nipon Theera‐Umpon
K
Keun Ho Ryu *
DOI:10.1109/ACCESS.2023.3243919delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
For the classification task, neural network-based approaches attempt to distinguish between two distributions by determining the joint distribution of input variables for each class. However, the most challenging task is still to classify the observations in the overlapping region of two classes. In this work, we propose a new discrimination neural network (DiscNN) architecture to address this issue. Our DiscNN learns to embed the initial input into more informative representations with better discriminability between the two distributions based on the cosine embedding loss. We also train our proposed model using the few-shot learning method to extract better-generalized representations from the initial input. We applied the DiscNN model to 35 tabular datasets from the OpenML-CC18 benchmark for a binary classification task. Our model showed superior performances on 28 datasets of them. In addition, we also performed experiments on 95 imbalanced datasets from the KEEL repository. The experiment results showed that the DiscNN outperformed the state-of-the-art models, including CatBoost, LightGBM, TabNet, VIME and Scarf, by around 0.23% AUC, 0.20% G-mean, and 1.06% F1 score.
Keywords:
Data models
Task analysis
Predictive models
Neural networks
Training
Loss measurement
Prediction algorithms
Neural network
cosine similarity
classification task
imbalanced problem
tabular data

Journal

IEEE Access cover
IEEE Access
IF:
3.6
Papers:
9.8W
Citations:
29.4W

Organization

A
alphabet inc.
Scholars:
1.1K
Papers: 663
Citations: 0
C
Chungbuk National University
Scholars:
8.5K
Papers: 8.0K
Citations: 6.4K
T
Ton Duc Thang University
Scholars:
3.4K
Papers: 4.8K
Citations: 6.6K
G
Google Incorporated
Scholars:
3.5K
Papers: 1.8K
Citations: 8
researcher View more organizations
Cited Papers

Cited Papers

Client ahead‐of‐time compiler for embedded Java platforms
err2008-08-05
err0
PREAI
errSunghyun Hong; Jin‐Chul Kim; Soo‐Mook Moon; Jin Woo Shin; Jaemok Lee; Hyeong‐Seok Oh; Hyung‐Kyu Choi
errShare
errSave
Core–Shell Catalyst CuO–ZnO–Al2O3@Al2O3 for Dimethyl Ether Synthesis from Syngas
err2013-04-05
err0
PREAI
errYan Wang; Wenli Wang; Yuexian Chen; Jinghong Ma; Jiajun Zheng; Ruifeng Li
errShare
errSave
errShare
errSave
Neural Network-Augmented Locally Adaptive Linear Regression Model for Tabular Data
err2022-11-17
err2
errOAAI
errMunkhdalai, Lkhagvadorj; Munkhdalai, Tsendsuren; Van Huy Pham; Jang-Eui Hong; Keun Ho Ryu; Theera-Umpon, Nipon
errShare
errSave
Evolving Neural Networks through a Reverse Encoding Tree
err2020-07-01
err0
errOAAI
errHaoling Zhang; Chao-Han Huck Yang; Hector Zenil; Narsis A. Kiani; Yue Shen; Jesper N. Tegner
errShare
errSave
GEV-NN: A deep neural network architecture for class imbalance problem in binary classification
err2020-04-01
err24
PREAI
errMunkhdalai, Lkhagvadorj; Munkhdalai, Tsendsuren; Ryu, Keun Ho
errShare
errSave
DC discharge plasma studies for nanostructured carbon CVD
err2003-03-01
err0
PREAI
errA.N. Obraztsov; A.A. Zolotukhin; A.O. Ustinov; A.P. Volkov; Yu. Svirko; K. Jefimovs
errShare
errSave
researcher View more