arrow
Return

Generating information for small data sets with a multi-modal distribution

delete2014-10-01
delete21
PRE
AI
D
Der‐Chiang Li *
L
Liang-Sian Lin
DOI:10.1016/j.dss.2014.06.004delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Virtual sample generation approaches have been used with small data sets to enhance classification performance in a number of reports. The appropriate estimation of data distribution plays an important role in this process, with performance usually better for data sets that have a simple distribution rather than a complex one. Mixed-type data sets often have a multi-modal distribution instead of a simple, uni-modal one. This study thus proposes a new approach to detect multi-modality in data sets, to avoid the problem of inappropriately using a uni-modal distribution. We utilize the common k-means clustering method to detect possible clusters, and, based on the clustered sample sets, a Weibull variate is developed for each of these to produce multi-modal virtual data. In this approach, the degree of error variation in the Weibull skewness between the original and virtual data is measured and used as the criterion for determining the sizes of virtual samples. Six data sets with different training data sizes are employed to check the performance of the proposed method, and comparisons are made based on the classification accuracies. The results using non-parametric testing show that the proposed method has better classification performance to that of the recently presented Mega-Trend-Diffusion method. (C) 2014 Elsevier B.V. All rights reserved.
Keywords:
Multi-modal distribution
Small data set
Multi-modal virtual sample
Virtual sample size
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Decision Support Systems cover
Decision Support Systems
IF:
6.8
Papers:
3.8K
Citations:
1.5W

Organization

N
National Cheng Kung University
Scholars:
2.6W
Papers: 2.3W
Citations: 1.7W