arrow
Return

A new adaptive sampling algorithm for big data classification

delete2022-05-01
delete8
PRE
AI
K
Kheyreddine Djouzi *
K
Kadda Beghdad-Bey
A
Abdenour Amamra
DOI:10.1016/j.jocs.2022.101653delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The exponential growth of the quantity of data that circulates on the web led to the emergence of the big data phenomenon. This fact is a natural consequence of the proliferation of social media, mobile devices, the abundance of free online storage, and new technologies like the internet of things. Subsequently, big data has created several challenges to the computer science community, among which the large size of data is the most challenging. Traditional machine learning algorithms used mostly for insight extraction find themselves inadequate, even on high-performance computer architectures. For instance, big data analytics algorithms can overcome the size issue by either: (1) adapting the existing machine learning techniques to the scale of the big data; or, (2) by sampling big datasets, choosing randomly much smaller subsets of the data population, to meet what current algorithms can handle. In the present work, we aim to proceed through the second alternative to address the size challenge in the big data context. We propose intelligent sampling techniques based on Scalable Simple Random Sampling (ScaSRS) and Subsampled Double Bootstrap (SDB). Test results carried out on public generic datasets show that our proposal is able to address the size dimension efficiently. The proposed algorithms were evaluative on a classification task where the obtained results provided significant improvement compared to the state-of-the-art.
Keywords:
Big data
Data classification
Sampling methods
Subsampled Double Bootstrap
Naive Bayes classifier

Journal

Nature Computational Science cover
Nature Computational Science
IF:
18.3
Papers:
3.1K
Citations:
4.0K

Organization

E
ecole military polytechnic
Scholars:
645
Papers: 410
Citations: 2
Cited Papers

Cited Papers

Study on a magnetic spiral-type wireless capsule endoscope controlled by rotational external permanent magnet
err2015-12-01
err0
PREAI
errBo Ye; Wei Zhang; Zhen-jun Sun; Lin Guo; Chao Deng; Ya-qi Chen; Hong-hai Zhang; Sheng Liu
errShare
errSave
A scalable bootstrap for massive data
err2014-03-17
err286
errOAAI
errKleiner, Ariel; Talwalkar, Ameet; Sarkar, Purnamrita; Jordan, Michael I.
errShare
errSave
An Overview of End-to-End Entity Resolution for Big Data
err2020-12-06
err84
errOAAI
errChristophides, Vassilis; Efthymiou, Vasilis; Palpanas, Themis; Papadakis, George; Stefanidis, Kostas
errShare
errSave
A Subsampled Double Bootstrap for Massive Data
err2016-10-18
err35
errOAAI
errSengupta, Srijan; Volgushev, Stanislav; Shao, Xiaofeng
errShare
errSave
A comprehensive survey on support vector machine classification: Applications, challenges and trends
err2020-09-01
err1.1K
errOAAI
errCervantes, Jair; Garcia-Lamont, Farid; Rodriguez-Mazahua, Lisbeth; Lopez, Asdrubal
errShare
errSave
An adaptive rule-based classifier for mining big biological data
err2016-12-01
err34
PREAI
errFarid, Dewan Md; Al-Mamun, Mohammad Abdullah; Manderick, Bernard; Nowe, Ann
errShare
errSave
errShare
errSave
Learning Curve and Associated Morbidity of Minimally Invasive Esophagectomy A Retrospective Multicenter Study
err2019-01-01
err212
PREAI
errvan Workum, Frans; Stenstra, Marianne H. B. C.; Berkelmans, Gijs H. K.; Slaman, Annelijn E.; Henegouwen, Mark I. van Berge; Gisbertz, Suzanne S.; van den Wildenberg, Frits J. H.; Polat, Fatih; Irino, Tomoyuki; Nilsson, Magnus; Nieuwenhuijzen, Grard A. P.; Luyer, Misha D.; Adang, Eddy M.; Hannink, Gerjon; Rovers, Maroeska M.; Rosman, Camiel
errShare
errSave
researcher View more