arrow
返回

A new adaptive sampling algorithm for big data classification

delete2022-05-01
delete8
PRE
AI
K
Kheyreddine Djouzi *
K
Kadda Beghdad-Bey
A
Abdenour Amamra
DOI:10.1016/j.jocs.2022.101653delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The exponential growth of the quantity of data that circulates on the web led to the emergence of the big data phenomenon. This fact is a natural consequence of the proliferation of social media, mobile devices, the abundance of free online storage, and new technologies like the internet of things. Subsequently, big data has created several challenges to the computer science community, among which the large size of data is the most challenging. Traditional machine learning algorithms used mostly for insight extraction find themselves inadequate, even on high-performance computer architectures. For instance, big data analytics algorithms can overcome the size issue by either: (1) adapting the existing machine learning techniques to the scale of the big data; or, (2) by sampling big datasets, choosing randomly much smaller subsets of the data population, to meet what current algorithms can handle. In the present work, we aim to proceed through the second alternative to address the size challenge in the big data context. We propose intelligent sampling techniques based on Scalable Simple Random Sampling (ScaSRS) and Subsampled Double Bootstrap (SDB). Test results carried out on public generic datasets show that our proposal is able to address the size dimension efficiently. The proposed algorithms were evaluative on a classification task where the obtained results provided significant improvement compared to the state-of-the-art.
Keyword:
Big data
Data classification
Sampling methods
Subsampled Double Bootstrap
Naive Bayes classifier

期刊

Nature Computational Science 封面图
Nature Computational Science
IF:
18.3
论文数:
3.1K
被引数:
4.0K

机构

E
ecole military polytechnic
学者数:
645
论文数: 410
被引数: 2
引用论文

引用论文

Study on a magnetic spiral-type wireless capsule endoscope controlled by rotational external permanent magnet
err2015-12-01
err0
PREAI
errBo Ye; Wei Zhang; Zhen-jun Sun; Lin Guo; Chao Deng; Ya-qi Chen; Hong-hai Zhang; Sheng Liu
err分享
err收藏
A scalable bootstrap for massive data
err2014-03-17
err286
errOAAI
errKleiner, Ariel; Talwalkar, Ameet; Sarkar, Purnamrita; Jordan, Michael I.
err分享
err收藏
An Overview of End-to-End Entity Resolution for Big Data
err2020-12-06
err84
errOAAI
errChristophides, Vassilis; Efthymiou, Vasilis; Palpanas, Themis; Papadakis, George; Stefanidis, Kostas
err分享
err收藏
A Subsampled Double Bootstrap for Massive Data
err2016-10-18
err35
errOAAI
errSengupta, Srijan; Volgushev, Stanislav; Shao, Xiaofeng
err分享
err收藏
err分享
err收藏
An adaptive rule-based classifier for mining big biological data
err2016-12-01
err34
PREAI
errFarid, Dewan Md; Al-Mamun, Mohammad Abdullah; Manderick, Bernard; Nowe, Ann
err分享
err收藏
err分享
err收藏
Learning Curve and Associated Morbidity of Minimally Invasive Esophagectomy A Retrospective Multicenter Study
err2019-01-01
err212
PREAI
errvan Workum, Frans; Stenstra, Marianne H. B. C.; Berkelmans, Gijs H. K.; Slaman, Annelijn E.; Henegouwen, Mark I. van Berge; Gisbertz, Suzanne S.; van den Wildenberg, Frits J. H.; Polat, Fatih; Irino, Tomoyuki; Nilsson, Magnus; Nieuwenhuijzen, Grard A. P.; Luyer, Misha D.; Adang, Eddy M.; Hannink, Gerjon; Rovers, Maroeska M.; Rosman, Camiel
err分享
err收藏
学者 查看更多内容