arrow
返回

DISCONA: distributed sample compression for nearest neighbor algorithm

delete2023-03-23
delete0
delete
OA
AI
J
Jedrzej Rybicki *
T
Tatiana Frenklach
R
Rami Puzis
DOI:10.1007/s10489-023-04482-ydelete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Sample compression using epsilon-net effectively reduces the number of labeled instances required for accurate classification with nearest neighbor algorithms. However, one-shot construction of an epsilon-net can be extremely challenging in large-scale distributed data sets. We explore two approaches for distributed sample compression: one where local epsilon-net is constructed for each data partition and then merged during an aggregation phase, and one where a single backbone of an epsilon-net is constructed from one partition and aggregates target label distributions from other partitions. Both approaches are applied to the problem of malware detection in a complex, real-world data set of Android apps using the nearest neighbor algorithm. Examination of the compression rate, computational efficiency, and predictive power shows that a single backbone of an epsilon-net attains favorable performance while achieving a compression rate of 99%.
Keyword:
Distributed machine learning
Malware detection
Nearest neighbors
Sample compression
Big data

期刊

Applied Intelligence 封面图
Applied Intelligence
IF:
3.5
论文数:
7.6K
被引数:
1.7W

机构

R
research center julich
学者数:
9.9K
论文数: 6.7K
被引数: 10
H
Helmholtz Association
学者数:
13.2W
论文数: 10.7W
被引数: 145
引用论文

引用论文

Similarity-based Android malware detection using Hamming distance of static binary features
err2020-04-01
err116
errOAAI
errTaheri, Rahim; Ghahramani, Meysam; Javidan, Reza; Shojafar, Mohammad; Pooranian, Zahra; Conti, Mauro
err分享
err收藏
Chromate lung cancer with special reference to its cell type and relation to the manufacturing process
err1982-02-15
err0
errOAAI
errShosaku Abe; Yutaka Ohsaki; Kiyonobu Kimura; Yasuhiro Tsuneta; Hiroshi Mikami; Makoto Murao
err分享
err收藏
Sensitivity of chaotic behavior to low optical frequencies of a double-beam torsional actuator
err2019-07-01
err0
errOAAI
errF. Tajik; M. Sedighi; A. A. Masoudi; H. Waalkens; G. Palasantzas
err分享
err收藏
err分享
err收藏
err分享
err收藏
学者 查看更多内容