arrow
返回

Fast-RCM: Fast Tree-Based Unsupervised Rare-Class Mining

delete2021-10-01
delete1
PRE
AI
H
Haiqin Weng
纪
纪守领 (Shouling Ji)
C
Changchang Liu
T
Ting Wang
Q
Qinming He
J
Jianhai Chen *
DOI:10.1109/TCYB.2019.2924804delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Rare classes are usually hidden in an imbalanced dataset with the majority of the data examples from major classes. Rare-class mining (RCM) aims at extracting all the data examples belonging to rare classes. Most of the existing approaches for RCM require a certain amount of labeled data examples as input. However, they are ineffective in practice since requesting label information from domain experts is time consuming and human-labor extensive. Thus, we investigate the unsupervised RCM problem, which to the best of our knowledge is the first such attempt. To this end, we propose an efficient algorithm called Fast-RCM for unsupervised RCM, which has an approximately linear time complexity with respect to data size and data dimensionality. Given an unlabeled dataset, Fast-RCM mines out the rare class by first building a rare tree for the input dataset and then extracting data examples of the rare classes based on this rare tree. Compared with the existing approaches which have quadric or even cubic time complexity, Fast-RCM is much faster and can be extended to large-scale datasets. The experimental evaluation on both synthetic and real-world datasets demonstrate that our algorithm can effectively and efficiently extract the rare classes from an unlabeled dataset under the unsupervised settings, and is approximately five times faster than that of the state-of-the-art methods.
Keyword:
Anomaly detection
Diseases
Vegetation
Approximation algorithms
Time complexity
Computer science
Clustering methods
data mining
tree data structures
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Cybernetics 封面图
IEEE Transactions on Cybernetics
IF:
10.5
论文数:
1.1W
被引数:
5.0W

机构

I
international business machines (ibm)
学者数:
5.7K
论文数: 4.5K
被引数: 4
L
Lehigh University
学者数:
4.8K
论文数: 5.1K
被引数: 6.3K
Z
zhejiang university
学者数:
17.7W
论文数: 12.1W
被引数: 152
学者 查看更多机构
引用论文

引用论文

Prior-free rare category detection: More effective and efficient solutions
err2014-12-01
err15
PREAI
errLiu, Zhenguang; Chiew, Kevin; He, Qinming; Huang, Hao; Huang, Butian
err分享
err收藏
Quality of Life Among Family of Patients with Atopic Dermatitis and Psoriasis
err2022-05-26
err0
PREAI
errAshley M. Snyder; Adelheid U. Brandenberger; Vanina L. Taliercio; Bianca E. Rich; Lisa B. Webber; Abram P. Beshay; Joshua E. Biber; Rachel Hess; Jamie L. W. Rhoads; Aaron M. Secrest
err分享
err收藏
Predicting Clustering From Semantic Structure
err1993-01-01
err0
PREAI
errA. Kimball Romney; Devon D. Brewer; William H. Batchelder
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
Rare category exploration via wavelet analysis: Theory and applications
err2016-11-01
err5
PREAI
errLiu, Zhenguang; Chiew, Kevin; Zhang, Luming; Zhang, Beibei; He, Qinming; Zimmermann, Roger
err分享
err收藏
学者 查看更多内容