.png){kind=icon}
返回
Rare Category Analysis for Complex Data: A Review
.png){kind=icon}
OA
AI
DOI：10.1145/3626520.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Though the sheer volume of data that is collected is immense, it is the rare categories that are often the most important in many high-impact domains, ranging from financial fraud detection in online transaction networks to emerging trend detection in social networks, from spam image detection on social media platforms to rare disease diagnosis in medical decision support systems. The unique challenges of rare category analysis include (1) the highly skewed class distribution; (2) the non-separable nature of the rare categories from the majority classes; (3) data and task heterogeneity; and (4) the time-evolving property of the input data sources. This survey reviews state-of-the-art techniques used in complex rare category analysis, where the majority classes have a smooth distribution while the minority classes exhibit the compactness property in the feature space or subspace. Rare category analysis aims to identify, characterize, represent, and interpret anomalies that not only show statistical significance but also exhibit interesting patterns (e.g., compactness, high-order structures, showing in a burst). We introduce our study, define the problem setting, and describe the unique challenges of complex rare category analysis. We then present a comprehensive review of recent advances that are designed for this problem setting, from rare category exploration without any label information to rare category exposition that characterizes rare examples with a compact representation, from the representation of rare patterns in a salient embedding space to the interpretation the prediction results and providing relevant clues for the end-users' interpretation. Finally we discuss potential challenges and shed light on the future directions for complex rare category analysis.
Keyword:
Rare category analysis
imbalanced data distribution
anomaly detection
期刊
IF:
28
论文数:
2.4K
被引数:
3.5W
机构
引用论文
Altered expression of synaptotagmin 13 mRNA in adult mouse brain after contextual fear conditioning
PREAI
分享收藏Inner ear development in cyclostomes and evolution of the vertebrate semicircular canals.png)
Nature
NatureIF0
PREAI
分享收藏A survey of signature based methods for financial fraud detection基于签名的金融欺诈检测方法综述COMPUTERS & SECURITY
COMPUTERS & SECURITYIF5.4
PREAI
分享收藏
查看更多内容