arrow
返回

A COMPARATIVE STUDY FOR OUTLIER DETECTION METHODS IN HIGH DIMENSIONAL TEXT DATA

delete2022-11-28
delete9
delete
OA
AI
C
Cheong Hee Park *
DOI:10.2478/jaiscr-2023-0001delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Outlier detection aims to find a data sample that is significantly different from other data samples. Various outlier detection methods have been proposed and have been shown to be able to detect anomalies in many practical problems. However, in high dimensional data, conventional outlier detection methods often behave unexpectedly due to a phenomenon called the curse of dimensionality. In this paper, we compare and analyze outlier detection performance in various experimental settings, focusing on text data with dimensions typically in the tens of thousands. Experimental setups were simulated to compare the performance of outlier detection methods in unsupervised versus semi-supervised mode and uni-modal versus multi-modal data distributions. The performance of outlier detection methods based on dimension reduction is compared, and a discussion on using k-NN distance in high dimensional data is also provided. Analysis through experimental comparison in various environments can provide insights into the application of outlier detection methods in high dimensional data.
Keyword:
Curse of dimensionality
Dimension reduction
High dimensional text data
Outlier detection

期刊

Journal of Artificial Intelligence and Soft Computing Research 封面图
Journal of Artificial Intelligence and Soft Computing Research
IF:
2.4
论文数:
170
被引数:
459

机构

C
Chungnam National University
学者数:
1.5W
论文数: 1.4W
被引数: 1.2W
引用论文

引用论文

Extended Isolation Forest扩展隔离林
err2021-04-01
err190
errOAAI
errHariri, Sahand; Kind, Matias Carrasco; Brunner, Robert J.
err分享
err收藏
Progress in Outlier Detection Techniques: A Survey
err2019-01-01
err320
errOAAI
errWang, Hongzhi; Bah, Mohamed Jaward; Hammad, Mohamed
err分享
err收藏
Gangrenous Cholecystitis: Mortality and Risk Factors
err2015-02-01
err0
errOAAI
errAkın Önder; Murat Kapan; Burak Veli Ülger; Abdullah Oğuz; Ahmet Türkoğlu; Ömer Uslukaya
err分享
err收藏
err分享
err收藏
学者 查看更多内容