arrow
返回

An efficient algorithm for distributed density-based outlier detection on big data

delete2016-03-01
delete68
PRE
AI
X
Xite Wang
J
Junchang Xin
王
王国仁 (Guoren Wang)
DOI:10.1016/j.neucom.2015.05.135delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The outlier detection is a popular issue in the area of data management and multimedia analysis, and it can be used in many applications such as detection of noisy images, credit card fraud detection, network intrusion detection. The density-based outlier is an important definition of outlier, whose target is to compute a Local Outlier Factor (LOF) for each tuple in a data set to represent the degree of this tuple to be an outlier. It shows several significant advantages comparing with other existing definitions. This paper focuses on the problem of distributed density-based outlier detection for large-scale data. First, we propose a Gird-Based Partition algorithm (GBP) as a data preparation method. GBP first splits the data set into several grids, and then allocates these grids to the datanodes in a distributed environment. Second, we propose a Distributed LOF Computing method (DLC) for detecting density-based outliers in parallel, which only needs a small amount of network communications. At last, the efficiency and effectiveness of the proposed approaches are verified through a series of simulation experiments. (C) 2015 Elsevier B.V. All rights reserved.
Keyword:
Density-based outlier
Local outlier factor
Distributed algorithm
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Neurocomputing 封面图
Neurocomputing
IF:
6.5
论文数:
2.5W
被引数:
6.5W

机构

N
northeastern university - china
学者数:
3.2W
论文数: 2.7W
被引数: 37
引用论文

引用论文

Forced vibration experiments on flexible piezoelectric devices operating in air and water environments
err2014-02-01
err0
PREAI
errYoshikazu Tanaka; Takuya Oko; Hidemi Mutsuda; Atanas A. Popov; Rupesh Patel; Stewart McWilliam
err分享
err收藏
Fusion of Multichannel Local and Global Structural Cues for Photo Aesthetics Evaluation
err2014-03-01
err142
PREAI
errZhang, Luming; Gao, Yue; Zimmermann, Roger; Tian, Qi; Li, Xuelong
err分享
err收藏
Discovering Discriminative Graphlets for Aerial Image Categories Recognition
err2013-12-01
err181
PREAI
errZhang, Luming; Han, Yahong; Yang, Yi; Song, Mingli; Yan, Shuicheng; Tian, Qi
err分享
err收藏
err分享
err收藏
err分享
err收藏
Fast multi-view segment graph kernel for object classification
err2013-06-01
err62
PREAI
errZhang, Luming; Song, Mingli; Liu, Xiao; Bu, Jiajun; Chen, Chun
err分享
err收藏
Evaluating design-based formative assessment practices in outdoor science teaching
err2016-09-30
err0
PREAI
errRikke Hartmeyer; Matt P. Stevenson; Peter Bentsen
err分享
err收藏
学者 查看更多内容