arrow
Return

Data mining in distributed environment: a survey

delete2017-07-18
delete102
PRE
AI
W
Wensheng Gan
J
Jerry Chun‐Wei Lin *
H
Han‐Chieh Chao
J
Justin Zhan
DOI:10.1002/widm.1216delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Due to the rapid growth of resource sharing, distributed systems are developed, which can be used to utilize the computations. Data mining (DM) provides powerful techniques for finding meaningful and useful information from a very large amount of data, and has a wide range of real-world applications. However, traditional DM algorithms assume that the data is centrally collected, memory-resident, and static. It is challenging to manage the large-scale data and process them with very limited resources. For example, large amounts of data are quickly produced and stored at multiple locations. It becomes increasingly expensive to centralize them in a single place. Moreover, traditional DM algorithms generally have some problems and challenges, such as memory limits, low processing ability, and inadequate hard disk, and so on. To solve the above problems, DM on distributed computing environment [also called distributed data mining (DDM)] has been emerging as a valuable alternative in many applications. In this study, a survey of state-of-the-art DDM techniques is provided, including distributed frequent item-set mining, distributed frequent sequence mining, distributed frequent graph mining, distributed clustering, and privacy preserving of distributed data mining. We finally summarize the opportunities of data mining tasks in distributed environment. (C) 2017Wiley Periodicals, Inc.
Keywords:
K-MEANS
SEQUENTIAL PATTERNS
FREQUENT PATTERNS
ASSOCIATION RULES
PARALLEL
PRIVACY
EFFICIENT
ALGORITHM
ITEMSETS
GENERATION
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Wiley Interdisciplinary Reviews-Data Mining and Knowledge Discovery cover
Wiley Interdisciplinary Reviews-Data Mining and Knowledge Discovery
IF:
11.7
Papers:
546
Citations:
5.3K

Organization

H
harbin institute of technology
Scholars:
8.0W
Papers: 6.6W
Citations: 66
N
National Dong Hwa University
Scholars:
2.8K
Papers: 2.5K
Citations: 18
N
nevada system of higher education (nshe)
Scholars:
1.4W
Papers: 1.3W
Citations: 30
researcher View more organizations
Cited Papers

Cited Papers

errShare
errSave
Mutation screening for the 5α-reductase type 2 gene in Japanese men with idiopathic azoospermia
err2002-05-01
err0
errOAAI
errKeiichi Itoh; Isoji Sasagawa; Yasuhiro Suzuki; Junko Ashida; Teruhiro Nakada; Tsutomu Ogata
errShare
errSave
Adrenal steroidogenesis is related to insulin in hyperandrogenic women
err1996-10-01
err0
errOAAI
errHannu Martikainen; Pasi Salmela; Sinikka Nuojua-Huttunen; Jukka Perälä; Sami Leinonen; Mikael Knip; Aimo Ruokonen
errShare
errSave
errShare
errSave
researcher View more