返回
Facilitating data preprocessing by a generic framework: a proposal for clustering
DOI:10.1007/s10462-015-9446-6.png)
摘要
En 中文
Clustering is among the most popular data mining algorithm families. Before applying clustering algorithms to datasets, it is usually necessary to preprocess the data properly. Data preprocessing is a crucial, still neglected step in data mining. Although preprocessing techniques and algorithms are well-known, the preprocessing process is very complex and takes usually a lot of time. Instead of handling preprocessing more systematically, it is usually undervalued, i.e. more emphasis is put on choosing the appropriate clustering algorithm and setting its parameters. In our opinion, this is not because preprocessing is less important, but because it is difficult to choose the best sequence of preprocessing algorithms. We argue that it is important to better standardize this process so it is performed efficiently. Therefore, this paper proposes a generic framework for data preprocessing. It is based on a survey with data mining experts, as well as a literature and software review. The framework enables pipelining preprocessing algorithms and methods which facilitate further automated preprocessing design and the selection of a suitable preprocessing stream. The proposed framework is easily extendible, so it can be applied to other data mining algorithm families that have their own idiosyncrasies.
Keyword:
Clustering algorithm
Preprocessing in data mining
Generic framework
Preprocessing stream selection
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
13.9
论文数:
6.1K
被引数:
1.9W
机构
引用论文
Modulation of Squamous Carcinoma Cell Growth, Morphology, Adhesiveness and Extracellular Matrix Production by Interferon-γ and Tumor Necrosis Factor-α
Pathobiology
IF0
Characterization of rare human papillomavirus type 11 mRNAs coding for regulatory and structural proteins, using the polymerase chain reaction
Virology
IF0
Principal manifolds and nonlinear dimensionality reduction via tangent space alignment基于切线空间对齐的主流形和非线性降维

