.png){kind=icon}
返回
A dynamic programming-based data-adaptive information granulation approach and its distributed implementation
.png){kind=icon}
PRE
AI
DOI：10.1007/s10489-023-04786-z.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Information granules are fundamental and effective constructs in human cognitive and decision-making activities. It is unavoidable to automatically describe and extract some valuable information from large-scale datasets. In this study, we suggest a data-adaptive information granulation method to reinforce the data description mechanisms. First, a dynamic programming-based attribute-value clustering method is proposed to adaptively partition the numeric attribute values to several optimal data fragments for different condition attributes. Then, some interval information granules are constructed from the clustered data fragments by the principle of justifiable granularity for some specific tasks in machine learning. Furthermore, we introduce the distributed implementation in the framework of Map-Reduce to overcome some restrictions in large-scale datasets. The experiments on several benchmark datasets are provided to demonstrate the adaptivity on different datasets and the feasibility in machine learning tasks. Furthermore, the distributed performance are tested on some artificial datasets.
Keyword:
Information granules
Big data
Machine learning
Map-reduce
期刊
IF:
3.5
论文数:
7.6K
被引数:
1.7W
机构
引用论文
Detection and Classification of Anomalies in Large Datasets on the Basis of Information Granules
PREAI
分享收藏A fuzzy rough set approach to hierarchical feature selection based on Hausdorff distance基于Hausdorff距离的模糊粗糙集层次特征选择方法.png)
APPLIED INTELLIGENCE
APPLIED INTELLIGENCEIF3.5
PREAI
分享收藏ASFS: A novel streaming feature selection for multi-label data based on neighborhood rough setAPPLIED INTELLIGENCE
APPLIED INTELLIGENCEIF3.5
PREAI
分享收藏MapReduce based parallel fuzzy-rough attribute reduction using discernibility matrixAPPLIED INTELLIGENCE
APPLIED INTELLIGENCEIF3.5
PREAI
分享收藏
查看更多内容