.png){kind=icon}
Return
A dynamic programming-based data-adaptive information granulation approach and its distributed implementation
.png){kind=icon}
PRE
AI
DOI：10.1007/s10489-023-04786-z.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Information granules are fundamental and effective constructs in human cognitive and decision-making activities. It is unavoidable to automatically describe and extract some valuable information from large-scale datasets. In this study, we suggest a data-adaptive information granulation method to reinforce the data description mechanisms. First, a dynamic programming-based attribute-value clustering method is proposed to adaptively partition the numeric attribute values to several optimal data fragments for different condition attributes. Then, some interval information granules are constructed from the clustered data fragments by the principle of justifiable granularity for some specific tasks in machine learning. Furthermore, we introduce the distributed implementation in the framework of Map-Reduce to overcome some restrictions in large-scale datasets. The experiments on several benchmark datasets are provided to demonstrate the adaptivity on different datasets and the feasibility in machine learning tasks. Furthermore, the distributed performance are tested on some artificial datasets.
Keywords:
Information granules
Big data
Machine learning
Map-reduce
Journal
IF:
3.5
Papers:
7.6K
Citations:
1.7W
Organization
View more organizations
Cited Papers
Detection and Classification of Anomalies in Large Datasets on the Basis of Information Granules
PREAI
ShareSaveA fuzzy rough set approach to hierarchical feature selection based on Hausdorff distance.png)
APPLIED INTELLIGENCE
APPLIED INTELLIGENCEIF3.5
PREAI
ShareSaveShareSaveASFS: A novel streaming feature selection for multi-label data based on neighborhood rough setAPPLIED INTELLIGENCE
APPLIED INTELLIGENCEIF3.5
PREAI
ShareSaveMapReduce based parallel fuzzy-rough attribute reduction using discernibility matrixAPPLIED INTELLIGENCE
APPLIED INTELLIGENCEIF3.5
PREAI
ShareSaveShareSave View more