arrow
Return

Multiagent-consensus-MapReduce-based attribute reduction using co-evolutionary quantum PSO for big data applications

delete2018-01-01
delete35
PRE
AI
丁卫平 cover
丁卫平 (Weiping Ding) *
C
Chin‐Teng Lin
S
Senbo Chen
X
Xiaofeng Zhang
B
Bin Hu
DOI:10.1016/j.neucom.2017.06.059delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The attribute reduction for big data applications has become an urgent challenge in pattern recognition, machine learning and data mining. In this paper, we introduce the multi-agent consensus MapReduce optimization model and co-evolutionary quantum PSO with self-adaptive memeplexes for designing the attribute reduction method, and propose a multiagent-consensus-MapReduce-based attribute reduction algorithm (MCMAR). Firstly, the co-evolutionary quantum PSO with self-adaptive memeplexes is designed for grouping particles into different memeplexes, which aims to explore the search space and locate the global best region during the attribute reduction of big datasets. Secondly, the four layers neighborhood radius framework with compensatory scheme is constructed to partition big attribute sets by exploiting the interdependency among multiple-relevant-attribute sets. Thirdly, a novel multi-agent consensus MapReduce optimization model is adopted to perform the multiple-relevance-attribute reduction, in which five kinds of agents are used to conduct the ensemble co-evolutionary optimization. So the uniform reduction framework of different agents' co-evolutionary game under the bounded rationality is further refined. Fourthly, the approximation MapReduce parallelism mechanism is permitted to formalize to the multi-agent co-evolutionary consensus structure, interaction and adaptation, which enhances different agents to share their solutions. Finally, extensive experimental studies substantiate the effectiveness and accuracy of MCMAR on some well-known benchmark datasets. Moreover, successful applications in big medical datasets are expected to dramatically scaling up MCMAR for complex infant brain MRI in terms of efficiency and feasibility. (C) 2017 Elsevier B.V. All rights reserved.
Keywords:
Multi-agent consensus MapReduce model
Co-evolutionary quantum PSO
Self-adaptive memeplexes
Neighborhood radius with compensatory scheme
Ensemble co-evolutionary optimization of attribute reduction
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Neurocomputing cover
Neurocomputing
IF:
6.5
Papers:
2.5W
Citations:
6.5W

Organization

U
university of technology sydney
Scholars:
1.6W
Papers: 2.0W
Citations: 25
N
Nantong University
Scholars:
1.9W
Papers: 1.1W
Citations: 2.0W