High-order interaction feature selection for classification learning: A robust knowledge metric perspective

Jihong Wan

doi:10.1016/j.patcog.2023.109733

2023-11-01

PRE

DOI：10.1016/j.patcog.2023.109733

原文链接

原文求助

摘要

En 中文

Feature selection is an important learning task in data mining and knowledge discovery. Nevertheless, the fuzziness, uncertainty, and noise presented by the data greatly complicate the construction of learning models. Moreover, most works focus on exploring low-order correlations between variables using lowdimensional mutual information, without paying attention to high-order interaction for multiple variables, resulting in the loss of some potentially important dependency information. Driven by these two issues, a robust knowledge metric approach is invented to perceive and excavate the latent information hidden in interaction. In this study, firstly, a robust fuzzy granularity space is constructed from different granular structures induced by different f eatures, and the robust fuzzy uncertainty measures (RFUMs) are successively devised. Then, RFUMs are used to measure pair-wise, three-order, and even higher-order interaction dependencies among features. Further, a constrained high-order interaction evaluation function inspired by the N-gram language model is formulated, and a corresponding high-order interaction feature selection algorithm with RFUMs ( HIFS-RFUMs ) is designed. Next, comparative experiments with seven representative algorithms on twenty datasets illustrate its effectiveness. In addition, ablation experiments are conducted on the high-order interaction feature selection algorithm with fuzzy uncertainty measures ( HIFS -FUMs) and the relative reduction algorithm with RFUMs (R2- RFUMs ), which demonstrate the robustness of the metric and the effectiveness for mining high-order interactive features, respectively. & COPY; 2023 Elsevier Ltd. All rights reserved.

Keyword:

Feature selection

Fuzzy rough set

High -order interaction

Robust knowledge metric

Uncertainty measures

Classification