arrow
Return

Deep Q-Network-Based Feature Selection for Multisourced Data Cleaning

delete2021-11-01
delete10
PRE
AI
Q
Qianlong Wang
Y
Yifan Guo
L
Lixing Yu
X
Xuhui Chen
P
Pan Li *
DOI:10.1109/JIOT.2020.3016297delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The Internet of Things (IoT) integrates information collected from multisources and is able to support various intelligent smart city applications, such as industrial manufacturing, power systems, and mobile healthcare. In the big data era, multisourced data are collected on a daily basis, whereas a large part of the data may be irrelevant, redundant, noisy, or even malicious from a machine learning perspective. Feature selection has been a powerful data cleaning technique to reduce data redundancy and improve system performance in machine learning. Inspired by reinforcement learning that learns from its experience, in this article, we propose a novel efficient deep Q-network (DQN)-based feature selection method for multisourced data cleaning. In particular, we model the feature selection problem as a competition between an agent and the environment in dynamic states, which is solved by a DQN. Traditional DQN suffers from high computational complexity and requires a significant amount of time in order to converge in the training process. To tackle these challenges, we develop a space searching algorithm called SS to speed up the training process of the DQN agent. To validate the efficacy and efficiency of the proposed method, we conduct extensive experiments on various types of IoT data. Simulation results show that the proposed DQN-based feature selection algorithms achieve much better performance compared with state-of-the-art methods, and are robust under data poisoning attacks.
Keywords:
Deep Q-network (DQN)
feature selection
multisourced data
reinforcement learning

Journal

IEEE Internet of Things Journal cover
IEEE Internet of Things Journal
IF:
8.9
Papers:
1.4W
Citations:
7.8W

Organization

U
University System of Ohio
Scholars:
15.5W
Papers: 13.0W
Citations: 200
C
Case Western Reserve University
Scholars:
2.1W
Papers: 1.6W
Citations: 3.4W
Cited Papers

Cited Papers

Using S3D to analyze ship system alternatives for a 100 MW 10,000 ton surface combatant
err2017-08-01
err0
errOAAI
errRichard Smart; Julie Chalfant; John Herbst; Blake Langland; Angela Card; Rod Leonard; Angelo Gattozzi
errShare
errSave
TrafficChain: A Blockchain-Based Secure and Privacy-Preserving Traffic Map
err2020-01-01
err26
errOAAI
errWang, Qianlong; Ji, Tianxi; Guo, Yifan; Yu, Lixing; Chen, Xuhui; Li, Pan
errShare
errSave
Feature selection in machine learning: A new perspective
err2018-07-01
err1.3K
PREAI
errCai, Jie; Luo, Jiawei; Wang, Shulin; Yang, Sheng
errShare
errSave
A survey on feature selection approaches for clustering
err2020-01-02
err103
PREAI
errHancer, Emrah; Xue, Bing; Zhang, Mengjie
errShare
errSave
Intelligent IoT Traffic Classification Using Novel Search Strategy for Fast-Based-Correlation Feature Selection in Industrial Environments
err2018-06-01
err55
errOAAI
errEgea, Santiago; Rego Manez, Albert; Carro, Belen; Sanchez-Esguevillas, Antonio; Lloret, Jaime
errShare
errSave
Self-monitoring in the cerebral cortex: Neural responses to small pitch shifts in auditory feedback during speech production
err2018-10-01
err0
errOAAI
errMatthias K. Franken; Frank Eisner; Daniel J. Acheson; James M. McQueen; Peter Hagoort; Jan-Mathijs Schoffelen
errShare
errSave
errShare
errSave
Gradient-based learning applied to document recognition
err1998-01-01
err3.8W
PREAI
errLecun, Y; Bottou, L; Bengio, Y; Haffner, P
errShare
errSave
researcher View more