arrow
Return

AutoML With Parallel Genetic Algorithm for Fast Hyperparameters Optimization in Efficient IoT Time Series Prediction

delete2023-09-01
delete6
PRE
AI
吴迪 cover
吴迪 (Di Wu) *
Q
Qinghua Guan
Z
Zhe Fan
H
Hanhui Deng
T
Tao Wu *
DOI:10.1109/TII.2022.3231419delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
With the development of artificial intelligence and the improvement of hardware computing power, deep learning models have become widely used in the Internet of Things (IoT) field, especially for analyzing spatiotemporal data collected by wireless sensors. Recurrent neural networks (RNNs) such as long short-term memory (LSTM) network are generally used for these time-series data. Hyperparameter settings of model training are regarded as essential factors for the performance of deep learning models. Manually optimizing hyperparameters not only cost more resources but also be more likely to set hyperparameters that follow stereotypes, resulting in unreasonable hyperparameter settings and poor model performance. As one of the most important fields in automated machine learning research, automated hyperparameter optimization (HPO) mainly includes grid search, hyperparameter search based on genetic algorithm, etc. Whereas these methods have their own drawbacks. In this article, an automated HPO method based on parallel genetic algorithm (PGA) is proposed. According to the process of PGA, this article divided HPO into several stages, including population initialization, fitness function, tournament selection, crossover operators, mutation operators, subgroup exchange, and end of evolution. Then, the proposed HPO method is implemented in LSTM models and tested on two different time-series datasets collected by real-world IoT sensors. By comparing our proposed method with other mainstream HPO methods in different datasets, it is proved that our HPO method based on PGA shows a better performance on both time costs and prediction results.
Keywords:
Automated machine learning (AutoML)
deep learning
Internet of Things (IoT)
parallel genetic algorithm (PGA)

Journal

IEEE Transactions on Industrial Informatics cover
IEEE Transactions on Industrial Informatics
IF:
9.9
Papers:
8.3K
Citations:
6.0W

Organization

H
Hunan Normal University
Scholars:
1.3W
Papers: 8.2K
Citations: 9.1K
H
hunan university
Scholars:
4.5W
Papers: 3.3W
Citations: 70