arrow
返回

Filter Transfer Learning Algorithm for Missing Data Imputation in Wastewater Treatment Process

delete2023-12-01
delete4
PRE
AI
H
Honggui Han *
李
李蒙蒙 (Mengmeng Li)
乔俊飞 封面图
乔俊飞 (Junfei Qiao)
杨
杨庆 (Qing Yang)
Y
Yongzhen Peng
DOI:10.1109/TKDE.2023.3270118delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Missing data imputation is a critical data processing procedure in wastewater treatment process. However, the existing imputation methods cannot stand the missing data with high proportions that frequently happens due to unmaintained instruments or detection failures. Transfer Learning aims to learn much reliable information for the target domain with previous learned knowledge from a source domain, which provides a framework for solving such problem. This paper proposes a filter transfer learning algorithm (FTLA) for missing data imputation with high proportions. First, a knowledge acquisition strategy is developed to extract the source knowledge, including independent knowledge from historical datasets and parallel knowledge in terms of related datasets. The missing data is then interpreted through source knowledge comprehensively. Second, a filter transfer learning algorithm is designed to achieve target knowledge that mimics the tendency of the missing data. This algorithm can avoid serious negative transfer by using the extended Kalman filter to filtrate source knowledge. Third, a knowledge rolling mechanism is established to perform the imputation online with target knowledge, which can maintain the reliable imputation for missing data with high proportions. Finally, several comparative experiments of wastewater data are provided to demonstrate the merits of missing data imputation with FTLA.
Keyword:
Transfer learning
Time series analysis
Data models
Water pollution
Wastewater
Wastewater treatment
Neurons
Missing data imputation
wastewater treatment process
transfer learning
extended Kalman filter

期刊

IEEE Transactions on Knowledge and Data Engineering 封面图
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
论文数:
6.9K
被引数:
3.2W

机构

B
Beijing University of Technology
学者数:
2.8W
论文数: 2.1W
被引数: 2.7W
引用论文

引用论文

Quantized load distribution for tree and bus-connected processors
err2004-07-01
err0
PREAI
errGerassimos Barlas; Bharadwaj Veeravalli
err分享
err收藏
A Unified Framework for Metric Transfer Learning度量迁移学习的统一框架
err2017-06-01
err151
PREAI
errXu, Yonghui; Pan, Sinno Jialin; Xiong, Hui; Wu, Qingyao; Luo, Ronghua; Min, Huaqing; Song, Hengjie
err分享
err收藏
Interactive Transfer Learning-Assisted Fuzzy Neural Network
err2022-06-01
err12
PREAI
errHan, Honggui; Liu, Hongxu; Liu, Zheng; Qiao, Junfei
err分享
err收藏
Capillary filling of sub-10nm nanochannels
err2008-07-10
err0
PREAI
errJeroen Haneveld; Niels R. Tas; Nataliya Brunets; Henri V. Jansen; Miko Elwenspoek
err分享
err收藏
学者 查看更多内容