arrow
返回

Parallel LSTM-CNN Network With Radar Multispectrogram for Human Activity Recognition

delete2023-01-15
delete15
PRE
AI
Y
Yujia Qian
陈川 封面图
陈川 (Chuan Chen) *
L
Longzhen Tang
Y
Yong Jia
崔国龙 封面图
崔国龙 (Guolong Cui)
DOI:10.1109/JSEN.2022.3224083delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Owing to the ability of automatic feature extraction, deep learning is extensively applied in human activity recognition (HAR) based on radar. In this article, a recognition method based on a multispectrogram and deep-learning model is proposed. The radar echo data are transformed into spectrograms with different feature expressions by performing three time-frequency analyses, including short-time Fourier transform (STFT), reduced interference distribution with Hanning kernel (RIDHK), and smoothed pseudo-Wigner-Ville distribution (SPWVD), and then the spectrograms are sent to deep-learning model to realize HAR. The model employs three long short-term memory (LSTM) networks to learn the temporal features of the spectrograms and uses a 3-D convolutional neural network (3-DCNN) to extract the independent spatial features of a single spectrogram and the spatial correlation features between different kinds of spectrograms, named parallel LSTM-CNN network (PLCN). The PLCN is capable of effectively improving the degree of feature utilization in the spectrogram and the accuracy of human activity classification by fusing both temporal and spatial features. The final experimental results show that the average recognition accuracy of the method based on the PLCN for eight human activities reaches 94.75%, which is significantly higher than that of the three parallel LSTMs and the single 3-DCNN.
Keyword:
Feature extraction
Spectrogram
Time-frequency analysis
Radar
Human activity recognition
Signal resolution
Correlation
Deep learning
human activity recognition (HAR)
parallel LSTM-CNN network (PLCN)
radar multispectrogram

期刊

IEEE Sensors Journal 封面图
IEEE Sensors Journal
IF:
4.5
论文数:
2.2W
被引数:
7.3W

机构

C
Chengdu University of Technology
学者数:
1.2W
论文数: 6.9K
被引数: 24
引用论文

引用论文

err
IF0
err
err0
errOAAI
err
err分享
err收藏
Human Activity Recognition Based on WRGAN-GP-Synthesized Micro-Doppler Spectrograms
err2022-05-01
err22
PREAI
errQu, Lele; Wang, Yutong; Yang, Tianhong; Sun, Yanpeng
err分享
err收藏
Observation of a 1,5-Silyl-Migration on Fructose
err2005-01-01
err0
PREAI
errAndrew D. Miller; Stefan Furegati; Andrew J. White
err分享
err收藏
A Fast SAR Imaging Method for Ground Moving Target Using a Second-Order WVD Transform
err2016-04-01
err101
PREAI
errHuang, Penghui; Liao, Guisheng; Yang, Zhiwei; Xia, Xiang-Gen; Ma, Jing-Tao; Zhang, Xuepan
err分享
err收藏
Human Activity Recognition Based on Mixed CNN With Radar Multi-Spectrogram
err2021-11-15
err22
PREAI
errTang, Longzhen; Jia, Yong; Qian, Yujia; Yi, Shi; Yuan, Peng
err分享
err收藏
学者 查看更多内容