返回
Parallel LSTM-CNN Network With Radar Multispectrogram for Human Activity Recognition
DOI:10.1109/JSEN.2022.3224083.png)
摘要
En 中文
Owing to the ability of automatic feature extraction, deep learning is extensively applied in human activity recognition (HAR) based on radar. In this article, a recognition method based on a multispectrogram and deep-learning model is proposed. The radar echo data are transformed into spectrograms with different feature expressions by performing three time-frequency analyses, including short-time Fourier transform (STFT), reduced interference distribution with Hanning kernel (RIDHK), and smoothed pseudo-Wigner-Ville distribution (SPWVD), and then the spectrograms are sent to deep-learning model to realize HAR. The model employs three long short-term memory (LSTM) networks to learn the temporal features of the spectrograms and uses a 3-D convolutional neural network (3-DCNN) to extract the independent spatial features of a single spectrogram and the spatial correlation features between different kinds of spectrograms, named parallel LSTM-CNN network (PLCN). The PLCN is capable of effectively improving the degree of feature utilization in the spectrogram and the accuracy of human activity classification by fusing both temporal and spatial features. The final experimental results show that the average recognition accuracy of the method based on the PLCN for eight human activities reaches 94.75%, which is significantly higher than that of the three parallel LSTMs and the single 3-DCNN.
Keyword:
Feature extraction
Spectrogram
Time-frequency analysis
Radar
Human activity recognition
Signal resolution
Correlation
Deep learning
human activity recognition (HAR)
parallel LSTM-CNN network (PLCN)
radar multispectrogram
期刊
IF:
4.5
论文数:
2.2W
被引数:
7.3W
机构
引用论文
Human Activity Recognition Based on WRGAN-GP-Synthesized Micro-Doppler Spectrograms
IEEE SENSORS JOURNAL
IF4.5
Babes in the Woods: Wilderness Aesthetics in Children's Stories and Toys, 1830-1915《林中婴儿:1830-1915年儿童故事与玩具中的荒野美学》
Do Perceptions of Competence Mediate The Relationship Between Fundamental Motor Skill Proficiency and Physical Activity Levels of Children in Kindergarten?能力的感知是否可以介导幼儿园儿童的基本运动技能熟练程度与身体活动水平之间的关系?

