arrow
Return

Understanding the learning mechanism of convolutional neural networks in spectral analysis

delete2020-07-01
delete103
PRE
AI
X
Xiaolei Zhang
J
Jinfan Xu
J
Jie Yang
L
Li Chen
周海波 (Haibo Zhou)
刘湘江 cover
刘湘江 (Xiangjiang Liu)
H
Haifeng Li
T
Tao Lin *
Y
Yibin Ying
DOI:10.1016/j.aca.2020.03.055delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Deep learning approaches, especially convolutional neural network (CNN) models, have achieved excellent performances in vibrational spectral analysis. The critical drawback of the CNN approach is the lack of interpretation, and it is regarded as a black box. Interpreting the learning mechanism of chemometric models is critical for intuitive understanding and further application. In this study, an interpretable CNN model with a global average pooling layer is presented for Raman and mid-infrared spectral data analysis. A class activation mapping (CAM)-based approach is leveraged to visualize the active variables in the whole spectrum. The visualization of active variables shows a discriminative pattern in which the most contributed variables peaked around theoretical chemical characteristic bands. The visualization of the feature maps by three convolutional layers demonstrates the data transformation pipeline and how the CNN model hierarchically extracts informative spectral features. The first layer acts as a Savitzky-Golay filter and learns spectral shape characteristics, while the second layer learns enhanced patterns from typical spectral peaks on a few correlated variables. The third layer shows stable activations on critical spectral peaks. A partial least squares - linear discriminant analysis (PLS-LDA) model is presented for comparison on classification accuracy and model interpretation. The CNN model yields mean classification accuracies of 99.01 and 100% for E. coli and meat datasets on the test set, while the PLS-LDA models obtain accuracies of 98.83 and 100%. Both the CNN and PLS-LDA models demonstrate stable patterns on active variables while CNN models are more stable than PLS-LDA models on classification performances for various dataset partitions with Monte-Carlo cross-validation. (C) 2020 Elsevier B.V. All rights reserved.
Keywords:
Feature visualization
Interpretation
Deep learning
Reliability
Class activation mapping
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Analytica Chimica Acta cover
Analytica Chimica Acta
IF:
6
Papers:
3.3W
Citations:
6.1W

Organization

C
Central South University
Scholars:
10.0W
Papers: 7.2W
Citations: 10.9W
J
jinan university
Scholars:
4.2W
Papers: 2.6W
Citations: 38
Z
zhejiang university
Scholars:
17.1W
Papers: 11.9W
Citations: 152
researcher View more organizations