arrow
返回

Convolutional Neural Networks Demystified: A Matched Filtering Perspective-Based Tutorial

delete2023-06-01
delete12
delete
OA
AI
L
Ljubiša Stanković
D
Danilo P. Mandic *
DOI:10.1109/TSMC.2022.3228597delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Deep neural networks (DNNs) and especially convolutional neural networks (CNNs) have revolutionized the way we approach the analysis of large quantities of data. However, the largely ad hoc fashion of their development, albeit one reason for their rapid success, has also brought to light the intrinsic limitations of CNNs-in particular, those related to their black box nature. In addition, the ability to explain both the way such systems behave and the results they produce is increasingly becoming an imperative in many practical applications. Therefore, it would be particularly useful to establish physically meaningful mechanisms underpinning the operation of CNNs, thus helping to resolve the issue of interpretability of the processing steps and explain their input-output relationship. To this end, we revisit the operation of CNNs from first principles and show that their very backbone-the convolution operation-represents a matched filter which examines the input for the presence of characteristic patterns in data. Our treatment is based on temporal signals, naturally generated by physical sensors, which admit rigorous analysis through systems science. This serves as a vehicle for a unifying account on the overall functionality of CNNs, whereby both the convolution-activation-pooling chain and learning strategies are shown to admit a compact and elegant interpretation under the umbrella of matched filtering. In addition to helping reveal the physical principles underpinning CNNs and providing an intuitive understanding of their operation, the treatment of CNNs from a matched filtering perspective is also shown to offer a platform to support further developments in this area.
Keyword:
Convolutional neural networks (CNNs)
domain knowledge
explainability
interpretability of CNNs
matched filter

期刊

IEEE Transactions on Cybernetics 封面图
IEEE Transactions on Cybernetics
IF:
10.5
论文数:
1.1W
被引数:
5.0W

机构

U
University of Montenegro
学者数:
1.6K
论文数: 1.2K
被引数: 804
I
Imperial College London
学者数:
8.3W
论文数: 7.3W
被引数: 11.1W
引用论文

引用论文

Catalysts effect on single-walled carbon nanotube branching
err2007-08-01
err0
PREAI
errJun Huang; Do Hyun Kim; Raghunandan Seelaboyina; Banglore K. Rao; Dake Wang; Minseo Park; WonBong Choi
err分享
err收藏
Recent advances in convolutional neural network acceleration
err2019-01-01
err245
errOAAI
errZhang, Qianru; Zhang, Meng; Chen, Tinghuan; Sun, Zhifei; Ma, Yuzhe; Yu, Bei
err分享
err收藏
Asymmetric CNN for Image Superresolution
err2022-06-01
err85
errOAAI
errTian, Chunwei; Xu, Yong; Zuo, Wangmeng; Lin, Chia-Wen; Zhang, David
err分享
err收藏
Automated Deep CNN-LSTM Architecture Design for Solar Irradiance Forecasting
err2022-01-01
err93
PREAI
errJalali, Seyed Mohammad Jafar; Ahmadian, Sajad; Kavousi-Fard, Abdollah; Khosravi, Abbas; Nahavandi, Saeid
err分享
err收藏
First COVID-19 case in Zambia — Comparative phylogenomic analyses of SARS-CoV-2 detected in African countries
err2021-01-01
err0
errOAAI
errEdgar Simulundu; Francis Mupeta; Pascalina Chanda-Kapata; Ngonda Saasa; Katendi Changula; Walter Muleya; Simbarashe Chitanga; Miniva Mwanza; Paul Simusika; Herman Chambaro; Benjamin Mubemba; Masahiro Kajihara; Duncan Chanda; Lloyd Mulenga; Sombo Fwoloshi; Aaron Lunda Shibemba; Fred Kapaya; Paul Zulu; Kunda Musonda; Mwaka Monze; Nyambe Sinyange; Mazyanga L. Mazaba; Muzala Kapin’a; Peter J. Chipimo; Raymond Hamoonga; Davie Simwaba; William Ngosa; Albertina N. Morales; Nkomba Kayeyi; John Tembo; Mathew Bates; Yasuko Orba; Hirofumi Sawa; Ayato Takada; King S. Nalubamba; Kennedy Malama; Victor Mukonka; Alimuddin Zumla; Nathan Kapata
err分享
err收藏
1D convolutional neural networks and applications: A survey
err2021-04-01
err1.3K
errOAAI
errKiranyaz, Serkan; Avci, Onur; Abdeljaber, Osama; Ince, Turker; Gabbouj, Moncef; Inman, Daniel J.
err分享
err收藏
学者 查看更多内容