arrow
返回

Neural network interpretation using descrambler groups

delete2021-01-26
delete22
delete
OA
AI
J
J. L. Amey
J
Jake Keeley
T
Tajwar Choudhury
I
Ilya Kuprov *
DOI:10.1073/pnas.2016917118delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
The lack of interpretability and trust is a much-criticized feature of deep neural networks. In fully connected nets, the signaling between inner layers is scrambled because backpropagation training does not require perceptrons to be arranged in any particular order. The result is a black box; this problem is particularly severe in scientific computing and digital signal processing (DSP), where neural nets perform abstract mathematical transformations that do not reduce to features or concepts. We present here a group-theoretical procedure that attempts to bring inner-layer signaling into a human-readable form, the assumption being that this form exists and has identifiable and quantifiable features-for example, smoothness or locality. We applied the proposed method to DEERNet (a DSP network used in electron spin resonance) and managed to descramble it. We found considerable internal sophistication: the network spontaneously invents a bandpass filter, a notch filter, a frequency axis rescaling transformation, frequency-division multiplexing, group embedding, spectral filtering regularization, and a map from harmonic functions into Chebyshev polynomials-in 10 min of unattended training from a random initial guess.
Keyword:
machine learning
interpretability
digital signal processing
electron spin resonance
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

P
Proceedings of the National Academy of Sciences of the United States of America
IF:
9.1
论文数:
10.8W
被引数:
73.5W

机构

U
university of southampton
学者数:
3.3W
论文数: 3.2W
被引数: 52
引用论文

引用论文

err分享
err收藏
err分享
err收藏
Deep neural network processing of DEER data
err2018-08-03
err135
errOAAI
errWorswick, Steven G.; Spencer, James A.; Jeschke, Gunnar; Kuprov, Ilya
err分享
err收藏
学者 查看更多内容