Alignment-Invertibility Regularization for Explainable Neural Networks

Borui Zhang

doi:10.1109/TPAMI.2026.3665728

Alignment-Invertibility Regularization for Explainable Neural Networks

2026-02-17

0

PRE

AI

DOI：10.1109/TPAMI.2026.3665728

Original

Original request for help

Save

Abstract

En 中文

Deep learning has profoundly impacted society, yet the inherent nature of deep neural networks hinders further application to high-reliability industries. To demystify these closed-boxes, numerous works attempt to improve the explainability by observing or impacting internal variables of the models. However, existing methods rely on heuristics without rigorous theoretical foundations, often requiring intricate model modifications or redesigns. This work first formalizes two fundamental properties of explainability: alignment and invertibility, serving as theoretical pillars for rigorous interpretability analysis. Building on these, we introduce Bort, a plug-and-play optimizer that enforces Boundedness and orthogonality constraints on model parameters to improve explainability. These constraints are theoretically derived from the alignment and invertibility principles. Considering conventional optimizers can not leverage data features for precise attribution, we present a data-aware extension, termed DBort, which integrates an auxiliary loss term. Intriguingly, in the linear case, DBort converges to Principal Component Analysis (PCA). Our in-depth analysis of penalty term design reveals that <inline-formula><tex-math notation="LaTeX">$l_{1}$</tex-math></inline-formula>-based penalties provide a more stringent adherence to the imposed constraints compared to their <inline-formula><tex-math notation="LaTeX">$l_{2}$</tex-math></inline-formula> counterparts. Our experiments involve reconstructing and backtracking through the optimized model representations, which reveal a marked enhancement in explainability. Furthermore, leveraging Bort, we successfully synthesize explainable adversarial examples without additional training. Notably, Bort consistently improves the classification accuracy across diverse architectures, including ResNet and DeiT, on benchmark datasets such as MNIST, CIFAR-10, and ImageNet.

Keywords:

Interpretable deep learning

XAI

neural networks

optimizer

explainability

Alignment-Invertibility Regularization for Explainable Neural Networks

Abstract

Journal

Organization