arrow
返回

Interpreting Face Inference Models Using Hierarchical Network Dissection

delete2022-03-23
delete1
PRE
AI
D
Divyang Teotia
À
Àgata Lapedriza
S
Sarah Ostadabbas *
DOI:10.1007/s11263-022-01603-xdelete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
This paper presents Hierarchical Network Dissection, a general pipeline to interpret the internal representation of face-centric inference models. Using a probabilistic formulation, our pipeline pairs units of the model with concepts in our Face Dictionary, a collection of facial concepts with corresponding sample images. Our pipeline is inspired by Network Dissection, a popular interpretability model for object-centric and scene-centric models. However, our formulation allows to deal with two important challenges of face-centric models that Network Dissection cannot address: (1) spacial overlap of concepts: there are different facial concepts that simultaneously occur in the same region of the image, like nose (facial part) and pointy nose (facial attribute); and (2) global concepts: there are units with affinity to concepts that do not refer to specific locations of the face (e.g. apparent age). We use Hierarchical Network Dissection to dissect different face-centric inference models trained on widely-used facial datasets. The results show models trained for different tasks learned different internal representations. Furthermore, the interpretability results can reveal some biases in the training data and some interesting characteristics of the face-centric inference tasks. Finally, we conduct controlled experiments on biased data to showcase the potential of Hierarchical Network Dissection for bias discovery. The results illustrate how Hierarchical Network Dissection can be used to discover and quantify bias in the training data that is also encoded in the model.
Keyword:
Bias discovery
Face-based inference models
Face dictionary
Model interpretability
Network dissection

期刊

International Journal of Computer Vision 封面图
International Journal of Computer Vision
IF:
9.3
论文数:
3.9K
被引数:
2.8W

机构

U
uoc universitat oberta de catalunya
学者数:
1.5K
论文数: 1.3K
被引数: 0
N
Northeastern University
学者数:
2.5W
论文数: 1.6W
被引数: 3.0W
引用论文

引用论文

Breakdown of the Mott-Hubbard State inFe2O3: A First-Order Insulator-Metal Transition with Collapse of Magnetism at 50 GPa
err1999-06-07
err0
PREAI
errM. P. Pasternak; G. Kh. Rozenberg; G. Yu. Machavariani; O. Naaman; R. D. Taylor; R. Jeanloz
err分享
err收藏
err分享
err收藏
An Early Triassic gladius associated with soft tissue remains from Idaho, USA—a squid-like coleoid cephalopod at the onset of Mesozoic Era
err2018-01-01
err0
errOAAI
errLarisa Doguzhaeva; Arnaud Brayard; Nicolas Goudemand; Laurel Krumenacker; James Jenk; Kevin Bylund; Emmanuel Fara; Nicolas x Olivier; Gilles Escarguel; Emmanuelle Vennin
err分享
err收藏
Cycloaddition Rates of Diazomethane and Diphenyldiazomethane
err1978-01-01
err0
errOAAI
errRolf Huisgen; Lubor Fisera; Jochen Geittner; Hans-Ulrich Reissig
err分享
err收藏
Two-photon absorption and photoluminescence of colloidal gold nanoparticles and nanoclusters
err2019-01-01
err0
PREAI
errJoanna Olesiak-Banska; Magdalena Waszkielewicz; Patryk Obstarczyk; Marek Samoc
err分享
err收藏
学者 查看更多内容