arrow
Return

Empowering Morphing Attack Detection Using Interpretable Image-Text Foundation Model

delete2026-01-01
delete2
PRE
AI
S
Sushrut Patwardhan
R
Raghavendra Ramachandra *
S
Sushma Venkatesh
DOI:10.1007/978-3-031-93694-4_14delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Morphing attack detection has become an essential component of face recognition systems for ensuring a reliable verification scenario. In this paper, we present a multimodal learning approach that can provide a textual description of morphing attack detection. We first show that zero-shot evaluation of the proposed framework using Contrastive Language-Image Pretraining (CLIP) can yield not only generalizable morphing attack detection, but also predict the most relevant text snippet. We present an extensive analysis of ten different textual prompts that include both short and long textual prompts. These prompts are engineered by considering the human understandable textual snippet. Extensive experiments were performed on a face morphing dataset that was developed using a publicly available face biometric dataset. We present an evaluation of SOTA pre-trained neural networks together with the proposed framework in the zero-shot evaluation of five different morphing generation techniques that are captured in three different mediums.
Keywords:
Biometric
Face biometrics
Morphing attacks
Vulnerabilities
Interpretable

Journal

C
COMPUTER VISION AND IMAGE PROCESSING, CVIP 2024, PT III
IF:
0
Papers:
32
Citations:
0

Organization

N
norwegian university of science & technology (ntnu)
Scholars:
1.3K
Papers: 588
Citations: 0
Cited Papers

Cited Papers

Towards generalized morphing attack detection by learning residuals*
err2022-10-01
err8
errOAAI
errRaja, Kiran; Gupta, Gourav; Venkatesh, Sushma; Ramachandra, Raghavendra; Busch, Christoph
errShare
errSave
Morphed Face Detection Based on Deep Color Residual Noise
err2019-11-01
err0
errOAAI
errSushma Venkatesh; Raghavendra Ramachandra; Kiran Raja; Luuk Spreeuwers; Raymond Veldhuis; Christoph Busch
errShare
errSave
MIPGAN—Generating Strong and High Quality Morphing Attacks Using Identity Prior Driven GAN
err2021-07-01
err0
errOAAI
errHaoyu Zhang; Sushma Venkatesh; Raghavendra Ramachandra; Kiran Raja; Naser Damer; Christoph Busch
errShare
errSave
Face Morphing Attack Generation and Detection: A Comprehensive Survey
err2021-09-01
err0
errOAAI
errSushma Venkatesh; Raghavendra Ramachandra; Kiran Raja; Christoph Busch
errShare
errSave
errShare
errSave
Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization
err2017-10-01
err0
errOAAI
errRamprasaath R. Selvaraju; Michael Cogswell; Abhishek Das; Ramakrishna Vedantam; Devi Parikh; Dhruv Batra
errShare
errSave
Detecting Face Morphing Attacks with Collaborative Representation of Steerable Features
err2019-11-01
err0
PREAI
errRaghavendra Ramachandra; Sushma Venkatesh; Kiran Raja; Christoph Busch
errShare
errSave
researcher View more