arrow
Return

Diffusion-based network for unsupervised landmark detection

delete2024-05-01
delete2
PRE
AI
T
Tao Wu
王凯 (Kexin Wang)
C
Chuanming Tang
J
Jianlin Zhang *
DOI:10.1016/j.knosys.2024.111627delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Landmark detection is a fundamental task aiming at identifying specific landmarks that serve as representations of distinct object features within an image. However, the present landmark detection algorithms often adopt complex architectures and are trained in a supervised manner using large datasets to achieve satisfactory performance. When faced with limited data, these algorithms tend to experience a notable decline in accuracy. To address these drawbacks, we propose a novel diffusion -based network ( DBN ) for unsupervised landmark detection, which leverages the generation ability of the diffusion models to detect the landmark locations. In particular, we introduce a dual-branch encoder ( DualE ) for extracting visual features and predicting landmarks. Additionally, we lighten the decoder structure for faster inference, referred to as LightD . By this means, we avoid relying on extensive data comparison and the necessity of designing complex architectures as in previous methods. Experiments on CelebA, AFLW, 300W and Deepfashion benchmarks have shown that DBN performs state -of -the -art compared to the existing methods. Furthermore, DBN shows robustness even when faced with limited data cases.
Keywords:
Computer vision
Unsupervised learning
Landmark detection
Generation model

Journal

K
Knowledge-Based Systems
IF:
7.6
Papers:
1.2W
Citations:
4.5W

Organization

U
university of chinese academy of sciences, cas
Scholars:
4.1W
Papers: 3.8W
Citations: 75
C
chinese academy of sciences
Scholars:
56.1W
Papers: 44.8W
Citations: 704