arrow
返回

Diffusion-based network for unsupervised landmark detection

delete2024-05-01
delete2
PRE
AI
T
Tao Wu
王
王凯 (Kexin Wang)
C
Chuanming Tang
J
Jianlin Zhang *
DOI:10.1016/j.knosys.2024.111627delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Landmark detection is a fundamental task aiming at identifying specific landmarks that serve as representations of distinct object features within an image. However, the present landmark detection algorithms often adopt complex architectures and are trained in a supervised manner using large datasets to achieve satisfactory performance. When faced with limited data, these algorithms tend to experience a notable decline in accuracy. To address these drawbacks, we propose a novel diffusion -based network ( DBN ) for unsupervised landmark detection, which leverages the generation ability of the diffusion models to detect the landmark locations. In particular, we introduce a dual-branch encoder ( DualE ) for extracting visual features and predicting landmarks. Additionally, we lighten the decoder structure for faster inference, referred to as LightD . By this means, we avoid relying on extensive data comparison and the necessity of designing complex architectures as in previous methods. Experiments on CelebA, AFLW, 300W and Deepfashion benchmarks have shown that DBN performs state -of -the -art compared to the existing methods. Furthermore, DBN shows robustness even when faced with limited data cases.
Keyword:
Computer vision
Unsupervised learning
Landmark detection
Generation model

期刊

K
Knowledge-Based Systems
IF:
7.6
论文数:
1.3W
被引数:
4.5W

机构

U
university of chinese academy of sciences, cas
学者数:
4.1W
论文数: 3.8W
被引数: 75
C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
引用论文

引用论文

Robust Face Alignment by Multi-Order High-Precision Hourglass Network
err2021-01-01
err39
errOAAI
errWan, Jun; Lai, Zhihui; Liu, Jun; Zhou, Jie; Gao, Can
err分享
err收藏
A glove-based system for studying hand-object manipulation via joint pose and force sensing
err2017-09-01
err0
PREAI
errHangxin Liu; Xu Xie; Matt Millar; Mark Edmonds; Feng Gao; Yixin Zhu; Veronica J. Santos; Brandon Rothrock; Song-Chun Zhu
err分享
err收藏
Thalamocortical Long-Term Potentiation Becomes Gated after the Early Critical Period in the Auditory Cortex
err2013-04-24
err0
errOAAI
errSungkun Chun; Ildar T. Bayazitov; Jay A. Blundon; Stanislav S. Zakharenko
err分享
err收藏
err分享
err收藏
Potential role of new anticoagulants for prevention and treatment of venous thromboembolism in cancer patients
err2013-05-01
err0
errOAAI
errAntonio Gómez-Outes; Suárez-Gea; Lecumberri; Ana Isabel Terleira-Fernández; Emilio Vargas-Castrillón; Rocha
err分享
err收藏
Structural Neural Substrates of Reading the Mind in the Eyes在眼睛中阅读心灵的结构神经基质
err2016-04-11
err0
errOAAI
errWataru Sato; Takanori Kochiyama; Shota Uono; Reiko Sawada; Yasutaka Kubota; Sayaka Yoshimura; Motomi Toichi
err分享
err收藏
err分享
err收藏
Precise Facial Landmark Detection by Reference Heatmap Transformer
err2023-01-01
err34
errOAAI
errWan, Jun; Liu, Jun; Zhou, Jie; Lai, Zhihui; Shen, Linlin; Sun, Hang; Xiong, Ping; Min, Wenwen
err分享
err收藏
Text2Human: Text-Driven Controllable Human Image Generation
err2022-07-22
err53
PREAI
errJiang, Yuming; Yang, Shuai; Qju, Haonan; Wu, Wayne; Loy, Chen Change; Liu, Ziwei
err分享
err收藏
学者 查看更多内容