arrow
Return

Prototype-based semantic consistency learning for unsupervised 2D image-based 3D shape retrieval

delete2023-04-11
delete2
PRE
AI
刘安安 (An-An Liu)
Y
Yuwei Zhang
C
Chenyu Zhang
李文辉 cover
李文辉 (Wenhui Li) *
B
Bo Lv
L
Lei Lei
X
Xuanya Li
DOI:10.1007/s00530-023-01086-xdelete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In this paper, we study the task of unsupervised 2D image-based 3D shape retrieval (UIBSR), which aims to retrieve unlabeled shapes (target domain) using labeled images (source domain). Previous works on UIBSR mainly focus on aligning the prototypes generated by the source labels and predicted target pseudo labels for reducing the cross-domain discrepancy. However, simply maintaining consistency between features may corrupt the original semantic information. Moreover, the existing methods usually ignore the diversity of the instances during the adaptation process, which results in reducing the discrimination of features. To solve these problems, we propose the prototype-based semantic consistency (PSC) learning method, exploring semantic knowledge in both prototype-prototype and prototype-instance relationships in the probability space rather than the embedding space to preserve the structure of semantic information. Besides, we propose a novel adversarial scheme between feature extractor and classifier to explore the characteristic of different instances, which can further enhance the model to learn more robust representations. Extensive experiments on two challenging datasets demonstrate the superiority of our proposed method.
Keywords:
Unsupervised 2D image-based 3D shape retrieval
Semantic consistency
Adversarial learning
Domain adaptation

Journal

Multimedia Systems cover
Multimedia Systems
IF:
3.1
Papers:
2.7K
Citations:
2.7K

Organization

T
tianjin university
Scholars:
7.8W
Papers: 5.7W
Citations: 88
C
china electronics technology group
Scholars:
1.8K
Papers: 1.4K
Citations: 0