arrow
返回

Sequential learning for sketch-based 3D model retrieval

delete2022-01-09
delete11
PRE
AI
H
Hairui Yang
Y
Yu Tian
Z
Zhihui Wang *
L
Lei Wang
H
Haojie Li
DOI:10.1007/s00530-021-00871-wdelete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Sketch-based 3D model retrieval suffers large visual discrepancy between 3D models and 2D sketches. Most existing methods directly project samples from both modalities into a same semantic embedding space to alleviate the discrepancy. We argue that simultaneous learning of those two modalities would restrict the discrimination of 3D model representation, resulting in inferior retrieval results. In this work, we propose a novel sequential learning (SL) framework for sketch-based 3D model retrieval to learn 3D model representation and 2D sketch representation separately and sequentially. Specifically, the SL framework is composed of two modules, 3D model network (3DMN) and 2D sketch network (2DSN). Firstly, we train 3DMN with a discriminative loss formulated only on 3D models to promote discrimination. Then, the learned representations of 3D models guide 2DSN to learn discriminative 2D sketch representations. In the second phase, we further mine the implicit fine-grained class information of 3D models by unsupervised clustering algorithms. An alignment loss is formulated on 2D sketches and corresponding fine-grained class centers of 3D models. Extensive experiments on three large-scale benchmark datasets for 3D model retrieval validate the efficacy of the proposed SL framework and fine-grained class representations.
Keyword:
Sketch-based retrieval
3D model retrieval
Sequential learning
Shape representation

期刊

Multimedia Systems 封面图
Multimedia Systems
IF:
3.1
论文数:
2.8K
被引数:
2.7K

机构

D
Dalian University of Technology
学者数:
6.0W
论文数: 4.4W
被引数: 5.5W
引用论文

引用论文

Core–Shell Catalyst CuO–ZnO–Al2O3@Al2O3 for Dimethyl Ether Synthesis from Syngas
err2013-04-05
err0
PREAI
errYan Wang; Wenli Wang; Yuexian Chen; Jinghong Ma; Jiajun Zheng; Ruifeng Li
err分享
err收藏
A histories perspective on characterizing quantum non-locality
err2014-03-26
err0
errOAAI
errFay Dowker; Joe Henson; Petros Wallden
err分享
err收藏
Effective 3-D Shape Retrieval by Integrating Traditional Descriptors and Pointwise Convolution
err2019-12-01
err10
PREAI
errKuang, Zhenzhong; Yu, Jun; Zhu, Suguo; Li, Zongmin; Fan, Jianping
err分享
err收藏
Adequacy of Nutritional Intake in a Canadian Population of Patients with Crohn’s Disease
err2007-09-01
err0
PREAI
errElaheh Aghdassi; Barbara E. Wendland; Melanie Stapleton; Maitreyi Raman; Johane P. Allard
err分享
err收藏
Endoscopic and Pathologic Changes of the Upper Gastrointestinal Tract in Crohn’s Disease
err2014-01-01
err0
errOAAI
errAtsushi Sakuraba; Yasushi Iwao; Katsuyoshi Matsuoka; Makoto Naganuma; Haruhiko Ogata; Takanori Kanai; Toshifumi Hibi
err分享
err收藏
学者 查看更多内容