arrow
返回

Two-Stream Network Based on Visual Saliency Sharing for 3D Model Recognition

delete2020-01-01
delete5
delete
OA
AI
W
Weizhi Nie
Q
Qu Lu
M
Minjie Ren
Q
Qi Liang *
苏育挺 封面图
苏育挺 (Yuting Su)
Y
Yangyang Li
H
Hao Jin
DOI:10.1109/ACCESS.2019.2963511delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Shape representation for 3D models is an important topic in computer vision, multimedia analysis, and computer graphics. Recent multiview-based methods demonstrate promising performance for 3D model recognition and retrieval. However, most of the multiview-based methods focus on the visual information from the taken views and ignore correlation information among these views, which means the similarity and differentiation of multiple views have lost in their methods. In order to address this issue, we propose a novel two-stream network architecture for 3D model recognition and retrieval. The proposed network includes two sub-networks: a multi-view convolutional neural network (MVCNN) that extracts the view information from the taken views, and an Visual Saliency model that defines the weight of views based on the similarity and differentiation information of multiple views. Special, the weight of views defined by the Visual Saliency model can effectively be used to guide the visual information fusion in MVCNN model. This design can make the MVCNN model save visual information and the correlation information of these views in the learning step. Finally, we employ early-fusion method to fuse the feature vectors from MVCNN model and Visual Saliency model respectively, to generate the shape descriptor for 3D model recognition and retrieval. The experimental result on two public datasets, ModelNet40 and ShapeNetCore55, demonstrates the correlation information of multiple views is crucial for view-based 3D model recognition methods and the proposed method can achieve the state-of-the-art performance on both 3D object classification and retrieval.
Keyword:
3D model
view-based
classification
retrieval
MVCNN
LSTM
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

T
tianjin university
学者数:
8.0W
论文数: 5.8W
被引数: 88
引用论文

引用论文

View-Based 3-D Model Retrieval: A Benchmark
err2018-03-01
err74
errOAAI
errLiu, An-An; Nie, Wei-Zhi; Gao, Yue; Su, Yu-Ting
err分享
err收藏
err分享
err收藏
Automatic Instrument Segmentation in Robot-Assisted Surgery Using Deep Learning
err
IF0
err2018-03-03
err0
errOAAI
errAlexey A. Shvets; Alexander Rakhlin; Alexandr A. Kalinin; Vladimir I. Iglovikov
err分享
err收藏
Norepinephrine and traumatic brain injury: a possible role in post-traumatic edema
err1998-08-01
err0
PREAI
errAmbrose A Dunn-Meynell; Mohammed Hassanain; Barry E Levin
err分享
err收藏
学者 查看更多内容