arrow
Return

Zero-Shot Learning on 3D Point Cloud Objects and Beyond

delete2022-08-04
delete18
delete
OA
AI
A
Ali Cheraghian
S
Shafin Rahman *
T
Townim Faisal Chowdhury
D
Dylan Campbell
L
Lars Petersson
DOI:10.1007/s11263-022-01650-4delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Zero-shot learning, the task of learning to recognize new classes not seen during training, has received considerable attention in the case of 2D image classification. However, despite the increasing ubiquity of 3D sensors, the corresponding 3D point cloud classification problem has not been meaningfully explored and introduces new challenges. In this paper, we identify some of the challenges and apply 2D Zero-Shot Learning (ZSL) methods in the 3D domain to analyze the performance of existing models. Then, we propose a novel approach to address the issues specific to 3D ZSL. We first present an inductive ZSL process and then extend it to the transductive ZSL and Generalized ZSL (GZSL) settings for 3D point cloud classification. To this end, a novel loss function is developed that simultaneously aligns seen semantics with point cloud features and takes advantage of unlabeled test data to address some known issues (e.g., the problems of domain adaptation, hubness, and data bias). While designed for the particularities of 3D point cloud classification, the method is shown to also be applicable to the more common use-case of 2D image classification. An extensive set of experiments is carried out, establishing state-of-the-art for ZSL and GZSL on synthetic (ModelNet40, ModelNet10, McGill) and real (ScanObjectNN) 3D point cloud datasets.
Keywords:
Zero-shot learning
3D point clouds
Transductive learning
Hubness problem

Journal

International Journal of Computer Vision cover
International Journal of Computer Vision
IF:
9.3
Papers:
3.9K
Citations:
2.8W

Organization

N
north south university (nsu)
Scholars:
1.5K
Papers: 929
Citations: 0
U
university of oxford
Scholars:
9.8W
Papers: 8.6W
Citations: 137
researcher View more organizations
Cited Papers

Cited Papers

Sclerostin deficient mice rapidly heal bone defects by activating β-catenin and increasing intramembranous ossification
err2013-11-01
err0
errOAAI
errMeghan E. McGee-Lawrence; Zachary C. Ryan; Lomeli R. Carpio; Sanjeev Kakar; Jennifer J. Westendorf; Rajiv Kumar
errShare
errSave
Alternative solid state routes to mixed metal oxides (LnCrO3, LnFeO3)
err1996-06-01
err0
PREAI
errI.P. Parkin; A.V. Komarov; Q. Fang
errShare
errSave
researcher View more