Localizing Open World Objects Using Self-learned Latent Keypoints

Sharad Joshi

doi:10.1007/978-3-031-93691-3_5

Localizing Open World Objects Using Self-learned Latent Keypoints

2026-01-01

0

PRE

AI

DOI：10.1007/978-3-031-93691-3_5

Original

Original request for help

Save

Abstract

En 中文

Detecting instances of object categories unseen by the model during training has essential applications in several downstream computer vision tasks. However, conventional object detectors are not designed to detect unseen, open-world object categories. The performance on unseen categories may be improved by improving the model's generic objectness criteria, which tends to overfit the seen categories. We introduce a self-learned latent keypoints (Self-LKP)-based training approach that guides a conventional object detection model to learn class-agnostic weights. Specifically, our method allows the model to incorporate objectness cues by learning latent keypoints within each object boundary. This helps improve the model's ability to detect and localize a generic object. We extensively evaluate the proposed approach for cross-category and cross-dataset setups using three well-established object detection datasets using both one and two-stage detectors. The proposed Self-LKP approach improves average recall by 7.2% on unseen object categories using a one-stage object detector.

Keywords:

Object Detection

Object Localization

Keypoints

Class-agnostic

Self-learning

Localizing Open World Objects Using Self-learned Latent Keypoints

Abstract

Journal

Organization