.png){kind=icon}
Return
EIK-Nav: Boosting zero-shot object navigation with explicit and implicit knowledge
.png){kind=icon}
PRE
AI
DOI：10.1016/j.patcog.2025.112945.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Zero-shot Object Navigation demands the agent to explore unfamiliar environments and navigate to certain objects. In this paper, we propose a new framework that combines Explicit and Implicit Knowledge Navigation (EIK-Nav) to facilitate the overall zero-shot object navigation from both the exploration and detection process. The implicit knowledge is derived from the pre-trained vision-language model (VLM) that measures the semantic distance between the textual target category and RGB images, and thus provides a baseline value for determining the exploration potential of a specific area. The explicit knowledge is provided by the large language model (LLM), consisting of the co-occurrence relation among the target, the room, and other objects. EIK-Nav uses explicit knowledge as an extra constraint over the implicit value to decide where the most valuable area to explore is. In the detection process, the explicit co-occurrence relation can further offer additional evidence for determining the confidence of the detected target, which can elevate the detection process from being independent to considering the surrounding context. The experimental results on photo-realistic environments, including Matterport 3D (MP3D), Habitat-Matterport 3D (HM3D), and Gibson demonstrate that our proposed method achieves state-ofthe-art results even compared with training-based methods.
Keywords:
Zero-shot object navigation
Object navigation
Embodied AI
Journal
IF:
7.6
Papers:
1.3W
Citations:
4.5W
Organization
Cited Papers
Investigating Synthetic-to-Real Transfer Robustness for Stereo Matching and Optical Flow Estimation
PREAI
ShareSaveShareSaveLiDAR-based localization using universal encoding and memory-aware regression.png)
PATTERN RECOGNITION
PATTERN RECOGNITIONIF7.6
PREAI
ShareSaveShareSaveParameter-efficient action planning with large language models for vision-and-language navigationPattern Recognition
OAAI
Pattern RecognitionIF7.6
OAAIShareSaveShareSave
View more