1
Return

Enhancing task-oriented robotic grasping via 3D affordance grounding from vision-language models

delete2025-12-29
delete0
delete
OA
AI
W
Wenkai Chen *
S
Shang-Ching Liu
Q
Qingdu Li
Y
Yung-Hui Li
J
Jianwei Zhang
DOI:10.1007/s40747-025-02169-0delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Existing task-oriented grasping approaches often rely on 2D pixel-wise affordance segmentation or predefined part annotations, limiting their applicability in unstructured 3D environments and constraining the grasp planning space. To overcome these limitations, we introduce a novel affordance-labeled grasp dataset constructed on simulation, capturing diverse functional interactions across object categories in a 6-DoF space. Building on this foundation, we propose a unified, language-guided grasping framework that takes partial point clouds and natural language instructions as input to generate semantically meaningful and geometrically feasible grasp poses. Specifically, a vision-language affordance grounding module produces dense 3D affordance maps aligned with task semantics, and a task-oriented grasp pipeline predicts coarse grasp candidates with implicit affordance cues. The coarse grasp proposals are subsequently refined based on visual affordance guidance, significantly enhancing both semantic alignment and grasp practicality. Extensive experiments in synthetic and real-world scenarios demonstrate that our method outperforms state-of-the-art approaches, effectively generalizing across diverse objects and tasks.
Keywords:
Task-oriented grasping
3D affordance grounding
Vision-language models
Computational Intelligence
Complexity
Data Structures and Information Theory
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Complex and Intelligent Systems cover
Complex and Intelligent Systems
IF:
4.6
Papers:
2.1K
Citations:
6.6K

Organization

H
hon hai research institute (hhri)
Scholars:
1
Papers: 1
Citations: 0
I
Institute of Machine Intelligence
Scholars:
4
Papers: 4
Citations: 0
D
department of informatics
Scholars:
197
Papers: 106
Citations: 2
Cited Papers

Cited Papers

Citing Papers

Citing Papers