arrow
返回

Language-Guided Robot Grasping Based on Basic Geometric Shape Fitting

delete2025-12-01
delete0
delete
OA
AI
Q
Qun Niu
C
Chuanlin Zhang
张天宇 封面图
张天宇 (Tianyu Zhang)
J
Jieliang Zhao *
T
Tie Fu
X
Xuemei Chen
DOI:10.1002/aisy.202501276delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
In open-world robotic manipulation tasks, language-guided model-free grasping has garnered increasing attention. However, existing approaches often overlook the geometric structure of target objects, which limits the effectiveness of subsequent tasks such as manipulation and placement. To address this limitation, a novel method called Language-Guided Grasping via Primitive Fitting is proposed. This approach integrates language instructions with multimodal perception to enhance the semantic interpretability and downstream usability of the grasp through structured geometric modeling. Specifically, the user-specified object using 2D images and depth data via multimodal understanding is first localized. Then, primitive fitting on the object's point cloud using basic geometric shapes (e.g., cuboids, ellipsoids, truncated cones) to extract approximate size and structural features is performed. Based on the geometric information, a grasp pose generation strategy guided by semantic geometry is defined, and modules for grasp feasibility filtering and task-oriented optimization to select the optimal grasp pose are introduced. This method is validated in real-world complex environments and achieved grasp success rates of 95% in structured and 90% in cluttered scenes. Geometric fitting enhances post-grasp predictability and semantic consistency, enabling better generalization and planning.
Keyword:
robot grasping
robotics
shape fitting
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Advanced Intelligent Systems 封面图
Advanced Intelligent Systems
IF:
6.1
论文数:
2.1K
被引数:
9.8K

机构

B
Beijing Institute of Technology
学者数:
5.5K
论文数: 1.6K
被引数: 2
引用论文

引用论文

Learning task-oriented grasping for tool manipulation from simulated self-supervision
err2019-08-29
err114
errOAAI
errKuan Fang; Zhu, Yuke; Garg, Animesh; Kurenkov, Andrey; Mehta, Viraj; Li Fei-Fei; Savarese, Silvio
err分享
err收藏
err分享
err收藏
GPR: Grasp Pose Refinement Network for Cluttered Scenes
err2021-05-30
err0
errOAAI
errWei Wei; Yongkang Luo; Fuyu Li; Guangyun Xu; Jun Zhong; Wanyi Li; Peng Wang
err分享
err收藏
Human-level control through deep reinforcement learning通过深度强化学习实现人类层面的控制
errNature
IF48.5
err2015-02-25
err0
PREAI
errVolodymyr Mnih; Koray Kavukcuoglu; David Silver; Andrei A. Rusu; Joel Veness; Marc G. Bellemare; Alex Graves; Martin Riedmiller; Andreas K. Fidjeland; Georg Ostrovski; Stig Petersen; Charles Beattie; Amir Sadik; Ioannis Antonoglou; Helen King; Dharshan Kumaran; Daan Wierstra; Shane Legg; Demis Hassabis
err分享
err收藏
学者 查看更多内容