arrow
返回

Learning Humanoid Navigation From Human Data

delete2026-07-06
delete0
PRE
AI
W
Weizhuo Wang
Y
Yanjie Ze
C
C. Karen Liu
M
Monroe Kennedy
DOI:10.1109/lra.2026.3710346delete
delete原文链接
delete分享
delete收藏
摘要

摘要

En 中文
我们提出EgoNav系统,该系统使类人机器人能够通过完全学习5小时的人类行走数据(无需机器人数据或微调),实现零样本、无目标约束的穿越任务,可应用于经过评估的未见环境。扩散模型根据过去轨迹、360°视觉记忆(融合颜色、深度和语义信息)以及来自冻结DINOv3骨干网络的视频特征(捕捉深度传感器不可见的外观线索)来预测未来可能轨迹的分布。混合采样方案在10步去噪过程中实现实时推理,而滚动时域控制器从预测分布中选择路径。我们通过离线评估、与VFH+和MPPI的实际世界对比以及类人机器人Unitree G1在未见室内外环境中的零样本部署失败模式分析验证了EgoNav。诸如等待门开启、绕行人群和避开玻璃墙等行为自然地从学习到的先验中涌现。我们将发布数据集和训练模型。
Keyword:
Learning from demonstration
humanoid robot systems
vision-based navigation

期刊

I
IEEE Robotics and Automation Letters
IF:
5.3
论文数:
3.4K
被引数:
4.0W

机构

S
Stanford University
学者数:
7.3K
论文数: 2.4K
被引数: 9.7W
引用论文

引用论文

Trace and Pace: Controllable Pedestrian Animation via Guided Trajectory Diffusion
err2023-06-01
err0
errOAAI
errDavis Rempe; Zhengyi Luo; Xue Bin Peng; Ye Yuan; Kris Kitani; Karsten Kreis; Sanja Fidler; Or Litany
err分享
err收藏
Universal Manipulation Interface: In-The-Wild Robot Teaching Without In-The-Wild Robots通用操作接口:无需在野机器人的在野机器人教学
err2024-07-15
err0
PREAI
errCheng Chi; Zhenjia Xu; Chuer Pan; Eric Cousineau; Benjamin Burchfiel; Siyuan Feng; Russ Tedrake; Shuran Song
err分享
err收藏
Learning Social Etiquette: Human Trajectory Understanding In Crowded Scenes
err2016-09-17
err0
PREAI
errAlexandre Robicquet; Amir Sadeghian; Alexandre Alahi; Silvio Savarese
err分享
err收藏
LookOut: Real-World Humanoid Egocentric Navigation
err2025-10-19
err0
PREAI
errPan,Boxiao; Harley,Adam W.; Engelmann,Francis; Liu,C. Karen; Guibas,Leonidas J.
err分享
err收藏
Humanoid Locomotion as Next Token Prediction
err2024-01-01
err0
PREAI
errDarrell,Trevor; Kamat,Sarthak; Malik,Jitendra; Radosavovic,Ilija; Rajasegaran,Jathushan; Shi,Baifeng; Sreenath,Koushil; Zhang,Bike
err分享
err收藏
Multimodal Trajectory Predictions for Autonomous Driving using Deep Convolutional Networks基于深度卷积网络的自动驾驶多模态轨迹预测
err2019-05-01
err0
errOAAI
errHenggang Cui; Vladan Radosavljevic; Fang-Chieh Chou; Tsung-Han Lin; Thi Nguyen; Tzu-Kuo Huang; Jeff Schneider; Nemanja Djuric
err分享
err收藏
Multi-Head Attention for Multi-Modal Joint Vehicle Motion Forecasting
err2020-05-01
err0
errOAAI
errJean Mercat; Thomas Gilles; Nicole El Zoghby; Guillaume Sandou; Dominique Beauvois; Guillermo Pita Gil
err分享
err收藏
NaVILA: Legged Robot Vision-Language-Action Model for Navigation
err
err0
PREAI
errCheng,An-Chieh; Ji,Yandong; Yang,Zhaojing; Gongye,Zaitian; Zou,Xueyan; Kautz,Jan; Biyik,Erdem; Yin,Hongxu; Liu,Sifei; Wang,Xiaolong
err分享
err收藏
学者 查看更多内容