arrow
Return

MSG: Multi-Stream Generative Policies for Sample-Efficient Robotic Manipulation

delete2026-04-09
delete0
PRE
AI
J
Jan Ole von Hartz
L
Lukas Schweizer
J
Joschka Boedecker
A
Abhinav Valada
DOI:10.1109/LRA.2026.3682566delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Generative robot policies such as Flow Matching offer flexible, multi-modal policy learning but are sample-inefficient. Although object-centric policies improve sample efficiency, it does not resolve this limitation. In this work, we propose Multi-Stream Generative Policy (MSG), an inference-time composition framework that trains multiple object-centric policies and combines them at inference to improve generalization and sample efficiency. MSG is model-agnostic and inference-only, hence widely applicable to various generative policies and training paradigms. We perform extensive experiments both in simulation and on a real robot, demonstrating that our approach learns high-quality generative policies from as few as five demonstrations, resulting in a 95% reduction in demonstrations, and improves policy performance by 89 percent compared to single-stream approaches. Furthermore, we present comprehensive ablation studies on various composition strategies and provide practical recommendations for deployment. Finally, MSG enables zero-shot object instance transfer.
Keywords:
Imitation learning
learning from demonstration
deep learning in grasping and manipulation

Journal

I
IEEE Robotics and Automation Letters
IF:
5.3
Papers:
2.0K
Citations:
3.9W

Organization

U
university of freiburg
Scholars:
3.7K
Papers: 1.3K
Citations: 0
Cited Papers

Cited Papers

PoCo: Policy Composition from and for Heterogeneous Robot Learning
err
err0
PREAI
errWang,Lirui; Zhao,Jialiang; Du,Yilun; Adelson,Edward; Tedrake,Russ
errShare
errSave
errShare
errSave
RLBench: The Robot Learning Benchmark & Learning Environment
err2020-04-01
err0
PREAI
errStephen James; Zicong Ma; David Rovick Arrojo; Andrew J. Davison
errShare
errSave
Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardware
err2023-07-10
err0
errOAAI
errTony Zhao; Vikash Kumar; Sergey Levine; Chelsea Finn
errShare
errSave
KALM: Keypoint Abstraction Using Large Models for Object-Relative Imitation Learning
err2025-05-19
err0
PREAI
errFang,Xiaolin; Huang,Bo-Ruei; Mao,Jiayuan; Shone,Jasmine; Tenenbaum,Joshua B.; Lozano-Pérez,Tomás; Kaelbling,Leslie Pack
errShare
errSave
3D Diffusion Policy: Generalizable Visuomotor Policy Learning via Simple 3D Representations
err
IF0
err2024-07-15
err0
PREAI
errYanjie Ze; Gu Zhang; Kangning Zhang; Chenyuan Hu; Muhan Wang; Huazhe Xu
errShare
errSave
The Treachery of Images: Bayesian Scene Keypoints for Deep Policy Learning in Robotic Manipulation
err2023-11-01
err0
PREAI
errvon Hartz,Jan Ole; Chisari,Eugenio; Welschehold,Tim; Burgard,Wolfram; Boedecker,Joschka; Valada,Abhinav
errShare
errSave
errShare
errSave
researcher View more