arrow
Return

Trajectory Segmentation and Self-Supervised Classification for Subtask Discovery

delete2026-01-01
delete0
PRE
AI
R
Runze Tang *
P
Penny Sweetser
DOI:10.1007/978-981-95-4972-6_8delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Discovering and solving subtasks individually is a common approach to tackle long-horizon tasks. However, the existing approaches for subtask discovery primarily aim to accelerate downstream task training and often fail to identify semantically meaningful subtasks. We aim to discover semantically meaningful subtasks, in a robotic dataset where the demonstrations complete subtasks in varying orders, to enable sequential execution of subtask policies. We first segment the demonstrations into subtask working and transition phases in a semantically meaningful way. We then employ a self-supervised approach that is agnostic to the number of labels to classify the trajectory segments to obtain distinct subtasks. We trained a set of independent policies solely on the corresponding subtask demonstration segments. The policy learns to decide when to switch to the next subtask policy. Our experiment showed that executing these subtask policies sequentially achieved 98% of the total rewards of a baseline policy trained on complete demonstrations. This result demonstrates that our method identifies semantically meaningful subtasks with accurate boundaries, ensuring the seamless execution of multiple independent subtask policies.
Keywords:
Robot Manipulation
Behaviour Cloning
Subtask Discovery
Self-supervised classification

Journal

A
AI 2025: ADVANCES IN ARTIFICIAL INTELLIGENCE, PT II
IF:
0
Papers:
31
Citations:
0

Organization

A
australian national university
Scholars:
2.3K
Papers: 1.2K
Citations: 0
Cited Papers

Cited Papers

errShare
errSave
Density-based clustering
err2011-04-05
err674
PREAI
errKriegel, Hans-Peter; Kroeger, Peer; Sander, Joerg; Zimek, Arthur
errShare
errSave
A Deep Hierarchical Approach to Lifelong Learning in Minecraft
err2017-02-12
err0
errOAAI
errChen Tessler; Shahar Givony; Tom Zahavy; Daniel Mankowitz; Shie Mannor
errShare
errSave
SKID RAW: Skill Discovery From Raw Trajectories
err2021-07-01
err0
errOAAI
errDaniel Tanneberg; Kai Ploeger; Elmar Rueckert; Jan Peters
errShare
errSave
A Survey of Imitation Learning: Algorithms, Recent Developments, and Challenges
err2024-12-01
err4
errOAAI
errZare, Maryam; Kebria, Parham M.; Khosravi, Abbas; Nahavandi, Saeid
errShare
errSave
Time-Contrastive Networks: Self-Supervised Learning from Video
err2018-05-01
err0
errOAAI
errPierre Sermanet; Corey Lynch; Yevgen Chebotar; Jasmine Hsu; Eric Jang; Stefan Schaal; Sergey Levine; Google Brain
errShare
errSave
Diffusion Policy: Visuomotor Policy Learning via Action Diffusion
err2023-07-10
err0
errOAAI
errCheng Chi; Siyuan Feng; Yilun Du; Zhenjia Xu; Eric Cousineau; Benjamin Burchfiel; Shuran Song
errShare
errSave
no more