1
Return

COMFI: A multimodal industrial human motion dataset for markerless motion capture and collaborative robotics

delete2026-07-25
delete0
PRE
AI
K
Kahina Chalabi
M
Maxime Sabbah
N
Nicolas Gouget
M
Mohamed Adjel
G
Guilhem Saurel
K
Krzysztof Wojciechowski
B
Bruno Watier
V
Vincent Bonnet
DOI:10.1177/02783649261468361delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
<jats:p> COMFI (human–robot Collaboration Oriented Markerless For Industry) is a multimodal dataset designed to advance markerless motion capture, ergonomics, and Human–Robot Collaboration (HRC) in factory settings. COMFI contains 5.4 h of synchronized and spatially co-registered streams acquired from 18 participants performing 24 tasks that span everyday movements (e.g., walking, sit-to-stand) and ergonomically demanding industrial tasks (lifting, overhead work, screwdriving, polishing, welding), with the addition of two HRC scenarios in which a Franka Emika Panda is guided by the human while holding a tool. For a total of 86.5 GB of data, it includes: calibrated multi-view RGB videos (40 Hz), optical motion capture markers and joint centers positions, as well as joint angles (100 and 40 Hz), 6D ground reaction forces (1000 and 40 Hz), and robot telemetry (200 and 40 Hz). Camera intrinsics/extrinsics, global triggers, and software-barrier synchronization for webcams are distributed, along with participant-scaled human Universal Robot Description Files that adhere to International Society of Biomechanics conventions, enabling kinematics, dynamics, and torque estimation. Videos are anonymized while preserving facial cues useful to markerless pipelines. Accompanying code supports loading, calibration, and visualization. COMFI enables rigorous benchmarking of markerless pose estimation under occlusion and clutter against reference systems, allowing the extension of current state-of-the-art algorithms to complex industrial scenarios. COMFI is expected to catalyze reproducible, cross-disciplinary research toward safer, more ergonomic HRC. For a more illustrative summary, go to <jats:ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="uri" xlink:href="https://comfi-gepetto.github.io/">https://comfi-gepetto.github.io/</jats:ext-link> . </jats:p>

Journal

International Journal of Robotics Research cover
International Journal of Robotics Research
IF:
5
Papers:
2.4K
Citations:
1.5W

Organization

L
laas-cnrs
Scholars:
27
Papers: 6
Citations: 0
N
naturalpad
Scholars:
2
Papers: 1
Citations: 0
Cited Papers

Cited Papers

Citing Papers

Citing Papers