.png){kind=icon}
返回
RocSync: Millisecond-Accurate Temporal Synchronization for Heterogeneous Camera Systems
.png){kind=icon}
OA
AI
DOI：10.3390/s26031036.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Accurate spatiotemporal alignment of multi-view video streams is essential for a wide range of dynamic-scene applications such as multi-view 3D reconstruction, pose estimation, and scene understanding. However, synchronizing multiple cameras remains a significant challenge, especially in heterogeneous setups combining professional- and consumer-grade devices, visible and infrared sensors, or systems with and without audio, where common hardware synchronization capabilities are often unavailable. This limitation is particularly evident in real-world environments, where controlled capture conditions are not feasible. In this work, we present a low-cost, general-purpose synchronization method that achieves millisecond-level temporal alignment across diverse camera systems while supporting both visible (RGB) and infrared (IR) modalities. The proposed solution employs a custom-built LED Clock that encodes time through red and infrared LEDs, allowing visual decoding of the exposure window (start and end times) from recorded frames for millisecond-level synchronization. We benchmark our method against hardware synchronization and achieve a residual error of 1.34 ms RMSE across multiple recordings. In further experiments, our method outperforms light-, audio-, and timecode-based synchronization approaches and directly improves downstream computer vision tasks, including multi-view pose estimation and 3D reconstruction. Finally, we validate the system in large-scale surgical recordings involving over 25 heterogeneous cameras spanning both IR and RGB modalities. This solution simplifies and streamlines the synchronization pipeline and expands access to advanced vision-based sensing in unconstrained environments, including industrial and clinical applications.
Keyword:
video synchronization
heterogeneous camera systems
sub-frame temporal alignment
multi-view 3D reconstruction
multi-view pose estimation
infrared and RGB imaging
computer vision
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
3.5
论文数:
7.2W
被引数:
20.9W
机构
引用论文
分享收藏Synchronized High-Speed Vision Sensor Network for Expansion of Field of View同步高速视觉传感器网络用于扩展视场.png)
SensorsOAAI
SensorsIF0
OAAI分享收藏
Subframe-Level Synchronization in Multi-Camera System Using Time-Calibrated Video使用时间校准视频的多摄像机系统中的子帧级同步SENSORSOAAI
SENSORSIF3.5
OAAI分享收藏
查看更多内容