arrow
Return

Benchmarking Vision-Based Object Tracking for USVs in Complex Maritime Environments

delete2025-01-01
delete1
delete
OA
AI
M
Muhayy Ud Din
A
Ahsan Baidar Bakht
W
Waseem Akram
Y
Yihao Dong
L
Lakmal Seneviratne
I
Irfan Hussain *
DOI:10.1109/ACCESS.2025.3532299delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Vision-based target tracking is crucial for unmanned surface vehicles (USVs) to perform tasks such as inspection, monitoring, and surveillance. However, real-time tracking in complex maritime environments is challenging due to dynamic camera movement, low visibility, and scale variation. Typically, object detection methods combined with filtering techniques are commonly used for tracking, but they often lack robustness, particularly in the presence of camera motion and missed detections. Although advanced tracking methods have been proposed recently, their application in maritime scenarios is limited. To address this gap, this study proposes a vision-guided object tracking framework for USVs, integrating state-of-the-art tracking algorithms with low-level control systems to enable precise tracking in dynamic maritime environments. We benchmarked the performance of seven distinct trackers, developed using advanced deep learning techniques such as Siamese Networks and Transformers, by evaluating them on both simulated and real-world maritime datasets. In addition, we evaluated the robustness of various control algorithms in conjunction with these tracking systems. The proposed framework was validated through simulations and real-world sea experiments, demonstrating its effectiveness in handling dynamic maritime conditions. The results show that SeqTrack, a Transformer-based tracker, performed best in adverse conditions, such as dust storms. Among the control algorithms evaluated, the linear quadratic regulator controller (LQR) demonstrated the most robust and smooth control, allowing for stable tracking of the USV. Videos and code can be found here: https://muhayyuddin.github.io/tracking/.
Keywords:
Target tracking
Radar tracking
Cameras
Tracking
Laser radar
Real-time systems
Navigation
Heuristic algorithms
Transformers
Robustness
USV navigation
vision-based tracking
visual servoing
marine robotics

Journal

IEEE Access cover
IEEE Access
IF:
3.6
Papers:
9.8W
Citations:
29.4W

Organization

No organization information available