arrow
Return

Log detection for autonomous forwarding using auto-annotated data from a real-time virtual environment

delete2025-09-01
delete0
delete
OA
AI
M
Mattias Lehto *
L
Lideskog, Hakan
M
Magnus Karlberg
DOI:10.1016/j.jterra.2025.101096delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Object detectors for autonomous forestry operations have previously been developed mainly by training on physical manually annotated data, which is both time-consuming and costly. Since the ground truth in the virtual model is known, the training data can be auto-annotated, enabling the creation of larger training datasets, while also improving time and cost efficiency. In this work, a virtual environment in Unity is used in co-simulation with a real-time digital twin of a physical forestry vehicle, to generate realistic auto-annotated training data, as captured by an onboard stereo camera. First, it is shown that a log detector trained on physical data can detect logs in the virtual environment. Second, new detectors are trained, using different shares of virtual and physical data. It is shown that a detector trained using only virtual data, can learn to detect logs in the physical world. Moreover, virtual pre-training is shown to improve the performance of physically trained and tested detectors, both at low availability of physical training data, and in terms of domain generalization. A detailed detector performance analysis also highlights further potential and opportunities for future improvements. Furthermore, the real-time capable virtual models enable future machine learning tasks utilizing different levels of Hardware-in-the-Loop.
Keywords:
Transfer learning
Domain generalization
Virtual training
Auto-annotation
Real-time
Logging
Tree harvesting
Forwarder
Cut-to-length
CTL
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

J
Journal of Terramechanics
IF:
3.7
Papers:
24
Citations:
2.4K

Organization

No organization information available