arrow
Return

Unified benchmark construction and algorithm performance evaluation for large-scale object detection

delete2025-09-17
delete0
delete
OA
AI
J
Jiayan Wang
S
Shirong Zou
王怡璇 cover
王怡璇 (Yixuan Wang) *
W
Wendong Huang
J
Jiajun Song
DOI:10.1007/s10791-025-09707-xdelete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
In order to establish a unified performance evaluation benchmark for large-scale object detection algorithms, solve the problem of fragmented evaluation system, and provide objective basis for algorithm selection and optimization through system experiments. By integrating the MS COCO and KITTI datasets, ablation experiments were designed to compare the performance of the two algorithms, with F1 score, convergence effect, and detection timeliness as the core indicators. The experiments revealed that the convergence speeds and detection accuracy of the two methods on different datasets were basically the same, and the F1 scores were all higher than 0.9, up to 0.931. The ablation experiments further revealed the critical impact of the module design on the performance. Ablation experiments revealed the significant impact of module design. Notably, supplementing the grid attention feature fusion module substantially improved detection accuracy (DA) for specific engineering vehicles, raising DA to 0.615, 0.793, and 0.692 for the three vehicle types tested (representing an improvement of up to 29% over the baseline). Increasing DL model depth by 50% yielded a modest accuracy gain (from 0.921 to 0.929) but incurred a significant detection speed penalty (from 284 FPS to 202 FPS). The study provides reproducible and unified evaluation standards for academia and industry, resolves the uncertainty of algorithm selection and optimization, and lays the foundation for the convergence and extension of multimodal target detection technology.
Keywords:
Target detection
Large vehicles
Deep learning
Laser radar
Performance analysis
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

D
Discover Computing
IF:
0
Papers:
447
Citations:
8

Organization

No organization information available
Cited Papers

Cited Papers

A novel target detection method with dual‐domain multi‐frequency feature in side‐scan sonar images
err2024-09-18
err0
errOAAI
errWen Wang; Yifan Zhang; Houpu Li; Yixin Kang; Lei Liu; Cheng Chen; Guojun Zhai
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
An Explainable Ensemble Deep Learning Approach for Intrusion Detection in Industrial Internet of Things
err2023-01-01
err23
errOAAI
errShtayat, Mousa'B Mohammad; Hasan, Mohammad Kamrul; Sulaiman, Rossilawati; Islam, Shayla; Khan, Atta Ur Rehman
errShare
errSave
Secured lightweight authentication for 6LoWPANs in machine-to-machine communications
err2024-10-01
err2
PREAI
errAshrif, Fatma Foad; Sundararajan, Elankovan A.; Hasan, Mohammad Kamrul; Ahmad, Rami; Abdullah, Salwani; Wazirali, Raniyah
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
Federated Learning for Computational Offloading and Resource Management of Vehicular Edge Computing in 6G-V2X Network
err2024-02-01
err28
PREAI
errHasan, Mohammad Kamrul; Jahan, Nusrat; Nazri, Mohd Zakree Ahmad; Islam, Shayla; Khan, Muhammad Attique; Alzahrani, Ahmed Ibrahim; Alalwan, Nasser; Nam, Yunyoung
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
researcher View more