.png){kind=icon}
返回
Semi-Open Set Object Detection Algorithm Leveraged by Multi-Modal Large Language Models
.png){kind=icon}
OA
AI
DOI：10.3390/bdcc8120175.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Currently, closed-set object detection models represented by YOLO are widely deployed in the industrial field. However, such closed-set models lack sufficient tuning ability for easily confused objects in complex detection scenarios. Open-set object detection models such as GroundingDINO expand the detection range to a certain extent, but they still have a gap in detection accuracy compared with closed-set detection models and cannot meet the requirements for high-precision detection in practical applications. In addition, existing detection technologies are also insufficient in interpretability, making it difficult to clearly show users the basis and process of judgment of detection results, causing users to have doubts about the trust and application of detection results. Based on the above deficiencies, we propose a new object detection algorithm based on multi-modal large language models that significantly improves the detection effect of closed-set object detection models for more difficult boundary tasks while ensuring detection accuracy, thereby achieving a semi-open set object detection algorithm. It has significant improvements in accuracy and interpretability under the verification of seven common traffic and safety production scenarios.
Keyword:
large-scale foundation model
computer vision
object detection
期刊
B
IF:
4.4
论文数:
1.3K
被引数:
2.4K
机构
引用论文
.png){kind=icon}
CO-STAR: A collaborative prediction service for short-term trends on continuous spatio-temporal dataCo-star: 一种针对连续时空数据的短期趋势的协作预测服务
PREAI
分享收藏Recycling of NdFeB Magnets from Electric Drive Motors of (Hybrid) Electric Vehicles从 (混合动力) 电动汽车的驱动电机中回收NdFeB磁体
PREAI
分享收藏
查看更多内容