.png){kind=icon}
返回
MSI-RGB Dual-Source Multiscale Fusion-Based Solid Waste Object Detection
.png){kind=icon}
PRE
AI
DOI：10.1109/TIM.2024.3480227.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
This article focuses on the significant challenges faced by single-modal visual sensors in object detection under the fine-sorting process of solid waste. Object detection using a single sensor has inherent limitations due to the lack of comprehensive material and contour information about the object. Therefore, this article proposes a real-time detection network based on the MSI-RGB dual-source multiscale fusion network (DMFNet) and introduces a coarse-to-fine dual-stage band selection (dual-stage BS) method for reducing spectral redundant information. As a case study, we focus on plastic solid waste and build a dual-sensor experimental platform to collect color and hyperspectral images (HSIs) using a face-matrix color camera and a hyperspectral camera. Specifically, the dual-stage BS method is employed to analyze the hyper-spectral data and a small number of spectral bands were selected to generate a multispectral image (MSI) as the first input source for DMFNet. Meanwhile, the RGB image serves as the second input source for DMFNet. First, a spectral image feature extraction backbone (SIFEBackbone) and a multiscale stacking unit (MSU) are designed to extract multiscale features from spectral images fully. Second, a multibranch fusion unit (MBFU) is designed to realize the fusion of multiscale features with the spectral feature maps in the RGB-enhanced feature extraction stage. The experimental results show that dual-stage BS exhibits advantages over other methods, while DMF-YOLOv7, which integrates DMFNet and YOLOv7 detectors, improves the average precision and recall by 7.2% and 5.5%, respectively, compared with the original YOLOv7, and the mAP reaches 95.4% at IOU =0.5. It effectively reduces the material misrecognition problem and reflects the advantages of the dual-sensor algorithm. The source code is available at: https://github.com/Caicai-D/DMFNet.
Keyword:
Feature extraction
Waste materials
Hyperspectral imaging
Solid modeling
Plastics
Deep learning
Cameras
Analytical models
Data models
Accuracy
Dual-source fusion technology
hyperspectral imagery
multispectral feature extraction
object detection
spectral band selection
期刊
IF:
5.9
论文数:
2.0W
被引数:
5.8W
机构
引用论文
HyperNet: A deep network for hyperspectral, multispectral, and panchromatic image fusionHyperNet: 用于高光谱，多光谱和全色图像融合的深度网络
PREAI
分享收藏A Novel Framework for Trash Classification Using Deep Transfer Learning一种基于深度迁移学习的垃圾分类新框架.png)
IEEE ACCESS
OAAI
IEEE ACCESSIF3.6
OAAI分享收藏A discrimination model in waste plastics sorting using NIR hyperspectral imaging system基于NIR高光谱成像系统的废塑料分选判别模型WASTE MANAGEMENT
WASTE MANAGEMENTIF7.1
PREAI
分享收藏Few-layered metallic 1T-MoS2/TiO2 with exposed (001) facets: two-dimensional nanocomposites for enhanced photocatalytic activities具有暴露的 (001) 面的少层金属1T-MoS2/TiO2: 用于增强光催化活性的二维纳米复合材料
PREAI
分享收藏A review on chemometric techniques with infrared, Raman and laser-induced breakdown spectroscopy for sorting plastic waste in the recycling industry利用红外，拉曼和激光诱导击穿光谱对回收行业中塑料废物进行分类的化学计量技术综述OAAI
OAAI分享收藏Auto-sorting commonly recovered plastics from waste household appliances and electronics using near-infrared spectroscopy使用近红外光谱从废弃的家用电器和电子产品中自动分类通常回收的塑料
PREAI
分享收藏
查看更多内容