arrow
Return

Deep Pixel-Wise Textures for Construction Waste Classification

delete2024-07-01
delete0
PRE
AI
J
Jun Yang
G
Guorun Wang
Y
Yaoru Sun *
L
Lizhi Bai
B
Bohan Yang
DOI:10.1109/TASE.2023.3301157delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Construction waste classification (CWC) is a crucial and challenging task. However, this promising CWC system has not yet been fully implemented worldwide. The similar appearance of construction waste makes it difficult to be classified. We believe that if the characteristics of the appearance between different materials can not be fully extracted and effectively propagated, any further improvements of CWC models will be futile. To this end, this paper develops a texture and pixel gradient convolutional network (TPCNet) to capture material features. We find that the texture features as the additional input features can provide intrinsic fine-grained patterns. First, we propose the early-stage fusion strategy, where natural texture features and RGB are concatenated together as input. Second, we propose a texture and pixel gradient convolution (TPC) module to consider subtle texture information. TPC focuses on the texture guidance and introduces it to the modern CNNs, which enjoy the best of both worlds. We extend TPC to GTPC using a lossless synthetic large kernel (SLK) to achieve global contextual dependencies and seamlessly incorporate channel-wise adaptability. Moreover, we propose a two-stage feature pyramid network (TFPN) to fuse richer and denser spatial multi-scale contextual information. We also construct a large-scale real-world dataset and a production line to demonstrate the effectiveness of our model.Note to Practitioners-This paper is motivated by the problem in real-world construction waste classification task. The construction waste have similar 2D appearance makes them hard to be classified. Current models often blindly feed raw RGB images into CNNs instead of considering specific features, such as textured material surface textures. This paper proposes the texture guidance mechanism and introduces it to the training of CNN. Furthermore, we propose a lossless synthetic large kernel (SLK) to achieve global texture information. By introducing texture information as a basis for classification, our model can effectively classify similarly shaped construction waste and improve segmentation performance, thus providing the robot with more accurate location information.
Keywords:
Construction waste classification
texture and pixel gradient convolution
texture-aware
feature enhancement
synthetic large kernel

Journal

IEEE Transactions on Automation Science and Engineering cover
IEEE Transactions on Automation Science and Engineering
IF:
6.4
Papers:
4.9K
Citations:
1.6W

Organization

T
tongji university
Scholars:
7.8W
Papers: 5.9W
Citations: 98
Z
zhejiang university
Scholars:
17.6W
Papers: 12.1W
Citations: 152