arrow
Return

Cross-modal generative models for multi-modal plastic sorting

delete2023-08-01
delete4
delete
OA
AI
E
Edward Ren Kai Neo *
J
Jonathan Sze Choong Low
V
Vannessa Goodship
S
Stuart R. Coles
K
Kurt Debattista
DOI:10.1016/j.jclepro.2023.137919delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Automated sorting through chemometric analysis of plastic spectral data could be a key strategy towards improving plastic waste management. Deep learning is a promising chemometric tool, but further development through multi-modal deep learning has been limited by lack of data availability. A new Multi-modal Plastic Spectral Database (MMPSD) consisting of Fourier Transform Infrared (FTIR), Raman and Laser-induced Break-down Spectroscopy (LIBS) data for each sample in the database is introduced in this work. MMPSD serves as the basis for novel cross-modality generative model technique termed Spectral Conversion Autoencoders (SCAE), which generates synthetic data from data of another modality. SCAE is advantageous over traditional generative models like Variational Autoencoders (VAE), as it can generate class specific synthetic data without the need to train multiple models for each data class. MMPSD also facilitated the exploration of multi-modal deep learning, which improved the classification accuracy as compared to an uni-modal approach from 0.933 to 0.970. SCAE can further be combined with multi-modal methods to achieve a higher accuracy of 0.963 while still using a single sensor to reduce costs, which can be applied for multi-modal augmentation from FTIR sensors used in industrial sorting.
Keywords:
Generative deep learning
Multi-modal
Data augmentation
Chemometrics
Spectroscopy
Plastic recycling
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Journal of Cleaner Production cover
Journal of Cleaner Production
IF:
10
Papers:
4.6W
Citations:
36.8W

Organization

A
agency for science technology & research (a*star)
Scholars:
2.2W
Papers: 1.9W
Citations: 57
U
University of Warwick
Scholars:
2.2W
Papers: 2.2W
Citations: 85