arrow
Return

Improving long-tailed pest classification using diffusion model-based data augmentation

delete2025-07-01
delete0
PRE
AI
M
Meng‐Ze Du
F
Fei Wang
Y
Yu Wang
L
Li, Kun
H
Hou, Wenhui
L
Liu, Lu
H
He, Yong
王
王玉伟 (Wang, Yuwei) *
DOI:10.1016/j.compag.2025.110244delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Long-tail problem is common in large-scale agricultural datasets, posing significant challenges to agricultural research. It is often resulting from the prohibitively high costs of data collection, the challenges of obtaining accurate, comprehensive data, and the restricted access to diverse sources of information. This issue manifests especially within agricultural pest datasets, where the imbalance in the frequency of different pest types can severely hinder detection accuracy. To counteract this pervasive challenge, this paper introduces a robust method leveraging the power of a diffusion model to address the long-tailed problem effectively. Our method focuses on fine-tuning specialized pre-trained models to generate highly realistic pest images, providing a critical solution for balancing the dataset's distribution. This paper also presents a visualization technique that offers a clear, intuitive representation of the long-tailed problem's impact on the dataset. By producing high-quality synthetic images using the diffusion model, our method not only balances the uneven data distribution but also reduces the discrepancies between real and synthetic data, effectively mitigating the under-representation of tail categories. The experimental results, tested on the widely-used IP102 large-scale pest dataset, confirm the superiority of our approach. The method strikes an optimal balance between sample fidelity and diversity, outperforming traditional methods in image quality. Moreover, it demonstrates remarkable performance in pest classification tasks, achieving the highest evaluation metrics and showcasing its ability to address the long-tailed problem with notable success.
Keywords:
Insect pest classification
Long-tailed problem
Diffusion model
Data augmentation

Journal

Computers and Electronics in Agriculture cover
Computers and Electronics in Agriculture
IF:
8.9
Papers:
1.0W
Citations:
4.8W

Organization

H
hefei univ technol
Scholars:
1.9K
Papers: 759
Citations: 248
Cited Papers

Cited Papers

Combining generative adversarial networks and agricultural transfer learning for weeds identification
err2021-04-01
err0
PREAI
errBorja Espejo-Garcia; Nikos Mylonas; Loukas Athanasakos; Eleanna Vali; Spyros Fountas
errShare
errSave
Handling the Challenges of Small-Scale Labeled Data and Class Imbalances in Classifying the N and K Statuses of Rubber Leaves Using Hyperspectroscopy Techniques
err2024-01-01
err1
errOAAI
errHu, Wenfeng; Tang, Weihao; Li, Chuang; Wu, Jinjing; Liu, Hong; Wang, Chao; Luo, Xiaochuan; Tang, Rongnian
errShare
errSave
An Effective Image-Based Tomato Leaf Disease Segmentation Method Using MC-UNet
err2023-01-01
err25
errOAAI
errDeng, Yubao; Xi, Haoran; Zhou, Guoxiong; Chen, Aibin; Wang, Yanfeng; Li, Liujun; Hu, Yahui
errShare
errSave
A Comprehensive Overview of Image Enhancement Techniques
err2021-04-23
err87
PREAI
errQi, Yunliang; Yang, Zhen; Sun, Wenhao; Lou, Meng; Lian, Jing; Zhao, Wenwei; Deng, Xiangyu; Ma, Yide
errShare
errSave
Making a Completely Blind Image Quality Analyzer
err2013-03-01
err4.2K
PREAI
errMittal, Anish; Soundararajan, Rajiv; Bovik, Alan C.
errShare
errSave
MD-YOLO: Multi-scale Dense YOLO for small target pest detection
err2023-10-01
err37
PREAI
errTian, Yunong; Wang, Shihui; Li, En; Yang, Guodong; Liang, Zize; Tan, Min
errShare
errSave
Adaptive feature fusion pyramid network for multi-classes agricultural pest detection
err2022-04-01
err43
PREAI
errJiao, Lin; Xie, Chengjun; Chen, Peng; Du, Jianming; Li, Rui; Zhang, Jie
errShare
errSave
Synthetic data augmentation by diffusion probabilistic models to enhance weed recognition
err2024-01-01
err7
PREAI
errChen, Dong; Qi, Xinda; Zheng, Yu; Lu, Yuzhen; Huang, Yanbo; Li, Zhaojian
errShare
errSave
Out-of-Distribution Detection Algorithms for Robust Insect Classification
err2024-01-01
err0
errOAAI
errSaadati, Mojdeh; Balu, Aditya; Chiranjeevi, Shivani; Jubery, Talukder Zaki; Singh, Asheesh K.; Sarkar, Soumik; Singh, Arti; Ganapathysubramanian, Baskar
errShare
errSave
researcher View more