arrow
返回

Multiscale patch-based feature graphs for image classification

delete2024-01-01
delete7
PRE
AI
M
Matheus Vinícius Todescato *
L
Luan Fonseca Garcia
D
Dennis Giovani Balreira
J
Joel Luís Carbonera
DOI:10.1016/j.eswa.2023.121116delete
delete原文链接
delete分享
delete收藏
摘要

摘要

En 中文
Deep learning architectures have demonstrated outstanding results in image classification in the last few years. However, applying sophisticated neural network architectures in small datasets remains challenging. In this context, transfer learning is a promising approach for dealing with this scenario. Generally, the available pre-trained architectures adopt a standard fixed input, which usually implies resizing and cropping the input images in the preprocessing phase, causing information loss. Besides, images present visual features in different scales in real-world scenarios, and most common approaches do not consider this fact. In this paper, we propose an approach that applies transfer learning for dealing with small datasets and leverages visual features extracted by pre-trained models from different scales. We based our approach on graph convolutional networks (GCN) that take graphs representing the images in different scales as input and whose nodes are characterized by features extracted by pre-trained models from regular image patches of different scales. Since GCN can deal with graphs with different numbers of nodes, our approach can deal naturally with images of heterogeneous sizes without discarding relevant information. We evaluated our approach in two datasets: a set of geological images and a publicly available dataset, both presenting characteristics that challenge traditional approaches. We tested our approach by adopting three different pre-trained models as feature extractors: two efficient pre-trained CNN models (DenseNet and ResNeXt) and one Vision Transformer (CLIP). We compared our approach with two conventional approaches for dealing with image classification. The experiments show that our approach achieves better results than the conventional approaches for this task.
Keyword:
Image classification
Transfer learning
Feature extraction
Multiscale

期刊

Expert Systems with Applications 封面图
Expert Systems with Applications
IF:
7.5
论文数:
3.0W
被引数:
12.7W

机构

U
universidade federal do rio grande do sul
学者数:
518
论文数: 187
被引数: 3.9K
引用论文

引用论文

COVID-19 Detection Through Transfer Learning Using Multimodal Imaging Data使用多模态成像数据通过迁移学习进行新型冠状病毒肺炎检测
err2020-01-01
err263
errOAAI
errHorry, Michael J.; Chakraborty, Subrata; Paul, Manoranjan; Ulhaq, Anwaar; Pradhan, Biswajeet; Saha, Manas; Shukla, Nagesh
err分享
err收藏
High prevalence of malaria in a non-endemic setting among febrile episodes in travellers and migrants coming from endemic areas: a retrospective analysis of a 2013–2018 cohort
err2021-11-27
err0
errOAAI
errAlejandro Garcia-Ruiz de Morales; Covadonga Morcate; Elena Isaba-Ares; Ramon Perez-Tanoira; Jose A. Perez-Molina
err分享
err收藏
Synthesis of n-type semiconducting diamond film using diphosphorus pentaoxide as the doping source以五氧化二磷为掺杂源合成n型半导体金刚石膜
err1990-10-01
err0
PREAI
errKen Okano; Hideo Kiyota; Tatsuya Iwasaki; Yoshitaka Nakamura; Yukio Akiba; Tateki Kurosu; Masamori Iida; Terutaro Nakamura
err分享
err收藏
err分享
err收藏
HLA‐G Expression in Placenta in Relation to HLA‐G Genotype and Polymorphisms
err2004-09-16
err0
errOAAI
errThomas Vauvert F. Hviid; Lise Grupe Larsen; Anne Mette Hoegh; Michael Bzorek
err分享
err收藏
学者 查看更多内容