arrow
Return

Fine-art recognition using convolutional transformers

delete2024-10-18
delete0
delete
OA
AI
Y
Yu Liu *
H
Haozhe Bai
J
Jingchao Wang
DOI:10.7717/peerj-cs.2409delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Digital image processing is a constantly evolving field encompassing a wide range of techniques and applications. Researchers worldwide are continually developing various algorithms across multiple fields to achieve accurate image classification. Advanced computer vision algorithms are crucial for architectural and artistic analysis. The digitalization of art has significantly enhanced the accessibility and conservation of fine-art paintings, yet the risk of art theft remains a significant challenge. Improving art security necessitates the precise identification of fine-art paintings. Although current recognition systems have shown potential, there is significant scope for enhancing their efficiency. We developed an improved recognition system for categorizing fine-art paintings using convolutional transformers, specified by an attention mechanism to enhance focused learning on the data. As part of the most advanced architectures in the deep learning family, transformers are empowered by a multi-head attention mechanism, thus improving learning efficiency. To assess the performance of our model, we compared it with those developed using four pre-trained networks: ResNet50, VGG16, AlexNet, and ViT. Each pre-trained network was integrated into a corresponding state-of-the-art model as the first processing blocks. These four state-of-the-art models were constructed under the transfer learning strategy, one of the most commonly used approaches in this field. The experimental results showed that our proposed system outperformed the other models. Our study also highlighted the effectiveness of using convolutional transformers for learning image features.
Keywords:
Fine-art
Painting
Deep learning
Recognition
Transfer learning
Transformers
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

PeerJ Computer Science cover
PeerJ Computer Science
IF:
2.5
Papers:
3.4K
Citations:
6.9K

Organization

C
Chongqing University
Scholars:
5.1W
Papers: 4.1W
Citations: 6.0W
Cited Papers

Cited Papers

Image processing for artist identification
err2008-07-01
err216
PREAI
errJohnson, C. Richard, Jr.; Hendriks, Ella; Berezhnoy, Igor J.; Brevdo, Eugene; Hughes, Shannon M.; Daubechies, Ingrid; Li, Jia; Postma, Eric; Wang, James Z.
errShare
errSave
Evolution of the COPD Assessment Test Score during Chronic Obstructive Pulmonary Disease Exacerbations: Determinants and Prognostic Value
err2013-01-01
err0
errOAAI
errDarwin Feliz-Rodriguez; Santiago Zudaire; Carlos Carpio; Elizabet Martínez; Antonia Gómez-Mendieta; Ana Santiago; Rodolfo Alvarez-Sala; Francisco García-Río
errShare
errSave
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
errShare
errSave
Neuronal nitric oxide synthase (nNOS) expression in the epithelial neuroendocrine cell system and nerve fibers in the gill of the catfish, Heteropneustes fossilis
err1999-11-01
err0
PREAI
errAngela Mauceri; Salvatore Fasulo; Luigi Ainis; Aurelio Licata; Eugenia Rita lauriano; Alfredo Martfnez; Bernd Mayer; Giacomo Zaccone
errShare
errSave
researcher View more