arrow
返回

Transform Domain Learning for Image Recognition

delete2024-01-01
delete0
delete
OA
AI
D
Dengtai Tan *
J
Jinlong Zhao
S
Shichao Li
DOI:10.1109/ACCESS.2024.3432670delete
delete原文链接
delete分享
delete收藏
摘要

摘要

En 中文
Image and video classification are distinct tasks in computer vision. Three-dimensional convolutional neural networks (3D CNNs) are commonly employed for video classification, while two-dimensional convolutional neural networks (2D CNNs) are more suitable for image classification. To enable image and video recognition to adopt the same network-3D CNNs, we propose a transform domain learning approach for image recognition utilizing the video recognition model 3D CNNs. The transform domain learning not only permits the use of RGB images as input for 3D CNNs but also allows for the input of orthogonally transformed image sequences into the networks. Furthermore, randomly transformed images can be fed into the networks, where the random transformation is a customized arbitrary transformation. The standard 3D CNNs can be seamlessly applied to both images and videos. The experiments show that whether orthogonal transformation or random transformation is used as the input, 3D CNNs can effectively classify images. Compared to 2D CNNs, the data after orthogonal transformation does not reduce the accuracy. To unify the tasks of image and video classification, the image dataset Caltech101 and the video dataset UCF101 are mixed, and 3D CNNs are used to recognize images in the transform domain. The results illustrate that mixed and individual training produce almost the same recognition effect. Additionally, it can be observed that directly transferring the video pre-training model to the image classification task can significantly enhance the performance.
Keyword:
Transforms
Image recognition
Task analysis
Kernel
Three-dimensional displays
Solid modeling
Convolutional neural networks
Videos
Convolutional neural network
image recognition
orthogonal transformation
video recognition

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
34.5W

机构

G
gansu university of political science & law
学者数:
138
论文数: 114
被引数: 71
桂林电子科技大学 封面图
桂林电子科技大学
学者数:
569
论文数: 199
被引数: 1.9K
引用论文

引用论文

err
IF0
err
err0
PREAI
err
err分享
err收藏
An Efficient Methodology for Brain MRI Classification Based on DWT and Convolutional Neural Network一种基于DWT和卷积神经网络的高效脑MRI分类方法
errSENSORS
IF3.5
err2021-11-10
err19
errOAAI
errFayaz, Muhammad; Torokeldiev, Nurlan; Turdumamatov, Samat; Qureshi, Muhammad Shuaib; Qureshi, Muhammad Bilal; Gwak, Jeonghwan
err分享
err收藏
Adaptive ranking of facial attractiveness
err2014-07-01
err0
PREAI
errChong Cao; Iljung Sam Kwak; Serge Belongie; David Kriegman; Haizhou Ai
err分享
err收藏
学者 查看更多内容