arrow
返回

Recurrent Affine Transform Encoder for Image Representation

delete2022-01-01
delete1
delete
OA
AI
L
Letao Liu *
蒋旭东 封面图
蒋旭东 (Xudong Jiang)
M
Martin Saerbeck
J
Justin Dauwels
DOI:10.1109/ACCESS.2022.3150340delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
This paper proposes a Recurrent Affine Transform Encoder (RATE) that can be used for image representation learning. We propose a learning architecture that enables a CNN encoder to learn the affine transform parameter of images. The proposed learning architecture decomposes an affine transform matrix into two transform matrices and learns them jointly in a self-supervised manner. The proposed RATE is trained by unlabeled image data without any ground truth and infers the affine transform parameter of input images recurrently. The inferred affine transform parameter can be used to represent images in canonical form to greatly reduce the image variations in affine transforms such as rotation, scaling, and translation. Different from the spatial transformer network, the proposed RATE does not need to be embedded into other networks for training with the aid of other learning objectives. We show that the proposed RATE learns the affine transform parameter of images and achieves impressive image representation results in terms of invariance to translation, scaling, and rotation. We also show that the classification performance is enhanced and is more robust against distortion by incorporating the RATE into the existing classification model.
Keyword:
Transforms
Training
Transformers
Matrix decomposition
Task analysis
Image representation
Feature extraction
Canonical image base
self-supervised learning
representation learning

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

D
Delft University of Technology
学者数:
2.6W
论文数: 2.5W
被引数: 3.8W
N
Nanyang Technological University
学者数:
4.9W
论文数: 4.8W
被引数: 8.1W
引用论文

引用论文

Composition Changes of Peanut Fruit Parts During Maturation1
err1974-07-01
err0
PREAI
errHarold E. Pattee; Elizabeth B. Johns; John A. Singleton; Timothy H. Sanders
err分享
err收藏
Neighbourhood-scale urban forest ecosystem classification
err2015-11-01
err0
PREAI
errJames W.N. Steenberg; Andrew A. Millward; Peter N. Duinker; David J. Nowak; Pamela J. Robinson
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
Special forest products in context: gatherers and gathering in the Eastern United States
err
IF0
err2003-01-01
err0
errOAAI
errMarla R. Emery; Clare Ginger; Siri Newman; Michael R.B. Giammusso
err分享
err收藏
err分享
err收藏
学者 查看更多内容