arrow
返回

Self-Supervised Feature Augmentation for Large Image Object Detection

delete2020-01-01
delete24
PRE
AI
X
Xingjia Pan
唐
唐帆 (Fan Tang)
董未名 封面图
董未名 (Weiming Dong) *
Y
Yang Gu
Z
Zhichao Song
Y
Yiping Meng
P
Pengfei Xu
O
Oliver Deußen
徐
徐常胜 (Changsheng Xu)
DOI:10.1109/TIP.2020.2993403delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Input scale plays an important role in modern detection frameworks, and an optimal training scale for images exists empirically. However, the optimal one usually cannot be reached in facing extremely large images under the memory constraint. In this study, we explore the scale effect inside the object detection pipeline and find that feature upsampling with the introduction of high-resolution information benefits the detection. Compared with direct input upscaling, feature upsampling trades a small performance loss for a large amount of memory savings. From these observations, we propose a self-supervised feature augmentation network, which takes downsampled images as inputs and aims to generate comparable features with the ones when feeding upscaled images to networks. We present a guided feature upsampling module, which takes downsampled images as inputs, to learn upscaled feature representations with the supervision of real large features acquired from upscaled images. In a self-supervised learning manner, we can introduce detailed information of images to the network. For an efficient feature upsampling, we design a residualized sub-pixel convolution block based on a sub-pixel convolution layer, which involves considerable information in upsampling process. Experiments on Mapillary Vistas Dataset (MVD), Cityscapes, and COCO are conducted to demonstrate the effectiveness of our method. On the MVD and Cityscapes detection benchmarks, in which the images are extremely large, our method surpasses current approaches. On COCO, the proposed method obtains comparable results to existing methods but with higher efficiency.
Keyword:
Feature extraction
Object detection
Task analysis
Image resolution
Pipelines
Convolution
Detectors
Self-supervise
feature augmentation
object detection
large image
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Image Processing 封面图
IEEE Transactions on Image Processing
IF:
13.7
论文数:
1.0W
被引数:
8.4W

机构

U
University of Konstanz
学者数:
6.1K
论文数: 5.1K
被引数: 7.7K
C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
引用论文

引用论文

Conductivity Enhancement in Thin Silicon-on-Insulator Layer Embedding Artificial Dislocation Network
err2011-02-01
err0
PREAI
errYasuhiko Ishikawa; Kazuaki Yamauchi; Chihiro Yamamoto; Michiharu Tabe
err分享
err收藏
err分享
err收藏
The oxygen effect and fractionated radiotherapy
err2012-12-20
err0
PREAI
errMichael Horsman; Bradly Wouters; Michael Joiner; Jens Overgaard
err分享
err收藏
A review of nature-based solutions for urban water management in European circular cities: a critical assessment based on case studies and literature
err2020-01-03
err0
errOAAI
errHasan Volkan Oral; Pedro Carvalho; Magdalena Gajewska; Nadia Ursino; Fabio Masi; Eric D. van Hullebusch; Jan K. Kazak; Alfonso Exposito; Giulia Cipolletta; Theis Raaschou Andersen; David Christian Finger; Lena Simperler; Martin Regelsberger; Vit Rous; Matej Radinja; Gianluigi Buttiglieri; Pawel Krzeminski; Anacleto Rizzo; Kaveh Dehghanian; Mariyana Nikolova; Martin Zimmermann
err分享
err收藏
Electrochemically assisted micro localized grafting of aptamers in a microchannel engraved in fluorinated thermoplastic polymer Dyneon THV
err2015-01-01
err0
PREAI
errC. Perréard; Y. Ladner; F. d'Orlyé; S. Descroix; V. Taniga; A. Varenne; F. Kanoufi; C. Slim; S. Griveau; F. Bedioui
err分享
err收藏
Testing the low latitude/high defense hypothesis for broad-leaved tree species
err2012-01-22
err0
PREAI
errRobert J. Marquis; Robert E. Ricklefs; Luis Abdala-Roberts
err分享
err收藏
学者 查看更多内容