arrow
返回

Deep Patch Representations with Shared Codebook for Scene Classification

delete2019-01-24
delete21
PRE
AI
S
Shuqiang Jiang *
G
Gongwei Chen
宋新航 (Xinhang Song)
L
Linhu Liu
DOI:10.1145/3231738delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Scene classification is a challenging problem. Compared with object images, scene images are more abstract, as they are composed of objects. Object and scene images have different characteristics with different scales and composition structures. How to effectively integrate the local mid-level semantic representations including both object and scene concepts needs to be investigated, which is an important aspect for scene classification. In this article, the idea of a sharing codebook is introduced by organically integrating deep learning, concept feature, and local feature encoding techniques. More specifically, the shared local feature codebook is generated from the combined ImageNet1K and Places365 concepts (Mixed1365) using convolutional neural networks. As the Mixed1365 features cover all the semantic information including both object and scene concepts, we can extract a shared codebook from the Mixed1365 features, which only contain a subset of the whole 1,365 concepts with the same codebook size. The shared codebook can not only provide complementary representations without additional codebook training but also be adaptively extracted toward different scene classification tasks. A method of fusing the encoded features with both the original codebook and the shared codebook is proposed for scene classification. In this way, more comprehensive and representative image features can be generated for classification. Extensive experimentations conducted on two public datasets validate the effectiveness of the proposed method. Besides, some useful observations are also revealed to show the advantage of shared codebook.
Keyword:
Scene classification
convolutional neural network
feature encoding
shared codebook
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

ACM Transactions on Multimedia Computing Communications and Applications 封面图
ACM Transactions on Multimedia Computing Communications and Applications
IF:
6
论文数:
2.0K
被引数:
5.4K

机构

C
chinese academy of sciences
学者数:
56.7W
论文数: 44.9W
被引数: 704
引用论文

引用论文

Xenon migration in UO2 under irradiation studied by SIMS profilometry
err2013-09-01
err0
PREAI
errB. Marchand; N. Moncoffre; Y. Pipon; N. Bérerd; C. Garnier; L. Raimbault; P. Sainsot; T. Epicier; C. Delafoy; M. Fraczkiewicz; C. Gaillard; N. Toulhoat; A. Perrat-Mabilon; C. Peaucelle
err分享
err收藏
Suppression of vacancy formation and hydrogen isotope retention in irradiated tungsten by addition of chromium
err2022-02-01
err0
errOAAI
errJing Wang; Yuji Hatano; Takeshi Toyama; Tomoaki Suzudo; Tatsuya Hinoki; Vladimir Kh. Alimov; Thomas Schwarz-Selinger
err分享
err收藏
QuantumNAS: Noise-Adaptive Search for Robust Quantum Circuits
err2022-04-01
err0
errOAAI
errHanrui Wang; Yongshan Ding; Jiaqi Gu; Yujun Lin; David Z. Pan; Frederic T. Chong; Song Han
err分享
err收藏
Hyperlink-Aware Object Retrieval
err2016-09-01
err6
PREAI
errZhang, Wei; Ngo, Chong-Wah; Cao, Xiaochun
err分享
err收藏
ImageNet Large Scale Visual Recognition ChallengeImageNet大规模视觉识别挑战
err2015-04-11
err2.7W
PREAI
errRussakovsky, Olga; Deng, Jia; Su, Hao; Krause, Jonathan; Satheesh, Sanjeev; Ma, Sean; Huang, Zhiheng; Karpathy, Andrej; Khosla, Aditya; Bernstein, Michael; Berg, Alexander C.; Fei-Fei, Li
err分享
err收藏
学者 查看更多内容