arrow
返回

Fast Semantic Diffusion for Large-Scale Context-Based Image and Video Annotation

delete2012-06-01
delete37
delete
OA
AI
Y
Yu–Gang Jiang *
Q
Qi Dai
J
Jun Wang
C
Chong‐Wah Ngo
X
Xiangyang Xue
S
Shih‐Fu Chang
DOI:10.1109/TIP.2012.2188038delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Exploring context information for visual recognition has recently received significant research attention. This paper proposes a novel and highly efficient approach, which is named semantic diffusion, to utilize semantic context for large-scale image and video annotation. Starting from the initial annotation of a large number of semantic concepts (categories), obtained by either machine learning or manual tagging, the proposed approach refines the results using a graph diffusion technique, which recovers the consistency and smoothness of the annotations over a semantic graph. Different from the existing graph-based learning methods that model relations among data samples, the semantic graph captures context by treating the concepts as nodes and the concept affinities as the weights of edges. In particular, our approach is capable of simultaneously improving annotation accuracy and adapting the concept affinities to new test data. The adaptation provides a means to handle domain change between training and test data, which often occurs in practice. Extensive experiments are conducted to improve concept annotation results using Flickr images and TV program videos. Results show consistent and significant performance gain (10 on both image and video data sets). Source codes of the proposed algorithms are available online.
Keyword:
Context
image and video annotation
semantic concept
semantic diffusion (SD)

期刊

IEEE Transactions on Image Processing 封面图
IEEE Transactions on Image Processing
IF:
13.7
论文数:
1.0W
被引数:
8.4W

机构

C
Columbia University
学者数:
7.1W
论文数: 6.4W
被引数: 263
F
fudan university
学者数:
11.8W
论文数: 7.7W
被引数: 121
C
City University of Hong Kong
学者数:
2.3W
论文数: 3.0W
被引数: 6.1W
I
international business machines (ibm)
学者数:
5.7K
论文数: 4.5K
被引数: 4
学者 查看更多机构
引用论文

引用论文

Low-intensity exercise training decreases cardiac output and hypertension in spontaneously hypertensive rats
err1997-12-01
err0
PREAI
errAcácio Salvador Véras-Silva; Katt Coelho Mattos; Nilo Sérgio Gava; Patricia Chakur Brum; Carlos Eduardo Negrão; Eduardo Moacyr Krieger
err分享
err收藏
DOP60 Environmental risk factors for Inflammatory bowel disease: A large prospective case-control study in India
err2023-01-30
err0
errOAAI
errR Banerjee; P Pal; N Prakash; S Mudigonda; S Joseph; R Patel; M Khalil; A Komawar; S Korikana; D Mekala; Y Akki; A Gaddam; S Valluri
err分享
err收藏
A novel polyamine analog (SL-11093) inhibits growth of human prostate tumor xenografts in nude mice
err2003-04-15
err0
PREAI
errBenjamin Frydman; Carl W. Porter; Yulia Maxuitenko; Aparajita Sarkar; Subhra Bhattacharya; Aldonia Valasinas; Venodhar K. Reddy; Nick Kisiel; Laurence J. Marton; Hirak S. Basu
err分享
err收藏
err分享
err收藏
Unique behavior of dermal cells from regenerative mammal, the African Spiny Mouse, in response to substrate stiffness
err2018-11-01
err0
PREAI
errDaniel C. Stewart; P. Nicole Serrano; Andrés Rubiano; Ryosuke Yokosawa; Justin Sandler; Marah Mukhtar; Jason O. Brant; Malcolm Maden; Chelsey S. Simmons
err分享
err收藏
学者 查看更多内容