arrow
返回

A structured learning framework for content-based image indexing and visual query

delete2005-04-01
delete17
PRE
AI
J
Joo‐Hwee Lim
J
Jesse S. Jin
DOI:10.1007/s00530-004-0158-zdelete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Nonspecific images in a broad domain remain a challenge for content-based image retrieval. As a typical example, consumer photos exhibit highly varied content, diverse resolutions, and inconsistent quality. The objects are usually ill-posed, occluded, and cluttered with poor lighting, focus, and exposure. Traditional image retrieval approaches face many obstacles such as semantic description of images, robust semantic object segmentation, small sampling problem, semantic gaps between low-level features and high-level semantics, etc. To manage the high diversity of images in a broad domain, we propose a structured learning framework to systematically design domain-relevant visual semantics, known as semantic support regions, to support index and query in a content-based image retrieval system. Semantic support regions are segmentation-free image regions that exhibit semantic meanings and that can be learned statistically to span a new indexing space. They are detected from image content, reconciled across multiple resolutions, and aggregated spatially to form local semantic histograms. The resulting compact and abstract representation can support both similarity-based query and compositional visual query efficiently. The query by spatial icons (QBSI) formulation is a unique visual query language to explicitly specify visual icons and spatial extents in a Boolean expression. For empirical evaluation, we perform the learning and indexing processes of 26 semantic support regions over 2400 heterogeneous consumer photos from a single family using Support Vector Machines. We report a 27% improvement in average precision over a very high dimension feature-based approach on 24 semantic queries based on multiple examples and pooled ground truths. Last but not least, we demonstrate the usefulness of the visual query language with 15 QBSI queries that have attained high precision values at top retrieved images on the 2400 consumer images.
Keyword:
content-based image retrieval
image semantics
image indexing
image query

期刊

Multimedia Systems 封面图
Multimedia Systems
IF:
3.1
论文数:
2.8K
被引数:
2.7K

机构

暂无机构信息
引用论文

引用论文

err1999-01-01
err0
PREAI
errJens Schmitt; Lars Wolf; Martin Karsten; Ralf Steinmetz
err分享
err收藏
Longitudinal transcriptome analyses show robust T cell immunity during recovery from COVID-19纵向转录组分析显示新型冠状病毒肺炎恢复过程中T细胞免疫功能强大
err2020-12-24
err0
errOAAI
errHong-Yi Zheng; Min Xu; Cui-Xian Yang; Ren-Rong Tian; Mi Zhang; Jian-Jian Li; Xi-Cheng Wang; Zhao-Li Ding; Gui-Mei Li; Xiao-Lu Li; Yu-Qi He; Xing-Qi Dong; Yong-Gang Yao; Yong-Tang Zheng
err分享
err收藏
Silent Surrender
err
IF0
err2002-11-21
err0
PREAI
errKari Levitt; Mel Watkins
err分享
err收藏
Policy Generation Framework for Large-Scale Storage Infrastructures
err2010-01-01
err0
PREAI
errRamani Routray; Rui Zhang; David Eyers; Douglas Willcocks; Peter Pietzuch; Prasenjit Sarkar
err分享
err收藏
学者 查看更多内容