arrow
返回

Image Retrieval for Complex Queries Using Knowledge Embedding

delete2020-03-29
delete10
PRE
AI
C
Chandramani Chaudhary
P
Poonam Goyal
N
Navneet Goyal *
Y
Yi‐Ping Phoebe Chen
DOI:10.1145/3375786delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
With the increase in popularity of image-based applications, users are retrieving images using more sophisticated and complex queries. We present three types of complex queries, namely, long, ambiguous, and abstract. Each type of query has its own characteristics/complexities and thus leads to imprecise and incomplete image retrieval. Existing methods for image retrieval are unable to deal with the high complexity of such queries. Search engines need to integrate their image retrieval process with knowledge to obtain rich semantics for effective retrieval. We propose a framework, Image Retrieval using Knowledge Embedding (ImReKE), for embedding knowledge with images and queries, allowing retrieval approaches to understand the context of queries and images in a better way. ImReKE (IR_Approach, Knowledge_Base) takes two inputs, namely, an image retrieval approach and a knowledge base. It selects quality concepts (concepts that possess properties such as rarity, newness, etc.) from the knowledge base to provide rich semantic representations for queries and images to be leveraged by the image retrieval approach. For the first time, an effective knowledge base that exploits both the visual and textual information of concepts has been developed. Our extensive experiments demonstrate that the proposed framework improves image retrieval significantly for all types of complex queries. The improvement is remarkable in the case of abstract queries, which have not yet been dealt with explicitly in the existing literature. We also compare the quality of our knowledge base with the existing text-based knowledge bases, such as ConceptNet, ImageNet, and the like.
Keyword:
Image retrieval
query expansion
knowledge base
knowledge embedding
diversity
ambiguous query
complex query
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

ACM Transactions on Multimedia Computing Communications and Applications 封面图
ACM Transactions on Multimedia Computing Communications and Applications
IF:
6
论文数:
2.0K
被引数:
5.4K

机构

B
birla institute of technology & science pilani (bits pilani)
学者数:
6.5K
论文数: 5.1K
被引数: 10
L
La Trobe University
学者数:
1.1W
论文数: 1.1W
被引数: 1.5W
引用论文

引用论文

Semantic image retrieval for complex queries using a knowledge parser
err2017-06-21
err3
PREAI
errChen, Hua; Trouve, Antoine; Murakami, Kazuaki J.; Fukuda, Akira
err分享
err收藏
Image Re-Ranking Based on Topic Diversity
err2017-08-01
err33
PREAI
errQian, Xueming; Lu, Dan; Wang, Yaxiong; Zhu, Li; Tang, Yuan Yan; Wang, Meng
err分享
err收藏
Sensitized by a sea slug: Site-specific short-term and general long-term sensitization in Aplysia following Navanax attack
err2022-01-01
err0
errOAAI
errChrissy Pepino; Cyril Rakovski; Candace Gutierrez; Amanda Rodriguez; Scott Tillett; Cassandra Berriman; Maria Mason; Amanda Watkins Ingalls; Rebecca Emshwiler; Sarah Christian Scher; Virginia Zachary; Lucy Lee; Sarah Johnson; Kendra Olsen; William G. Wright
err分享
err收藏
Predicting Entry-Level Categories预测入门级类别
err2015-04-08
err13
PREAI
errOrdonez, Vicente; Liu, Wei; Deng, Jia; Choi, Yejin; Berg, Alexander C.; Berg, Tamara L.
err分享
err收藏
Episodic memory effects of gamma frequency precuneus transcranial magnetic stimulation in Alzheimer's disease: A randomized multiple baseline study
err2022-11-09
err0
errOAAI
errArtemis Traikapi; Ioanna Kalli; Andrea Kyriakou; Elena Stylianou; Rafaella Tereza Symeou; Akrivi Kardama; Yiolanda Panayiota Christou; Phivos Phylactou; Nikos Konstantinou
err分享
err收藏
Detailed temporal dissection of an enhancer cluster reveals two distinct roles for individual elements
err
IF0
err2020-05-08
err0
errOAAI
errHenry Thomas; Elena Kotova; Axel Pilz; Merrit Romeike; Andreas Lackner; Christoph Bock; Martin Leeb; Joanna Wysocka; Christa Buecker
err分享
err收藏
学者 查看更多内容