.png){kind=icon}
返回
Dual Modality Reverse Reranking (DM-RR) Based Image Retrieval Framework
.png){kind=icon}
OA
AI
DOI：10.1109/OJIES.2024.3435956.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Retrieval of a product with desired modifications from a vast inventory of online industrial platforms is frequently encountered in our daily life. This study presents a specialized framework to retrieve user's queried product with its desired changes incorporated. To facilitate interaction between the end-user and agent in such scenarios, a multimodal content-based image retrieval system is essential. The system extracts textual and visual attributes, combining them through inductive learning to a unified representation. It is based on an in-depth understanding of visual characteristics that are modified by textual semantics. Lastly, a novel reverse reranking (RR) algorithm arranges the joint representation of dual modality queries and their corresponding target images for efficient retrieval. The proposed framework is novel compared to earlier methodologies. First, it achieves successful fusion of two different modalities. Second, it introduces a RR algorithm in the inference stage for efficient retrieval. The proposed framework's enhanced performance has been assessed using the Fashion-200 K and MIT-States real-world benchmark datasets. The proposed system can be used in real-world applications subject to its practical implications, such as generalization to diverse domains, availability of domain specific data, nature of the data and queries, and availability of computational resources.
Keyword:
Feature extraction
Visualization
Image retrieval
Industrial electronics
Semantics
Computer architecture
Transformers
Textual and visual embedding generations
bidirectional encoder representation from transformer (BERT)
residual neural network-50 (RESNET-50)
collaborative embeddings composition
inference-based learning
reverse reranking (RR)
期刊
I
IF:
4.3
论文数:
1.7K
被引数:
991
机构
引用论文
.png){kind=icon}
分享收藏Removal of methylene blue from colored effluents by adsorption onto ZnAPSO-34 nanoporous material
OAAI
OAAI分享收藏分享收藏分享收藏Remote Sensing Cross-Modal Text-Image Retrieval Based on Global and Local Information基于全局和局部信息的遥感跨模态文本图像检索OAAI
OAAI分享收藏
查看更多内容