.png){kind=icon}
返回
Learning Fundamental Visual Concepts Based on Evolved Multi-Edge Concept Graph
.png){kind=icon}
PRE
AI
DOI：10.1109/TMM.2020.3042072.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
In general, visual media comprises a set of elements of basic semantics, named fundamental visual concepts, that may not be semantically decomposed, such as objects, scenes and actions. This paper proposes a dynamic learning framework for fundamental visual concept learning from image-textual description paired data based on an evolved multi-edge concept graph (EMCG). First, we construct a multi-edge concept graph to represent the relationships between visual concept instances, in which we introduce two types of edges named visual edges and semantic edges to describe the connection strength in terms of visual appearance and semantic content. Second, we evolve the graph by updating connection strength based on the predicted results of concept learning. Finally, we present a growth algorithm for the multi-edge concept graph to handle cross-dataset concept learning. Driven by the predictions, the multi-edge concept graph can dynamically evolve over time by adjusting the connection strength to adapt better to the observations. In addition, our approach can be considered a weakly-supervised learning algorithm since no labeled concepts are employed for learning. Experimental results demonstrate that evolution can significantly improve the learning of fundamental visual concepts by 14.2%, 7.9% and 12.7% in terms of F1-score for the MSRC, VOC2012 and MSCOCO datasets, respectively, and that the proposed EMCG approach largely outperforms the compared approaches.
Keyword:
Fundamental visual concepts
concept graph
model evolution
cross media
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
9.7
论文数:
4.6K
被引数:
2.4W
机构
引用论文
.png){kind=icon}
分享收藏Evaluation of the Narrow Anterior Chamber Angle by Anterior Segment Optical Coherence Tomography
PREAI
分享收藏
Optimized Graph Learning Using Partial Tags and Multiple Features for Image and Video Annotation
PREAI
分享收藏
查看更多内容