arrow
Return

A rank aggregation framework for video multimodal geocoding

delete2013-08-01
delete4
PRE
AI
L
Lin Tzy Li *
D
Daniel Carlos Guimarães Pedronette
J
Jurandy Almeida
O
Otávio A. B. Penatti
R
Rodrigo Tripodi Calumby
R
Ricardo da Silva Torres
DOI:10.1007/s11042-013-1588-4delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
This paper proposes a rank aggregation framework for video multimodal geocoding. Textual and visual descriptions associated with videos are used to define ranked lists. These ranked lists are later combined, and the resulting ranked list is used to define appropriate locations for videos. An architecture that implements the proposed framework is designed. In this architecture, there are specific modules for each modality (e. g, textual and visual) that can be developed and evolved independently. Another component is a data fusion module responsible for combining seamlessly the ranked lists defined for each modality. We have validated the proposed framework in the context of the MediaEval 2012 Placing Task, whose objective is to automatically assign geographical coordinates to videos. Obtained results show how our multimodal approach improves the geocoding results when compared to methods that rely on a single modality (either textual or visual descriptors). We also show that the proposed multimodal approach yields comparable results to the best submissions to the Placing Task in 2012 using no extra information besides the available development/training data. Another contribution of this work is related to the proposal of a new effectiveness evaluation measure. The proposed measure is based on distance scores that summarize how effective a designed/tested approach is, considering its overall result for a test dataset.
Keywords:
Video geotagging
Multimodal retrieval
Rank aggregation
Effectiveness measure

Journal

Multimedia Tools and Applications cover
Multimedia Tools and Applications
IF:
3
Papers:
1.9W
Citations:
3.2W

Organization

U
universidade estadual de campinas
Scholars:
3.3W
Papers: 2.3W
Citations: 19