arrow
返回

Multimodal Distributional Semantics

delete2014-01-23
delete0
delete
OA
AI
DOI:10.1613/jair.4135delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Distributional semantic models derive computational representations of word meaning from the patterns of co-occurrence of words in text. Such models have been a success story of computational linguistics, being able to provide reliable estimates of semantic relatedness for the many semantic tasks requiring them. However, distributional models extract meaning information exclusively from text, which is an extremely impoverished basis compared to the rich perceptual sources that ground human semantic knowledge. We address the lack of perceptual grounding of distributional models by exploiting computer vision techniques that automatically identify discrete “visual words” in images, so that the distributional representation of a word can be extended to also encompass its co-occurrence with the visual words of images it is associated with. We propose a flexible architecture to integrate text- and image-based distributional information, and we show in a set of empirical tests that our integrated model is superior to the purely text-based approach, and it provides somewhat complementary semantic information with respect to the latter.

期刊

暂无期刊信息

机构

暂无机构信息
引用论文

引用论文

暂无论文信息