arrow
Return

PolyMeme: Fine-Grained Internet Meme Sensing

delete2024-08-23
delete0
delete
OA
AI
V
Vasileios Arailopoulos
K
Koutlis, Christos *
S
Symeon Papadopoulos
P
Panagiotis C. Petrantonakis
DOI:10.3390/s24175456delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Internet memes are a special type of digital content that is shared through social media. They have recently emerged as a popular new format of media communication. They are often multimodal, combining text with images and aim to express humor, irony, sarcasm, or sometimes convey hatred and misinformation. Automatically detecting memes is important since it enables tracking of social and cultural trends and issues related to the spread of harmful content. While memes can take various forms and belong to different categories, such as image macros, memes with labeled objects, screenshots, memes with text out of the image, and funny images, existing datasets do not account for the diversity of meme formats, styles and content. To bridge this gap, we present the PolyMeme dataset, which comprises approximately 27 K memes from four categories. This was collected from Reddit and a part of it was manually labelled into these categories. Using the manual labels, deep learning networks were trained to classify the unlabelled images with an estimated error rate of 7.35%. The introduced meme dataset in combination with existing datasets of regular images were used to train deep learning networks (ResNet, ViT) on meme detection, exhibiting very high accuracy levels (98% on the test set). In addition, no significant gains were identified from the use of regular images containing text.
Keywords:
meme taxonomy
meme classification
meme detection
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Sensors cover
Sensors
IF:
3.5
Papers:
7.1W
Citations:
20.9W

Organization

A
aristotle university of thessaloniki
Scholars:
2.6W
Papers: 2.0W
Citations: 19