Multi-channel Convolutional Neural Network for Precise Meme Classification

被引:0
|
作者
Sherratt, Victoria [1 ]
Pimbblet, Kevin [2 ,3 ]
Dethlefs, Nina [4 ]
机构
[1] Univ Hull, Ctr Excellence Data Sci AI & Modelling DAIM, Kingston Upon Hull, England
[2] Univ Hull, Big Data Analyt Res Grp, Kingston Upon Hull, England
[3] Univ Hull, Sch Comp Sci, Kingston Upon Hull, England
[4] Univ Hull, EA Milne Ctr Astrophys, Kingston Upon Hull, England
关键词
multimodal learning; computer vision and language; neural networks; social media analysis;
D O I
10.1145/3591106.3592275
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper proposes a multi-channel convolutional neural network (MC-CNN) for classifying memes and non-memes. Our architecture is trained and validated on a challenging dataset that includes non-meme formats with textual attributes, which are also circulated online but rarely accounted for in meme classification tasks. Alongside a transfer learning base, two additional channels capture low-level and fundamental features of memes that make them unique from other images with text. We contribute an approach which outperforms previous meme classifiers specifically in live data evaluation, and one that is better able to generalise 'in the wild'. Our research aims to improve accurate collation of meme content to support continued research in meme content analysis, and meme-related sub-tasks such as harmful content detection.
引用
收藏
页码:190 / 198
页数:9
相关论文
共 50 条
  • [1] A multi-channel attention graph convolutional neural network for node classification
    Zhai, Rui
    Zhang, Libo
    Wang, Yingqi
    Song, Yalin
    Yu, Junyang
    [J]. JOURNAL OF SUPERCOMPUTING, 2023, 79 (04): : 3561 - 3579
  • [2] Multi-channel Convolutional Neural Network with Sentiment Information for Sentiment Classification
    Yan, Hao
    Li, Huixin
    Yi, Benshun
    [J]. ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING, 2023, 48 (08) : 10551 - 10561
  • [3] Classification of Hyperspectral Data Using a Multi-Channel Convolutional Neural Network
    Chen, Chen
    Zhang, Jing-Jing
    Zheng, Chun-Hou
    Yan, Qing
    Xun, Li-Na
    [J]. INTELLIGENT COMPUTING METHODOLOGIES, ICIC 2018, PT III, 2018, 10956 : 81 - 92
  • [4] Multi-channel Convolutional Neural Network with Sentiment Information for Sentiment Classification
    Hao Yan
    Huixin Li
    Benshun Yi
    [J]. Arabian Journal for Science and Engineering, 2023, 48 : 10551 - 10561
  • [5] A multi-channel attention graph convolutional neural network for node classification
    Rui Zhai
    Libo Zhang
    Yingqi Wang
    Yalin Song
    Junyang Yu
    [J]. The Journal of Supercomputing, 2023, 79 : 3561 - 3579
  • [6] Multi-Channel Embedding Convolutional Neural Network Model for Arabic Sentiment Classification
    Dahou, Abdelghani
    Xiong, Shengwu
    Zhou, Junwei
    Abd Elaziz, Mohamed
    [J]. ACM TRANSACTIONS ON ASIAN AND LOW-RESOURCE LANGUAGE INFORMATION PROCESSING, 2019, 18 (04)
  • [7] A MULTI-CHANNEL TEMPORAL ATTENTION CONVOLUTIONAL NEURAL NETWORK MODEL FOR ENVIRONMENTAL SOUND CLASSIFICATION
    Wang, You
    Feng, Chuyao
    Anderson, David, V
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 930 - 934
  • [8] INVARIANT FEATURE EXTRACTION FOR IMAGE CLASSIFICATION VIA MULTI-CHANNEL CONVOLUTIONAL NEURAL NETWORK
    Mei, Shaohui
    Jiang, Ruoqiao
    Ji, Jingyu
    Sun, Jun
    Peng, Yang
    Zhang, Yifan
    [J]. 2017 INTERNATIONAL SYMPOSIUM ON INTELLIGENT SIGNAL PROCESSING AND COMMUNICATION SYSTEMS (ISPACS 2017), 2017, : 491 - 495
  • [9] Fire Recognition Based On Multi-Channel Convolutional Neural Network
    Mao, Wentao
    Wang, Wenpeng
    Dou, Zhi
    Li, Yuan
    [J]. FIRE TECHNOLOGY, 2018, 54 (02) : 531 - 554
  • [10] Multi-channel Convolutional Neural Network Ensemble for Pedestrian Detection
    Ribeiro, David
    Carneiro, Gustavo
    Nascimento, Jacinto C.
    Bernardino, Alexandre
    [J]. PATTERN RECOGNITION AND IMAGE ANALYSIS (IBPRIA 2017), 2017, 10255 : 122 - 130