Multi-channel Convolutional Neural Network for Precise Meme Classification

被引:0
|
作者
Sherratt, Victoria [1 ]
Pimbblet, Kevin [2 ,3 ]
Dethlefs, Nina [4 ]
机构
[1] Univ Hull, Ctr Excellence Data Sci AI & Modelling DAIM, Kingston Upon Hull, England
[2] Univ Hull, Big Data Analyt Res Grp, Kingston Upon Hull, England
[3] Univ Hull, Sch Comp Sci, Kingston Upon Hull, England
[4] Univ Hull, EA Milne Ctr Astrophys, Kingston Upon Hull, England
关键词
multimodal learning; computer vision and language; neural networks; social media analysis;
D O I
10.1145/3591106.3592275
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper proposes a multi-channel convolutional neural network (MC-CNN) for classifying memes and non-memes. Our architecture is trained and validated on a challenging dataset that includes non-meme formats with textual attributes, which are also circulated online but rarely accounted for in meme classification tasks. Alongside a transfer learning base, two additional channels capture low-level and fundamental features of memes that make them unique from other images with text. We contribute an approach which outperforms previous meme classifiers specifically in live data evaluation, and one that is better able to generalise 'in the wild'. Our research aims to improve accurate collation of meme content to support continued research in meme content analysis, and meme-related sub-tasks such as harmful content detection.
引用
收藏
页码:190 / 198
页数:9
相关论文
共 50 条
  • [41] Deformable Cardiovascular Image Registration via multi-Channel Convolutional Neural Network
    Guan, Shaoya
    Meng, Cai
    Xie, Yi
    Wang, Qi
    Sun, Kai
    Wang, Tianmiao
    [J]. IEEE ACCESS, 2019, 7 : 17524 - 17534
  • [42] Bearing Fault Diagnosis with Multi-Channel Sample and Deep Convolutional Neural Network
    Zhang, Hongbin
    Yuan, Qi
    Zhao, Bingxi
    Niu, Guangshuo
    [J]. Hsi-An Chiao Tung Ta Hsueh/Journal of Xi'an Jiaotong University, 2020, 54 (08): : 58 - 66
  • [43] Biometric Face Presentation Attack Detection With Multi-Channel Convolutional Neural Network
    George, Anjith
    Mostaani, Zohreh
    Geissenbuhler, David
    Nikisins, Olegs
    Anjos, Andre
    Marcel, Sebastien
    [J]. IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2020, 15 : 42 - 55
  • [44] Classification of hand direction using multi-channel electromyography by neural network
    Ma, N
    Kumar, DK
    Pah, N
    [J]. ANZIIS 2001: PROCEEDINGS OF THE SEVENTH AUSTRALIAN AND NEW ZEALAND INTELLIGENT INFORMATION SYSTEMS CONFERENCE, 2001, : 405 - 410
  • [45] Multi-Channel Neural Network for Steganalysis
    Liu, Kai
    Li, Xuan
    Zhang, Qiong
    Kang, Xiangui
    [J]. 2017 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC 2017), 2017, : 1210 - 1213
  • [46] Multi-channel Convolutional Neural Networks with Multi-level Feature Fusion for Environmental Sound Classification
    Chong, Dading
    Zou, Yuexian
    Wang, Wenwu
    [J]. MULTIMEDIA MODELING, MMM 2019, PT II, 2019, 11296 : 157 - 168
  • [47] Multi-channel and multi-scale separable dilated convolutional neural network with attention mechanism for flue-cured tobacco classification
    Xu, Ming
    Gao, Jinfeng
    Zhang, Zhong
    Guo, Xin
    [J]. NEURAL COMPUTING & APPLICATIONS, 2023, 35 (21): : 15511 - 15529
  • [48] Multi-channel and multi-scale separable dilated convolutional neural network with attention mechanism for flue-cured tobacco classification
    Ming Xu
    Jinfeng Gao
    Zhong Zhang
    Xin Guo
    [J]. Neural Computing and Applications, 2023, 35 : 15511 - 15529
  • [49] Aspect extraction on user textual reviews using multi-channel convolutional neural network
    Da'u, Aminu
    Salim, Naomie
    [J]. PEERJ COMPUTER SCIENCE, 2019,
  • [50] LTE Device Identification Based on RF Fingerprint with Multi-Channel Convolutional Neural Network
    Yin, Pengcheng
    Peng, Linning
    Zhang, Junqing
    Liu, Ming
    Fu, Hua
    Hu, Aiqun
    [J]. 2021 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2021,