Federated Multi-task Learning for Complaint Identification from Social Media Data

被引:2
|
作者
Singh, Apoorva [1 ]
Sen, Tanmay [2 ]
Saha, Sriparna [1 ]
Hasanuzzaman, Mohammed [3 ]
机构
[1] Indian Inst Technol Patna, Patna, Bihar, India
[2] Ericsson, Kolkata, India
[3] Dublin City Univ, ADAPT Ctr, Dublin, Ireland
关键词
Complaint Identification; Deep Multitask learning; Federated Learning;
D O I
10.1145/3465336.3475119
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Complaining is a speech act that is often used by consumers to signify a breach of expectation, i.e., an expression of displeasure on a consumer's behalf towards an organization, product, or event. Complaint identification has been previously analyzed based on extensive feature engineering in centralized settings, disregarding the non-identically independently distributed (non-IID), security and privacy-preserving characteristics of complaints that can hamper data accumulation, distribution, and learning. In this work, we propose a Bidirectional Encoder Representations from Transformers (BERT) based multi-task framework that aims to learn two closely related tasks, viz. complaint identification (primary task) and sentiment classification (auxiliary tasks) concurrently under federated-learning settings. Extensive evaluation on two real-world datasets show that our proposed framework surpasses the baselines and state-of-the-art framework results by a significant margin.
引用
收藏
页码:201 / 210
页数:10
相关论文
共 50 条
  • [1] Federated Multi-Task Learning
    Smith, Virginia
    Chiang, Chao-Kai
    Sanjabi, Maziar
    Talwalkar, Ameet
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 30 (NIPS 2017), 2017, 30
  • [2] Federated Multi-task Graph Learning
    Liu, Yijing
    Han, Dongming
    Zhang, Jianwei
    Zhu, Haiyang
    Xu, Mingliang
    Chen, Wei
    [J]. ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2022, 13 (05)
  • [3] Federated Multi-Task Learning with Non-Stationary Heterogeneous Data
    Zhang, Hongwei
    Tao, Meixia
    Shi, Yuanming
    Bi, Xiaoyan
    [J]. IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2022), 2022, : 4950 - 4955
  • [4] Federated Multi-task Learning with Hierarchical Attention for Sensor Data Analytics
    Chen, Yujing
    Ning, Yue
    Chai, Zheng
    Rangwala, Huzefa
    [J]. 2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [5] HFedMTL: Hierarchical Federated Multi-Task Learning
    Yi, Xingfu
    Li, Rongpeng
    Peng, Chenghui
    Wu, Jianjun
    Zhao, Zhifeng
    [J]. 2022 IEEE 33RD ANNUAL INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR AND MOBILE RADIO COMMUNICATIONS (IEEE PIMRC), 2022,
  • [6] Multi-task learning for spatial events prediction from social data
    Eom, Sungkwang
    Oh, Byungkook
    Shin, Sangjin
    Lee, Kyong-Ho
    [J]. INFORMATION SCIENCES, 2021, 581 : 278 - 290
  • [7] Multi-Task Federated Edge Learning (MTFeeL) With SignSGD
    Mahara, Sawan Singh
    Shruti, M.
    Bharath, B. N.
    [J]. 2022 NATIONAL CONFERENCE ON COMMUNICATIONS (NCC), 2022, : 379 - 384
  • [8] Multi-task Federated Learning for Heterogeneous Pancreas Segmentation
    Shen, Chen
    Wang, Pochuan
    Roth, Holger R.
    Yang, Dong
    Xu, Daguang
    Oda, Masahiro
    Wang, Weichung
    Fuh, Chiou-Shann
    Chen, Po-Ting
    Liu, Kao-Lang
    Liao, Wei-Chih
    Mori, Kensaku
    [J]. CLINICAL IMAGE-BASED PROCEDURES, DISTRIBUTED AND COLLABORATIVE LEARNING, ARTIFICIAL INTELLIGENCE FOR COMBATING COVID-19 AND SECURE AND PRIVACY-PRESERVING MACHINE LEARNING, CLIP 2021, DCL 2021, LL-COVID19 2021, PPML 2021, 2021, 12969 : 101 - 110
  • [9] Federated Multi-Task Learning under a Mixture of Distributions
    Marfoq, Othmane
    Neglia, Giovanni
    Bellet, Aurelien
    Kameni, Laetitia
    Vidal, Richard
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [10] Over-the-Air Federated Multi-Task Learning
    Ma, Haoming
    Yuan, Xiaojun
    Fan, Dian
    Ding, Zhi
    Wang, Xin
    Fang, Jun
    [J]. IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2022), 2022, : 5184 - 5189