FedStream: Prototype-Based Federated Learning on Distributed Concept-Drifting Data Streams

被引:3
|
作者
Mawuli, Cobbinah B. [1 ,2 ]
Che, Liwei [4 ,5 ]
Kumar, Jay [1 ,2 ,3 ]
Din, Salah Ud [1 ,2 ]
Qin, Zhili [1 ,2 ]
Yang, Qinli [4 ]
Shao, Junming [1 ,2 ]
机构
[1] Univ Elect Sci & Technol China, Sch Comp Sci & Engn, Chengdu 611731, Peoples R China
[2] Univ Elect Sci & Technol China, Yangtze Delta Reg Inst, Huzhou 313001, Peoples R China
[3] Dalhousie Univ, Inst Big Data Analyt, Halifax, NS B3H 4R2, Canada
[4] Univ Elect Sci & Technol China, Data Min Lab, Chengdu 611731, Peoples R China
[5] Penn State Univ, Coll Informat Sci & Technol IST, State Coll, PA 16802 USA
基金
中国国家自然科学基金;
关键词
Index Terms-Classification; concept drift; data streams; fed-erated learning (FL); prototype learning; CLASSIFICATION;
D O I
10.1109/TSMC.2023.3293462
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Distributed data stream mining has gained increasing attention in recent years since many organizations collect tremendous amounts of streaming data from different locations. Existing studies mainly focus on learning evolving concepts on distributed data streams, while the privacy issue is little investigated. In this article, for the first time, we develop a federated learning framework for distributed concept-drifting data streams, called FedStream. The proposed method allows capturing the evolving concepts by dynamically maintaining a set of prototypes with error-driven representative learning. Meanwhile, a new metric-learning-based prototype transformation technique is introduced to preserve privacy among participating clients in the distributed data streams setting. Extensive experiments on both real-world and synthetic datasets have demonstrated the superiority of FedStream, and it even achieves competitive performance with state-of-the-art distributed learning methods.
引用
收藏
页码:7112 / 7124
页数:13
相关论文
共 50 条
  • [1] Prototype-based Learning on Concept-drifting Data Streams
    Shao, Junming
    Ahmadi, Zahra
    Kramer, Stefan
    [J]. PROCEEDINGS OF THE 20TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING (KDD'14), 2014, : 412 - 421
  • [2] Selective prototype-based learning on concept-drifting data streams
    Chen, Dongzi
    Yang, Qinli
    Liu, Jiaming
    Zeng, Zhu
    [J]. INFORMATION SCIENCES, 2020, 516 : 20 - 32
  • [3] An adaptive distributed ensemble approach to mine concept-drifting data streams
    Folino, Gianluigi
    Pizzuti, Clara
    Spezzano, Giandomenico
    [J]. 19TH IEEE INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE, VOL II, PROCEEDINGS, 2007, : 183 - 187
  • [4] Random Ensemble Decision Trees for Learning Concept-Drifting Data Streams
    Li, Peipei
    Wu, Xindong
    Liang, Qianhui
    Hu, Xuegang
    Zhang, Yuhong
    [J]. ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PT I: 15TH PACIFIC-ASIA CONFERENCE, PAKDD 2011, 2011, 6634 : 313 - 325
  • [5] Learning concept-drifting data streams with random ensemble decision trees
    Li, Peipei
    Wu, Xindong
    Hu, Xuegang
    Wang, Hao
    [J]. NEUROCOMPUTING, 2015, 166 : 68 - 83
  • [6] Robust Prototype-Based Learning on Data Streams
    Shao, Junming
    Huang, Feng
    Yang, Qinli
    Luo, Guangchun
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2018, 30 (05) : 978 - 991
  • [7] Ubiquitous Self-Organizing Map: Learning Concept-Drifting Data Streams
    Silva, Bruno
    Marques, Nuno
    [J]. NEW CONTRIBUTIONS IN INFORMATION SYSTEMS AND TECHNOLOGIES, VOL 1, PT 1, 2015, 353 : 713 - 722
  • [8] An approach of support approximation to discover frequent patterns from concept-drifting data streams based on concept learning
    Li, Chao-Wei
    Jea, Kuen-Fang
    [J]. KNOWLEDGE AND INFORMATION SYSTEMS, 2014, 40 (03) : 639 - 671
  • [9] ACCD: Associative Classification over Concept-Drifting Data Streams
    Waiyamai, Kitsana
    Kangkachit, Thanapat
    Saengthongloun, Bordin
    Rakthanmanon, Thanawin
    [J]. MACHINE LEARNING AND DATA MINING IN PATTERN RECOGNITION, MLDM 2014, 2014, 8556 : 78 - 90
  • [10] An approach of support approximation to discover frequent patterns from concept-drifting data streams based on concept learning
    Chao-Wei Li
    Kuen-Fang Jea
    [J]. Knowledge and Information Systems, 2014, 40 : 639 - 671