Multi-source Heterogeneous Data Fusion Algorithm Based on Federated Learning

被引:1
|
作者
Zhou, Jincheng [1 ,3 ]
Lei, Yang [1 ,2 ]
机构
[1] Qiannan Normal Univ Nationalities, Sch Comp & Informat, Duyun 558000, Guizhou, Peoples R China
[2] Baoji Univ Arts & Sci, Sch Comp Sci, Baoji 721007, Peoples R China
[3] Key Lab Complex Syst & Intelligent Optimizat Guiz, Duyun 558000, Guizhou, Peoples R China
来源
基金
中国国家自然科学基金;
关键词
Edge computing; Federated learning; Deep learning; Tensor theory; Heterogeneous data fusion;
D O I
10.1007/978-981-99-0405-1_4
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
With the rapid advancement of science and technology, the number of edge devices with computing and storage capabilities, as well as the generated data traffic, continues to increase, making it difficult for the centralized processing mode centered on cloud computing to efficiently process the data generated by edge devices. Moreover, multimodal data is abundant due to the diversity of edge network devices and the ongoing improvement of data representation techniques. To make full use of heterogeneous data on edge devices and to tackle the "data communication barrier" problem caused by data privacy in edge computing, a multi-source heterogeneous data fusion technique based on Tucker decomposition is developed. The algorithm introduces tensor Tucker decomposition theory and realizes federated learning by constructing a high-order tensorwith heterogeneous spatial dimension characteristics to capture the high-dimensional features of heterogeneous data and solve the fusion problem of heterogeneous data assuming no interaction. Combining and remembering. This method, unlike its predecessors, can efficiently integrate multi-source heterogeneous data without data transfer, therefore overcoming privacy and security-related data communication concerns. Finally, the effectiveness of the technique is confirmed using the MOSI data set, and the shortcomings of the original federated learning algorithm are solved by the updated federated weighted average algorithm. Subjective criteria are used to calculate the data quality for the improved federated average approach based on AHP. We present Influence, an improved federated weighted average method for dealing with multi-source data from a data quality perspective.
引用
收藏
页码:46 / 60
页数:15
相关论文
共 50 条
  • [1] A multi-source credit data fusion approach based on federated distillation learning
    Zhang, Xiaodong
    Sun, Zhoubao
    Mao, Lin
    Li, Xiaoping
    [J]. INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2024, 15 (03) : 1153 - 1164
  • [2] A multi-source credit data fusion approach based on federated distillation learning
    Xiaodong Zhang
    Zhoubao Sun
    Lin Mao
    Xiaoping Li
    [J]. International Journal of Machine Learning and Cybernetics, 2024, 15 : 1153 - 1164
  • [3] Multi-source Heterogeneous Data Fusion
    Zhang, Lili
    Xie, Yuxiang
    Luan Xidao
    Zhang, Xin
    [J]. 2018 INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND BIG DATA (ICAIBD), 2018, : 47 - 51
  • [4] The Indoor Positioning Fusion Algorithm of Multi-source and Heterogeneous
    Gu, Tianlong
    Tang, Yanhao
    Wang, Zhongshuai
    Lan, Rushi
    Zhong, Yanru
    Chang, Liang
    [J]. 2018 7TH INTERNATIONAL CONFERENCE ON DIGITAL HOME (ICDH 2018), 2018, : 294 - 299
  • [5] Federated Generative Model on Multi-Source Heterogeneous Data in IoT
    Xiong, Zuobin
    Li, Wei
    Cai, Zhipeng
    [J]. THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 9, 2023, : 10537 - 10545
  • [6] Multi-source heterogeneous data fusion model based on fuzzy mathematics
    Zeng, Qiao
    [J]. JOURNAL OF COMPUTATIONAL METHODS IN SCIENCES AND ENGINEERING, 2023, 23 (04) : 2165 - 2178
  • [7] A Hybrid Recommendation Model Based on Fusion of Multi-Source Heterogeneous Data
    Ji, Zhen-Yan
    Pi, Huai-Yu
    Yao, Wei-Na
    [J]. Beijing Youdian Daxue Xuebao/Journal of Beijing University of Posts and Telecommunications, 2019, 42 (01): : 126 - 132
  • [8] Multi-Source Data Fusion and Target Tracking of Heterogeneous Network Based on Data Mining
    Quan, Xunzhong
    Chen, Jie
    [J]. TRAITEMENT DU SIGNAL, 2021, 38 (03) : 663 - 671
  • [9] Multi-source Heterogeneous Data Fusion Model Based on FC-SAE
    Zhang, Hong
    Jiang, Kun
    Cheng, Chuanqi
    Cao, Jie
    Zhang, Wenyue
    [J]. JOURNAL OF INTERNET TECHNOLOGY, 2022, 23 (07): : 1473 - 1481
  • [10] Technology State Control Based on Multi-source Heterogeneous Data Fusion in Manufacturing
    Yu, Jie
    Gu, Shenggao
    Zhang, Wei
    [J]. INTERNATIONAL JOURNAL OF COMPUTATIONAL INTELLIGENCE SYSTEMS, 2020, 13 (01) : 638 - 644