FRAMU: Attention-Based Machine Unlearning Using Federated Reinforcement Learning

被引:3
|
作者
Shaik, Thanveer [1 ]
Tao, Xiaohui [1 ]
Li, Lin [2 ]
Xie, Haoran [3 ]
Cai, Taotao [1 ]
Zhu, Xiaofeng [4 ]
Li, Qing [5 ]
机构
[1] Univ Southern Queensland, Sch Math Phys & Comp, Darling Hts, Qld 4350, Australia
[2] Wuhan Univ Technol, Sch Comp Sci & Artificial Intelligence, Wuhan 430062, Hubei, Peoples R China
[3] Lingnan Univ, Dept Comp & Decis Sci, Hong Kong, Tuen Mun, Peoples R China
[4] Univ Elect Sci & Technol China, Chengdu 610054, Sichuan, Peoples R China
[5] Hong Kong Polytech Univ, Dept Comp, Hung Hom, Hong Kong, Peoples R China
关键词
Data privacy; Distributed databases; Data models; Adaptation models; Attention mechanism; federated learning; machine unlearning; privacy; reinforcement learning;
D O I
10.1109/TKDE.2024.3382726
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Machine Unlearning, a pivotal field addressing data privacy in machine learning, necessitates efficient methods for the removal of private or irrelevant data. In this context, significant challenges arise, particularly in maintaining privacy and ensuring model efficiency when managing outdated, private, and irrelevant data. Such data not only compromises model accuracy but also burdens computational efficiency in both learning and unlearning processes. To mitigate these challenges, we introduce a novel framework: Attention-based Machine Unlearning using Federated Reinforcement Learning (FRAMU). This framework incorporates adaptive learning mechanisms, privacy preservation techniques, and optimization strategies, making it a well-rounded solution for handling various data sources, either single-modality or multi-modality, while maintaining accuracy and privacy. FRAMU's strengths include its adaptability in fluctuating data landscapes, its ability to unlearn outdated, private, or irrelevant data, and its support for continual model evolution without compromising privacy. Our experiments, conducted on both single-modality and multi-modality datasets, revealed that FRAMU significantly outperformed baseline models. Additional assessments of convergence behavior and optimization strategies further validate the framework's utility in federated learning applications. Overall, FRAMU advances Machine Unlearning by offering a robust, privacy-preserving solution that optimizes model performance while also addressing key challenges in dynamic data environments.
引用
收藏
页码:5153 / 5167
页数:15
相关论文
共 50 条
  • [1] Unlearning during Learning: An Efficient Federated Machine Unlearning Method
    Gul, Hanlin
    Zhu, Gongxi
    Zhang, Jie
    Zhao, Xinyuan
    Han, Yuxing
    Fan, Lixin
    Yang, Qiang
    PROCEEDINGS OF THE THIRTY-THIRD INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2024, 2024, : 4035 - 4043
  • [2] Attention-Based Mechanisms for Cognitive Reinforcement Learning
    Gao, Yue
    Li, Di
    Chen, Xiangjian
    Zhu, Junwu
    APPLIED SCIENCES-BASEL, 2023, 13 (13):
  • [3] Learning to Drive at Unsignalized Intersections using Attention-based Deep Reinforcement Learning
    Seong, Hyunki
    Jung, Chanyoung
    Lee, Seungwook
    Shim, David Hyunchul
    2021 IEEE INTELLIGENT TRANSPORTATION SYSTEMS CONFERENCE (ITSC), 2021, : 559 - 566
  • [4] Dual Attention-Based Federated Learning for Wireless Traffic Prediction
    Zhang, Chuanting
    Dang, Shuping
    Shihada, Basem
    Alouini, Mohamed-Slim
    IEEE CONFERENCE ON COMPUTER COMMUNICATIONS (IEEE INFOCOM 2021), 2021,
  • [5] Federated deep active learning for attention-based transaction classification
    Ahmed, Usman
    Lin, Jerry Chun-Wei
    Fournier-Viger, Philippe
    APPLIED INTELLIGENCE, 2023, 53 (08) : 8631 - 8643
  • [6] PFedAtt: Attention-based Personalized Federated Learning on Heterogeneous Clients
    Ma, Zichen
    Lu, Yu
    Li, Wenye
    Yi, Jinfeng
    Cui, Shuguang
    ASIAN CONFERENCE ON MACHINE LEARNING, VOL 157, 2021, 157 : 1253 - 1268
  • [7] Federated deep active learning for attention-based transaction classification
    Usman Ahmed
    Jerry Chun-Wei Lin
    Philippe Fournier-Viger
    Applied Intelligence, 2023, 53 : 8631 - 8643
  • [8] Federated learning for network attack detection using attention-based graph neural networks
    Wu, Jianping
    Qiu, Guangqiu
    Wu, Chunming
    Jiang, Weiwei
    Jin, Jiahe
    SCIENTIFIC REPORTS, 2024, 14 (01):
  • [9] ARiADNE: A Reinforcement learning approach using Attention-based Deep Networks for Exploration
    Cao, Yuhong
    Hou, Tianxiang
    Wang, Yizhuo
    Yi, Xian
    Sartoretti, Guillaume
    2023 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2023), 2023, : 10219 - 10225
  • [10] Attention-based Open RAN Slice Management using Deep Reinforcement Learning
    Lotfi, Fatemeh
    Afghah, Fatemeh
    Ashdown, Jonathan
    IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 6328 - 6333