FRAMU: Attention-Based Machine Unlearning Using Federated Reinforcement Learning

被引:3
|
作者
Shaik, Thanveer [1 ]
Tao, Xiaohui [1 ]
Li, Lin [2 ]
Xie, Haoran [3 ]
Cai, Taotao [1 ]
Zhu, Xiaofeng [4 ]
Li, Qing [5 ]
机构
[1] Univ Southern Queensland, Sch Math Phys & Comp, Darling Hts, Qld 4350, Australia
[2] Wuhan Univ Technol, Sch Comp Sci & Artificial Intelligence, Wuhan 430062, Hubei, Peoples R China
[3] Lingnan Univ, Dept Comp & Decis Sci, Hong Kong, Tuen Mun, Peoples R China
[4] Univ Elect Sci & Technol China, Chengdu 610054, Sichuan, Peoples R China
[5] Hong Kong Polytech Univ, Dept Comp, Hung Hom, Hong Kong, Peoples R China
关键词
Data privacy; Distributed databases; Data models; Adaptation models; Attention mechanism; federated learning; machine unlearning; privacy; reinforcement learning;
D O I
10.1109/TKDE.2024.3382726
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Machine Unlearning, a pivotal field addressing data privacy in machine learning, necessitates efficient methods for the removal of private or irrelevant data. In this context, significant challenges arise, particularly in maintaining privacy and ensuring model efficiency when managing outdated, private, and irrelevant data. Such data not only compromises model accuracy but also burdens computational efficiency in both learning and unlearning processes. To mitigate these challenges, we introduce a novel framework: Attention-based Machine Unlearning using Federated Reinforcement Learning (FRAMU). This framework incorporates adaptive learning mechanisms, privacy preservation techniques, and optimization strategies, making it a well-rounded solution for handling various data sources, either single-modality or multi-modality, while maintaining accuracy and privacy. FRAMU's strengths include its adaptability in fluctuating data landscapes, its ability to unlearn outdated, private, or irrelevant data, and its support for continual model evolution without compromising privacy. Our experiments, conducted on both single-modality and multi-modality datasets, revealed that FRAMU significantly outperformed baseline models. Additional assessments of convergence behavior and optimization strategies further validate the framework's utility in federated learning applications. Overall, FRAMU advances Machine Unlearning by offering a robust, privacy-preserving solution that optimizes model performance while also addressing key challenges in dynamic data environments.
引用
收藏
页码:5153 / 5167
页数:15
相关论文
共 50 条
  • [21] AFLEMP: Attention-based Federated Learning for Emotion recognition using Multi-modal Physiological data
    Gahlan, Neha
    Sethia, Divyashikha
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 94
  • [22] Attention-based Deep Reinforcement Learning for Multi-view Environments
    Barati, Elaheh
    Chen, Xuewen
    Zhong, Zichun
    AAMAS '19: PROCEEDINGS OF THE 18TH INTERNATIONAL CONFERENCE ON AUTONOMOUS AGENTS AND MULTIAGENT SYSTEMS, 2019, : 1805 - 1807
  • [23] Performance Optimization for Semantic Communications: An Attention-Based Reinforcement Learning Approach
    Wang, Yining
    Chen, Mingzhe
    Luo, Tao
    Saad, Walid
    Niyato, Dusit
    Poor, H. Vincent
    Cui, Shuguang
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2022, 40 (09) : 2598 - 2613
  • [24] ATTENTION-BASED CURIOSITY-DRIVEN EXPLORATION IN DEEP REINFORCEMENT LEARNING
    Reizinger, Patrik
    Szemenyei, Marton
    2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 3542 - 3546
  • [25] Attention-based Partial Decoupling of Policy and Value for Generalization in Reinforcement Learning
    Nafi, Nasik Muhammad
    Glasscock, Creighton
    Hsu, William
    2022 21ST IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS, ICMLA, 2022, : 15 - 22
  • [26] Subgoal-Driven Navigation in Dynamic Environments Using Attention-Based Deep Reinforcement Learning
    de Heuvel, Jorge
    Shi, Weixian
    Zeng, Xiangyu
    Bennewitz, Maren
    2023 21ST INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS, ICAR, 2023, : 79 - 85
  • [27] Mitigating Biases in Student Performance Prediction via Attention-Based Personalized Federated Learning
    Chu, Yun-Wei
    Hosseinalipour, Seyyedali
    Tenorio, Elizabeth
    Cruz, Laura
    Douglas, Kerrie
    Lan, Andrew
    Brinton, Christopher
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2022, 2022, : 3033 - 3042
  • [28] GreenLight: Green Traffic Signal Control using Attention-based Reinforcement Learning on Fog Computing Network
    Tang, Chengyu
    Baskiyar, Sanjeev
    2024 IEEE 15TH INTERNATIONAL GREEN AND SUSTAINABLE COMPUTING CONFERENCE, IGSC 2024, 2024, : 129 - 134
  • [29] ADRL: An attention-based deep reinforcement learning framework for knowledge graph reasoning
    Wang, Qi
    Hao, Yongsheng
    Cao, Jie
    KNOWLEDGE-BASED SYSTEMS, 2020, 197
  • [30] Attention-based model and deep reinforcement learning for distribution of event processing tasks
    Mazayev, Andriy
    Al-Tam, Faroq
    Correia, Noelia
    INTERNET OF THINGS, 2022, 19