A Framework for Verifiable and Auditable Collaborative Anomaly Detection

被引:1
|
作者
Santin, Gabriele [1 ]
Skarbovsky, Inna [2 ]
Fournier, Fabiana [2 ]
Lepri, Bruno [1 ]
机构
[1] Bruno Kessler Fdn FBK, Digital Soc Ctr, I-38123 Trento, Italy
[2] IBM Res, Haifa Univ Campus, IL-3498825 Haifa, Israel
来源
IEEE ACCESS | 2022年 / 10卷
关键词
Collaboration; Collaborative work; Anomaly detection; Radio frequency; Training; Computer architecture; Task analysis; Algorithm auditing; anomaly detection; blockchain; collaborative learning; BLOCKCHAIN;
D O I
10.1109/ACCESS.2022.3196391
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Collaborative and Federated Leaning are emerging approaches to manage cooperation between a group of agents for the solution of Machine Learning tasks, with the goal of improving each agent's performance without disclosing any data. In this paper we present a novel algorithmic architecture that tackle this problem in the particular case of Anomaly Detection (or classification of rare events), a setting where typical applications often comprise data with sensible information, but where the scarcity of anomalous examples encourages collaboration. We show how Random Forests can be used as a tool for the development of accurate classifiers with an effective insight-sharing mechanism that does not break the data integrity. Moreover, we explain how the new architecture can be readily integrated in a blockchain infrastructure to ensure the verifiable and auditable execution of the algorithm. Furthermore, we discuss how this work may set the basis for a more general approach for the design of collaborative ensemble-learning methods beyond the specific task and architecture discussed in this paper.
引用
收藏
页码:82896 / 82909
页数:14
相关论文
共 50 条
  • [1] Design of Active Learning Framework for Collaborative Anomaly Detection
    Cai, He
    Hua, Cunqing
    Xu, Wenchao
    2019 11TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS AND SIGNAL PROCESSING (WCSP), 2019,
  • [2] Collaborative Anomaly Detection Framework for handling Big Data of Cloud Computing
    Moustafa, Nour
    Creech, Gideon
    Sitnikova, Elena
    Keshk, Marwa
    2017 MILITARY COMMUNICATIONS AND INFORMATION SYSTEMS CONFERENCE (MILCIS), 2017,
  • [3] Collaborative Normality Learning Framework for Weakly Supervised Video Anomaly Detection
    Liu, Yang
    Liu, Jing
    Zhao, Mengyang
    Li, Shuang
    Song, Liang
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2022, 69 (05) : 2508 - 2512
  • [4] Anomaly Traffic Detection with Verifiable Interpretation in Industrial Networks
    Zhu, Hongyu
    Tian, Jianwei
    Tian, Zheng
    Zhu, Shi
    Li, Haozhi
    Zhang, Yuxiang
    2021 IEEE INTL CONF ON DEPENDABLE, AUTONOMIC AND SECURE COMPUTING, INTL CONF ON PERVASIVE INTELLIGENCE AND COMPUTING, INTL CONF ON CLOUD AND BIG DATA COMPUTING, INTL CONF ON CYBER SCIENCE AND TECHNOLOGY CONGRESS DASC/PICOM/CBDCOM/CYBERSCITECH 2021, 2021, : 460 - 467
  • [5] Federated Learning Framework for Collaborative Time Series Anomaly Detection on Distributed Machines
    Iwan, Ignatius
    Bukit, Tori Andika
    Yahya, Bernardo Nugroho
    Lee, Seok-Lyong
    2024 IEEE 48TH ANNUAL COMPUTERS, SOFTWARE, AND APPLICATIONS CONFERENCE, COMPSAC 2024, 2024, : 1665 - 1670
  • [6] A Medical Domain Collaborative Anomaly Detection Framework for Identifying Medical Identity Theft
    Mohan, Apurva
    PROCEEDINGS OF THE 2014 INTERNATIONAL CONFERENCE ON COLLABORATION TECHNOLOGIES AND SYSTEMS (CTS), 2014, : 428 - 435
  • [7] Collaborative Anomaly Detection in Distributed SDN
    Zhou, Lei
    Shu, Jiangang
    Jia, Xiaohua
    2020 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2020,
  • [8] Collaborative Alert Ranking for Anomaly Detection
    Lin, Ying
    Chen, Zhengzhang
    Cao, Cheng
    Tang, Lu-An
    Zhang, Kai
    Cheng, Wei
    Li, Zhichun
    CIKM'18: PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, 2018, : 1987 - 1995
  • [9] Collaborative Representation for Hyperspectral Anomaly Detection
    Li, Wei
    Du, Qian
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2015, 53 (03): : 1463 - 1474
  • [10] Leveraging ARM TrustZone and Verifiable Computing to Provide Auditable Mobile Functions
    Duarte, Nuno O.
    Yalew, Sileshi Demesie
    Santos, Nuno
    Correia, Miguel
    PROCEEDINGS OF THE 15TH EAI INTERNATIONAL CONFERENCE ON MOBILE AND UBIQUITOUS SYSTEMS: COMPUTING, NETWORKING AND SERVICES (MOBIQUITOUS 2018), 2018, : 302 - 311