A Framework for Verifiable and Auditable Collaborative Anomaly Detection

被引:1
|
作者
Santin, Gabriele [1 ]
Skarbovsky, Inna [2 ]
Fournier, Fabiana [2 ]
Lepri, Bruno [1 ]
机构
[1] Bruno Kessler Fdn FBK, Digital Soc Ctr, I-38123 Trento, Italy
[2] IBM Res, Haifa Univ Campus, IL-3498825 Haifa, Israel
来源
IEEE ACCESS | 2022年 / 10卷
关键词
Collaboration; Collaborative work; Anomaly detection; Radio frequency; Training; Computer architecture; Task analysis; Algorithm auditing; anomaly detection; blockchain; collaborative learning; BLOCKCHAIN;
D O I
10.1109/ACCESS.2022.3196391
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Collaborative and Federated Leaning are emerging approaches to manage cooperation between a group of agents for the solution of Machine Learning tasks, with the goal of improving each agent's performance without disclosing any data. In this paper we present a novel algorithmic architecture that tackle this problem in the particular case of Anomaly Detection (or classification of rare events), a setting where typical applications often comprise data with sensible information, but where the scarcity of anomalous examples encourages collaboration. We show how Random Forests can be used as a tool for the development of accurate classifiers with an effective insight-sharing mechanism that does not break the data integrity. Moreover, we explain how the new architecture can be readily integrated in a blockchain infrastructure to ensure the verifiable and auditable execution of the algorithm. Furthermore, we discuss how this work may set the basis for a more general approach for the design of collaborative ensemble-learning methods beyond the specific task and architecture discussed in this paper.
引用
收藏
页码:82896 / 82909
页数:14
相关论文
共 50 条
  • [41] Lightweight collaborative anomaly detection for the IoT using blockchain
    Mirsky, Yisroel
    Golomb, Tomer
    Elovici, Yuval
    JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 2020, 145 (145) : 75 - 97
  • [43] Selective Search Collaborative Representation for Hyperspectral Anomaly Detection
    Yin, Chensong
    Gao, Leitao
    Wang, Mingjie
    Liu, Anni
    APPLIED SCIENCES-BASEL, 2022, 12 (23):
  • [44] An Intervention Detection Framework for Collaborative Projects
    Sokolowski, Elizabeth
    Oussena, Samia
    PROCEEDINGS OF THE 2017 INTELLIGENT SYSTEMS CONFERENCE (INTELLISYS), 2017, : 246 - 251
  • [45] Pyxel: the collaborative detection simulation framework
    Prod'homme, Thibaut
    Lemmel, Frederic
    Arko, Matej
    Serra, Benoit
    George, Elizabeth M.
    Biancalani, Enrico
    Smit, Hans
    Lucsanyi, David
    X-RAY, OPTICAL, AND INFRARED DETECTORS FOR ASTRONOMY IX, 2020, 11454
  • [46] LabelGen: An Anomaly Label Generative Framework for Enhanced Graph Anomaly Detection
    Xia, Siqi
    Rajasegarar, Sutharshan
    Pan, Lei
    Leckie, Christopher
    Erfani, Sarah M.
    Chan, Jeffrey
    IEEE ACCESS, 2024, 12 : 121971 - 121982
  • [47] Developing an anomaly detection framework for Medicare claims
    Kemp, James
    Barker, Christopher
    Good, Norm
    Bain, Michael
    PROCEEDINGS OF 2023 AUSTRALIAN COMPUTER SCIENCE WEEK, ACSW 2023, 2023, : 234 - 237
  • [48] A BasisEvolution framework for network traffic anomaly detection
    Xia, Hui
    Fang, Bin
    Roughan, Matthew
    Cho, Kenjiro
    Tune, Paul
    COMPUTER NETWORKS, 2018, 135 : 15 - 31
  • [49] A Framework for Anomaly Detection in Blockchain Networks With Sketches
    Voronov, Tomer
    Raz, Danny
    Rottenstreich, Ori
    IEEE-ACM TRANSACTIONS ON NETWORKING, 2024, 32 (01) : 686 - 698
  • [50] Hashdoop: A MapReduce Framework for Network Anomaly Detection
    Fontugne, Romain
    Mazel, Johan
    Fukuda, Kensuke
    2014 IEEE CONFERENCE ON COMPUTER COMMUNICATIONS WORKSHOPS (INFOCOM WKSHPS), 2014, : 494 - 499