Machine learning in concept drift detection using statistical measures

被引:0
|
作者
Ali Abdu, Nail Adeeb [1 ]
Basulaim, Khaled Omer [2 ]
机构
[1] Information Technology Department, Faculty of Engineering & Computing, University of Science and Technology, Aden, Yemen
[2] Information Technology Engineering Department, Faculty of Engineering, University of Aden, Aden, Yemen
关键词
D O I
10.1080/1206212X.2023.2289706
中图分类号
学科分类号
摘要
In the data stream, the data has non-stationary quality because of continual and inconsistent change. This change is represented as the concept drift in the classifying process of the streaming data. Representing this data drift concept in data stream mining requires pre-labeled samples. However, labeling samples in real-time streaming (online) is not feasible due to resource utilization and time constraints. Therefore, this paper proposes the concept of Probabilistic Concept Drift Detection (PCDD) in the group classifier. PCDD relies on the data stream classification process and provides concept drift without labeled samples. The PCDD model is evaluated through an empirical study on a dataset called Poker-Hand. The study results show a high concept drift detection rate and a significant reduction in false alarms and missed detections compared to contemporary models. Hence, the results of the experimental study prove the accuracy and scalability of the PCDD model. © 2023 Informa UK Limited, trading as Taylor & Francis Group.
引用
收藏
页码:281 / 291
相关论文
共 50 条
  • [1] A Framework to Monitor Machine Learning Systems Using Concept Drift Detection
    Zhou, Xianzhe
    Lo Faro, Wally
    Zhang, Xiaoying
    Arvapally, Ravi Santosh
    BUSINESS INFORMATION SYSTEMS, PT I, 2019, 353 : 218 - 231
  • [2] FeSAD ransomware detection framework with machine learning using adaption to concept drift
    Fernando, Damien Warren
    Komninos, Nikos
    COMPUTERS & SECURITY, 2024, 137
  • [3] Machine learning based concept drift detection for predictive maintenance
    Zenisek, Jan
    Holzinger, Florian
    Affenzeller, Michael
    COMPUTERS & INDUSTRIAL ENGINEERING, 2019, 137
  • [4] Tiny Machine Learning for Concept Drift
    Disabato, Simone
    Roveri, Manuel
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (06) : 8470 - 8481
  • [5] Machine Learning & Concept Drift based Approach for Malicious Website Detection
    Singhal, Siddharth
    Chawla, Utkarsh
    Shorey, Rajeev
    2020 INTERNATIONAL CONFERENCE ON COMMUNICATION SYSTEMS & NETWORKS (COMSNETS), 2020,
  • [6] A systematic review on detection and adaptation of concept drift in streaming data using machine learning techniques
    Arora, Shruti
    Rani, Rinkle
    Saxena, Nitin
    WILEY INTERDISCIPLINARY REVIEWS-DATA MINING AND KNOWLEDGE DISCOVERY, 2024, 14 (04)
  • [7] Detection of Malicious Domains With Concept Drift Using Ensemble Learning
    Chiang, Pin-Hsuan
    Tsai, Shi-Chun
    IEEE Transactions on Network and Service Management, 2024, 21 (06): : 6796 - 6809
  • [8] Concept drift detection for distributed multi-model machine learning systems
    Quon, Beverly Abadines
    Gaudiot, Jean-Luc
    2022 IEEE 46TH ANNUAL COMPUTERS, SOFTWARE, AND APPLICATIONS CONFERENCE (COMPSAC 2022), 2022, : 1076 - 1080
  • [9] Unsupervised statistical concept drift detection for behaviour abnormality detection
    Friedrich, Bjoern
    Sawabe, Taishi
    Hein, Andreas
    APPLIED INTELLIGENCE, 2023, 53 (03) : 2527 - 2537
  • [10] Unsupervised statistical concept drift detection for behaviour abnormality detection
    Björn Friedrich
    Taishi Sawabe
    Andreas Hein
    Applied Intelligence, 2023, 53 : 2527 - 2537