Machine learning in concept drift detection using statistical measures

被引:0
|
作者
Ali Abdu, Nail Adeeb [1 ]
Basulaim, Khaled Omer [2 ]
机构
[1] Information Technology Department, Faculty of Engineering & Computing, University of Science and Technology, Aden, Yemen
[2] Information Technology Engineering Department, Faculty of Engineering, University of Aden, Aden, Yemen
关键词
D O I
10.1080/1206212X.2023.2289706
中图分类号
学科分类号
摘要
In the data stream, the data has non-stationary quality because of continual and inconsistent change. This change is represented as the concept drift in the classifying process of the streaming data. Representing this data drift concept in data stream mining requires pre-labeled samples. However, labeling samples in real-time streaming (online) is not feasible due to resource utilization and time constraints. Therefore, this paper proposes the concept of Probabilistic Concept Drift Detection (PCDD) in the group classifier. PCDD relies on the data stream classification process and provides concept drift without labeled samples. The PCDD model is evaluated through an empirical study on a dataset called Poker-Hand. The study results show a high concept drift detection rate and a significant reduction in false alarms and missed detections compared to contemporary models. Hence, the results of the experimental study prove the accuracy and scalability of the PCDD model. © 2023 Informa UK Limited, trading as Taylor & Francis Group.
引用
收藏
页码:281 / 291
相关论文
共 50 条
  • [31] Improving statistical approach for memory leak detection using machine learning
    Šor, Vladimir
    Oü, Plumbr
    Treier, Tarvo
    Srirama, Satish Narayana
    IEEE International Conference on Software Maintenance, ICSM, 2013, : 544 - 547
  • [32] Improving statistical approach for memory leak detection using machine learning
    Sor, Vladimir
    Treier, Tarvo
    Srirama, Satish Narayana
    2013 29TH IEEE INTERNATIONAL CONFERENCE ON SOFTWARE MAINTENANCE (ICSM), 2013, : 544 - 547
  • [33] Concept Drift Detection Technique using Supervised and Unsupervised Learning for Big Data Streams
    Hashmani, Manzoor Ahmed
    Jameel, Syed Muslim
    Uddin, Vali
    Rizvi, Syed Sajjad Hussain
    INTERNATIONAL JOURNAL OF COMPUTER SCIENCE AND NETWORK SECURITY, 2020, 20 (01): : 106 - +
  • [34] SDDM: an interpretable statistical concept drift detection method for data streams
    Simona Micevska
    Ahmed Awad
    Sherif Sakr
    Journal of Intelligent Information Systems, 2021, 56 : 459 - 484
  • [35] Concept Drift Detection Based on Pre-Clustering and Statistical Testing
    Wan, Jones Sai-Wang
    Wang, Sheng-De
    JOURNAL OF INTERNET TECHNOLOGY, 2021, 22 (02): : 465 - 472
  • [36] SDDM: an interpretable statistical concept drift detection method for data streams
    Micevska, Simona
    Awad, Ahmed
    Sakr, Sherif
    JOURNAL OF INTELLIGENT INFORMATION SYSTEMS, 2021, 56 (03) : 459 - 484
  • [37] Handling Concept Drift in Data Streams by Using Drift Detection Methods
    Patil, Malini M.
    DATA MANAGEMENT, ANALYTICS AND INNOVATION, ICDMAI 2018, VOL 2, 2019, 839 : 155 - 166
  • [38] Auditory Brainstem Response Detection Using Machine Learning: A Comparison With Statistical Detection Methods
    McKearney, Richard M.
    Bell, Steven L.
    Chesnaye, Michael A.
    Simpson, David M.
    EAR AND HEARING, 2022, 43 (03): : 949 - 960
  • [39] Machine learning approach tor ontology mapping using multiple concept similarity measures
    Ichise, Ryutaro
    7TH IEEE/ACIS INTERNATIONAL CONFERENCE ON COMPUTER AND INFORMATION SCIENCE IN CONJUNCTION WITH 2ND IEEE/ACIS INTERNATIONAL WORKSHOP ON E-ACTIVITY, PROCEEDINGS, 2008, : 340 - 346
  • [40] ECUE: A Spam Filter that Uses Machine Learning to Track Concept Drift
    Delany, Sarah Jane
    Cunningham, Padraig
    Smyth, Barry
    ECAI 2006, PROCEEDINGS, 2006, 141 : 627 - +