Deep learning framework for handling concept drift and class imbalanced complex decision-making on streaming data

被引:0
|
作者
S. Priya
R. Annie Uthra
机构
[1] SRM Institute of Science and Technology,Department of Computer Science and Engineering, College of Engineering and Technology
来源
关键词
Data science; Complex systems; Decision making; Streaming data; Concept drift; Classification model; Deep learning; Class imbalance data;
D O I
暂无
中图分类号
学科分类号
摘要
In present times, data science become popular to support and improve decision-making process. Due to the accessibility of a wide application perspective of data streaming, class imbalance and concept drifting become crucial learning problems. The advent of deep learning (DL) models finds useful for the classification of concept drift in data streaming applications. This paper presents an effective class imbalance with concept drift detection (CIDD) using Adadelta optimizer-based deep neural networks (ADODNN), named CIDD-ADODNN model for the classification of highly imbalanced streaming data. The presented model involves four processes namely preprocessing, class imbalance handling, concept drift detection, and classification. The proposed model uses adaptive synthetic (ADASYN) technique for handling class imbalance data, which utilizes a weighted distribution for diverse minority class examples based on the level of difficulty in learning. Next, a drift detection technique called adaptive sliding window (ADWIN) is employed to detect the existence of the concept drift. Besides, ADODNN model is utilized for the classification processes. For increasing the classifier performance of the DNN model, ADO-based hyperparameter tuning process takes place to determine the optimal parameters of the DNN model. The performance of the presented model is evaluated using three streaming datasets namely intrusion detection (NSL KDDCup) dataset, Spam dataset, and Chess dataset. A detailed comparative results analysis takes place and the simulation results verified the superior performance of the presented model by obtaining a maximum accuracy of 0.9592, 0.9320, and 0.7646 on the applied KDDCup, Spam, and Chess dataset, respectively.
引用
收藏
页码:3499 / 3515
页数:16
相关论文
共 50 条
  • [31] Online Extreme Learning Machine for Handling Concept Drift and Class Imbalance Problem
    Vinayagasundaram, B.
    Aarthi, R. J.
    Abirami, N.
    2017 FOURTH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING, COMMUNICATION AND NETWORKING (ICSCN), 2017,
  • [32] Handling imbalanced medical image data: A deep-learning-based one-class classification approach
    Gao, Long
    Zhang, Lei
    Liu, Chang
    Wu, Shandong
    ARTIFICIAL INTELLIGENCE IN MEDICINE, 2020, 108
  • [33] Imbalanced class incremental learning system: A task incremental diagnosis method for imbalanced industrial streaming data
    Shi, Mingkuan
    Ding, Chuancang
    Shen, Changqing
    Huang, Weiguo
    Zhu, Zhongkui
    ADVANCED ENGINEERING INFORMATICS, 2024, 62
  • [34] Learning and Decision-Making from Rank Data
    Xia L.
    Synthesis Lectures on Artificial Intelligence and Machine Learning, 2019, 13 (01): : 1 - 159
  • [35] Data-Driven Decision-Making for Bank Target Marketing Using Supervised Learning Classifiers on Imbalanced Big Data
    Nasir, Fahim
    Ahmed, Abdulghani Ali
    Kiraz, Mehmet Sabir
    Yevseyeva, Iryna
    Saif, Mubarak
    CMC-COMPUTERS MATERIALS & CONTINUA, 2024, 81 (01): : 1703 - 1728
  • [36] Forgetful Forests: Data Structures for Machine Learning on Streaming Data under Concept Drift
    Yuan, Zhehu
    Sun, Yinqi
    Shasha, Dennis
    ALGORITHMS, 2023, 16 (06)
  • [37] Learning Decision Trees from Data Streams with Concept Drift
    Jankowski, Dariusz
    Jackowski, Konrad
    Cyganek, Boguslaw
    INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE 2016 (ICCS 2016), 2016, 80 : 1682 - 1691
  • [38] Reinforcement learning for decision-making under deep uncertainty
    Pei, Zhihao
    Rojas-Arevalo, Angela M.
    de Haan, Fjalar J.
    Lipovetzky, Nir
    Moallemi, Enayat A.
    JOURNAL OF ENVIRONMENTAL MANAGEMENT, 2024, 359
  • [39] Deep Learning and Neural Networks: Decision-Making Implications
    Taherdoost, Hamed
    SYMMETRY-BASEL, 2023, 15 (09):
  • [40] An Ensemble Based Incremental Learning Framework for Concept Drift and Class Imbalance
    Ditzler, Gregory
    Polikar, Robi
    2010 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS IJCNN 2010, 2010,