Deep learning framework for handling concept drift and class imbalanced complex decision-making on streaming data

被引:18
|
作者
Priya, S. [1 ]
Uthra, R. Annie [1 ]
机构
[1] SRM Inst Sci & Technol, Coll Engn & Technol, Dept Comp Sci & Engn, Chennai, Tamil Nadu, India
关键词
Data science; Complex systems; Decision making; Streaming data; Concept drift; Classification model; Deep learning; Class imbalance data;
D O I
10.1007/s40747-021-00456-0
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In present times, data science become popular to support and improve decision-making process. Due to the accessibility of a wide application perspective of data streaming, class imbalance and concept drifting become crucial learning problems. The advent of deep learning (DL) models finds useful for the classification of concept drift in data streaming applications. This paper presents an effective class imbalance with concept drift detection (CIDD) using Adadelta optimizer-based deep neural networks (ADODNN), named CIDD-ADODNN model for the classification of highly imbalanced streaming data. The presented model involves four processes namely preprocessing, class imbalance handling, concept drift detection, and classification. The proposed model uses adaptive synthetic (ADASYN) technique for handling class imbalance data, which utilizes a weighted distribution for diverse minority class examples based on the level of difficulty in learning. Next, a drift detection technique called adaptive sliding window (ADWIN) is employed to detect the existence of the concept drift. Besides, ADODNN model is utilized for the classification processes. For increasing the classifier performance of the DNN model, ADO-based hyperparameter tuning process takes place to determine the optimal parameters of the DNN model. The performance of the presented model is evaluated using three streaming datasets namely intrusion detection (NSL KDDCup) dataset, Spam dataset, and Chess dataset. A detailed comparative results analysis takes place and the simulation results verified the superior performance of the presented model by obtaining a maximum accuracy of 0.9592, 0.9320, and 0.7646 on the applied KDDCup, Spam, and Chess dataset, respectively.
引用
收藏
页码:3499 / 3515
页数:17
相关论文
共 50 条
  • [1] Deep learning framework for handling concept drift and class imbalanced complex decision-making on streaming data
    S. Priya
    R. Annie Uthra
    [J]. Complex & Intelligent Systems, 2023, 9 : 3499 - 3515
  • [2] Incremental Learning of Concept Drift from Streaming Imbalanced Data
    Ditzler, Gregory
    Polikar, Robi
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2013, 25 (10) : 2283 - 2301
  • [3] Handling adversarial concept drift in streaming data
    Sethi, Tegjyot Singh
    Kantardzic, Mehmed
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2018, 97 : 18 - 40
  • [4] Active Learning for Decision-Making from Imbalanced Observational Data
    Sundin, Iiris
    Schulam, Peter
    Siivola, Eero
    Vehtari, Aki
    Saria, Suchi
    Kaski, Samuel
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 97, 2019, 97
  • [5] A Framework of Online Learning with Imbalanced Streaming Data
    Yan, Yan
    Yang, Tianbao
    Yang, Yi
    Chen, Jianhui
    [J]. THIRTY-FIRST AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2017, : 2817 - 2823
  • [6] Collaborative emergency decision-making: A framework for deep learning with social media data
    Qin, Jindong
    Li, Minxuan
    Wang, Xiaojun
    Pedrycz, Witold
    [J]. INTERNATIONAL JOURNAL OF PRODUCTION ECONOMICS, 2024, 267
  • [7] Synthesizing Data Using Variational Autoencoders for Handling Class Imbalanced Deep Learning
    Sheikh, Taimoor Shakeel
    Khan, Adil
    Fahim, Muhammad
    Ahmad, Muhammad
    [J]. ANALYSIS OF IMAGES, SOCIAL NETWORKS AND TEXTS (AIST 2019), 2020, 1086 : 270 - 281
  • [8] A streaming data visualization framework for supporting decision-making in the Intensive Care Unit
    Mohedano-Munoz, Miguel A.
    Soguero-Ruiz, Cristina
    Mora-Jimenez, Inmaculada
    Rubio-Sanchez, Manuel
    Alvarez-Rodriguez, Joaquin
    Sanchez, Alberto
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2023, 227
  • [9] Multi-Class Imbalanced Data Handling with Concept Drift in Fog Computing: A Taxonomy, Review, and Future Directions
    Sharief, Farhana
    Ijaz, Humaira
    Shojafar, Mohammad
    Naeem, Muhammad Asif
    [J]. ACM Computing Surveys, 2024, 57 (01)
  • [10] Active Learning Method for Imbalanced Concept Drift Data Stream
    Li Y.-H.
    Wang T.-T.
    Wang S.-G.
    Li D.-Y.
    [J]. Zidonghua Xuebao/Acta Automatica Sinica, 2024, 50 (03): : 589 - 606