DNNAttention: A deep neural network and attention based architecture for cross project defect number prediction

被引:9
|
作者
Pandey, Sushant Kumar [1 ]
Tripathi, Anil Kumar [1 ]
机构
[1] Indian Inst Technol BHU, Dept Comp Sci & Engn, Varanasi, Uttar Pradesh, India
关键词
Cross project defect prediction; Deep neural network; Attention layer; Long short term memory (LSTM); Software defect number prediction; ENSEMBLE; MODEL;
D O I
10.1016/j.knosys.2021.107541
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Software defect prediction (SDP) is the process of detecting fault-prone classes or modules in a software system. It helps in allocating resources before the testing phase more optimally. Due to a lack of an adequate dataset, defects can be predicted by employing data from different projects to train the classifier called cross-project defect prediction (CPDP). Cross-project defect number prediction (CPDNP) is one step ahead of CPDP, in which we can also estimate the number of defects in each module of a software system; we contemplate it as a regression problem. This article dealt with the CPDNP mechanism and suggested a CPDNP architecture by employing a deep neural network and attention layer called DNNAttention. We syntheses substantial data named cross-heap by utilizing an amalgamation of 44 projects from the PROMISE repository. We fed the cross-heap into DNNAttention to train and evaluate the performance over 44 datasets by applying transfer learning. We have also address class imbalance (CI) and overfitting problems by employing multi-label random over-sampling and dropout regularization, respectively. We compared the performance of the DNNAttention using mean squared error (MSE), mean absolute error (MAE), and accuracy over eight baseline methods. We found out of 44 projects, 19 and 20 have minimum MSE and MAE, respectively, and in 19 projects, accuracy yields by the proposed model surpasses exiting techniques. We also compared the performance in terms of Kendall and Fault-Percentile-Average with the recent unsupervised method and found DNNAttention significantly outperforms this method. Moreover, we found the improvement of the DNNAttention over other baseline methods in terms of MAE, MSE, and accuracy by inspecting 20% line of code are substantial. In most situations, the improvements are significant, and they have a large effect size across all 44 projects. (c) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页数:30
相关论文
共 50 条
  • [1] An Approach for Cross Project Defect Prediction Using Identical Metrics Matching and Deep Neural Network
    Bal, Pravas Ranjan
    Kumar, Sandeep
    [J]. IEEE TRANSACTIONS ON RELIABILITY, 2024,
  • [2] A Cross-Project Defect Prediction Model Based on Deep Learning With Self-Attention
    Wen, Wanzhi
    Zhang, Ruinian
    Wang, Chuyue
    Shen, Chenqiang
    Yu, Meng
    Zhang, Suchuan
    Gao, Xinxin
    [J]. IEEE ACCESS, 2022, 10 : 110385 - 110401
  • [3] Transfer Convolutional Neural Network for Cross-Project Defect Prediction
    Qiu, Shaojian
    Xu, Hao
    Deng, Jiehan
    Jiang, Siyu
    Lu, Lu
    [J]. APPLIED SCIENCES-BASEL, 2019, 9 (13):
  • [4] Retweet Prediction with Attention-based Deep Neural Network
    Zhang, Qi
    Gong, Yeyun
    Wu, Jindou
    Huang, Haoran
    Huang, Xuanjing
    [J]. CIKM'16: PROCEEDINGS OF THE 2016 ACM CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, 2016, : 75 - 84
  • [5] An Adversarial Discriminative Convolutional Neural Network for Cross-Project Defect Prediction
    Sheng, Lei
    Lu, Lu
    Lin, Junhao
    [J]. IEEE ACCESS, 2020, 8 : 55241 - 55253
  • [6] DeepCPDP: Deep Learning Based Cross-Project Defect Prediction
    Chen, Deyu
    Chen, Xiang
    Li, Hao
    Xie, Junfeng
    Mu, Yanzhou
    [J]. IEEE ACCESS, 2019, 7 : 184832 - 184848
  • [7] Software Defect Prediction via Attention-Based Recurrent Neural Network
    Fan, Guisheng
    Diao, Xuyang
    Yu, Huiqun
    Yang, Kang
    Chen, Liqiong
    [J]. SCIENTIFIC PROGRAMMING, 2019, 2019
  • [8] Within-project and cross-project just-in-time defect prediction based on denoising autoencoder and convolutional neural network
    Zhu, Kun
    Zhang, Nana
    Ying, Shi
    Zhu, Dandan
    [J]. IET SOFTWARE, 2020, 14 (03) : 185 - 202
  • [9] Performance Evaluation of Convolutional Neural Network for Multi-Class in Cross Project Defect Prediction
    Noreen, Sundas
    Bin Faiz, Rizwan
    Alyahya, Sultan
    Maddeh, Mohamed
    [J]. APPLIED SCIENCES-BASEL, 2022, 12 (23):
  • [10] Cross-project Defect Prediction via ASTToken2Vec and BLSTM-based Neural Network
    Li, Hao
    Li, Xiaohong
    Chen, Xiang
    Xie, Xiaofei
    Mu, Yanzhou
    Feng, Zhiyong
    [J]. 2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2019,