Enhancing data analysis: uncertainty-resistance method for handling incomplete data

被引:0
|
作者
Javad Hamidzadeh
Mona Moradi
机构
[1] Sadjad University of Technology,Faculty of Computer Engineering and Information Technology
来源
Applied Intelligence | 2020年 / 50卷
关键词
Incomplete data; Missing values; Belief function theory; Mapped data; Classification;
D O I
暂无
中图分类号
学科分类号
摘要
In data analysis, incomplete data commonly occurs and can have significant effects on the conclusions that can be drawn from the data. Incomplete data cause another problem, so-called uncertainty which leads to producing unreliable results. Hence, developing effective techniques to impute these missing values is crucial. Missing or incomplete data and noise are two common sources of uncertainty. In this paper, an effective method for imputing missing values is introduced which is robust to uncertainties that are arising from incompleteness and noise. A kernel-based method for removing the noise is designed. Using the belief function theory, the class of incomplete data is determined. Finally, every missing dimension is imputed considering the mean value of the same dimension of the members belonging to the determined class. The performance has been evaluated on real-world data sets from UCI repository. The results of the experiments have been compared with state-of-the-art methods, which show the superiority of the proposed method regarding classification accuracy.
引用
收藏
页码:74 / 86
页数:12
相关论文
共 50 条
  • [31] Handling Data Uncertainty in Decision Making with COMET
    Salabun, Wojciech
    Karczmarczyk, Artur
    Watrobski, Jaroslaw
    Jankowski, Jaroslaw
    2018 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (IEEE SSCI), 2018, : 1478 - 1484
  • [32] Handling Uncertainty in Geo-Spatial Data
    Zufle, Andreas
    Trajcevski, Goce
    Pfoser, Dieter
    Renz, Matthias
    Rice, Matthew T.
    Leslie, Timothy
    Delamater, Paul
    Emrich, Tobias
    2017 IEEE 33RD INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE 2017), 2017, : 1467 - 1470
  • [33] An illuminating method of handling data
    Jennings, HS
    SCIENCE, 1924, 59 : 39 - 39
  • [34] An illuminating method of handling data
    Jennings, HS
    SCIENCE, 1924, 59 : 39 - 39
  • [35] DECISION-MAKING BASED ON RISK ANALYSIS - COPING WITH UNCERTAINTY AND INCOMPLETE DATA
    ISLAM, S
    RISK ANALYSIS IN NUCLEAR WASTE MANAGEMENT, 1989, : 25 - 34
  • [36] A Practical Method for Failure Analysis Using Incomplete Warranty Data
    Mohan, Karen
    Cline, Brad
    Akers, Jennifer
    ANNUAL RELIABILITY AND MAINTAINABILITY SYMPOSIUM, 2008 PROCEEDINGS, 2008, : 195 - 201
  • [37] Recent Advances for Handling Imbalancement and Uncertainty in Labelling in Medicinal Chemistry Data Analysis
    Silva de Souza, Joao Carlos
    Claudino, Suzana Gomes
    Simoes, Rodolfo da Silva
    Oliveira, Patricia Rufino
    Honorio, Kathia Maria
    PROCEEDINGS OF THE 2016 SAI COMPUTING CONFERENCE (SAI), 2016, : 217 - 222
  • [38] On the uncertainty of interdisciplinarity measurements due to incomplete bibliographic data
    Calatrava Moreno, Maria del Carmen
    Auzinger, Thomas
    Werthner, Hannes
    SCIENTOMETRICS, 2016, 107 (01) : 213 - 232
  • [39] Local model uncertainty and incomplete-data bias
    Copas, J
    Eguchi, S
    JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 2005, 67 : 459 - 495
  • [40] Important but incomplete data analysis?
    Sewerin, Philipp
    Hoyer, Annika
    Schneider, Matthias
    Ostendorf, Ben
    Brinks, Ralph
    ANNALS OF THE RHEUMATIC DISEASES, 2018, 77 (04) : E18 - E18