OUTLIER DETECTION IN OCEAN WAVE MEASUREMENTS BY USING UNSUPERVISED DATA MINING METHODS

被引:12
|
作者
Mahmoodi, Kumars [1 ]
Ghassemi, Hassan [1 ]
机构
[1] Amirkabir Univ Technol, Dept Maritime Engn, Hafez Ave, Tehran 14717, Iran
关键词
ocean wave data; data mining; outlier detection; data correction; MODELS;
D O I
10.2478/pomr-2018-0005
中图分类号
U6 [水路运输]; P75 [海洋工程];
学科分类号
0814 ; 081505 ; 0824 ; 082401 ;
摘要
Outliers are considerably inconsistent and exceptional objects in the data set that do not adapt to expected normal condition. An outlier in wave measurements may be due to experimental and configuration errors, technical defects in equipment, variability in the measurement conditions, rare or unknown conditions such as tsunami, windstorm and etc. To improve the accuracy and reliability of an built ocean wave model, or to extract important and valuable information from collected wave data, detecting of outlying observations in wave measurements is very important. In this study, three typical outlier detection algorithms: Box-plot (BP), Local Distance-based Outlier Factor (LDOF), and Local Outlier Factor (LOF) methods are used to detect outliers in significant wave height (Hs) records. The historical wave data are taken from National Data Buoy Center (NDBC). Finally, those data points are considered as outlier identified by at least two methods which are presented and discussed. Then, Hs prediction has been modelled with and without the presence of outliers by using Regression trees (RTs).
引用
收藏
页码:44 / 50
页数:7
相关论文
共 50 条
  • [21] Unsupervised segmentation of microstructural images of steel using data mining methods
    Kim, Hoheok
    Arisato, Yuuki
    Inoue, Junya
    COMPUTATIONAL MATERIALS SCIENCE, 2022, 201
  • [22] Unsupervised Outlier Detection Using Memory and Contrastive Learning
    Huyan, Ning
    Quan, Dou
    Zhang, Xiangrong
    Liang, Xuefeng
    Chanussot, Jocelyn
    Jiao, Licheng
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 6440 - 6454
  • [23] Unsupervised Outlier Detection in IOT Using Deep VAE
    Gouda, Walaa
    Tahir, Sidra
    Alanazi, Saad
    Almufareh, Maram
    Alwakid, Ghadah
    SENSORS, 2022, 22 (17)
  • [24] Outlier detection and data association for data mining criminal incidents
    Lin, S
    Brown, DE
    DATA MINING III, 2002, 6 : 125 - 134
  • [25] Unsupervised approach for online outlier detection in industrial process data
    Bechny, Michal
    Himmelbauer, Johannes
    3RD INTERNATIONAL CONFERENCE ON INDUSTRY 4.0 AND SMART MANUFACTURING, 2022, 200 : 257 - 266
  • [26] Data mining application to healthcare fraud detection: a two-step unsupervised clustering method for outlier detection with administrative databases
    Massi, Michela Carlotta
    Ieva, Francesca
    Lettieri, Emanuele
    BMC MEDICAL INFORMATICS AND DECISION MAKING, 2020, 20 (01)
  • [27] Data mining application to healthcare fraud detection: a two-step unsupervised clustering method for outlier detection with administrative databases
    Michela Carlotta Massi
    Francesca Ieva
    Emanuele Lettieri
    BMC Medical Informatics and Decision Making, 20
  • [28] A Survey for Different Approaches of Outlier Detection in Data Mining
    Chandarana, Dhaval R.
    Dhamecha, Maulik V.
    2015 INTERNATIONAL CONFERENCE ON ELECTRICAL, ELECTRONICS, SIGNALS, COMMUNICATION AND OPTIMIZATION (EESCO), 2015,
  • [29] A comparative study of RNN for outlier detection in data mining
    Williams, G
    Baxter, R
    He, HX
    Hawkins, S
    Gu, LF
    2002 IEEE INTERNATIONAL CONFERENCE ON DATA MINING, PROCEEDINGS, 2002, : 709 - 712
  • [30] A comparative study for outlier detection techniques in data mining
    Abu Bakar, Zuriana
    Mohemad, Rosmayati
    Ahmad, Akbar
    Deris, Mustafa Mat
    2006 IEEE CONFERENCE ON CYBERNETICS AND INTELLIGENT SYSTEMS, VOLS 1 AND 2, 2006, : 360 - +