OUTLIER DETECTION IN OCEAN WAVE MEASUREMENTS BY USING UNSUPERVISED DATA MINING METHODS

被引:12
|
作者
Mahmoodi, Kumars [1 ]
Ghassemi, Hassan [1 ]
机构
[1] Amirkabir Univ Technol, Dept Maritime Engn, Hafez Ave, Tehran 14717, Iran
关键词
ocean wave data; data mining; outlier detection; data correction; MODELS;
D O I
10.2478/pomr-2018-0005
中图分类号
U6 [水路运输]; P75 [海洋工程];
学科分类号
0814 ; 081505 ; 0824 ; 082401 ;
摘要
Outliers are considerably inconsistent and exceptional objects in the data set that do not adapt to expected normal condition. An outlier in wave measurements may be due to experimental and configuration errors, technical defects in equipment, variability in the measurement conditions, rare or unknown conditions such as tsunami, windstorm and etc. To improve the accuracy and reliability of an built ocean wave model, or to extract important and valuable information from collected wave data, detecting of outlying observations in wave measurements is very important. In this study, three typical outlier detection algorithms: Box-plot (BP), Local Distance-based Outlier Factor (LDOF), and Local Outlier Factor (LOF) methods are used to detect outliers in significant wave height (Hs) records. The historical wave data are taken from National Data Buoy Center (NDBC). Finally, those data points are considered as outlier identified by at least two methods which are presented and discussed. Then, Hs prediction has been modelled with and without the presence of outliers by using Regression trees (RTs).
引用
收藏
页码:44 / 50
页数:7
相关论文
共 50 条
  • [41] Ocean Wave Integral Parameter Measurements Using Envisat ASAR Wave Mode Data
    Li, Xiao-Ming
    Lehner, Susanne
    Bruns, Thomas
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2011, 49 (01): : 155 - 174
  • [42] Ocean wave measurements using complex ERS-2 wave mode data
    Schulz-Stellenfleth, J
    Lehner, S
    Schättler, B
    Breit, H
    CEOS SAR WORKSHOP, 2000, 450 : 39 - 44
  • [43] An iterative approach to unsupervised outlier detection using ensemble method and distance-based data filtering
    Chakraborty, Bodhan
    Chaterjee, Agneet
    Malakar, Samir
    Sarkar, Ram
    COMPLEX & INTELLIGENT SYSTEMS, 2022, 8 (04) : 3215 - 3230
  • [44] An iterative approach to unsupervised outlier detection using ensemble method and distance-based data filtering
    Bodhan Chakraborty
    Agneet Chaterjee
    Samir Malakar
    Ram Sarkar
    Complex & Intelligent Systems, 2022, 8 : 3215 - 3230
  • [45] A comparison of multiple outlier detection methods for regression data
    Billor, Nedret
    Kiral, Gulsen
    COMMUNICATIONS IN STATISTICS-SIMULATION AND COMPUTATION, 2008, 37 (03) : 521 - 545
  • [46] Robust Multivariate Outlier Detection Methods for Environmental Data
    Alameddine, Ibrahim
    Kenney, Melissa A.
    Gosnell, Russell J.
    Reckhow, Kenneth H.
    JOURNAL OF ENVIRONMENTAL ENGINEERING-ASCE, 2010, 136 (11): : 1299 - 1304
  • [47] An Efficient Approach for Intrusion Detection Using Data Mining Methods
    Wankhade, Kapil
    Patka, Sadia
    Thool, Ravindra
    2013 INTERNATIONAL CONFERENCE ON ADVANCES IN COMPUTING, COMMUNICATIONS AND INFORMATICS (ICACCI), 2013, : 1615 - 1618
  • [48] Partition-Aware Scalable Outlier Detection Using Unsupervised Learning
    Parveen, Pallabi
    Lee, Melissa
    Henslee, Austin
    Dugan, Matt
    Ford, Brad
    2018 IEEE INTERNATIONAL CONFERENCE ON INFORMATION REUSE AND INTEGRATION (IRI), 2018, : 186 - 192
  • [49] Unsupervised Artificial Neural Networks for Outlier Detection in High-Dimensional Data
    Popovic, Daniel
    Fouche, Edouard
    Boehm, Klemens
    ADVANCES IN DATABASES AND INFORMATION SYSTEMS, ADBIS 2019, 2019, 11695 : 3 - 19
  • [50] Unsupervised pattern and outlier detection for pedestrian trajectories using diffusion maps
    Zeng, Fanqi
    Bode, Nikolai
    Gross, Thilo
    Homer, Martin
    PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS, 2024, 634