Outliers Detection Method Using Clustering in Buildings Data

被引:0
|
作者
Habib, Usman [1 ]
Zucker, Gerhard [1 ]
Bloechle, Max [1 ]
Judex, Florian [1 ]
Haase, Jan [2 ]
机构
[1] AIT Austrian Inst Technol, Dept Energy, Vienna, Austria
[2] Helmut Schmidt Univ Hamburg, Hamburg, Germany
关键词
adsorption chillers; physical rules; K-Means Clustering Algorithm; Outliers; Z-Score Normalization; Expectation Maximization Clustering Algorithm (EM); Heating; Ventilation and Air-Conditioning(H-VAC); Fault detection and diagnosis (FDD); Machine learning; regression; linear interpolation; FAULT-DETECTION; PROGNOSTICS; DIAGNOSTICS; SYSTEMS;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
To achieve energy efficiency in buildings, a lot of raw data is recorded, during the operation of buildings. This recorded raw data is further used for the analysis of the performance of buildings and its different components e.g. Heating, Ventilation and Air-Conditioning (HVAC). To save time and energy it is required to ensure resilience of the data by detecting and replacing outliers (i.e. data samples that are not plausible) in the data before detailed analysis. This paper discusses the steps involved for detecting outliers in the data obtained from absorption chiller using their On/Off state information. It also proposes a method for automatic detection of On/Off and/or Missing Data status of the chiller. The technique uses two layer K-Means clustering for detecting On/Off as well as Missing Data state of the chiller. After automatic detection of the chiller On/Off cycle, a method for outlier detection is proposed using Z-Score normalization based on the On/Off cycle state of chillers and clustering outliers by Expectation Maximization clustering algorithm. Moreover, the results of filling the missing values with regression and linear interpolation for short and long periods are elaborated. All proposed methods are applied to real building data and the results are discussed.
引用
收藏
页码:694 / 700
页数:7
相关论文
共 50 条
  • [31] An Outliers Detection Method of Time Series Data for Soft Sensor Modeling
    Tian, Hui-Xin
    Liu, Xing-Jun
    Han, Mei
    PROCEEDINGS OF THE 28TH CHINESE CONTROL AND DECISION CONFERENCE (2016 CCDC), 2016, : 3918 - 3922
  • [32] Detection of Outliers Method in Grouped Multivariate Data: A Method Based on Multiple Linear Regression
    Phuttisen, Suthat
    Srisodaphol, Wuttichai
    PAKISTAN JOURNAL OF STATISTICS AND OPERATION RESEARCH, 2024, 20 (03) : 445 - 453
  • [33] Detecting outliers in categorical data through rough clustering
    Suri, N. N. R. Ranga
    Murty, M. Narasimha
    Athithan, G.
    NATURAL COMPUTING, 2016, 15 (03) : 385 - 394
  • [34] Two-phase clustering process for outliers detection
    Jiang, MF
    Tseng, SS
    Su, CM
    PATTERN RECOGNITION LETTERS, 2001, 22 (6-7) : 691 - 700
  • [35] Detecting outliers in categorical data through rough clustering
    N. N. R. Ranga Suri
    M. Narasimha Murty
    G. Athithan
    Natural Computing, 2016, 15 : 385 - 394
  • [36] On Saving Outliers for Better Clustering over Noisy Data
    Song, Shaoxu
    Gao, Fei
    Huang, Ruihong
    Wang, Yihan
    SIGMOD '21: PROCEEDINGS OF THE 2021 INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA, 2021, : 1692 - 1704
  • [37] AN APPROACH TO PRELIMINARY DETECTION AND CONFIRMATION OF POTENTIAL OUTLIERS USING R: A CASE OF FALSE SUSPICION OF OUTLIERS IN DATA
    Shah, Immad A.
    Khan, Imran
    Mir, Shakeel A.
    Ozer, Ozen
    Mishra, Pradeep
    Maqbool, Showkat
    Bhat, Ishfaq A.
    Bhat, Owais
    INTERNATIONAL JOURNAL OF AGRICULTURAL AND STATISTICAL SCIENCES, 2023, 19 (01): : 177 - 182
  • [38] Detection of outliers in meteorological observation data
    Takahashi, Gendai
    Suzuki, Tomomichi
    Kawamura, Hironobu
    Journal of Quality, 2011, 18 (05): : 393 - 405
  • [39] Outliers Detection for Pareto Distributed Data
    Safari, M. A. Mohd
    Masseran, N.
    Ibrahim, K.
    2017 UKM FST POSTGRADUATE COLLOQUIUM, 2018, 1940
  • [40] Detection of Outliers in GPS Measurements by Using Functional-Data Analysis
    Ordonez, C.
    Martinez, J.
    Rodriguez-Perez, J. R.
    Reyes, A.
    JOURNAL OF SURVEYING ENGINEERING-ASCE, 2011, 137 (04): : 150 - 155